-- Logs begin at Thu 2022-07-14 13:44:38 UTC, end at Thu 2022-07-14 16:32:58 UTC. -- Jul 14 14:23:50.213983 n-d-768852-23 systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 14:23:50.222517 n-d-768852-23 devstack@n-api.service[103980]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:23:50 2022] *** Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: nodename: n-d-768852-23 Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: machine: x86_64 Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: clock source: unix Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: pcre jit disabled Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: detected number of CPU cores: 4 Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: current working directory: / Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:23:50.225030 n-d-768852-23 devstack@n-api.service[103980]: your processes number limit is 47680 Jul 14 14:23:50.225701 n-d-768852-23 devstack@n-api.service[103980]: your memory page size is 4096 bytes Jul 14 14:23:50.225701 n-d-768852-23 devstack@n-api.service[103980]: detected max file descriptor number: 2048 Jul 14 14:23:50.225701 n-d-768852-23 devstack@n-api.service[103980]: lock engine: pthread robust mutexes Jul 14 14:23:50.225701 n-d-768852-23 devstack@n-api.service[103980]: thunder lock: enabled Jul 14 14:23:50.225701 n-d-768852-23 devstack@n-api.service[103980]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 14:23:50.225701 n-d-768852-23 devstack@n-api.service[103980]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:23:50.269122 n-d-768852-23 devstack@n-api.service[103980]: Python main interpreter initialized at 0x557bf6cf79c0 Jul 14 14:23:50.269122 n-d-768852-23 devstack@n-api.service[103980]: python threads support enabled Jul 14 14:23:50.269122 n-d-768852-23 devstack@n-api.service[103980]: your server socket listen backlog is limited to 100 connections Jul 14 14:23:50.269122 n-d-768852-23 devstack@n-api.service[103980]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:23:50.269463 n-d-768852-23 devstack@n-api.service[103980]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:23:50.269552 n-d-768852-23 devstack@n-api.service[103980]: *** Operational MODE: preforking *** Jul 14 14:23:50.269810 n-d-768852-23 devstack@n-api.service[103980]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:23:50.269810 n-d-768852-23 devstack@n-api.service[103980]: spawned uWSGI master process (pid: 103980) Jul 14 14:23:50.270003 n-d-768852-23 systemd[1]: Started Devstack devstack@n-api.service. Jul 14 14:23:50.270587 n-d-768852-23 devstack@n-api.service[103980]: spawned uWSGI worker 1 (pid: 103981, cores: 1) Jul 14 14:23:50.275295 n-d-768852-23 devstack@n-api.service[103980]: spawned uWSGI worker 2 (pid: 103982, cores: 1) Jul 14 14:23:50.275295 n-d-768852-23 devstack@n-api.service[103980]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:23:50.932802 n-d-768852-23 devstack@n-api.service[103981]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:23:50.938225 n-d-768852-23 devstack@n-api.service[103982]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:23:52.054189 n-d-768852-23 devstack@n-api.service[103982]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:52.054189 n-d-768852-23 devstack@n-api.service[103982]: from cryptography.utils import int_from_bytes Jul 14 14:23:52.054931 n-d-768852-23 devstack@n-api.service[103982]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:52.054931 n-d-768852-23 devstack@n-api.service[103982]: from cryptography.utils import int_from_bytes Jul 14 14:23:52.058255 n-d-768852-23 devstack@n-api.service[103981]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:52.058255 n-d-768852-23 devstack@n-api.service[103981]: from cryptography.utils import int_from_bytes Jul 14 14:23:52.058679 n-d-768852-23 devstack@n-api.service[103981]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:23:52.058679 n-d-768852-23 devstack@n-api.service[103981]: from cryptography.utils import int_from_bytes Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.562252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.563867 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-768852-23 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.564741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.565605 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:23:54.566222 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.566387 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:23:54.566516 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.566516 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.566516 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.566865 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:23:54.567005 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.567005 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.567005 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.567356 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:23:54.567488 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.567614 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:23:54.567766 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.567766 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.568019 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.568144 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.568300 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-768852-23 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.568426 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.569202 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.569345 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.569486 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.569486 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.569778 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.569982 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.570127 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.570277 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.570549 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.570697 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.570849 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.571007 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.571145 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.571327 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.571568 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.571704 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.571886 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.572123 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.572220 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.572509 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.572633 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.572800 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.573031 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.573186 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.573477 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.573649 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-768852-23 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.573892 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.574089 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.574240 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.574528 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.574692 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.574849 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.575166 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.575387 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.575535 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.575686 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.575860 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.576114 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.576268 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.576410 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.576601 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.576786 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.576941 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.577232 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.577395 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.577646 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.577956 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.578106 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.578280 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.578523 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.578696 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.578862 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.579056 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.579207 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.579453 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.579686 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.579838 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.580051 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.580256 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.580406 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.581226 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.581397 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.581543 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.581820 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.581975 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.582232 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.582382 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.582533 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.582835 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.583383 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.583543 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.583771 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.583923 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.584067 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.584303 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.584471 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.584690 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.584952 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-768852-23 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.585127 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.585271 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.585496 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.585664 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.585884 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.586034 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.586226 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.586531 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.586686 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.586837 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.587062 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.587243 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.587517 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.587691 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.587852 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.587996 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.588288 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.588436 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.588594 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.588832 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.589004 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.589150 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.589378 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.589551 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.589739 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.589913 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.590064 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.590337 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.590485 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.590642 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.590924 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.591074 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.591220 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.591492 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.591664 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.591824 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.592070 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.592223 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.592424 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.592598 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.592748 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.593016 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.593164 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.593322 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.593603 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.593758 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.593911 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.594153 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.594308 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.594500 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.594693 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.594842 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.595088 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.595250 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.595471 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.595655 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.595818 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.596003 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.596801 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.596957 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.597132 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.597368 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.597521 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.597738 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.597925 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.598075 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.598331 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.598478 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.598635 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.598869 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.599037 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.599190 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.599369 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.599515 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.599808 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.599994 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.600152 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.600364 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.600528 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.600675 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.600899 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.601075 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.601285 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.601430 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.601590 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.601881 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.602083 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.602244 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.602446 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.602596 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.602829 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.602977 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.603236 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.603500 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.603701 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.603847 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.604040 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.604192 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.604448 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.604614 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.604758 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.605054 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.605217 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.605370 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.605599 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.605753 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.605964 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.606161 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.606311 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.606578 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.606748 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.606903 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.607175 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.607369 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.607512 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.607834 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.607985 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.608143 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.608284 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.608439 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.608743 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.608906 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.609050 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.609302 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.609455 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.609669 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.609844 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.610010 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.610331 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.610483 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.610629 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.610866 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.611030 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.611413 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.611536 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.611796 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.612505 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.612703 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.612891 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.613096 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.613383 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.613549 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.613746 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.613936 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.614102 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.614369 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.614517 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.614659 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.614943 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.615097 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.615263 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.615463 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.615622 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.615893 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.616058 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.616232 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.616437 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.616588 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.616852 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.617011 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.617154 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.617443 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.617599 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.617754 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.617987 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.618157 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.618362 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.618524 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.618670 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.618961 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.619111 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.619254 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.619520 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.619699 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.619884 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.620041 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.620189 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.620517 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.620670 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.620835 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.621050 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.621200 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.621431 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.621580 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.621724 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.622036 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.622187 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.622331 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.622561 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.622724 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.622929 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.623075 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.623332 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.623554 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.623718 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.623918 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.624162 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.624329 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.624476 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.624709 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.624864 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.625060 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.625250 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.625412 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.625660 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.625807 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.625950 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.626238 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.626416 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.626575 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.626778 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.626941 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.627158 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.627343 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.627510 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.627818 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.627984 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.628143 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.628363 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.628516 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.628809 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.628960 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.629150 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.629375 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.629538 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.629776 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.629938 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.630094 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.630372 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.630522 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.630665 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.630894 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.631166 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.631351 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.631491 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.631651 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.631849 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.632019 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.632175 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.632440 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.632592 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.632748 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.632990 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.633158 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.633313 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.633528 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.633681 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.633908 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.634057 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.634214 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.634495 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.634676 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.634823 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.635041 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.635195 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.635468 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.635615 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.635802 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.636083 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.636239 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.636428 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.636621 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.636852 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.637038 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.637191 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.637349 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.637665 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.637834 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.637979 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.638185 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.638341 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.638552 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.638739 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.638891 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.639172 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.639369 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.639516 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.639783 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.639951 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.640096 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.640312 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.640467 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.640692 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.640839 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.640998 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.641317 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:23:54.641468 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.641642 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.641884 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.642060 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.642261 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.642446 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.642597 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.642866 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.643194 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.643424 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.643571 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.643822 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.643970 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.644176 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.644434 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.644609 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.644774 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.645012 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.645164 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.645324 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.645556 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.645723 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.645925 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.646098 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.646247 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.646529 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.646691 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.646835 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.647120 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.647316 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.647461 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.647687 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.647875 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.648073 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.648221 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.648366 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.648683 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.648836 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.648995 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.649224 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.649390 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.649574 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.649786 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.649960 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.650166 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.650351 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.650504 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.650774 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.650925 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.651082 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.651396 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.651565 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.651710 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.651938 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.652092 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.652285 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.652495 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.652659 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.652889 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.653049 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.653193 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.653510 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.653660 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.653826 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.654221 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.654382 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.654525 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.654687 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.654832 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.655103 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.655289 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.655438 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.655730 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.655892 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.656037 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.656269 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.656424 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.656642 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.656805 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.656949 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.657241 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.657392 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.657610 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.657838 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.658018 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.658240 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.658391 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.658534 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.659398 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.659554 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.659719 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.659945 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.660110 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.660312 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.660509 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.660683 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.660918 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.661065 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.661221 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.661523 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.661674 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.661840 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.662071 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.662224 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.662432 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.662614 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.662765 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.663038 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.663187 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.663352 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.663661 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.663815 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.663964 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.664201 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.664539 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.664753 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.664906 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.665174 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.665339 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.665484 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.665764 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.665918 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.666095 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.666312 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.666478 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.666737 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.666885 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.667068 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.667384 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.667558 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.667705 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.667937 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.668090 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.668275 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.668486 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.668638 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.668874 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.669036 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.669181 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.669466 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.669616 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.669761 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.670017 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.670185 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.670330 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.670555 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.670721 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.670912 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.671109 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.671299 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.671543 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.671693 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.671838 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.672139 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.672310 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.672467 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.672683 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.672835 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.673031 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.673250 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.673418 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.673695 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.673845 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.674051 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.674315 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.675000 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.675162 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.675459 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.675612 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.675937 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.676107 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.676266 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.676470 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.676623 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.676834 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.677018 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.677169 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.677423 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.677581 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.677792 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.678015 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.678165 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.678310 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.678574 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.678730 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.678888 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.679119 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.679301 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.679518 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.679685 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.679840 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.680111 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.680261 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.680405 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.680681 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.680836 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.680981 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.681212 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.681379 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.681583 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.681749 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.681895 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.682181 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.682332 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.682487 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.682746 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.682915 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.683062 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.683330 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.683487 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.683672 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.683857 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.684035 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.684263 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.684409 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.684565 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.684853 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.685029 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.685174 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.685411 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.685566 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.685748 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.685975 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.686149 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.686344 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.686544 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.686697 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.686938 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.687086 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.687245 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.687562 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.687726 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.687943 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.688153 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.688319 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.688484 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.688701 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.688866 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.689133 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.689306 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.689465 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.689703 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.689858 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.690040 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.690255 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.690406 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.690636 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.690796 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.690988 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.691259 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.691460 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.691667 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.691836 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.691980 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.692275 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.692427 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.692570 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.692796 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.692964 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.693151 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.693327 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.693478 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.693781 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.693949 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.694093 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.694318 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.694471 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.694712 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.694872 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.695031 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.695362 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.695514 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.695678 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.695888 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.696041 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.696270 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.696429 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.696575 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.696870 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.697022 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.697166 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.697436 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.697590 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.697744 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.697978 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.698098 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.698351 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.698452 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.698662 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.698929 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.699015 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.699290 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.699400 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.699621 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.699809 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.699950 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.700254 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.700414 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.700635 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.700813 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.700969 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.701130 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.701353 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.701508 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.701734 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.701886 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.702095 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.702341 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.702560 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.702707 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.702942 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.703096 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.703254 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.703522 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.703676 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.703840 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.704065 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.704230 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.704438 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.704621 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.704785 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.705054 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.705205 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.705412 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.706434 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.706595 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.706741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.706908 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.707056 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.707201 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.707426 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.707574 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.707840 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.708270 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.708426 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.708647 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.708802 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.709034 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.709196 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.709339 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.709649 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.709802 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.709965 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.710233 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.710501 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.710661 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.710803 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.710957 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.711247 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.711428 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.711594 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.711838 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.711994 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.712140 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.712366 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.712522 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.712761 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.712912 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.713062 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.713356 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.713509 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.713670 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.713902 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.714054 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.714248 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.714457 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.714606 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.714935 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.715089 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.715236 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.715524 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.715681 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.715978 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.716158 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.716304 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.716540 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.716695 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.716879 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.717084 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.717249 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.717506 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.717666 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.717811 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.718105 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.718273 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.718478 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.718658 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.718808 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.719031 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.719210 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.719420 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.719668 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.719829 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.719973 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.720273 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.720437 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.720597 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.720816 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.720967 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.721236 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.721929 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.722141 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.722411 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.722564 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.722764 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.722946 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.723096 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.723420 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.723574 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.723737 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.723972 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.724127 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.724312 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.724511 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.724666 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.724908 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.725056 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.725228 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.725519 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.725694 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.725854 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.726060 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.726212 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.726418 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.726579 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.726737 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.727008 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.727158 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.727353 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.727621 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.727793 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.727954 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.728164 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.728317 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.728562 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.728711 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.728871 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.729172 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.729324 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.729471 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.729706 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.729862 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.730073 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.730267 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.730420 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.730663 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.730811 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.731000 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.731319 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.731476 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.731620 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.731866 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.732021 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.732265 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.732436 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.732581 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.732853 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.733019 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.733194 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.733420 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.733573 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.733811 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.733973 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.734116 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.734414 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.734583 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.734729 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.734941 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.735094 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.735305 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.735498 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.735738 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.735976 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.736126 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.736275 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.736561 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.736762 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.736974 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.737122 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.737267 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.737479 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.737664 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.737985 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.738134 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.738276 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.738432 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.738672 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.738821 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.738980 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.739240 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.739472 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.739682 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.739829 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.739972 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.740290 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.740445 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.740588 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.740829 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.740983 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.741215 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.741363 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.741508 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.741826 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.741978 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.742123 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.742358 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.742512 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.742741 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.742889 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.743035 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.743376 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.743549 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.743698 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.743925 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.744078 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.744282 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.744482 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.744648 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.744893 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.745061 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.745215 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.745511 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.745721 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.746015 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.746170 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.746355 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.746555 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.746719 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.746968 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.747117 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.747260 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.747599 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.747754 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.747911 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.748214 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.748469 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.748626 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.748820 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.749037 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.749200 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.749451 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.749612 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.749757 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.750054 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.750209 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.750369 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.750599 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.750752 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.750988 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.751135 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.751344 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.751671 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.751825 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.752040 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.752246 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.752431 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.752748 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.752911 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.753081 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.753300 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.753465 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.753657 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.753835 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.753979 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.754266 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.754418 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.754576 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.754829 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.754997 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.755187 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.755419 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.755573 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.755822 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.755972 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.756125 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.756425 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.756589 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.756766 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.756959 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.757122 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.757375 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.757538 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.757683 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.757954 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.758190 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.758438 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.758611 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.758818 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.758976 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.759134 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.759463 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.759617 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.759786 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.760006 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.760160 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.760383 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.760530 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.760676 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.760974 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.761126 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.761271 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.761517 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.761673 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.761854 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.762079 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.762233 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.762465 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.762615 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.762803 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.763070 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.763222 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.763391 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.763619 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.763921 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.764075 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.764263 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.764580 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.764740 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.764896 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.765125 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.765278 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.765511 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.765661 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.765821 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.766124 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.766276 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.766420 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.766709 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.766864 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.767024 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.767239 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.767465 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.767630 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.767800 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.767952 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.768728 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.768879 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.769024 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.769318 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.769475 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.769635 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.769847 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.770001 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.770225 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.770387 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.770547 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.770819 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.770970 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.771115 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.771383 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.771540 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.771735 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.771924 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.772075 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.772325 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.772473 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.772620 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.772920 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.773102 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.773248 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.773456 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.773611 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.773796 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.773998 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.774151 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.774395 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.774544 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.774690 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.774981 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.775161 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.775366 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.775528 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.775673 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.775930 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.776090 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.776249 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.776528 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.776697 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.776843 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.777055 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.777208 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.777434 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.777594 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.777774 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.778071 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.778240 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.778560 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.778715 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.778930 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.779079 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.779252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.779591 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.779760 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.779908 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.780119 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.780271 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.780504 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.780670 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.780830 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.781118 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.781272 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.781415 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.781646 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.781800 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.782024 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.782178 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.782325 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.782597 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.782758 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.782989 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.783211 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.783335 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.783632 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.784313 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.784520 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.784699 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.784828 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.785137 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.785244 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.785441 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.785580 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.785748 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.786025 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.786111 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.786384 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.786478 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.786701 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.786878 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.787020 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.787348 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.787439 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.787666 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.787808 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.787974 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.788269 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.788355 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.788583 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.788710 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.788889 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.789155 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.789252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.789521 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.789626 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.789835 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.790021 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.790136 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.790441 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.790550 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.790839 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.790943 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.791164 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.791249 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.791510 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.791716 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.791802 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.792118 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.792211 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.792438 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.792602 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.792750 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.792997 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.793170 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.793358 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.793443 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.793684 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.793874 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.794016 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.794308 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.794394 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.794647 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.794741 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.794949 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.795155 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.795367 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.795563 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.795709 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.795872 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.796185 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.796280 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.796491 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.796628 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.796791 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.797090 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.797174 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.797394 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.797543 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.797716 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.797987 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.798146 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.798313 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.798573 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.798672 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.798878 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.799001 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.799165 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.799515 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.799673 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.799825 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.800092 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.800252 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.800401 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.800621 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.800778 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.800940 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.801164 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.801334 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.801535 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.801809 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.801961 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.802119 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.802263 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.802411 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.802720 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.802889 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.803038 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.803249 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.803486 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.803654 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.803837 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.803992 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.804270 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.804434 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.804582 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.804852 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.805030 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.805179 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.805416 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.805573 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.805763 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.805974 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.806144 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.806388 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.806538 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.806683 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.806978 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.807160 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.807343 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.807545 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.807699 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.807887 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.808094 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.808262 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.808527 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.808678 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.808823 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.809086 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.809241 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.809437 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.809633 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.809787 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.810050 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.810209 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.810368 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.810648 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.810804 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.810951 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.811185 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.811384 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.811580 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.811767 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.811937 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.812190 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.812405 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.812563 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.812797 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.812948 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.813093 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.813326 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.813482 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.813705 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.813866 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.814106 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.814330 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.814485 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.814728 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.814914 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.815074 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.815410 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.815582 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.815757 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.815947 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.816112 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.816401 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.816554 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.816723 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.816951 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.817107 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.817318 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.817496 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.817648 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.817852 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103982) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:23:54.818055 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.818584 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.818999 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.819446 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.819855 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.820271 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.820693 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.821122 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.821536 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.821947 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.822471 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.822887 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.823331 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.823761 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.824167 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.824577 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.824993 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.825416 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.825822 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.826237 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.826641 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.827071 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.827516 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.827939 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.828460 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.828887 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.829352 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.829895 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.830314 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.831244 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.831722 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.832145 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.832573 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.833237 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.833654 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.834062 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.834493 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.834916 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.835372 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.835811 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.836173 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.836552 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.836948 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.837349 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.837729 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.838260 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.838661 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.839050 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.839682 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.840107 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.840530 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.840894 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.841262 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.841621 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.841979 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.842353 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.842712 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.843076 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.843485 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.843872 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.844242 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.844619 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.845014 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.845380 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.845835 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.846762 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.847148 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.847563 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.847944 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.848332 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.848717 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.849100 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.849479 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.849860 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.850273 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.850690 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.851087 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.851528 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.851930 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.852312 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.852709 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.853110 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.853508 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.853899 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.854283 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.854658 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.855022 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.855454 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.855860 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.856259 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.856628 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.856997 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.857373 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.857747 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.858131 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.858514 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.858890 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.859299 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.859687 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.860070 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.860435 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.860852 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.861256 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.861635 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.862069 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.862468 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.862863 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.863254 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.863708 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.864108 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.864501 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.864894 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.865286 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.865675 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.866158 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.866575 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.867005 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.867454 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.867874 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.868290 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.868705 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.869356 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.869794 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.870215 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.870633 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.871083 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.871537 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.871951 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.872376 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.872787 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.873201 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.873610 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.874061 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.874479 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.874915 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.875388 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.875805 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.876276 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.876691 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.877115 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.877726 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.878142 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.878547 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.878971 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.879427 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.879853 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.880266 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.880620 n-d-768852-23 devstack@n-api.service[103982]: INFO dbcounter [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Registered counter for database nova_api Jul 14 14:23:54.880797 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.881182 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.881602 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.882017 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.882426 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.882847 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.883261 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.883702 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.884169 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.884587 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.884999 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.885409 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.885827 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.886508 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.886924 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.887395 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.887824 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.888250 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.888665 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.889080 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.889514 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.889924 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.890330 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.890748 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.891159 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.891605 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.892026 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.892438 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.892852 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.893795 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.894233 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.894923 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.895414 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.895835 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.896272 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.896735 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.897158 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.897573 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.897998 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.898407 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.898816 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.899231 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.899712 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.900128 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.900536 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.900950 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.901363 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.901765 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.902189 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.902595 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.903031 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.903492 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.903905 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.904351 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.904781 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.905189 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.905603 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.906013 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.906442 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.906869 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.907297 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.907712 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.908118 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.908534 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.909521 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.909935 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.910406 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.910881 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.911311 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.911723 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.912155 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.912573 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.913001 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.913424 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.913840 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.914297 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.914716 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.915454 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.915889 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.916314 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.916753 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.917182 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.917590 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.918043 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.918415 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.918798 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.919162 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.919563 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.919954 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.920333 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.920729 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.921174 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.921630 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.922074 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.922520 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.922969 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.923449 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.923880 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.924321 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.924743 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.925200 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.925626 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.926047 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.926464 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.926883 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.927354 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.927766 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.928179 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.928590 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.929011 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.929444 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.929866 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.930274 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.930820 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.931264 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.931745 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.932171 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.932589 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.933025 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.933449 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.933865 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.934285 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.934696 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.935134 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.935613 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.936094 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.936529 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.936939 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.937393 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.937803 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.938249 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.938677 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.939088 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.939529 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.940183 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.940598 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.941004 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.941410 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.941847 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.942253 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.942669 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.943073 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.943516 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.943931 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.944344 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.944758 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.945163 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.945571 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.945974 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.946377 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.946785 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.947202 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.947631 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.948073 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.948505 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.948930 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.949352 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.949783 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.950211 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.950621 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.951042 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.951521 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.951944 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.952365 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.952802 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.953224 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.953635 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.954047 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.954462 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.954872 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.955307 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.956278 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.956734 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.957143 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.957600 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.958257 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.958685 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.959102 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.959556 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.959984 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.960410 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.960823 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.961238 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.961686 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.962177 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.962603 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.963012 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.963471 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.963898 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.964313 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.964745 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.965177 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.965589 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.966015 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.966440 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.966889 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.967324 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.967784 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.968209 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.968623 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.969038 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.969444 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:23:54.969794 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103981) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:23:54.990254 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_db.sqlalchemy.engines [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:54.996715 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writer thread running {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.033739 n-d-768852-23 devstack@n-api.service[103981]: INFO dbcounter [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Registered counter for database nova_api Jul 14 14:23:55.053199 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.context [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=103982) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:23:55.057364 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:55.058985 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:55.059860 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:55.062094 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:55.064399 n-d-768852-23 devstack@n-api.service[103982]: INFO dbcounter [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Registered counter for database nova_cell0 Jul 14 14:23:55.069170 n-d-768852-23 devstack@n-api.service[103982]: INFO dbcounter [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Registered counter for database nova_cell1 Jul 14 14:23:55.077718 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_db.sqlalchemy.engines [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.080010 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_db.sqlalchemy.engines [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.085017 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writer thread running {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.090772 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writer thread running {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.142319 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_db.sqlalchemy.engines [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.149075 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writer thread running {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.212330 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.context [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=103981) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:23:55.216292 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_concurrency.lockutils [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:55.217860 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_concurrency.lockutils [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:55.218664 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_concurrency.lockutils [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:23:55.220825 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_concurrency.lockutils [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103981) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:23:55.223344 n-d-768852-23 devstack@n-api.service[103981]: INFO dbcounter [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Registered counter for database nova_cell0 Jul 14 14:23:55.227209 n-d-768852-23 devstack@n-api.service[103981]: INFO dbcounter [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Registered counter for database nova_cell1 Jul 14 14:23:55.233482 n-d-768852-23 devstack@n-api.service[103982]: INFO dbcounter [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Registered counter for database nova_cell0 Jul 14 14:23:55.234693 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_db.sqlalchemy.engines [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.235896 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_db.sqlalchemy.engines [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.240970 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_db.sqlalchemy.engines [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103982) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.242558 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writer thread running {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.245069 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writer thread running {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.245672 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writer thread running {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.389860 n-d-768852-23 devstack@n-api.service[103981]: INFO dbcounter [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Registered counter for database nova_cell0 Jul 14 14:23:55.396728 n-d-768852-23 devstack@n-api.service[103981]: DEBUG oslo_db.sqlalchemy.engines [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103981) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:23:55.401048 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writer thread running {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:23:55.589140 n-d-768852-23 devstack@n-api.service[103982]: WARNING keystonemiddleware.auth_token [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:23:55.596535 n-d-768852-23 devstack@n-api.service[103982]: WARNING keystonemiddleware.auth_token [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:23:55.720696 n-d-768852-23 devstack@n-api.service[103981]: WARNING keystonemiddleware.auth_token [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:23:55.728569 n-d-768852-23 devstack@n-api.service[103981]: WARNING keystonemiddleware.auth_token [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:23:55.935337 n-d-768852-23 devstack@n-api.service[103982]: WARNING keystonemiddleware.auth_token [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:23:55.942126 n-d-768852-23 devstack@n-api.service[103982]: WARNING keystonemiddleware.auth_token [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:23:55.947629 n-d-768852-23 devstack@n-api.service[103982]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557bf6cf79c0 pid: 103982 (default app) Jul 14 14:23:55.949930 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:23:55.951140 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] 10.222.0.98 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001921 Jul 14 14:23:55.951888 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 1/1] 10.222.0.98 () {50 vars in 788 bytes} [Thu Jul 14 14:23:55 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:23:56.071063 n-d-768852-23 devstack@n-api.service[103981]: WARNING keystonemiddleware.auth_token [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:23:56.077045 n-d-768852-23 devstack@n-api.service[103981]: WARNING keystonemiddleware.auth_token [None req-12e16f1e-d73c-4a44-887e-8cb819958891 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:23:56.083769 n-d-768852-23 devstack@n-api.service[103981]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557bf6cf79c0 pid: 103981 (default app) Jul 14 14:25:12.726829 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:12.727979 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Jul 14 14:25:12.728586 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 2/2] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:12.740818 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_api:SELECT=3 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.741684 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_cell0:SELECT=3 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.742735 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_cell1:SELECT=3 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:12.743771 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_cell0:SELECT=3 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:13.630977 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-c5e460ab-dcc4-42eb-bd50-8e04516c95cc admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:13.661217 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-c5e460ab-dcc4-42eb-bd50-8e04516c95cc admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.925777 Jul 14 14:25:13.661874 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 1/3] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:25:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:15.905799 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:15.907399 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-6294143d-5aaa-42a5-b310-25934b838eb9 None None] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001987 Jul 14 14:25:15.908192 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 3/4] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:16.405418 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-d543ec05-8350-4a20-839a-8db93e59af62 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:16.425147 n-d-768852-23 devstack@n-api.service[103981]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:16.425147 n-d-768852-23 devstack@n-api.service[103981]: warnings.warn(msg) Jul 14 14:25:16.455378 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-d543ec05-8350-4a20-839a-8db93e59af62 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.540649 Jul 14 14:25:16.463368 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 2/5] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:15 2022] POST /compute/v2.1/flavors => generated 407 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:16.680998 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-90a93d33-a6f3-4bfd-b10a-ce04ea691b14 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:16.683479 n-d-768852-23 devstack@n-api.service[103982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:16.683479 n-d-768852-23 devstack@n-api.service[103982]: warnings.warn(msg) Jul 14 14:25:16.702226 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_api:SELECT=3 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.703102 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_cell0:SELECT=3 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.704424 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_cell1:SELECT=3 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.705250 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:16.750999 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-90a93d33-a6f3-4bfd-b10a-ce04ea691b14 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286123 Jul 14 14:25:16.751698 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 4/6] 10.222.0.98 () {64 vars in 1335 bytes} [Thu Jul 14 14:25:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:19.070613 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-d543ec05-8350-4a20-839a-8db93e59af62 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:19.071517 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-d543ec05-8350-4a20-839a-8db93e59af62 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Jul 14 14:25:19.071920 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 3/7] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:19.917506 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-3e80d5fe-01a5-40f4-8c14-d17291743501 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "name": "ds512M", "ram": 512, "id": "d1", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:19.935219 n-d-768852-23 devstack@n-api.service[103982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:19.935219 n-d-768852-23 devstack@n-api.service[103982]: warnings.warn(msg) Jul 14 14:25:19.957926 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-3e80d5fe-01a5-40f4-8c14-d17291743501 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.879979 Jul 14 14:25:19.963603 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 5/8] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:19.970188 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-e5a4c023-f87a-4648-be52-3b3e9ab5ac05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:19.971700 n-d-768852-23 devstack@n-api.service[103981]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:25:19.971700 n-d-768852-23 devstack@n-api.service[103981]: warnings.warn(msg) Jul 14 14:25:20.006173 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-e5a4c023-f87a-4648-be52-3b3e9ab5ac05 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039487 Jul 14 14:25:20.006760 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 4/9] 10.222.0.98 () {64 vars in 1335 bytes} [Thu Jul 14 14:25:19 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:22.465771 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-3e80d5fe-01a5-40f4-8c14-d17291743501 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:22.467528 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-3e80d5fe-01a5-40f4-8c14-d17291743501 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002453 Jul 14 14:25:22.479345 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 6/10] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:22.985214 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-8346a746-2184-40c2-a7de-224fd36d2274 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "os-flavor-access:is_public": true, "id": "d2", "vcpus": 1, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:23.006499 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-8346a746-2184-40c2-a7de-224fd36d2274 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529718 Jul 14 14:25:23.007325 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 5/11] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:23.019494 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-b7dac113-58b4-4ae7-b7cc-2a9d0df04a20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:23.043997 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-b7dac113-58b4-4ae7-b7cc-2a9d0df04a20 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028402 Jul 14 14:25:23.056119 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 7/12] 10.222.0.98 () {64 vars in 1335 bytes} [Thu Jul 14 14:25:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:25.597342 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-8346a746-2184-40c2-a7de-224fd36d2274 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:25.598951 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-8346a746-2184-40c2-a7de-224fd36d2274 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002037 Jul 14 14:25:25.601796 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 6/13] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:26.069265 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-7715c0e1-a366-4bba-b0fd-2c4dc60a3d0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "disk": 10}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:26.098468 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-7715c0e1-a366-4bba-b0fd-2c4dc60a3d0d admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492632 Jul 14 14:25:26.106548 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 8/14] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:26.111418 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-789c4afb-a85c-4c7d-91c9-f6afad8423c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:26.145436 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-789c4afb-a85c-4c7d-91c9-f6afad8423c7 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037863 Jul 14 14:25:26.160519 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 7/15] 10.222.0.98 () {64 vars in 1335 bytes} [Thu Jul 14 14:25:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:25:28.428657 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-7715c0e1-a366-4bba-b0fd-2c4dc60a3d0d admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:28.430680 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-7715c0e1-a366-4bba-b0fd-2c4dc60a3d0d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002050 Jul 14 14:25:28.436626 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 9/16] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:28.903690 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-0a78a0a4-7bd5-4f11-ad29-bd78ef06e007 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4"}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:28.926181 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-0a78a0a4-7bd5-4f11-ad29-bd78ef06e007 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.485496 Jul 14 14:25:28.926733 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 8/17] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:28.938983 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-a59c3965-df97-4a9f-8020-9dc3f0e0eb38 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:28.963433 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-a59c3965-df97-4a9f-8020-9dc3f0e0eb38 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028313 Jul 14 14:25:28.963932 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 10/18] 10.222.0.98 () {64 vars in 1335 bytes} [Thu Jul 14 14:25:28 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:31.295940 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-0a78a0a4-7bd5-4f11-ad29-bd78ef06e007 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:31.297698 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-0a78a0a4-7bd5-4f11-ad29-bd78ef06e007 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002275 Jul 14 14:25:31.298586 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 9/19] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:31.918510 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-a148d194-fc7d-41a6-bd0c-3292b6f08b57 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:31.945110 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-a148d194-fc7d-41a6-bd0c-3292b6f08b57 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.639152 Jul 14 14:25:31.960348 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 11/20] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:25:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:25:34.210826 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-0a78a0a4-7bd5-4f11-ad29-bd78ef06e007 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:34.212204 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-0a78a0a4-7bd5-4f11-ad29-bd78ef06e007 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Jul 14 14:25:34.212762 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 10/21] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:34.652387 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-22998e9d-1c3e-4d4c-b285-684c5c61ee89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny", "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "disk": 1}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:34.670670 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-22998e9d-1c3e-4d4c-b285-684c5c61ee89 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.449744 Jul 14 14:25:34.671231 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 12/22] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:34 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:34.685776 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-69e17f1c-a9f5-4ff1-a37e-bdbd3ee5af4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:34.710209 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-69e17f1c-a9f5-4ff1-a37e-bdbd3ee5af4d admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028128 Jul 14 14:25:34.710755 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 11/23] 10.222.0.98 () {64 vars in 1332 bytes} [Thu Jul 14 14:25:34 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:37.019902 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-22998e9d-1c3e-4d4c-b285-684c5c61ee89 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:37.021252 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-22998e9d-1c3e-4d4c-b285-684c5c61ee89 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001891 Jul 14 14:25:37.021721 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 13/24] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:37.460457 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-c9339bab-63da-4d88-b36b-61617d232605 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "id": "2", "vcpus": 1, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:37.478665 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-c9339bab-63da-4d88-b36b-61617d232605 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.450997 Jul 14 14:25:37.479332 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 12/25] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:37.491898 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-19bf851b-1c32-4d89-b3e1-c39ab0e68a7c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:37.516868 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-19bf851b-1c32-4d89-b3e1-c39ab0e68a7c admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028769 Jul 14 14:25:37.517471 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 14/26] 10.222.0.98 () {64 vars in 1332 bytes} [Thu Jul 14 14:25:37 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:39.813485 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-c9339bab-63da-4d88-b36b-61617d232605 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:39.814507 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-c9339bab-63da-4d88-b36b-61617d232605 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jul 14 14:25:39.814918 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 13/27] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:40.219340 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-3e4b2b9a-4b1a-4c41-9831-f970baa09ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "ram": 4096, "swap": 0, "disk": 40}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:40.237046 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-3e4b2b9a-4b1a-4c41-9831-f970baa09ea4 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.416134 Jul 14 14:25:40.237698 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 15/28] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:39 2022] POST /compute/v2.1/flavors => generated 406 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:40.250371 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-83373183-9736-4ba3-bade-5f5be777de2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:40.276440 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-83373183-9736-4ba3-bade-5f5be777de2e admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030268 Jul 14 14:25:40.277145 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 14/29] 10.222.0.98 () {64 vars in 1332 bytes} [Thu Jul 14 14:25:40 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:42.517030 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-3e4b2b9a-4b1a-4c41-9831-f970baa09ea4 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:42.518068 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-3e4b2b9a-4b1a-4c41-9831-f970baa09ea4 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jul 14 14:25:42.518498 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 16/30] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:42.972346 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-24b329a4-25e7-409b-ab10-88ffd7b1897c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:42.977702 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:25:42.991977 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-24b329a4-25e7-409b-ab10-88ffd7b1897c admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466357 Jul 14 14:25:42.992546 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 15/31] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:25:43.004379 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-4c5b0224-c19e-4506-a36a-5cb99e0042a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:43.037415 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-4c5b0224-c19e-4506-a36a-5cb99e0042a6 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036621 Jul 14 14:25:43.038017 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 17/32] 10.222.0.98 () {64 vars in 1332 bytes} [Thu Jul 14 14:25:42 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:25:45.396365 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-24b329a4-25e7-409b-ab10-88ffd7b1897c admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:25:45.397306 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-24b329a4-25e7-409b-ab10-88ffd7b1897c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 14 14:25:45.397718 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 16/33] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:25:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:25:45.849302 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-c749958f-d003-4656-ad8a-8e9179763e33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:45.869150 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-c749958f-d003-4656-ad8a-8e9179763e33 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.465163 Jul 14 14:25:45.869702 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 18/34] 10.222.0.98 () {64 vars in 1282 bytes} [Thu Jul 14 14:25:45 2022] POST /compute/v2.1/flavors => generated 408 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:25:45.882582 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-082e50c6-3005-4c6b-ad98-0bfdb071f7e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:25:45.907692 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-082e50c6-3005-4c6b-ad98-0bfdb071f7e2 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029007 Jul 14 14:25:45.908832 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 17/35] 10.222.0.98 () {64 vars in 1332 bytes} [Thu Jul 14 14:25:45 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:26:10.641606 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-c749958f-d003-4656-ad8a-8e9179763e33 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:10.642609 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-c749958f-d003-4656-ad8a-8e9179763e33 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Jul 14 14:26:10.643007 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 19/36] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:26:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:10.653436 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:11.041143 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-86f218b0-aff2-42ea-b76a-4678603b423d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:11.058794 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-86f218b0-aff2-42ea-b76a-4678603b423d admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409714 Jul 14 14:26:11.059360 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 18/37] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:26:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:12.131023 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-c749958f-d003-4656-ad8a-8e9179763e33 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:12.132057 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-c749958f-d003-4656-ad8a-8e9179763e33 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jul 14 14:26:12.132444 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 20/38] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:12.691962 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-27618cb1-566b-4c43-98eb-59e3ad5886ea admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:12.697594 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.wsgi [None req-27618cb1-566b-4c43-98eb-59e3ad5886ea admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-27618cb1-566b-4c43-98eb-59e3ad5886ea admin admin] Request method failure captured: Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Accept: application/json Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Accept-Encoding: gzip, deflate Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Connection: keep-alive Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Content-Length: 0 Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Host: 10.222.0.98 Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Openstack-Api-Version: compute 2.90 Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: Openstack-System-Scope: None Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: User-Agent: python-novaclient Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Auth-Token: gAAAAABi0CeECbKPqTVZarcMRPKkW0VQLJO6I59KDRffT-GmCwDidu81MYtNk2QO6fbnilgB_Qwdms8kTvFru6wAQB9IAbTvu-oeR46EwLwnbuRE6woyqHBt9eJBpd2KTgpb-urr4LRF_1BvGxpzijTx3k6Y3udp2dxlssZeE4tZuDUp3l0Hd7w Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Domain-Id: None Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Domain-Name: None Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Identity-Status: Confirmed Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Is-Admin-Project: True Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Domain-Id: default Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Domain-Name: Default Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Name: admin Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Role: admin,member,reader Jul 14 14:26:12.700902 n-d-768852-23 devstack@n-api.service[103981]: X-Roles: admin,member,reader Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant: admin Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant-Name: admin Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-User: admin Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-User-Domain-Id: default Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-User-Domain-Name: Default Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-User-Id: c8378d889c17447db6fd8aa498751f4a Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: X-User-Name: admin Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: method: > Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: exception: Flavor 42 could not be found. Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: action_args: {'id': '42'} Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:12.702658 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:12.704426 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.705828 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-27618cb1-566b-4c43-98eb-59e3ad5886ea admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:12.707134 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-27618cb1-566b-4c43-98eb-59e3ad5886ea admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.407233 Jul 14 14:26:12.707134 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 19/39] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:12.712616 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-33f7b8a8-7352-437d-b033-f6f7dafb39ed admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:12.715486 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:26:12.735195 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-33f7b8a8-7352-437d-b033-f6f7dafb39ed admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026057 Jul 14 14:26:12.735784 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 21/40] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:26:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:26:12.745696 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-15fed381-3226-4286-b0a5-e0ff4ed2ab5a admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:12.766924 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-15fed381-3226-4286-b0a5-e0ff4ed2ab5a admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024765 Jul 14 14:26:12.767480 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 20/41] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:26:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:12.777553 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-6d7a72b8-16c2-48bc-b669-c251de79422d admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:12.784566 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.wsgi [None req-6d7a72b8-16c2-48bc-b669-c251de79422d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-6d7a72b8-16c2-48bc-b669-c251de79422d admin admin] Request method failure captured: Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Accept: application/json Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Accept-Encoding: gzip, deflate Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Connection: keep-alive Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Content-Length: 0 Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Host: 10.222.0.98 Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Openstack-Api-Version: compute 2.90 Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: Openstack-System-Scope: None Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: User-Agent: python-novaclient Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Auth-Token: gAAAAABi0CeECbKPqTVZarcMRPKkW0VQLJO6I59KDRffT-GmCwDidu81MYtNk2QO6fbnilgB_Qwdms8kTvFru6wAQB9IAbTvu-oeR46EwLwnbuRE6woyqHBt9eJBpd2KTgpb-urr4LRF_1BvGxpzijTx3k6Y3udp2dxlssZeE4tZuDUp3l0Hd7w Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Domain-Id: None Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Domain-Name: None Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Identity-Status: Confirmed Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Is-Admin-Project: True Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Domain-Id: default Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Domain-Name: Default Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Name: admin Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Role: admin,member,reader Jul 14 14:26:12.787845 n-d-768852-23 devstack@n-api.service[103982]: X-Roles: admin,member,reader Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant: admin Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant-Name: admin Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-User: admin Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-User-Domain-Id: default Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-User-Domain-Name: Default Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-User-Id: c8378d889c17447db6fd8aa498751f4a Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: X-User-Name: admin Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: method: > Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: exception: Flavor 42 could not be found. Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: action_args: {'id': '42'} Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:12.789394 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:12.790463 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:12.791930 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-6d7a72b8-16c2-48bc-b669-c251de79422d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:12.793170 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-6d7a72b8-16c2-48bc-b669-c251de79422d admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016085 Jul 14 14:26:12.793170 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 22/42] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 14:26:13.759811 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-15fed381-3226-4286-b0a5-e0ff4ed2ab5a admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:13.760850 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-15fed381-3226-4286-b0a5-e0ff4ed2ab5a admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jul 14 14:26:13.761251 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 21/43] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:14.290390 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-edec93d6-ee90-4e99-a648-fe230f0d9076 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:14.296379 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.wsgi [None req-edec93d6-ee90-4e99-a648-fe230f0d9076 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-edec93d6-ee90-4e99-a648-fe230f0d9076 admin admin] Request method failure captured: Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Accept: application/json Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Accept-Encoding: gzip, deflate Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Connection: keep-alive Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Content-Length: 0 Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Host: 10.222.0.98 Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Openstack-Api-Version: compute 2.90 Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: Openstack-System-Scope: None Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: User-Agent: python-novaclient Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Auth-Token: gAAAAABi0CeFonkvovsyCe4Q75KiU0A9A2R3lIEXH83G_yBJMftM77DQBQqjQVdJnloO2WPhie2kI8wFxOxeG0Znd-1JS5krfCjx8MTgVQEx-ke7baHZ6k4ecAoEesX0lZ1dH-zsySVthiNWmSfRylRLZzGDuCyL62Hg4VmMzs5B0QvP3PQk3qU Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Domain-Id: None Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Domain-Name: None Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Identity-Status: Confirmed Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Is-Admin-Project: True Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Domain-Id: default Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Domain-Name: Default Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Name: admin Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Role: admin,member,reader Jul 14 14:26:14.298383 n-d-768852-23 devstack@n-api.service[103982]: X-Roles: admin,member,reader Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant: admin Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant-Name: admin Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-User: admin Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-User-Domain-Id: default Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-User-Domain-Name: Default Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-User-Id: c8378d889c17447db6fd8aa498751f4a Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: X-User-Name: admin Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: method: > Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: exception: Flavor 84 could not be found. Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: action_args: {'id': '84'} Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:14.299969 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:14.300873 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.302319 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-edec93d6-ee90-4e99-a648-fe230f0d9076 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:14.303712 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-edec93d6-ee90-4e99-a648-fe230f0d9076 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.400906 Jul 14 14:26:14.303712 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 23/44] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:14.309382 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-4786dd59-b7bb-410c-a694-710620e31947 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:14.323618 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-4786dd59-b7bb-410c-a694-710620e31947 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017694 Jul 14 14:26:14.324153 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 22/45] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:26:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:14.334198 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-3883f5f9-2e44-4371-9f04-14440ecf1e1c admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:14.348025 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-3883f5f9-2e44-4371-9f04-14440ecf1e1c admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017798 Jul 14 14:26:14.348564 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 24/46] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:26:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:14.357844 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-8db85a77-d096-42d7-b46f-92cc7e85e172 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:14.363984 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.wsgi [None req-8db85a77-d096-42d7-b46f-92cc7e85e172 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-8db85a77-d096-42d7-b46f-92cc7e85e172 admin admin] Request method failure captured: Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Accept: application/json Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Accept-Encoding: gzip, deflate Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Connection: keep-alive Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Content-Length: 0 Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Host: 10.222.0.98 Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Openstack-Api-Version: compute 2.90 Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: Openstack-System-Scope: None Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: User-Agent: python-novaclient Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Auth-Token: gAAAAABi0CeFonkvovsyCe4Q75KiU0A9A2R3lIEXH83G_yBJMftM77DQBQqjQVdJnloO2WPhie2kI8wFxOxeG0Znd-1JS5krfCjx8MTgVQEx-ke7baHZ6k4ecAoEesX0lZ1dH-zsySVthiNWmSfRylRLZzGDuCyL62Hg4VmMzs5B0QvP3PQk3qU Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Domain-Id: None Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Domain-Name: None Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Identity-Status: Confirmed Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Is-Admin-Project: True Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Domain-Id: default Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Domain-Name: Default Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Name: admin Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Role: admin,member,reader Jul 14 14:26:14.365462 n-d-768852-23 devstack@n-api.service[103981]: X-Roles: admin,member,reader Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant: admin Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant-Name: admin Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-User: admin Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-User-Domain-Id: default Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-User-Domain-Name: Default Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-User-Id: c8378d889c17447db6fd8aa498751f4a Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: X-User-Name: admin Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: method: > Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: exception: Flavor 84 could not be found. Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: action_args: {'id': '84'} Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:14.366956 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:14.367805 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:14.368916 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-8db85a77-d096-42d7-b46f-92cc7e85e172 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:14.370065 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-8db85a77-d096-42d7-b46f-92cc7e85e172 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012513 Jul 14 14:26:14.370065 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 23/47] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:26:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 14:26:15.351995 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-3883f5f9-2e44-4371-9f04-14440ecf1e1c admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:15.352997 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-3883f5f9-2e44-4371-9f04-14440ecf1e1c admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 14 14:26:15.353396 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 25/48] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:16.008187 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-0e9d3723-ffd9-4cca-a646-eed450de94f8 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.013879 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.wsgi [None req-0e9d3723-ffd9-4cca-a646-eed450de94f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-0e9d3723-ffd9-4cca-a646-eed450de94f8 admin admin] Request method failure captured: Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Accept: application/json Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Accept-Encoding: gzip, deflate Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Connection: keep-alive Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Content-Length: 0 Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Host: 10.222.0.98 Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Openstack-Api-Version: compute 2.90 Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: Openstack-System-Scope: None Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: User-Agent: python-novaclient Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Auth-Token: gAAAAABi0CeHLPKvbA-FNLQ60KTi9vvNbnHXb6TEm4aALmbxvgRFX6r2D5aR7bn89GACNMkvKo4efXvWNU_4P2zk6T4zg1xAnEIH0arDl6K9y0IFQFEFSlqHP3LoqQ4fJW4CWiyJt6CI-uWdwkO2pr1ULVeQHPP4GQ3rDN1xjSjWQWqcmuoDz9k Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Domain-Id: None Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Domain-Name: None Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Identity-Status: Confirmed Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Is-Admin-Project: True Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Domain-Id: default Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Domain-Name: Default Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Project-Name: admin Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Role: admin,member,reader Jul 14 14:26:16.015409 n-d-768852-23 devstack@n-api.service[103981]: X-Roles: admin,member,reader Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant: admin Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-Tenant-Name: admin Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-User: admin Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-User-Domain-Id: default Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-User-Domain-Name: Default Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-User-Id: c8378d889c17447db6fd8aa498751f4a Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: X-User-Name: admin Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: method: > Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: exception: Flavor 451 could not be found. Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: action_args: {'id': '451'} Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:16.017901 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:16.018892 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.020209 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-0e9d3723-ffd9-4cca-a646-eed450de94f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103981) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:16.021577 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-0e9d3723-ffd9-4cca-a646-eed450de94f8 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.527345 Jul 14 14:26:16.021577 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 24/49] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 529 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:26:16.027321 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-2e58aa3a-d091-42cd-87b4-c433c44943cb admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.041953 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-2e58aa3a-d091-42cd-87b4-c433c44943cb admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018268 Jul 14 14:26:16.042493 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 26/50] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:26:16.052013 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.066029 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017558 Jul 14 14:26:16.066569 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 25/51] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:26:16.075834 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-2b964110-e43d-4b97-bebe-d124c6cfb7ef admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:16.081866 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.wsgi [None req-2b964110-e43d-4b97-bebe-d124c6cfb7ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-2b964110-e43d-4b97-bebe-d124c6cfb7ef admin admin] Request method failure captured: Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Accept: application/json Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Accept-Encoding: gzip, deflate Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Connection: keep-alive Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Content-Length: 0 Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Host: 10.222.0.98 Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Openstack-Api-Version: compute 2.90 Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: Openstack-System-Scope: None Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: User-Agent: python-novaclient Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Auth-Token: gAAAAABi0CeHLPKvbA-FNLQ60KTi9vvNbnHXb6TEm4aALmbxvgRFX6r2D5aR7bn89GACNMkvKo4efXvWNU_4P2zk6T4zg1xAnEIH0arDl6K9y0IFQFEFSlqHP3LoqQ4fJW4CWiyJt6CI-uWdwkO2pr1ULVeQHPP4GQ3rDN1xjSjWQWqcmuoDz9k Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Domain-Id: None Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Domain-Name: None Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Identity-Status: Confirmed Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Is-Admin-Project: True Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Domain-Id: default Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Domain-Name: Default Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Project-Name: admin Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Role: admin,member,reader Jul 14 14:26:16.083815 n-d-768852-23 devstack@n-api.service[103982]: X-Roles: admin,member,reader Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8825e26169ac4a448a49e26a9c5f74ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant: admin Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant-Id: 8825e26169ac4a448a49e26a9c5f74ba Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-Tenant-Name: admin Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-User: admin Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-User-Domain-Id: default Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-User-Domain-Name: Default Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-User-Id: c8378d889c17447db6fd8aa498751f4a Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: X-User-Name: admin Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: method: > Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: exception: Flavor 451 could not be found. Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: action_args: {'id': '451'} Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:26:16.085483 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:16.086504 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: ERROR nova.api.openstack.wsgi Jul 14 14:26:16.087872 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-2b964110-e43d-4b97-bebe-d124c6cfb7ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103982) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:26:16.089129 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-2b964110-e43d-4b97-bebe-d124c6cfb7ef admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012690 Jul 14 14:26:16.089129 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 27/52] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:26:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 14 14:26:17.055740 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:17.056743 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 14 14:26:17.057132 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 26/53] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:17.585790 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-09fa7f8b-f3c3-4858-bbda-2d53eb878308 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:17.604297 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-09fa7f8b-f3c3-4858-bbda-2d53eb878308 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.409318 Jul 14 14:26:17.604849 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 28/54] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Jul 14 14:26:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:18.699161 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:18.700191 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 14 14:26:18.700589 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 27/55] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:19.241322 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-62021c44-e57e-47b6-930e-ea49c51ce9f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:19.260651 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-62021c44-e57e-47b6-930e-ea49c51ce9f7 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.422010 Jul 14 14:26:19.261117 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 29/56] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Jul 14 14:26:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:20.242619 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:20.243689 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 14 14:26:20.244113 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 28/57] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:20.789072 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-75ef9e75-f1ca-4e50-95f6-2dc03f9386bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:20.806370 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-75ef9e75-f1ca-4e50-95f6-2dc03f9386bc admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.423474 Jul 14 14:26:20.806957 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 30/58] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Jul 14 14:26:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:21.780870 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:21.782456 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 Jul 14 14:26:21.782831 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 29/59] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:22.311143 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-57a6a3bd-f332-43a7-a3ae-0d90bb1e22a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:26:22.331765 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-57a6a3bd-f332-43a7-a3ae-0d90bb1e22a9 admin admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.414624 Jul 14 14:26:22.332303 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 31/60] 10.222.0.98 () {64 vars in 1235 bytes} [Thu Jul 14 14:26:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:26:23.312176 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:23.313220 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Jul 14 14:26:23.313612 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 30/61] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:26:23.842571 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-643cbb9e-bb5a-42cd-b366-447eaf7d12d9 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:26:23.863149 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-643cbb9e-bb5a-42cd-b366-447eaf7d12d9 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413132 Jul 14 14:26:23.863694 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 32/62] 10.222.0.98 () {60 vars in 1202 bytes} [Thu Jul 14 14:26:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:20.069613 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.070635 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-5a6b515d-4cf7-4eae-bd2d-e9ef4de8c70d admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 14 14:27:20.071042 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 31/63] 10.222.0.98 () {54 vars in 930 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:27:20.086503 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:20.539773 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-287b24a0-ef9b-48d9-82b5-4df69ba8fc3f admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.563420 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-287b24a0-ef9b-48d9-82b5-4df69ba8fc3f admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.484753 Jul 14 14:27:20.564003 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 33/64] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:27:20.585549 n-d-768852-23 devstack@n-api.service[103981]: DEBUG dbcounter [-] [103981] Writing DB stats nova_api:SELECT=14 {{(pid=103981) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:27:20.589504 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-96c2c278-2af7-4b34-a3c3-445e6f72a404 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.598853 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-96c2c278-2af7-4b34-a3c3-445e6f72a404 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014945 Jul 14 14:27:20.599656 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 32/65] 10.222.0.98 () {60 vars in 1282 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:20.612999 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-4f662e8d-80af-47df-9571-378b62fec9d1 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.621505 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-4f662e8d-80af-47df-9571-378b62fec9d1 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013062 Jul 14 14:27:20.622143 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 34/66] 10.222.0.98 () {60 vars in 1285 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:20.634836 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-983458e4-f97d-4ac1-a4fb-bd3b7f5cca82 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.643896 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-983458e4-f97d-4ac1-a4fb-bd3b7f5cca82 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012732 Jul 14 14:27:20.644539 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 33/67] 10.222.0.98 () {60 vars in 1285 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:27:20.657757 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-e43a35ea-78b8-455a-b32c-c4e955059b57 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:27:20.666714 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-e43a35ea-78b8-455a-b32c-c4e955059b57 admin admin] 10.222.0.98 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013450 Jul 14 14:27:20.667375 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 35/68] 10.222.0.98 () {60 vars in 1282 bytes} [Thu Jul 14 14:27:20 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:33:19.406389 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-983458e4-f97d-4ac1-a4fb-bd3b7f5cca82 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.408409 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-983458e4-f97d-4ac1-a4fb-bd3b7f5cca82 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002906 Jul 14 14:33:19.409041 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 34/69] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:19.640841 n-d-768852-23 devstack@n-api.service[103982]: DEBUG dbcounter [-] [103982] Writing DB stats nova_api:SELECT=6 {{(pid=103982) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:33:19.850636 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-42507363-4c20-42b2-83aa-3f55ca1bde01 admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:19.852923 n-d-768852-23 devstack@n-api.service[103982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:33:19.852923 n-d-768852-23 devstack@n-api.service[103982]: warnings.warn(msg) Jul 14 14:33:19.855947 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-42507363-4c20-42b2-83aa-3f55ca1bde01 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.856739 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-42507363-4c20-42b2-83aa-3f55ca1bde01 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.857923 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-42507363-4c20-42b2-83aa-3f55ca1bde01 admin admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:19.858384 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-42507363-4c20-42b2-83aa-3f55ca1bde01 admin admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:19.904209 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-42507363-4c20-42b2-83aa-3f55ca1bde01 admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.264743 Jul 14 14:33:19.904796 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 36/70] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:33:19 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:33:20.765713 n-d-768852-23 devstack@n-api.service[103981]: DEBUG nova.api.openstack.wsgi [None req-983458e4-f97d-4ac1-a4fb-bd3b7f5cca82 admin admin] Calling method '>' {{(pid=103981) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:20.766840 n-d-768852-23 devstack@n-api.service[103981]: INFO nova.api.openstack.requestlog [None req-983458e4-f97d-4ac1-a4fb-bd3b7f5cca82 admin admin] 10.222.0.98 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jul 14 14:33:20.767385 n-d-768852-23 devstack@n-api.service[103981]: [pid: 103981|app: 0|req: 35/71] 10.222.0.98 () {56 vars in 1074 bytes} [Thu Jul 14 14:33:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:33:20.976703 n-d-768852-23 devstack@n-api.service[103982]: DEBUG nova.api.openstack.wsgi [None req-e954402e-61a1-4a4a-906b-c8a113ac494b admin admin] Calling method '>' {{(pid=103982) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:33:20.977919 n-d-768852-23 devstack@n-api.service[103982]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:33:20.977919 n-d-768852-23 devstack@n-api.service[103982]: warnings.warn(msg) Jul 14 14:33:20.979316 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-e954402e-61a1-4a4a-906b-c8a113ac494b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.979941 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-e954402e-61a1-4a4a-906b-c8a113ac494b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:20.980745 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-e954402e-61a1-4a4a-906b-c8a113ac494b admin admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:33:20.981173 n-d-768852-23 devstack@n-api.service[103982]: DEBUG oslo_concurrency.lockutils [None req-e954402e-61a1-4a4a-906b-c8a113ac494b admin admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103982) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:33:21.005136 n-d-768852-23 devstack@n-api.service[103982]: INFO nova.api.openstack.requestlog [None req-e954402e-61a1-4a4a-906b-c8a113ac494b admin admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.094631 Jul 14 14:33:21.005724 n-d-768852-23 devstack@n-api.service[103982]: [pid: 103982|app: 0|req: 37/72] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:33:20 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:34:06.545107 n-d-768852-23 systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 14:34:06.545980 n-d-768852-23 devstack@n-api.service[103980]: Thu Jul 14 14:34:06 2022 - graceful shutdown triggered... Jul 14 14:34:06.546669 n-d-768852-23 devstack@n-api.service[103982]: Gracefully killing worker 2 (pid: 103982)... Jul 14 14:34:06.547297 n-d-768852-23 devstack@n-api.service[103981]: Gracefully killing worker 1 (pid: 103981)... Jul 14 14:34:07.547317 n-d-768852-23 devstack@n-api.service[103980]: worker 1 buried after 1 seconds Jul 14 14:34:07.547317 n-d-768852-23 devstack@n-api.service[103980]: worker 2 buried after 1 seconds Jul 14 14:34:07.547317 n-d-768852-23 devstack@n-api.service[103980]: goodbye to uWSGI. Jul 14 14:34:07.549099 n-d-768852-23 systemd[1]: devstack@n-api.service: Succeeded. Jul 14 14:34:07.549996 n-d-768852-23 systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 14:34:07.554264 n-d-768852-23 systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 14:34:07.570408 n-d-768852-23 devstack@n-api.service[125950]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 14:34:07 2022] *** Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: nodename: n-d-768852-23 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: machine: x86_64 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: clock source: unix Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: pcre jit disabled Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: detected number of CPU cores: 4 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: current working directory: / Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: detected binary path: /usr/bin/uwsgi-core Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: your processes number limit is 47680 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: your memory page size is 4096 bytes Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: detected max file descriptor number: 2048 Jul 14 14:34:07.594681 n-d-768852-23 devstack@n-api.service[125950]: lock engine: pthread robust mutexes Jul 14 14:34:07.597527 n-d-768852-23 devstack@n-api.service[125950]: thunder lock: enabled Jul 14 14:34:07.597527 n-d-768852-23 devstack@n-api.service[125950]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 14:34:07.597527 n-d-768852-23 devstack@n-api.service[125950]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 14:34:07.652105 n-d-768852-23 devstack@n-api.service[125950]: Python main interpreter initialized at 0x5641d8e9b9c0 Jul 14 14:34:07.652105 n-d-768852-23 devstack@n-api.service[125950]: python threads support enabled Jul 14 14:34:07.652105 n-d-768852-23 devstack@n-api.service[125950]: your server socket listen backlog is limited to 100 connections Jul 14 14:34:07.652105 n-d-768852-23 devstack@n-api.service[125950]: your mercy for graceful operations on workers is 90 seconds Jul 14 14:34:07.652891 n-d-768852-23 devstack@n-api.service[125950]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 14:34:07.652891 n-d-768852-23 devstack@n-api.service[125950]: *** Operational MODE: preforking *** Jul 14 14:34:07.652891 n-d-768852-23 devstack@n-api.service[125950]: *** uWSGI is running in multiple interpreter mode *** Jul 14 14:34:07.652891 n-d-768852-23 devstack@n-api.service[125950]: spawned uWSGI master process (pid: 125950) Jul 14 14:34:07.653151 n-d-768852-23 systemd[1]: Started Devstack devstack@n-api.service. Jul 14 14:34:07.655945 n-d-768852-23 devstack@n-api.service[125950]: spawned uWSGI worker 1 (pid: 125965, cores: 1) Jul 14 14:34:07.655945 n-d-768852-23 devstack@n-api.service[125950]: spawned uWSGI worker 2 (pid: 125966, cores: 1) Jul 14 14:34:07.655945 n-d-768852-23 devstack@n-api.service[125950]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 14:34:08.393683 n-d-768852-23 devstack@n-api.service[125965]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:34:08.397261 n-d-768852-23 devstack@n-api.service[125966]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 14:34:09.654738 n-d-768852-23 devstack@n-api.service[125965]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:34:09.654738 n-d-768852-23 devstack@n-api.service[125965]: from cryptography.utils import int_from_bytes Jul 14 14:34:09.655527 n-d-768852-23 devstack@n-api.service[125965]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:34:09.655527 n-d-768852-23 devstack@n-api.service[125965]: from cryptography.utils import int_from_bytes Jul 14 14:34:09.680450 n-d-768852-23 devstack@n-api.service[125966]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:34:09.680450 n-d-768852-23 devstack@n-api.service[125966]: from cryptography.utils import int_from_bytes Jul 14 14:34:09.681181 n-d-768852-23 devstack@n-api.service[125966]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 14:34:09.681181 n-d-768852-23 devstack@n-api.service[125966]: from cryptography.utils import int_from_bytes Jul 14 14:34:12.277066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:34:12.277554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:34:12.277875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:34:12.278251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:34:12.278510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:34:12.278907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.279242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.279603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.279928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.280267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.280585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.280913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.281235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.281576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.281964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.282482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.282810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-768852-23 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.283141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.283482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.283803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.284134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.284439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.284768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.285084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.285595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.286271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.288775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.289156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.289461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.289614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-768852-23 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.290323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.290323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.290618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.291561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.291997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.292480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.292480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.293208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.293208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.294008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.294008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.294825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.294825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.294825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.295961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.295961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.295961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.295961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.297125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.297125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.297125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.297125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.298095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.298095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.298095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.298805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.298805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.298805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.299660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.299660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.300122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.300122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.300568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.300806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.301027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.301264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.302601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.302601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.302601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.302601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.303599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.303599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.303599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.304237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.304237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.304667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.304891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.305285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.305574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.306062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.306332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.306614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.307441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.307766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.308080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.308362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.308676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.308989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.309335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.309628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.309942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.310253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.310560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.310932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.311187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.311510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.312952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.312952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.312952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.312952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.313868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.313868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.313868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.314611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.314611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.314611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.315228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.315228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.315769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.315769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.316214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.316439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.316677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.316994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.317291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.317603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.318412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.318412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.318986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.318986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.319587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.319587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.320116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.320116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.320665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.320665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.321210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.321210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.323229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.323229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.323229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.323229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.323229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.323229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.324683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.324683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.324683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.324683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.325594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.325594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.325594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.326258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.326258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.326750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.326750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.327449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.327449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.327961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.327961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.328424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.328666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.328889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.329224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.329547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.329930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.330236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.330493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.330823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.331152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.331581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.331853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.332271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.332547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.333843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.333843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.333843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.333843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.334840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.334840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.334840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.335853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.335853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.336306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.336306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.337172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.337172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.337631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.338364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.338658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.339060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.339488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.339817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.340138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.340452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.340771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.341093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.341421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.341733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.342075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.342495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.342733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.343717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.343717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.343717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.344866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.344866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.344866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.345557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.345557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.345557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.346242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.346242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.346680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.346906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.347143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.347491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.347741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.347996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.348345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.348596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.348936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.349332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.349649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.349986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.350304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.350749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.351034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.351329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.351772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.352117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.352368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.354998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.354998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.354998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.354998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.354998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.354998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.356414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.356414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.356414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.356414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.356414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.357564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.357564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.357564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.357564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.358484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.358484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.358484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.359218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.359218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.359711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.359711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.360181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.360426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.360693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.361062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.361342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.361605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.361937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.362247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.362614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.362905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.363362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.363633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.364007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.364260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.365378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.365378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.365378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.366061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.366061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.366061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.366666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.366666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.366984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.367318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.367628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.367944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.368401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.368700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.369073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.369408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.369749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.370067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.370395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.370749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.371024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.373182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.373182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.373182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.373182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.373182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.373182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.376015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.377794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.377794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.377794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.377794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.377794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.377794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.379525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.379525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.379525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.379525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.379525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.379525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.380847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.380847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.380847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.380847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.381716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.381716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.381716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.382894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.382894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.382894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.382894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.384054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.384054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.384054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.384054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.385663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.385663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.385663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.385663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.385663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.387178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.387178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.387178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.387178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.387178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.388335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.388335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.388335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.388959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.388959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.389496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.389749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.389983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.390228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.390491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.390814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.391184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.391526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.391843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.392156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.392469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.393219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.393219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.393826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.393826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.394324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.394324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.394933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.394933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.395952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.395952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.395952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.397016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.397016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.397016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.397662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.397662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.398138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.398138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.398551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.398779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.399077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.399585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.399829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.400201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.401000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.401352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.401673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.401943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.402355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.402669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.403563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.403563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.403563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.404474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.404474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.404474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.405346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.405346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.405346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.407250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.407250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.407250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.407250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.407250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.407250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.408677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.408677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.408677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.408677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.408677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.410091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.410091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.410091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.410091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.410091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.411192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.411192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.411192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.412006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.412006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.412006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.412762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.412762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.414830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.418462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.420571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.422364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.424645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.426534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.430309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.432217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.434431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.436726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.440078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.441953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.444049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.446064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.446064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.446064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.446064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.446064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.446064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.448344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.450558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.452673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.454473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.454473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.454473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.454473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.454473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.454473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.456282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.456282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.456282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.456282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.456282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.457697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.457697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.457697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.457697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.457697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.459829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.464019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.464019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.464019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.464019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.464019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.465741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.465741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.465741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.465741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.465741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.467229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.467229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.467229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.467229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.467229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.468957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.468957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.468957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.468957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.468957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.468957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.470819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.470819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.470819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.470819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.470819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.472084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.472084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.472084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.472084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.473032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.473032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.473032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.473946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.473946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.473946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.474823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.474823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.474823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.475744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.475744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.475744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.476637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.476637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.477306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.477306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.477306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.478043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.478043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.479588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.479588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.479588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.480556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.480556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.480556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.481411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.481411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.481411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.481981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.482244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.482500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.482739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.482998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.483352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.483996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.484261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.484544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.484972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.485225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.485502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.485894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.486163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.486429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.486835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.487094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.487569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.487819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.488084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.488338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.488597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.488912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.489225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.489960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.490224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.491039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.491039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.491794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.491794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.491794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.492531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.492531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.493011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.493011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.493473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.493733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.493992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.494479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.494479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.494943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.495386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.495386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.495916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.496291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.496529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.496796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.497203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.497203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.497833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.497833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.498311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.498556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.498812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.499061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.499477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.500253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.500253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.500253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.501181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.501181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.501181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.502054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.502054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.502054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.502869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.502869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.503374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.503374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.503892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.504284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.504961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.504961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.505615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.505615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.506100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.506435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.506679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.506914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.507177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.507630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.508060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.508060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.508572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.508816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.509069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.509328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 14:34:12.510704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.512495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 14:34:12.512719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.512719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.513028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 14:34:12.513230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.513527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 14:34:12.513788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.514036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 14:34:12.514299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.514556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.515189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.515513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.515914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.516169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.516423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.516662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.517029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.517311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.517588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.518336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.518606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.518852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.519120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.519429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.519677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.519919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.520165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.520923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.521188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.521448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.521730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.521985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-768852-23 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.522266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.522898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.523323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.523603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.524182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.524447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.524711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.525000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.526118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.526280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.526450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.526623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.526798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.526953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.527102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.527102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.527414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.527592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.527747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.527966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.528106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.528804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.528962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.529122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.529271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.529410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.529551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.529699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.529837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.530089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.530243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.530380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.530544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.531175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.531348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.531493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.531621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.532236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.532364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-768852-23 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.532498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.532675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.533171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.533347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.533501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.533640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.533800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.533937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.534073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.534073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.534337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.534477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.534628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.534777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.534931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.535230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.535654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.535933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.535933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.537071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.537567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.537715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.537878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.537878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.538141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.538293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.538438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.538587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.538587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.539201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.539368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.539528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.539669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.539669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.539943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.540094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.540245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.540396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.540542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.540674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.540828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.541715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.541864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.542033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.542169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.542325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.542471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.542609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.542748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.542906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.542906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.543188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.543399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.543895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.544046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.544201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.544355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.544498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.544635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.544780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.544916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.545061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.545221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.545372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.545501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.545613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.545741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.545885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.546030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.98 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.546167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.546346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.98 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.546849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.547011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.547163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.547344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.547596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.547773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.547925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.548092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.548257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.548423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.548590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.548747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.548912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.549413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.549605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.549762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.549927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.550064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.550201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.550351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.550528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.550685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.550838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.551004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.551183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.552023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.552186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.552350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.552350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.552687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.552687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.553005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.553005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.553301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.553469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.553624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.553803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.554316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.554487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.554641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.554802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.554957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.555113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.555309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.555484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.555648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.555800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.555960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.556123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.556278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.556440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.557474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.557706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.557864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.558025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.558182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.558336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.558500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.558653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.558808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.558976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.559129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.559747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.559907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.560059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.560059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.560381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.560542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.560694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.560860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.561022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.561176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.561176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.561459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.561631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.561792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.562427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125965) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.562746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.563914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 14:34:12.565527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.566944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.568462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.569619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.571061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.573752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.575621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.576812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.580256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.581435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.582563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.584313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.584313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.584313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.584313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.584313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.585237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.585237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.585518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.585820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.586045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.586359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.586672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.586979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.587329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.587815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.588420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.588739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.589087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.589406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.589984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.590160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.590430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.590787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.591101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.591517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.591867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.592201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.593349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.593349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.593349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.594738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.594738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.594738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.594738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.594738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.595557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.595557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.595898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.596051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.596353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.596642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.596951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.597280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.597638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.597974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.598430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.598606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.598930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.599254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.599618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.599965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.600341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.600562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.600892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.601209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.601534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.601852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.602190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.602508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.602855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.603382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.604136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.605099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.605099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.605099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.605570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.605727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.606135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.606298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.606629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.606956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.607247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.607619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.608062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.608284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.608685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.608940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.609328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.609649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.609964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.610440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.610600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.610966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.611243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.612610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.612610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.612610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.612610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.613449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.613449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.613749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.613919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.614274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.614470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.615315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.615315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.615607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.615773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.616093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.617425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.617425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.617425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.617425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.617991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.617991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.618260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.618981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.618981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.619835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.620321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.620490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.620795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.621212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.622254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.622254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.622254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.622698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.623954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.623954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.623954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.623954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.625936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.625936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.625936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.625936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.625936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.626729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.626729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.626729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.627135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.627306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.627662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.627925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.628309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.628707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.629260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.629260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.629565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.632323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.633631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.633631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.633631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.633631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.633631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.634320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.634320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.634608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.637022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.637022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.637022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.637022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.637022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.637022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.638050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.638050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.638050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.638534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.638691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.638856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.639732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.639732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.640091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.640240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.640432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.640748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.641066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.641383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.641748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.642009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.642319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.642645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.643049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.643304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.643812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.644050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.644368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.644685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.645029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.645351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.645670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.645984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.646301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.647339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.647339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.647339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.647813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.680905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.682918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.684071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.685978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.686825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.688045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.690433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.691625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.692482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.693342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.694220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.695974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.696850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.698245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.698245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.698245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.698245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.699160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.699160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.699555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.699886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.700837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.700837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.701124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.701380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.701705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.702062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.702661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.702800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.703217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.703827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.704108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.704480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.704854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.705254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.705523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.705911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.706236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.706568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.706954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.707251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.707633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.707972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.708314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.708644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.709019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.709435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.709804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.710519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.710725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.711066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.711430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.711771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.712108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.712487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.712852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.713269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.713570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.713899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.714237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.714559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.714914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.715261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.715661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.716008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.716348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.716674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.717000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.717324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.717654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.717973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.718299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.718625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.719207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.719573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.719905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.720223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.720561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.720865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.721187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.721506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.721826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.722142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.722462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.722800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.723131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.723495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.723873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.724201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.724525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.724850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.725171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.725538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.725861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.726181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.726522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.726824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.727143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.727499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.727816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.728137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.729064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.729356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.729627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.729949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.730265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.730628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.730994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.731360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.731714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.732145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.732584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.733101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.733508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.733817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.734175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.734531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.734897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.735251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.735650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.736043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.736415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.736767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.737085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.737399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.737733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.738053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.738362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.738688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.739006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.739614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.739985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.740304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.741049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.741049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.741298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.741574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.741906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.742224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.742532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.742856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.743176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.743520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.743831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.744207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.745016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.745328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.745649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.745960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.746295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.746615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.746929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.747239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.747581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.747891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.748199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.748509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.748817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.749134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.749443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.749761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.750075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.750664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.751668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754662 n-d-768852-23 devstack@n-api.service[125965]: INFO dbcounter [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Registered counter for database nova_api Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.754820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.755494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.755494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.755750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.756356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.756709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.757040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.757389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.757776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.758101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.758425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.758745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.760454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.760454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.760454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.760988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.761622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.762201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.762715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.763224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.763808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.764401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.764987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.765566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.766142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.766723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.767258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.767852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.768508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.769645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.769645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.769890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.770398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.770975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.771532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.771943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.772515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.773052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.773344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.773854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.774411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.774860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.775421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.776012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.776570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.777026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.777422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_db.sqlalchemy.engines [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:12.777596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.777999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.778533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.779078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.779739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.780491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.780804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.781183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.781552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.781960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.782379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.782928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.783209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.783776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.784322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.784872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.785454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.786040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.786409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writer thread running {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:12.786613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.787136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.787651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.788165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.788622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.789036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.789513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.790038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.790596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.791742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.792143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.792545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.792878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.793199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.793527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.793855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.794215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.794559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.794890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.795233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.795738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.796315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.796744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.797161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.797631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.798159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.798618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.799166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.799760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.801296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.801296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.801296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.808335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.808919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.809562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.810184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.810784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.811932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.812775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.813389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.813985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.814546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.815509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.816042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.816402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.816880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.817265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.817752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.818275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.818847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.819826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.822108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.822729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.823432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.824156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.824748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.825392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.826026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.826679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.827326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.827936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.828481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.829030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.830078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.830586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 14:34:12.831054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125966) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 14:34:12.863712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.context [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=125965) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:34:12.868914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:12.871207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:12.872144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:12.874351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:12.876658 n-d-768852-23 devstack@n-api.service[125965]: INFO dbcounter [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Registered counter for database nova_cell0 Jul 14 14:34:12.881594 n-d-768852-23 devstack@n-api.service[125965]: INFO dbcounter [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Registered counter for database nova_cell1 Jul 14 14:34:12.891668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_db.sqlalchemy.engines [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:12.896208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_db.sqlalchemy.engines [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:12.900089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writer thread running {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.028298 n-d-768852-23 devstack@n-api.service[125966]: INFO dbcounter [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Registered counter for database nova_api Jul 14 14:34:13.050678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_db.sqlalchemy.engines [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:13.058926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writer thread running {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.120865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.context [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=125966) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 14:34:13.125313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.127155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.134861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:34:13.134861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:34:13.134861 n-d-768852-23 devstack@n-api.service[125966]: INFO dbcounter [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Registered counter for database nova_cell0 Jul 14 14:34:13.138254 n-d-768852-23 devstack@n-api.service[125966]: INFO dbcounter [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Registered counter for database nova_cell1 Jul 14 14:34:13.147661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_db.sqlalchemy.engines [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:13.149426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_db.sqlalchemy.engines [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:13.157037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writer thread running {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.158416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writer thread running {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.195373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writer thread running {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.213899 n-d-768852-23 devstack@n-api.service[125965]: INFO dbcounter [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Registered counter for database nova_cell0 Jul 14 14:34:13.226160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_db.sqlalchemy.engines [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125965) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:13.235441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writer thread running {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.378125 n-d-768852-23 devstack@n-api.service[125966]: INFO dbcounter [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Registered counter for database nova_cell0 Jul 14 14:34:13.388818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_db.sqlalchemy.engines [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125966) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 14:34:13.396758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writer thread running {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 14:34:13.792865 n-d-768852-23 devstack@n-api.service[125966]: WARNING keystonemiddleware.auth_token [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:34:13.800601 n-d-768852-23 devstack@n-api.service[125966]: WARNING keystonemiddleware.auth_token [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:34:13.872775 n-d-768852-23 devstack@n-api.service[125965]: WARNING keystonemiddleware.auth_token [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:34:13.888061 n-d-768852-23 devstack@n-api.service[125965]: WARNING keystonemiddleware.auth_token [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:34:14.257169 n-d-768852-23 devstack@n-api.service[125965]: WARNING keystonemiddleware.auth_token [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:34:14.264117 n-d-768852-23 devstack@n-api.service[125965]: WARNING keystonemiddleware.auth_token [None req-1a2321e4-655a-44bc-9dca-ae497257501d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:34:14.270607 n-d-768852-23 devstack@n-api.service[125965]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5641d8e9b9c0 pid: 125965 (default app) Jul 14 14:34:14.329126 n-d-768852-23 devstack@n-api.service[125966]: WARNING keystonemiddleware.auth_token [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 14:34:14.342681 n-d-768852-23 devstack@n-api.service[125966]: WARNING keystonemiddleware.auth_token [None req-390e7329-756d-4725-9092-6ba7b9d468ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 14:34:14.355433 n-d-768852-23 devstack@n-api.service[125966]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5641d8e9b9c0 pid: 125966 (default app) Jul 14 14:35:04.145092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.147734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.149775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:04.151030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.210438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56b3780d-45b3-425d-8d0c-7788563e1be0 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:06.212576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56b3780d-45b3-425d-8d0c-7788563e1be0 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:06.213034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56b3780d-45b3-425d-8d0c-7788563e1be0 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:06.213848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56b3780d-45b3-425d-8d0c-7788563e1be0 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:06.214290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56b3780d-45b3-425d-8d0c-7788563e1be0 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:06.268768 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56b3780d-45b3-425d-8d0c-7788563e1be0 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] 10.222.0.98 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 2.143725 Jul 14 14:35:06.269583 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1/1] 10.222.0.98 () {58 vars in 1163 bytes} [Thu Jul 14 14:35:04 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 2147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:06.558059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-824ba547-1272-4bfb-9efb-1dbac862f751 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:06.559643 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:06.559643 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:06.561048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-824ba547-1272-4bfb-9efb-1dbac862f751 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:06.561570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-824ba547-1272-4bfb-9efb-1dbac862f751 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:06.562379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-824ba547-1272-4bfb-9efb-1dbac862f751 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:06.562811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-824ba547-1272-4bfb-9efb-1dbac862f751 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:06.563384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.564280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.564989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.565694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:06.644328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-824ba547-1272-4bfb-9efb-1dbac862f751 tempest-AZAdminV2TestJSON-1679268696 tempest-AZAdminV2TestJSON-1679268696-project-admin] 10.222.0.98 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.361330 Jul 14 14:35:06.645533 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1/2] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 14:35:06 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:08.332174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a297130-81df-4c82-87e6-e8e3fff0f450 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:08.335718 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:08.335718 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:08.338522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a297130-81df-4c82-87e6-e8e3fff0f450 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.340988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a297130-81df-4c82-87e6-e8e3fff0f450 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.342485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a297130-81df-4c82-87e6-e8e3fff0f450 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.343328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a297130-81df-4c82-87e6-e8e3fff0f450 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:08.376575 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a297130-81df-4c82-87e6-e8e3fff0f450 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.782669 Jul 14 14:35:08.377416 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2/3] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:35:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:08.396984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-467ef445-0b5f-4df3-81a5-790427322998 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-236972397"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:08.418419 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:08.418419 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:08.420697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-467ef445-0b5f-4df3-81a5-790427322998 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 0cb86759-ab81-4045-9008-fc0d9ce1c5af for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:08.512078 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-467ef445-0b5f-4df3-81a5-790427322998 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.119624 Jul 14 14:35:08.518961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3/4] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:08.524203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f91119c-e5d0-4350-b422-5c7f8e0f6cc4 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:08.526539 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:08.526539 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:08.566321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f91119c-e5d0-4350-b422-5c7f8e0f6cc4 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:08.567606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f91119c-e5d0-4350-b422-5c7f8e0f6cc4 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.308656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '.version_select at 0x7fdc01b52790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:09.309508 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:09.309508 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:09.318061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=125966) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 14 14:35:09.319111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.319593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.366635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.367738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.390493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:09.391259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:09.403231 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56991573-1606-4b65-b7d5-799e89c12166 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 1.501078 Jul 14 14:35:09.404300 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2/5] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 14:35:07 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:09.703754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81b78876-9095-4643-a4de-1ee471959c95 tempest-AZAdminNegativeTestJSON-1038958015 tempest-AZAdminNegativeTestJSON-1038958015-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:09.705323 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:09.705323 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:09.706580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81b78876-9095-4643-a4de-1ee471959c95 tempest-AZAdminNegativeTestJSON-1038958015 tempest-AZAdminNegativeTestJSON-1038958015-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '65b23c692f4e40dd80218b649202dcc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5b1ad669de4499b8ff71b9dd2cc780', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81b78876-9095-4643-a4de-1ee471959c95 tempest-AZAdminNegativeTestJSON-1038958015 tempest-AZAdminNegativeTestJSON-1038958015-project] Request method failure captured: Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmYvN1KxzUIaw4Izpda08qUaZJvVY_xTXEadibDCsJwnJCpY5mUisECzCD6c8FlswjJOwfwK6fheo1T7m2s7AwS9mBDmWln8j0R5Sj90SocSzPaWfXd-zUMJEjhDs0jyXSmGAla42jfGsVd4YvLCSKgGESiK2paNF_EWYRC6pkXf6A Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 7d5b1ad669de4499b8ff71b9dd2cc780 Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1038958015 Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:09.713174 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7d5b1ad669de4499b8ff71b9dd2cc780"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7d5b1ad669de4499b8ff71b9dd2cc780"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7d5b1ad669de4499b8ff71b9dd2cc780"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7d5b1ad669de4499b8ff71b9dd2cc780"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AZAdminNegativeTestJSON-1038958015 Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 7d5b1ad669de4499b8ff71b9dd2cc780 Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1038958015 Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AZAdminNegativeTestJSON-1038958015-project Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 65b23c692f4e40dd80218b649202dcc5 Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AZAdminNegativeTestJSON-1038958015-project Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 14 14:35:09.714374 n-d-768852-23 devstack@n-api.service[125966]: action_args: {} Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:09.715018 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:09.716111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81b78876-9095-4643-a4de-1ee471959c95 tempest-AZAdminNegativeTestJSON-1038958015 tempest-AZAdminNegativeTestJSON-1038958015-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:09.716942 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81b78876-9095-4643-a4de-1ee471959c95 tempest-AZAdminNegativeTestJSON-1038958015 tempest-AZAdminNegativeTestJSON-1038958015-project] 10.222.0.98 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.309728 Jul 14 14:35:09.716942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3/6] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 14:35:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 312 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:09.867657 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f91119c-e5d0-4350-b422-5c7f8e0f6cc4 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 242 microversion: 2.1 time: 1.347088 Jul 14 14:35:09.868391 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 4/7] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:35:08 2022] POST /compute/v2.1/os-aggregates/1/action => generated 242 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:10.047124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01355a9e-3e58-48d8-81c4-50d8495b0574 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-789441647", "id": 386946897, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:10.085574 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.085574 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:10.154735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01355a9e-3e58-48d8-81c4-50d8495b0574 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.435021 Jul 14 14:35:10.156135 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 4/8] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:09 2022] POST /compute/v2.1/flavors => generated 426 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:10.312036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Calling method '.version_select at 0x7fdc000efee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.313842 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.313842 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:10.322528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=125965) load_cells /opt/stack/nova/nova/compute/api.py:306}} Jul 14 14:35:10.323501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.324209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.351175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.352224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.355830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2657c18-6a42-43be-b989-8e6ed8de52ce tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-884089398", "id": 136818154, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:10.375558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.376610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.387806 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2657c18-6a42-43be-b989-8e6ed8de52ce tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.86 time: 0.229470 Jul 14 14:35:10.388761 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 5/9] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:35:10 2022] POST /compute/v2.1/flavors => generated 467 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:10.390519 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5b6ee6c-3973-4ecd-8268-ecdbfae93547 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1429 microversion: 2.41 time: 0.520414 Jul 14 14:35:10.391906 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 5/10] 10.222.0.98 () {60 vars in 1207 bytes} [Thu Jul 14 14:35:09 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1429 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:10.403001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:10.406261 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.406261 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:10.420831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.421865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.470626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] HTTP exception thrown: Aggregate 1 already has host n-h1-768852-23. Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-aggregates/1/action HTTP/1.1 Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 40 Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:10.508093 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: {"add_host": {"host": "n-h1-768852-23"}} Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:10.510517 n-d-768852-23 devstack@n-api.service[125965]: exception: Aggregate 1 already has host n-h1-768852-23. Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '1', 'body': {'add_host': {'host': 'n-h1-768852-23'}}} Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:35:10.511836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-768852-23-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi session.flush() Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:35:10.513671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:35:10.516444 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:35:10.520370 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-768852-23-1' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 14, 14, 35, 10, 451976), 'updated_at': None, 'host': 'n-h1-768852-23', 'aggregate_id': 1}] Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.523902 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6513, in add_host_to_aggregate Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 1 already has host n-h1-768852-23. Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.527475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 1 already has host n-h1-768852-23. Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:10.531837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:10.537728 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 1 already has host n-h1-768852-23. Jul 14 14:35:10.537728 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.537728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 409 to user: Aggregate 1 already has host n-h1-768852-23. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:10.537728 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0195bf00-11ce-44ea-9186-96e83a8a25e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 96 microversion: 2.1 time: 0.117006 Jul 14 14:35:10.537728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 6/11] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:35:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 96 bytes in 127 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Jul 14 14:35:10.539104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-567952c9-2ffa-4893-a4bf-93626beccdeb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.542755 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.542755 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:10.598545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-567952c9-2ffa-4893-a4bf-93626beccdeb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/386946897" status: 202 len: 0 microversion: 2.1 time: 0.069910 Jul 14 14:35:10.600417 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 7/12] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:10 2022] DELETE /compute/v2.1/flavors/386946897 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:10.611549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4f21819c-fbfd-41e8-b0c3-e76e20b28f19 tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:10.614225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eefeaafb-c836-4ee2-8220-3629e20361e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.614421 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.614421 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:10.615058 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.615058 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:10.623198 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-eefeaafb-c836-4ee2-8220-3629e20361e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eefeaafb-c836-4ee2-8220-3629e20361e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin] Request method failure captured: Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmdklyyjH7mAx3EC53pLd8gMSj9YmUbrmt0rH_G11WxXrqqnDzGnhtmnGIN7oqgsf7gmSI6uuKFjPeZEJrYFLoS3rBVawvzMm_G_ukr5EMu012xPhLGBhDrIbemwbplCmpKNiNv8FSqJUazoPXHldWqVJNpmrxdAF8Xazx_s8-tR4U Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 814c67643349454aa591a40c1f35528f Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:10.636592 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/814c67643349454aa591a40c1f35528f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_814c67643349454aa591a40c1f35528f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/814c67643349454aa591a40c1f35528f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/814c67643349454aa591a40c1f35528f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 814c67643349454aa591a40c1f35528f Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ff66fbcd8f5341d69b92eb5b60e56cee Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:10.638601 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid timestamp for date invalid_time Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'invalid_time'} Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:10.639346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:10.640353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eefeaafb-c836-4ee2-8220-3629e20361e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:10.641036 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eefeaafb-c836-4ee2-8220-3629e20361e2 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034 tempest-InstanceUsageAuditLogNegativeTestJSON-1260396034-project-admin] 10.222.0.98 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.250209 Jul 14 14:35:10.643020 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 6/13] 10.222.0.98 () {58 vars in 1223 bytes} [Thu Jul 14 14:35:10 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:10.655537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e747a80f-f93f-47af-9e15-1d4e6ca77e3b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:10.658746 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:10.658746 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:10.723670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e747a80f-f93f-47af-9e15-1d4e6ca77e3b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:10.725713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e747a80f-f93f-47af-9e15-1d4e6ca77e3b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:10.942003 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4f21819c-fbfd-41e8-b0c3-e76e20b28f19 tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/136818154/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.339317 Jul 14 14:35:10.942807 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 8/14] 10.222.0.98 () {62 vars in 1261 bytes} [Thu Jul 14 14:35:10 2022] POST /compute/v2.1/flavors/136818154/os-extra_specs => generated 62 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:10.949458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2611acb-5d9f-4c8e-b813-666e84df3029 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:10.993550 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2611acb-5d9f-4c8e-b813-666e84df3029 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5409 microversion: 2.1 time: 0.048115 Jul 14 14:35:10.995637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 9/15] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:10 2022] GET /compute/v2.1/flavors/detail => generated 5409 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:11.528038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fdb6f57-cef0-4dfe-9d9b-cca6a74cc33a tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.530150 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.530150 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:11.533647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6fdb6f57-cef0-4dfe-9d9b-cca6a74cc33a tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '921ab539d8be44f09b5277aa1abe4665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149c07a07cc04dc5acb9e626459b6222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fdb6f57-cef0-4dfe-9d9b-cca6a74cc33a tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Request method failure captured: Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmZMbtTm44g5_vLBPRuyTJSAaLXJr5Zp4c2BE6AJNo5dkub1XOtCs6z_3LoCzvWLtVG2bpCgNc0j9GbccPy_CyPIqRF75KxpEtMNILe8uCMP71svS2d5V-xPOPRt_4U55XWdP1PcOJJuC6Et7uwEj59VsdWdZ9Idjj_HadnYR1Fers Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 149c07a07cc04dc5acb9e626459b6222 Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:11.545444 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 149c07a07cc04dc5acb9e626459b6222 Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 921ab539d8be44f09b5277aa1abe4665 Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:11.547202 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:11.548284 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:11.550242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fdb6f57-cef0-4dfe-9d9b-cca6a74cc33a tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:11.556420 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6fdb6f57-cef0-4dfe-9d9b-cca6a74cc33a tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] 10.222.0.98 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.550623 Jul 14 14:35:11.556420 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 10/16] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 14:35:10 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 558 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:11.563460 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e747a80f-f93f-47af-9e15-1d4e6ca77e3b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.917870 Jul 14 14:35:11.564878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-972ca098-44bb-4efc-84ba-a38927c1346d tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.567967 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 7/17] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:35:10 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:11.589004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc2c8a54-9b95-492f-bf0f-6ab8ba8759f4 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1377642887", "id": 560536050, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:11.594833 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.594833 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:11.604151 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-972ca098-44bb-4efc-84ba-a38927c1346d tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/136818154" status: 202 len: 0 microversion: 2.86 time: 0.046609 Jul 14 14:35:11.605224 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 11/18] 10.222.0.98 () {60 vars in 1198 bytes} [Thu Jul 14 14:35:11 2022] DELETE /compute/v2.1/flavors/136818154 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:11.614203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e67e548-396e-4d7a-a89e-a75343faf939 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.616112 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.616112 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:11.617609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e67e548-396e-4d7a-a89e-a75343faf939 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '921ab539d8be44f09b5277aa1abe4665', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '149c07a07cc04dc5acb9e626459b6222', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e67e548-396e-4d7a-a89e-a75343faf939 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Request method failure captured: Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14%2014:35:11 HTTP/1.1 Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmZMbtTm44g5_vLBPRuyTJSAaLXJr5Zp4c2BE6AJNo5dkub1XOtCs6z_3LoCzvWLtVG2bpCgNc0j9GbccPy_CyPIqRF75KxpEtMNILe8uCMP71svS2d5V-xPOPRt_4U55XWdP1PcOJJuC6Et7uwEj59VsdWdZ9Idjj_HadnYR1Fers Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 149c07a07cc04dc5acb9e626459b6222 Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:11.619680 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/149c07a07cc04dc5acb9e626459b6222"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 149c07a07cc04dc5acb9e626459b6222 Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 921ab539d8be44f09b5277aa1abe4665 Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:11.621876 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2022-07-14 14:35:11'} Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:11.623021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:11.625103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e67e548-396e-4d7a-a89e-a75343faf939 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:11.626791 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e67e548-396e-4d7a-a89e-a75343faf939 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119 tempest-InstanceUsageAuditLogNegativeTestJSON-1958877119-project] 10.222.0.98 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14 14:35:11" status: 403 len: 128 microversion: 2.1 time: 0.015632 Jul 14 14:35:11.627991 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc2c8a54-9b95-492f-bf0f-6ab8ba8759f4 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.058023 Jul 14 14:35:11.629754 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 8/19] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:11 2022] POST /compute/v2.1/flavors => generated 414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:11.635767 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 12/20] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:35:11 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14%2014%3A35%3A11 => generated 128 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:11.640698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f9f8644-897c-4b1c-ac25-c1ffba8e934e tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.642948 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.642948 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:11.648285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad4c023d-793a-43cc-ad68-79d08128c35c tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.697282 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad4c023d-793a-43cc-ad68-79d08128c35c tempest-FlavorMetadataValidation-581210026 tempest-FlavorMetadataValidation-581210026-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 6221 microversion: 2.86 time: 0.059745 Jul 14 14:35:11.699096 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 13/21] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:35:11 2022] GET /compute/v2.1/flavors/detail => generated 6221 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:11.707309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66e20289-9124-4f4c-9362-760b0a77d706 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.715216 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f9f8644-897c-4b1c-ac25-c1ffba8e934e tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.082685 Jul 14 14:35:11.722787 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 9/22] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:11 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:11.744312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74e83851-50db-4d55-ba78-afbddb594a44 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-37848298"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:11.744312 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.744312 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:11.745387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-74e83851-50db-4d55-ba78-afbddb594a44 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 6c59eb43-50aa-4730-8aee-4e487db0782f for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:11.748511 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66e20289-9124-4f4c-9362-760b0a77d706 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.047038 Jul 14 14:35:11.749508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 14/23] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:11 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:11.773148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46d1484f-2d7f-463f-9566-4a98fb6a71c7 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1270593265"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:11.807185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74e83851-50db-4d55-ba78-afbddb594a44 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.075177 Jul 14 14:35:11.808904 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 10/24] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:11 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:11.814951 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.814951 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:11.817327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-46d1484f-2d7f-463f-9566-4a98fb6a71c7 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Generated uuid 031dac78-948e-48b5-8b8b-7436dcba3e64 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:11.826960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f2a39baf-5aba-4651-9504-57f442a1683b tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.828429 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:11.828429 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:11.877267 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f2a39baf-5aba-4651-9504-57f442a1683b tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/560536050" status: 202 len: 0 microversion: 2.1 time: 0.054563 Jul 14 14:35:11.880263 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 11/25] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:11 2022] DELETE /compute/v2.1/flavors/560536050 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:11.888591 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46d1484f-2d7f-463f-9566-4a98fb6a71c7 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.129086 Jul 14 14:35:11.891328 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 15/26] 10.222.0.98 () {62 vars in 1204 bytes} [Thu Jul 14 14:35:11 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:35:11.903748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a38f2ec8-7d76-4027-98f9-ebcecf1cef21 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:11.955630 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a38f2ec8-7d76-4027-98f9-ebcecf1cef21 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059537 Jul 14 14:35:11.963414 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 16/27] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:11.969940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b98b127-040f-418c-85f8-cd37d15c49e1 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1420451131"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.080575 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.080575 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.144923 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b98b127-040f-418c-85f8-cd37d15c49e1 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.179948 Jul 14 14:35:12.146654 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 17/28] 10.222.0.98 () {62 vars in 1209 bytes} [Thu Jul 14 14:35:11 2022] PUT /compute/v2.1/os-aggregates/3 => generated 299 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:12.153282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcebfee5-847a-403e-9e03-77d124228924 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-64352475", "id": 1685189604, "os-flavor-access:is_public": "True"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.154935 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.154935 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.191757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcebfee5-847a-403e-9e03-77d124228924 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.044029 Jul 14 14:35:12.193018 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 18/29] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/flavors => generated 427 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:12.211646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87dfbc66-ff7d-4d20-8518-77da9dae4605 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.215152 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.215152 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.236463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87dfbc66-ff7d-4d20-8518-77da9dae4605 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 299 microversion: 2.41 time: 0.041435 Jul 14 14:35:12.238142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 19/30] 10.222.0.98 () {60 vars in 1189 bytes} [Thu Jul 14 14:35:12 2022] GET /compute/v2.1/os-aggregates/3 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:12.256349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba1bd470-78a5-4072-b3f9-4a026e1b6fc5 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.259308 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.259308 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.298290 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba1bd470-78a5-4072-b3f9-4a026e1b6fc5 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1685189604" status: 202 len: 0 microversion: 2.1 time: 0.057123 Jul 14 14:35:12.300472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 20/31] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:12 2022] DELETE /compute/v2.1/flavors/1685189604 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:12.307411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e1884ef-8926-4299-903a-9b110a5e7293 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.308852 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.308852 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.320817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e1884ef-8926-4299-903a-9b110a5e7293 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.322148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e1884ef-8926-4299-903a-9b110a5e7293 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.549093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e1884ef-8926-4299-903a-9b110a5e7293 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 315 microversion: 2.41 time: 0.247076 Jul 14 14:35:12.551696 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 21/32] 10.222.0.98 () {62 vars in 1231 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/os-aggregates/3/action => generated 315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:12.562147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44d70e04-1ef8-44bc-9019-1321dd6ca8c7 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.574089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=8,nova_api:DELETE=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:12.601461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44d70e04-1ef8-44bc-9019-1321dd6ca8c7 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047518 Jul 14 14:35:12.607175 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 22/33] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:12.611031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e2683da-b2a9-4388-96e6-f6657720759e tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.617656 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.617656 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.620694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77deead1-dfbe-484a-b270-d7d7157a5132 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.622932 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.622932 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.624962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77deead1-dfbe-484a-b270-d7d7157a5132 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '514824382c1f44c3a4cb77582c04c14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6cb6b271e40129098cf47adfb06e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77deead1-dfbe-484a-b270-d7d7157a5132 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Request method failure captured: Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-aggregates/2/action HTTP/1.1 Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 40 Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmYyOl1QA1i0VOdqHkgFjf9StlnYKcraDKDUbDXvglSHnAGeVJuTtJqb3JUsVVanCpSEO4LLbjA6bfWyYCGAN6o6YW1Sx9nc8rJ6l77FkVs6wrjxlZSCsiVdfFP7HYZ7TLFad1H-qvSVczWv-y5b8EfiLLyjp8zbL3D9H0X0N3Rt6s Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:12.627695 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 514824382c1f44c3a4cb77582c04c14e Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: {"add_host": {"host": "n-h1-768852-23"}} Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:12.628828 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2', 'body': {'add_host': {'host': 'n-h1-768852-23'}}} Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:12.629650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Jul 14 14:35:12.631573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.632902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e2683da-b2a9-4388-96e6-f6657720759e tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.634402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e2683da-b2a9-4388-96e6-f6657720759e tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.634906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77deead1-dfbe-484a-b270-d7d7157a5132 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:12.635941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77deead1-dfbe-484a-b270-d7d7157a5132 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] 10.222.0.98 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.754275 Jul 14 14:35:12.637018 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 12/34] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:35:11 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 756 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:12.642935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ae748a0-f2f0-425f-b5c6-0c836e285fa1 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2015676608", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.645175 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.645175 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.668061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ae748a0-f2f0-425f-b5c6-0c836e285fa1 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.029395 Jul 14 14:35:12.669309 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 13/35] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/flavors => generated 507 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:12.682208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d96cf0ff-b332-4e71-b9d5-ebe5188f2475 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.683366 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.683366 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.712570 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d96cf0ff-b332-4e71-b9d5-ebe5188f2475 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.035307 Jul 14 14:35:12.718506 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 14/36] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:12 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:12.725140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd0670fa-a49e-4d98-8d00-34eeefbb42cd tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.726455 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.726455 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.753803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd0670fa-a49e-4d98-8d00-34eeefbb42cd tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/57a9ec60-e8fe-4213-8f55-8279a64901d5" status: 202 len: 0 microversion: 2.1 time: 0.033374 Jul 14 14:35:12.755595 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 15/37] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:12 2022] DELETE /compute/v2.1/flavors/57a9ec60-e8fe-4213-8f55-8279a64901d5 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:12.768059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8838f78f-68f0-4317-afdc-5df76807591d tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1707164436"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.771160 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.771160 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.773807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-8838f78f-68f0-4317-afdc-5df76807591d tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid a4757462-49eb-491f-9b84-b0372f846a24 for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:12.821589 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8838f78f-68f0-4317-afdc-5df76807591d tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063167 Jul 14 14:35:12.827416 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 16/38] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:12.832715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e491ca1d-8eba-419f-bb77-9d6e5a22f247 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.852780 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4e2683da-b2a9-4388-96e6-f6657720759e tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 299 microversion: 2.41 time: 0.247695 Jul 14 14:35:12.855926 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 23/39] 10.222.0.98 () {62 vars in 1231 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/os-aggregates/3/action => generated 299 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:12.878554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1086877943"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.880903 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.880903 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.893986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.895049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.897406 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e491ca1d-8eba-419f-bb77-9d6e5a22f247 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.071686 Jul 14 14:35:12.910843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 17/40] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:12.910843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-940542ca-2666-4029-88a8-10d92b172c59 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.911094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:12.911179 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.911179 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.911431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:12.926317 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1086877943 could not be found. Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-aggregates/4/action HTTP/1.1 Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 58 Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:12.932096 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: {"add_host": {"host": "tempest-nonexist_host-1086877943"}} Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:12.933345 n-d-768852-23 devstack@n-api.service[125965]: exception: Compute host tempest-nonexist_host-1086877943 could not be found. Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '4', 'body': {'add_host': {'host': 'tempest-nonexist_host-1086877943'}}} Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1086877943' is not mapped to any cell Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.933995 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6493, in add_host_to_aggregate Jul 14 14:35:12.934900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1086877943 could not be found. Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1086877943 could not be found. Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:12.936085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1086877943 could not be found. Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1086877943 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce5e8570-f7a3-47b7-b635-ed89cbeab9d7 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.076639 Jul 14 14:35:12.941721 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 24/41] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:12.948316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7870eb5e-9c93-437f-8178-70f75292ecd5 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1872315497", "id": "45f56cfd-1276-4a7c-ade6-a2f94a5d4c92", "os-flavor-access:is_public": "True"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:12.953752 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.953752 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:12.960521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-940542ca-2666-4029-88a8-10d92b172c59 tempest-AggregatesAdminTestV241-787057889 tempest-AggregatesAdminTestV241-787057889-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.41 time: 0.059528 Jul 14 14:35:12.963552 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 18/42] 10.222.0.98 () {60 vars in 1192 bytes} [Thu Jul 14 14:35:12 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:12.974129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9dd939cf-e514-48ff-a3ce-ffa928cb4c88 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:12.975578 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:12.975578 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:12.994678 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7870eb5e-9c93-437f-8178-70f75292ecd5 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.055314 Jul 14 14:35:12.999785 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 25/43] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/flavors => generated 507 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.010496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7cfb985d-3578-4c9d-9a68-62951ca11501 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2111653118", "name": "tempest-test_aggregate-2055467702"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.018808 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9dd939cf-e514-48ff-a3ce-ffa928cb4c88 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.052656 Jul 14 14:35:13.020399 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 19/44] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:12 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:13.041049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecc7e284-e895-4e3e-805e-3daf298d90e7 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.042797 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.042797 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:13.045621 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.045621 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.047728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-7cfb985d-3578-4c9d-9a68-62951ca11501 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid ec5f01a6-9008-452f-aaa3-ed55226cc717 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:13.077072 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ecc7e284-e895-4e3e-805e-3daf298d90e7 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/45f56cfd-1276-4a7c-ade6-a2f94a5d4c92" status: 202 len: 0 microversion: 2.1 time: 0.047081 Jul 14 14:35:13.081251 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 20/45] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:35:13 2022] DELETE /compute/v2.1/flavors/45f56cfd-1276-4a7c-ade6-a2f94a5d4c92 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:13.087706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97809432-9d1c-47f7-8d60-917d16b70a8f tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.101575 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7cfb985d-3578-4c9d-9a68-62951ca11501 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.094328 Jul 14 14:35:13.103087 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 26/46] 10.222.0.98 () {60 vars in 1164 bytes} [Thu Jul 14 14:35:12 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97809432-9d1c-47f7-8d60-917d16b70a8f tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 283 Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:13.107925 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:13.110059 n-d-768852-23 devstack@n-api.service[125966]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:35:13.111186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:35:13.113020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:35:13.114543 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:35:13.115750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:35:13.115750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.115750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97809432-9d1c-47f7-8d60-917d16b70a8f tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:13.115750 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97809432-9d1c-47f7-8d60-917d16b70a8f tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.031816 Jul 14 14:35:13.116195 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 21/47] 10.222.0.98 () {60 vars in 1164 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:35:13.122486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d14f151-e6b1-417e-b8a5-11cfcd38bba4 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.122753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29912cac-b2fe-4a20-a56e-d8f998c3d540 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.123691 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.123691 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:13.144134 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d14f151-e6b1-417e-b8a5-11cfcd38bba4 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates" status: 200 len: 303 microversion: 2.1 time: 0.029485 Jul 14 14:35:13.145858 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 22/48] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:35:13 2022] GET /compute/v2.1/os-aggregates => generated 303 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.148923 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29912cac-b2fe-4a20-a56e-d8f998c3d540 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044436 Jul 14 14:35:13.160363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cab432a-f9c6-4a16-b368-a36fc95711e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.162831 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 27/49] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cab432a-f9c6-4a16-b368-a36fc95711e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 27 Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:13.165039 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: {"aggregate": {"name": ""}} Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:13.167261 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'aggregate': {'name': ''}}} Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '' Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:13.168665 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:35:13.170671 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.172641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cab432a-f9c6-4a16-b368-a36fc95711e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:13.172641 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cab432a-f9c6-4a16-b368-a36fc95711e1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.012845 Jul 14 14:35:13.172641 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 23/50] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:35:13.177847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-432414b9-3a9d-40c1-a903-347fdb41440d tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-856404365", "id": 1462455291, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.180063 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.180063 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:13.189645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-725e7298-51d0-4a84-88ba-1d982dadb12b tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.192043 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.192043 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.208781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725e7298-51d0-4a84-88ba-1d982dadb12b tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:13.209511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725e7298-51d0-4a84-88ba-1d982dadb12b tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:13.211749 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-432414b9-3a9d-40c1-a903-347fdb41440d tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.041124 Jul 14 14:35:13.219426 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 24/51] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/flavors => generated 413 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.226181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e09a1a34-daea-4074-9db9-191b719a8152 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1228515216"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.228492 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.228492 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:13.231378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e09a1a34-daea-4074-9db9-191b719a8152 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '514824382c1f44c3a4cb77582c04c14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6cb6b271e40129098cf47adfb06e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e09a1a34-daea-4074-9db9-191b719a8152 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Request method failure captured: Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 60 Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmYyOl1QA1i0VOdqHkgFjf9StlnYKcraDKDUbDXvglSHnAGeVJuTtJqb3JUsVVanCpSEO4LLbjA6bfWyYCGAN6o6YW1Sx9nc8rJ6l77FkVs6wrjxlZSCsiVdfFP7HYZ7TLFad1H-qvSVczWv-y5b8EfiLLyjp8zbL3D9H0X0N3Rt6s Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:13.234373 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 514824382c1f44c3a4cb77582c04c14e Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: {"aggregate": {"name": "tempest-test_aggregate-1228515216"}} Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:13.236825 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1228515216'}}} Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:13.238289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:13.241197 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Jul 14 14:35:13.244262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.244262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e09a1a34-daea-4074-9db9-191b719a8152 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:13.244262 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e09a1a34-daea-4074-9db9-191b719a8152 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.015826 Jul 14 14:35:13.244262 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 25/52] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:13.260798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0fdac21-85f1-4ae0-aaa9-1155eb718bfb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.302469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0fdac21-85f1-4ae0-aaa9-1155eb718bfb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/1462455291" status: 200 len: 413 microversion: 2.1 time: 0.053061 Jul 14 14:35:13.304238 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 26/53] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:13 2022] GET /compute/v2.1/flavors/1462455291 => generated 413 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.314710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ff73542-953d-4dd1-b19f-301981f6fa76 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-539815511"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.320149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-0ff73542-953d-4dd1-b19f-301981f6fa76 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 786a3dfa-798b-40d2-a922-035c907cda66 for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:13.385213 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ff73542-953d-4dd1-b19f-301981f6fa76 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072417 Jul 14 14:35:13.395385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 27/54] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.549148 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-725e7298-51d0-4a84-88ba-1d982dadb12b tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 316 microversion: 2.1 time: 0.383919 Jul 14 14:35:13.550238 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 28/55] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates/5/action => generated 316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.560323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a28b93b8-74b7-4ca8-9083-5e1b7c02c073 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-539815511"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.563045 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.563045 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.564642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-a28b93b8-74b7-4ca8-9083-5e1b7c02c073 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 445b04df-a094-49d9-aa50-817fb3cdf445 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:13.594567 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a28b93b8-74b7-4ca8-9083-5e1b7c02c073 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-539815511 already exists. Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a28b93b8-74b7-4ca8-9083-5e1b7c02c073 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 59 Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:13.597897 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: {"aggregate": {"name": "tempest-test_aggregate-539815511"}} Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:13.600165 n-d-768852-23 devstack@n-api.service[125965]: exception: Aggregate tempest-test_aggregate-539815511 already exists. Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-539815511'}}} Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6330, in create_aggregate Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate.create() Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Jul 14 14:35:13.601393 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-539815511 already exists. Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:13.605079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-539815511 already exists. Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-539815511 already exists. Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a28b93b8-74b7-4ca8-9083-5e1b7c02c073 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-539815511 already exists. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:13.609082 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a28b93b8-74b7-4ca8-9083-5e1b7c02c073 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.048302 Jul 14 14:35:13.613570 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 29/56] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:13.635635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc09d69f-9562-45a8-82ff-6d588b6aedc6 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.639529 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.639529 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.698980 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc09d69f-9562-45a8-82ff-6d588b6aedc6 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.084386 Jul 14 14:35:13.700456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 30/57] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:13 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:13.722100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22da5d0c-a027-41af-ad44-dc7adb6a15c9 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-349880975"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:13.725457 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.725457 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.727900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-22da5d0c-a027-41af-ad44-dc7adb6a15c9 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 02171bc1-ac0e-4719-a3df-87153ec61e41 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:13.774605 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22da5d0c-a027-41af-ad44-dc7adb6a15c9 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.061031 Jul 14 14:35:13.784095 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 31/58] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:13 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:13.795939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac24ef80-50ab-4be2-b6ba-defe2abb6bcf tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.798842 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.798842 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.800847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac24ef80-50ab-4be2-b6ba-defe2abb6bcf tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '514824382c1f44c3a4cb77582c04c14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6cb6b271e40129098cf47adfb06e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac24ef80-50ab-4be2-b6ba-defe2abb6bcf tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Request method failure captured: Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmYyOl1QA1i0VOdqHkgFjf9StlnYKcraDKDUbDXvglSHnAGeVJuTtJqb3JUsVVanCpSEO4LLbjA6bfWyYCGAN6o6YW1Sx9nc8rJ6l77FkVs6wrjxlZSCsiVdfFP7HYZ7TLFad1H-qvSVczWv-y5b8EfiLLyjp8zbL3D9H0X0N3Rt6s Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:13.804610 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 514824382c1f44c3a4cb77582c04c14e Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 14 14:35:13.807470 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '7'} Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:13.808646 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.810518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac24ef80-50ab-4be2-b6ba-defe2abb6bcf tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:13.813011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac24ef80-50ab-4be2-b6ba-defe2abb6bcf tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/7" status: 403 len: 116 microversion: 2.1 time: 0.021657 Jul 14 14:35:13.813011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 32/59] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 116 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:13.832967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7ac470f-3232-4800-9359-c21e3c26ba28 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.935794 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7ac470f-3232-4800-9359-c21e3c26ba28 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.117735 Jul 14 14:35:13.937016 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 33/60] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:13 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:13.952803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce042c2a-c6f6-4007-9afa-5426776e0a7b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:13.955101 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:13.955101 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:13.974941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ce042c2a-c6f6-4007-9afa-5426776e0a7b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce042c2a-c6f6-4007-9afa-5426776e0a7b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:13.979155 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: exception: Aggregate -1 could not be found. Jul 14 14:35:13.981594 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '-1'} Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:35:13.982856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.985049 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:13.987517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:13.987517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:13.987517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:13.987517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:13.987517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 14 14:35:13.987517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:13.990403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce042c2a-c6f6-4007-9afa-5426776e0a7b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:13.993081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce042c2a-c6f6-4007-9afa-5426776e0a7b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.047159 Jul 14 14:35:13.994046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 34/61] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:35:13 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:14.013277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2860ad83-67d6-4b63-972a-f0fcc6b30779 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1588407827"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:14.016522 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.016522 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.018316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-2860ad83-67d6-4b63-972a-f0fcc6b30779 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid d188e315-6ce3-48c2-8cdf-d0f6a652e361 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:35:14.052379 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2860ad83-67d6-4b63-972a-f0fcc6b30779 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.049175 Jul 14 14:35:14.053367 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 35/62] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:14.070954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d0e2f64-253f-4730-ae79-d3599bd7c098 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.072754 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.072754 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.074709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d0e2f64-253f-4730-ae79-d3599bd7c098 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '514824382c1f44c3a4cb77582c04c14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6cb6b271e40129098cf47adfb06e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d0e2f64-253f-4730-ae79-d3599bd7c098 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Request method failure captured: Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-aggregates/8 HTTP/1.1 Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmYyOl1QA1i0VOdqHkgFjf9StlnYKcraDKDUbDXvglSHnAGeVJuTtJqb3JUsVVanCpSEO4LLbjA6bfWyYCGAN6o6YW1Sx9nc8rJ6l77FkVs6wrjxlZSCsiVdfFP7HYZ7TLFad1H-qvSVczWv-y5b8EfiLLyjp8zbL3D9H0X0N3Rt6s Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:14.078101 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 514824382c1f44c3a4cb77582c04c14e Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 14 14:35:14.079298 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '8'} Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:14.080022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.081016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d0e2f64-253f-4730-ae79-d3599bd7c098 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:14.082677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d0e2f64-253f-4730-ae79-d3599bd7c098 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] 10.222.0.98 "GET /compute/v2.1/os-aggregates/8" status: 403 len: 114 microversion: 2.1 time: 0.016909 Jul 14 14:35:14.088385 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 36/63] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/os-aggregates/8 => generated 114 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:35:14.097073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-03c089fa-0adb-4b07-b24b-42152e5380d1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.099258 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.099258 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.147480 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-03c089fa-0adb-4b07-b24b-42152e5380d1 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.057659 Jul 14 14:35:14.148660 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 37/64] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:14 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:14.167291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bbc9bd12-094e-4929-b123-0973de7f0e67 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.169042 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.169042 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.182497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-bbc9bd12-094e-4929-b123-0973de7f0e67 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bbc9bd12-094e-4929-b123-0973de7f0e67 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:14.188274 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: exception: Aggregate -1 could not be found. Jul 14 14:35:14.190771 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '-1'} Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.192180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Jul 14 14:35:14.194419 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.197019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bbc9bd12-094e-4929-b123-0973de7f0e67 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:14.197019 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bbc9bd12-094e-4929-b123-0973de7f0e67 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.032486 Jul 14 14:35:14.197019 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 38/65] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:14.213921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cb49de9-03c5-409b-9769-1439aea7f42f tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.216625 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.216625 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.219916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4cb49de9-03c5-409b-9769-1439aea7f42f tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '514824382c1f44c3a4cb77582c04c14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6cb6b271e40129098cf47adfb06e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cb49de9-03c5-409b-9769-1439aea7f42f tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Request method failure captured: Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmYyOl1QA1i0VOdqHkgFjf9StlnYKcraDKDUbDXvglSHnAGeVJuTtJqb3JUsVVanCpSEO4LLbjA6bfWyYCGAN6o6YW1Sx9nc8rJ6l77FkVs6wrjxlZSCsiVdfFP7HYZ7TLFad1H-qvSVczWv-y5b8EfiLLyjp8zbL3D9H0X0N3Rt6s Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:14.224298 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 514824382c1f44c3a4cb77582c04c14e Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 14 14:35:14.225398 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:14.226228 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.227401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cb49de9-03c5-409b-9769-1439aea7f42f tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:14.228266 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4cb49de9-03c5-409b-9769-1439aea7f42f tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] 10.222.0.98 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.022909 Jul 14 14:35:14.234303 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 39/66] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:14.247113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6fe0c53d-86de-4edc-b3df-e96ec0a6d0d4 tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.271849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=8,nova_api:DELETE=18 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:14.290916 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6fe0c53d-86de-4edc-b3df-e96ec0a6d0d4 tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.888947 Jul 14 14:35:14.291915 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 28/67] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:13 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:14.309673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9cc9872-01ca-4212-b4f4-3911bcd5c6d7 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.310512 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.310512 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.335332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9cc9872-01ca-4212-b4f4-3911bcd5c6d7 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1462455291" status: 202 len: 0 microversion: 2.1 time: 0.032471 Jul 14 14:35:14.340966 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 40/68] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:14 2022] DELETE /compute/v2.1/flavors/1462455291 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:14.349215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3de555b8-7dc2-416a-9c0c-3fdf14295b9d tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.390887 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3de555b8-7dc2-416a-9c0c-3fdf14295b9d tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.047785 Jul 14 14:35:14.392751 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 41/69] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:14.420702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ffc1711-e2f4-45da-b3c8-69f3f789e064 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-139216987", "id": 558767597, "os-flavor-access:is_public": "False"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:14.422290 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:14.422290 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:14.457218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ffc1711-e2f4-45da-b3c8-69f3f789e064 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.039798 Jul 14 14:35:14.458598 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 42/70] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/flavors => generated 426 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:14.476101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-731b51c1-43e1-4c27-a053-bc1035233e9f tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "558767597"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:14.504711 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-731b51c1-43e1-4c27-a053-bc1035233e9f tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] HTTP exception thrown: Flavor 558767597 could not be found. Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-731b51c1-43e1-4c27-a053-bc1035233e9f tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] Request method failure captured: Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 106 Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmZftFx99sDB0_4lOg9q_X_c8cujvd5uMPQEBj3hOorXKDrprfVmrlIdWjaVzDHcO0IimRzLRAXDqAkznyCAZGCA2XjDvoQDurs9YCT3pELU1ZwctGk61nc3XlWvX-rnZ_YFvqyiUkFYpv3JQVlHFUjqdzhvz4vI7rYjpVr75PRTEQ Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c7a730920325430ca28aa04a9434aea6 Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsAdminTestJSON-660697269 Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:14.510545 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c7a730920325430ca28aa04a9434aea6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c7a730920325430ca28aa04a9434aea6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c7a730920325430ca28aa04a9434aea6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c7a730920325430ca28aa04a9434aea6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsAdminTestJSON-660697269 Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c7a730920325430ca28aa04a9434aea6 Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-660697269 Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsAdminTestJSON-660697269-project Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 63af4fced46f4febbf930e90380338d2 Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsAdminTestJSON-660697269-project Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "test", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "558767597"}} Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:14.512770 n-d-768852-23 devstack@n-api.service[125965]: exception: Flavor 558767597 could not be found. Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '558767597'}}} Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 780, in create Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 558767597 could not be found. Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.514036 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 558767597 could not be found. Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:14.516103 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 558767597 could not be found. Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-731b51c1-43e1-4c27-a053-bc1035233e9f tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] Returning 400 to user: Flavor 558767597 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-731b51c1-43e1-4c27-a053-bc1035233e9f tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.043231 Jul 14 14:35:14.518088 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 43/71] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/servers => generated 80 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:35:14.528209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7de7dc91-56c2-4e87-be87-3879f9c559ed tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.572474 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7de7dc91-56c2-4e87-be87-3879f9c559ed tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/558767597" status: 202 len: 0 microversion: 2.1 time: 0.049886 Jul 14 14:35:14.574363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 44/72] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:14 2022] DELETE /compute/v2.1/flavors/558767597 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:14.586870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2f0673d-25ae-409b-b04f-40550c4bc8d3 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.612092 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2f0673d-25ae-409b-b04f-40550c4bc8d3 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031334 Jul 14 14:35:14.613312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 45/73] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:14.637237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c26dbe90-9f2a-42f9-99a4-dd3156df9d09 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1836920011", "id": 540572439, "os-flavor-access:is_public": "False"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:14.662419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c26dbe90-9f2a-42f9-99a4-dd3156df9d09 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.033841 Jul 14 14:35:14.663034 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 46/74] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/flavors => generated 412 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:14.675079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f6fe368-3ebf-4ea1-ba5a-a141c8bbde73 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2124322595", "id": 1145985462, "os-flavor-access:is_public": "True"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:14.710471 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f6fe368-3ebf-4ea1-ba5a-a141c8bbde73 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.039602 Jul 14 14:35:14.712147 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 47/75] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/flavors => generated 414 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:14.729112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cf273d7-25cd-44da-9e63-1d1fe7c5faeb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.759775 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cf273d7-25cd-44da-9e63-1d1fe7c5faeb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.037477 Jul 14 14:35:14.760916 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 48/76] 10.222.0.98 () {58 vars in 1168 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:14.773998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4018b3c-003a-4720-8f45-9ef1b12df8bc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.777596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=13,nova_api:INSERT=9 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:14.786138 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4018b3c-003a-4720-8f45-9ef1b12df8bc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.017454 Jul 14 14:35:14.792929 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 49/77] 10.222.0.98 () {58 vars in 1176 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:14.798137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5cabb898-1e46-4ef4-bf02-81b58f9b9027 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.810278 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5cabb898-1e46-4ef4-bf02-81b58f9b9027 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.016124 Jul 14 14:35:14.811728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 50/78] 10.222.0.98 () {58 vars in 1170 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:14.828512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e38a52b9-a951-4519-a724-a97bd1ff1437 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.839993 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e38a52b9-a951-4519-a724-a97bd1ff1437 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.015589 Jul 14 14:35:14.840801 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 51/79] 10.222.0.98 () {58 vars in 1168 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:14.858579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ae78464-7b5f-4cd2-834c-f8e2dcfccd8d tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.889796 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ae78464-7b5f-4cd2-834c-f8e2dcfccd8d tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5395 microversion: 2.1 time: 0.036358 Jul 14 14:35:14.891138 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 52/80] 10.222.0.98 () {58 vars in 1168 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5395 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:14.917999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5c31781f-5395-4b4f-af7c-84bfd38fe9a6 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:14.950182 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5c31781f-5395-4b4f-af7c-84bfd38fe9a6 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5395 microversion: 2.1 time: 0.038259 Jul 14 14:35:14.951319 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 53/81] 10.222.0.98 () {58 vars in 1174 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5395 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:14.979939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a225f063-6128-4120-b459-2b92aac7b1cb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.014893 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a225f063-6128-4120-b459-2b92aac7b1cb tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5395 microversion: 2.1 time: 0.044052 Jul 14 14:35:15.023827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 54/82] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 14:35:14 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5395 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:15.039004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56c580af-6e2d-4d8f-be90-465520c24e85 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.079725 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56c580af-6e2d-4d8f-be90-465520c24e85 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5395 microversion: 2.1 time: 0.046777 Jul 14 14:35:15.083445 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 55/83] 10.222.0.98 () {58 vars in 1168 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5395 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:15.115912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91f5cb39-7a73-4154-9bd7-c7705790d111 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.149166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91f5cb39-7a73-4154-9bd7-c7705790d111 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1145985462" status: 202 len: 0 microversion: 2.1 time: 0.045814 Jul 14 14:35:15.150795 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 56/84] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:15 2022] DELETE /compute/v2.1/flavors/1145985462 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:15.168633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56c72860-486e-48b7-8295-f82bf994735e tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.224307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56c72860-486e-48b7-8295-f82bf994735e tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.060213 Jul 14 14:35:15.226377 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 57/85] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:15.260423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-220a81a9-d02c-4ec6-af32-a82e37486dbc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.295721 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-220a81a9-d02c-4ec6-af32-a82e37486dbc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/540572439" status: 202 len: 0 microversion: 2.1 time: 0.043899 Jul 14 14:35:15.297049 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 58/86] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:15 2022] DELETE /compute/v2.1/flavors/540572439 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:15.310860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5fd73d5-94fe-4145-b1fc-a7c7f56e1b3a tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.317131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-496512029", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "availability_zone": "tempest-test_az-2111653118"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:15.348547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5fd73d5-94fe-4145-b1fc-a7c7f56e1b3a tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.043780 Jul 14 14:35:15.349841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 59/87] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:15.378807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1ac400c-ca91-4d1f-b9fb-5bd685462add tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1085255877", "id": 2095486607, "os-flavor-access:is_public": "False"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:15.415377 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1ac400c-ca91-4d1f-b9fb-5bd685462add tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.042547 Jul 14 14:35:15.420096 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 60/88] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:15 2022] POST /compute/v2.1/flavors => generated 415 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:15.422825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.423668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.429926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:15.432446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:15.441057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-08c85802-7ec7-4f72-acd6-61693ea7b557 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.497752 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-08c85802-7ec7-4f72-acd6-61693ea7b557 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.065451 Jul 14 14:35:15.511595 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 61/89] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:15.526580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f23689a5-4285-4876-ad4e-ed8c7dfaa8d4 tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.663444 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f23689a5-4285-4876-ad4e-ed8c7dfaa8d4 tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.144830 Jul 14 14:35:15.667614 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 62/90] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:15.690376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe445698-7608-40cc-9fe5-98b1967ab3cc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.737222 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe445698-7608-40cc-9fe5-98b1967ab3cc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/2095486607" status: 202 len: 0 microversion: 2.1 time: 0.053774 Jul 14 14:35:15.738019 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 63/91] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:15 2022] DELETE /compute/v2.1/flavors/2095486607 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:15.749901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94c6fe39-3905-4856-8fb4-9186e50136cc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.804002 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94c6fe39-3905-4856-8fb4-9186e50136cc tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.059213 Jul 14 14:35:15.815698 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 64/92] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:15.843094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe699ff7-d369-46bb-b01e-6066921c1a66 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-181220943", "id": 553696360, "os-flavor-access:is_public": "True"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:15.895810 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe699ff7-d369-46bb-b01e-6066921c1a66 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.069237 Jul 14 14:35:15.897193 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 65/93] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:15 2022] POST /compute/v2.1/flavors => generated 410 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:15.918745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e78d0109-e793-4955-80f2-6cd591166283 tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:15.951578 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e78d0109-e793-4955-80f2-6cd591166283 tempest-FlavorsAdminTestJSON-660697269 tempest-FlavorsAdminTestJSON-660697269-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5391 microversion: 2.1 time: 0.041758 Jul 14 14:35:15.953510 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 66/94] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:15 2022] GET /compute/v2.1/flavors/detail => generated 5391 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:15.976278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-72ddf1ea-6a80-4eae-9cc4-c45a48b3dae5 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:16.011880 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-72ddf1ea-6a80-4eae-9cc4-c45a48b3dae5 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/553696360" status: 202 len: 0 microversion: 2.1 time: 0.039091 Jul 14 14:35:16.014436 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 67/95] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:15 2022] DELETE /compute/v2.1/flavors/553696360 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:35:16.038654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85b9b9c1-bc2f-421e-95d1-22338ab198c3 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:16.111381 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85b9b9c1-bc2f-421e-95d1-22338ab198c3 tempest-FlavorsAdminTestJSON-157391116 tempest-FlavorsAdminTestJSON-157391116-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089070 Jul 14 14:35:16.122851 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 68/96] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:17.345957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50bf674b-de0b-4849-84b9-aad13be51efc tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-20485671", "id": 1206623186, "os-flavor-access:is_public": "False"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:17.380372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:17.404680 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50bf674b-de0b-4849-84b9-aad13be51efc tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.928981 Jul 14 14:35:17.412252 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 69/97] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:16 2022] POST /compute/v2.1/flavors => generated 429 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:17.421727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-770f4550-8108-4ba9-a404-7de3c59e5c7b tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "5bdc824cd62144b291d93b7d0046971c"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:17.433093 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:17.433093 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:17.880937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:17.882196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:17.883069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:17.885027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:17.885870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:17.912123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.914017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.916089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:17.917599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:17.980732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Getting quotas for project 4e1e3e2e4d114865804976a40c6cac55. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:17.992391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Getting quotas for user a876582ed4d94e9da876592597aa1c06 and project 4e1e3e2e4d114865804976a40c6cac55. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:18.015439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:18.020798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:18.122735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d4aa248-9e17-4541-9260-84de5f9d24e6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.790771 Jul 14 14:35:18.124192 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 29/98] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:35:18.150812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08fd61b8-8c40-492f-837a-c0f5db0cec9a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:18.152475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-08fd61b8-8c40-492f-837a-c0f5db0cec9a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:18.371621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-08fd61b8-8c40-492f-837a-c0f5db0cec9a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:18.395320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08fd61b8-8c40-492f-837a-c0f5db0cec9a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1242 microversion: 2.1 time: 0.259938 Jul 14 14:35:18.398240 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 30/99] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:18 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1242 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:18.651969 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-770f4550-8108-4ba9-a404-7de3c59e5c7b tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1206623186/action" status: 200 len: 97 microversion: 2.1 time: 1.237356 Jul 14 14:35:18.657251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 70/100] 10.222.0.98 () {60 vars in 1199 bytes} [Thu Jul 14 14:35:17 2022] POST /compute/v2.1/flavors/1206623186/action => generated 97 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:19.401011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3184a1ae-38bb-4daa-91c4-0562ee657cf0 tempest-FlavorsAccessTestJSON-827576556 tempest-FlavorsAccessTestJSON-827576556-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.423422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-48a562a3-ad9f-47a5-89af-fb95ee64f765 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:19.424615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-48a562a3-ad9f-47a5-89af-fb95ee64f765 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:19.431422 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3184a1ae-38bb-4daa-91c4-0562ee657cf0 tempest-FlavorsAccessTestJSON-827576556 tempest-FlavorsAccessTestJSON-827576556-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.762705 Jul 14 14:35:19.448869 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 31/101] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:18 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:19.455013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e630dd6f-0b18-42e2-9270-bd9f14a2e88f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "5bdc824cd62144b291d93b7d0046971c"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:19.456769 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:19.456769 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:20.501654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e630dd6f-0b18-42e2-9270-bd9f14a2e88f tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1206623186/action" status: 200 len: 21 microversion: 2.1 time: 1.050689 Jul 14 14:35:20.503127 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 32/102] 10.222.0.98 () {60 vars in 1199 bytes} [Thu Jul 14 14:35:19 2022] POST /compute/v2.1/flavors/1206623186/action => generated 21 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:20.528981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24ead4be-3dcd-47bf-892c-c50f0f910ab7 tempest-FlavorsAccessTestJSON-827576556 tempest-FlavorsAccessTestJSON-827576556-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.571517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24ead4be-3dcd-47bf-892c-c50f0f910ab7 tempest-FlavorsAccessTestJSON-827576556 tempest-FlavorsAccessTestJSON-827576556-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052794 Jul 14 14:35:20.571848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 33/103] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:20.597760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65c72ff8-fa44-4c5b-9853-6028c3c4c65e tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.599737 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:20.599737 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:20.631126 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65c72ff8-fa44-4c5b-9853-6028c3c4c65e tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1206623186" status: 202 len: 0 microversion: 2.1 time: 0.040122 Jul 14 14:35:20.638399 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 34/104] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:20 2022] DELETE /compute/v2.1/flavors/1206623186 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:20.649783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22eea919-9ace-4eb6-bbce-20b53e055e55 tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.693239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22eea919-9ace-4eb6-bbce-20b53e055e55 tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.052987 Jul 14 14:35:20.699619 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 35/105] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:20.718753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea8d7ccd-8721-4590-9d17-6b7fd40ba1b8 tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1029603080", "id": 187697739, "os-flavor-access:is_public": "False"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:20.721722 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:20.721722 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:20.749454 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ea8d7ccd-8721-4590-9d17-6b7fd40ba1b8 tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.035617 Jul 14 14:35:20.750495 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 36/106] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:20 2022] POST /compute/v2.1/flavors => generated 428 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:20.764322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b47460d1-9eda-4881-949f-4dc3cc919c4e tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.765762 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:20.765762 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:20.792746 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b47460d1-9eda-4881-949f-4dc3cc919c4e tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/187697739/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.034377 Jul 14 14:35:20.793921 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 37/107] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/flavors/187697739/os-flavor-access => generated 21 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:20.809994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-23627849-56d7-486d-9b86-fda6db952b10 tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.839503 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-23627849-56d7-486d-9b86-fda6db952b10 tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/187697739" status: 202 len: 0 microversion: 2.1 time: 0.036329 Jul 14 14:35:20.845714 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 38/108] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:20 2022] DELETE /compute/v2.1/flavors/187697739 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:20.855652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0df894e0-b82e-43c2-902b-0f1d59a672dc tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:20.892082 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0df894e0-b82e-43c2-902b-0f1d59a672dc tempest-FlavorsAccessTestJSON-362245311 tempest-FlavorsAccessTestJSON-362245311-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.044045 Jul 14 14:35:20.895421 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 39/109] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:21.371774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48a562a3-ad9f-47a5-89af-fb95ee64f765 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:21.387689 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-48a562a3-ad9f-47a5-89af-fb95ee64f765 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1242 microversion: 2.1 time: 1.971801 Jul 14 14:35:21.403358 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 71/110] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:19 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1242 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:22.422111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:22.424097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:22.437443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:22.438781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:22.440665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:22.442637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:22.700440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:22.732683 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8b2aa1a6-48e3-4f06-9b3f-23b06dc862d6 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1296 microversion: 2.1 time: 0.321508 Jul 14 14:35:22.748102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 40/111] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:22 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1296 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:23.773235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:23.785608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:23.799047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.810948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=30 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:23.854107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:23.856875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:23.861383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:23.864497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:25.337879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:25.371751 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd5e241c-3e02-4ba8-80c4-3bc65cd8aabd tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.615098 Jul 14 14:35:25.386593 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 72/112] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:23 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:26.393896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:26.395444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:26.406380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:26.406380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:26.412519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:26.418714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:27.809186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:27.849021 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ac3a6c2b-0b57-48be-8a22-05fbd3c6cb5f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.458694 Jul 14 14:35:27.850186 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 41/113] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:26 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 1462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:27.949633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:28.293183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21a44070-cfb2-4c24-89d8-e5ea27b06ae6 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-883722093", "id": 1724030588, "os-flavor-access:is_public": "False"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:28.295556 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:28.295556 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:28.389092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:28.404909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21a44070-cfb2-4c24-89d8-e5ea27b06ae6 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 1.294673 Jul 14 14:35:28.406471 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 73/114] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:27 2022] POST /compute/v2.1/flavors => generated 438 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:28.454048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67b1b8d8-3981-41cb-8d40-5b02735779f7 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:28.456569 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:28.456569 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:28.870501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1875751703", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:29.071788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:35:29.426581 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67b1b8d8-3981-41cb-8d40-5b02735779f7 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1724030588/action" status: 200 len: 97 microversion: 2.1 time: 1.007644 Jul 14 14:35:29.430525 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 74/115] 10.222.0.98 () {60 vars in 1199 bytes} [Thu Jul 14 14:35:28 2022] POST /compute/v2.1/flavors/1724030588/action => generated 97 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:35:30.445723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a7c526b-c779-4dc5-888b-3e99f56f51fa tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Calling method '.version_select at 0x7fdbf3b52160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:30.451613 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:30.451613 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:30.458179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7c526b-c779-4dc5-888b-3e99f56f51fa tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.458991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7c526b-c779-4dc5-888b-3e99f56f51fa tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.466922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7c526b-c779-4dc5-888b-3e99f56f51fa tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.470774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7c526b-c779-4dc5-888b-3e99f56f51fa tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.508663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:35:30.510338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:35:30.511543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:35:30.512527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:35:30.513247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:35:30.553635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.554477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.556085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.557817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.605592 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5a7c526b-c779-4dc5-888b-3e99f56f51fa tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 1.173635 Jul 14 14:35:30.614395 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 75/116] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:35:29 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:30.625132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:30.629083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:30.654312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.661374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.664124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:30.672795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:30.684359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:35:30.713816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:35:30.767565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:35:30.779781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:35:30.908056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17bdd958-d1f0-4657-966f-903017d88dae tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.047505 Jul 14 14:35:30.926292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 42/117] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 3075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:35:30.946490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-656d5ec2-b7d0-462f-ba17-eb8cc84d05e3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:30.952075 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:30.952075 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:31.382833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:31.640827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:31.661385 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-656d5ec2-b7d0-462f-ba17-eb8cc84d05e3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] HTTP exception thrown: Flavor access already exists for flavor 29 and project cb7498cccd6f46fd8a445d9f7455e31a combination. Jul 14 14:35:31.671569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6aa8f02-7ef2-43ef-beca-6376879ea0c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.052924 Jul 14 14:35:31.675544 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 76/118] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:30 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-656d5ec2-b7d0-462f-ba17-eb8cc84d05e3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Request method failure captured: Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/flavors/1724030588/action HTTP/1.1 Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 67 Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmqg98lM4xAjRXbYj_RS3LCpS8EjxOFmWyOb0vleD7tNtcGuCSRZ1vgkPERDi_A55aSST5DPYQfzU4yWLE7KAb85BKLc3HJ3ThdK5Y5XvBjKMueQd2-TIl9oFjJQ1OLLThslg9-qQw_4hKrEBSvqZ-2eeXQuLwfON6Dl7qpzZdTeBI Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8b2be727a8f34a1d86c8c4a59cc48d90 Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:31.741625 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8b2be727a8f34a1d86c8c4a59cc48d90 Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 439726d211b24daba1ce6d4aa2473493 Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: {"addTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} Jul 14 14:35:31.745115 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: exception: Flavor access already exists for flavor 29 and project cb7498cccd6f46fd8a445d9f7455e31a combination. Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '1724030588', 'body': {'addTenantAccess': {'tenant': 'cb7498cccd6f46fd8a445d9f7455e31a'}}} Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:35:31.746201 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '29-cb7498cccd6f46fd8a445d9f7455e31a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi project.save(context.session) Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi session.flush() Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:35:31.747858 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:35:31.749405 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:35:31.750977 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '29-cb7498cccd6f46fd8a445d9f7455e31a' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 14, 14, 35, 31, 631327), 'updated_at': None, 'flavor_id': 29, 'project_id': 'cb7498cccd6f46fd8a445d9f7455e31a'}] Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:31.761319 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 29 and project cb7498cccd6f46fd8a445d9f7455e31a combination. Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:31.766459 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 29 and project cb7498cccd6f46fd8a445d9f7455e31a combination. Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:31.772205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:31.777416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 29 and project cb7498cccd6f46fd8a445d9f7455e31a combination. Jul 14 14:35:31.777416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:31.777416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-656d5ec2-b7d0-462f-ba17-eb8cc84d05e3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Returning 409 to user: Flavor access already exists for flavor 29 and project cb7498cccd6f46fd8a445d9f7455e31a combination. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:31.777416 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-656d5ec2-b7d0-462f-ba17-eb8cc84d05e3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1724030588/action" status: 409 len: 152 microversion: 2.1 time: 0.819151 Jul 14 14:35:31.777416 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 43/119] 10.222.0.98 () {60 vars in 1199 bytes} [Thu Jul 14 14:35:30 2022] POST /compute/v2.1/flavors/1724030588/action => generated 152 bytes in 822 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:31.777416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-10b48fd4-237f-4314-94c3-8bc9ced58a47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:31.778796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-10b48fd4-237f-4314-94c3-8bc9ced58a47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:32.180315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-10b48fd4-237f-4314-94c3-8bc9ced58a47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:32.220529 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-10b48fd4-237f-4314-94c3-8bc9ced58a47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1217 microversion: 2.1 time: 0.469303 Jul 14 14:35:32.221629 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 44/120] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:31 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1217 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:32.308773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4698b670-0c05-48cb-8eae-8bab88f54108 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Calling method '.version_select at 0x7fdbf3b67160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:32.310092 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:32.310092 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:32.311329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4698b670-0c05-48cb-8eae-8bab88f54108 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '6f03ab9c2050476eadef3d20ef3df476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c59ae01bd47c78548b1a08114c9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4698b670-0c05-48cb-8eae-8bab88f54108 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Request method failure captured: Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmrvaNvuo65kuIUkbrtz0HZJETgRgWiGlkXZfy4VpLdvL91OQSAZrT2aSjB_c0cReQhnDo7PBaTdf01fYQjlvqvxFLrrN__utq7d8TdiMKZyMEWlbiNQtrHp7e_8JyF4_NEcVkn9gGH5ECAlL54ENiIApd50vwipCPGHfTeUNqzjhk Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:32.321156 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6f03ab9c2050476eadef3d20ef3df476 Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:35:32.322508 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:32.323250 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Jul 14 14:35:32.324445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:32.325413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4698b670-0c05-48cb-8eae-8bab88f54108 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:32.325413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4698b670-0c05-48cb-8eae-8bab88f54108 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] 10.222.0.98 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.642699 Jul 14 14:35:32.352924 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 77/121] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:35:31 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 676 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:32.710141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3995e201-307c-4df7-90c6-478da01767db tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-130967970", "ram": 512, "vcpus": 1, "disk": 10, "id": 1914331373, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:32.714600 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:32.714600 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:32.820523 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3995e201-307c-4df7-90c6-478da01767db tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.581009 Jul 14 14:35:32.825024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 45/122] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:32 2022] POST /compute/v2.1/flavors => generated 415 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:32.844774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3320fcec-e09d-43c0-89d7-b559c5a00722 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:32.851027 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:32.851027 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:32.856595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c20907ca-b7e8-44bf-b31d-d986e335fdab req-cb75214b-b876-4274-bd34-547192df9009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38dd8dab-42b8-49a8-a534-17f8f6412910", "tag": "963a2ea5-9ce6-41e2-8268-421b027fb8c4"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:32.887540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c20907ca-b7e8-44bf-b31d-d986e335fdab req-cb75214b-b876-4274-bd34-547192df9009 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.892216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c20907ca-b7e8-44bf-b31d-d986e335fdab req-cb75214b-b876-4274-bd34-547192df9009 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.955567 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c20907ca-b7e8-44bf-b31d-d986e335fdab req-cb75214b-b876-4274-bd34-547192df9009 service nova] Creating event network-changed:963a2ea5-9ce6-41e2-8268-421b027fb8c4 for instance 38dd8dab-42b8-49a8-a534-17f8f6412910 on n-h1-768852-23 Jul 14 14:35:32.960463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c20907ca-b7e8-44bf-b31d-d986e335fdab req-cb75214b-b876-4274-bd34-547192df9009 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:35:32.967162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.969690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:32.971316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:32.972043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.015695 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.compute.rpcapi [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 14:35:33.035052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] Releasing lock "compute-rpcapi-router" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:35:33.083215 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f8dd4405-9b63-4598-9594-0ee97463277c None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.728156 Jul 14 14:35:33.085964 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 78/123] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:33.125566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b02bc8a-5150-444f-a5ec-cee825cbd149 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Calling method '.version_select at 0x7fdbf3b1ec10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.129251 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:33.129251 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:33.135394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b02bc8a-5150-444f-a5ec-cee825cbd149 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '6f03ab9c2050476eadef3d20ef3df476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c59ae01bd47c78548b1a08114c9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b02bc8a-5150-444f-a5ec-cee825cbd149 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Request method failure captured: Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hosts/n-d-768852-23/reboot HTTP/1.1 Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmrvaNvuo65kuIUkbrtz0HZJETgRgWiGlkXZfy4VpLdvL91OQSAZrT2aSjB_c0cReQhnDo7PBaTdf01fYQjlvqvxFLrrN__utq7d8TdiMKZyMEWlbiNQtrHp7e_8JyF4_NEcVkn9gGH5ECAlL54ENiIApd50vwipCPGHfTeUNqzjhk Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:33.146849 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6f03ab9c2050476eadef3d20ef3df476 Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'n-d-768852-23'} Jul 14 14:35:33.149673 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:33.151059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Jul 14 14:35:33.152835 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.158054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b02bc8a-5150-444f-a5ec-cee825cbd149 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:33.161509 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b02bc8a-5150-444f-a5ec-cee825cbd149 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] 10.222.0.98 "GET /compute/v2.1/os-hosts/n-d-768852-23/reboot" status: 403 len: 111 microversion: 2.1 time: 0.072466 Jul 14 14:35:33.168198 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 79/124] 10.222.0.98 () {58 vars in 1190 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/os-hosts/n-d-768852-23/reboot => generated 111 bytes in 81 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:33.187059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.199501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:33.248873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.249599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.250423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.250870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.412805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3320fcec-e09d-43c0-89d7-b559c5a00722 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1724030588/action" status: 200 len: 21 microversion: 2.1 time: 0.583533 Jul 14 14:35:33.415344 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 46/125] 10.222.0.98 () {60 vars in 1199 bytes} [Thu Jul 14 14:35:32 2022] POST /compute/v2.1/flavors/1724030588/action => generated 21 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:33.441661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5682cf01-ecf1-4bcc-be89-79c401c8c4d1 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:33.452180 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:33.452180 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:33.494133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=9,nova_api:DELETE=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:33.620402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5682cf01-ecf1-4bcc-be89-79c401c8c4d1 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.202698 Jul 14 14:35:33.626454 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 47/126] 10.222.0.98 () {60 vars in 1223 bytes} [Thu Jul 14 14:35:33 2022] POST /compute/v2.1/flavors/1914331373/os-extra_specs => generated 66 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:33.648466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ee21d68-4fe1-4622-b785-7d06d632cc8b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Calling method '.version_select at 0x7fdbf3bdbe50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.658419 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:33.658419 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:33.713839 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-9ee21d68-4fe1-4622-b785-7d06d632cc8b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ee21d68-4fe1-4622-b785-7d06d632cc8b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:33.743682 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:35:33.745920 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:33.747243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 14 14:35:33.751608 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:33.754769 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:33.766958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ee21d68-4fe1-4622-b785-7d06d632cc8b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:33.773180 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ee21d68-4fe1-4622-b785-7d06d632cc8b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.144438 Jul 14 14:35:33.776624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 48/127] 10.222.0.98 () {58 vars in 1211 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:33.808789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.817341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:33.826591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:33.836359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.845746 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-615613e8-dfd3-4f73-918b-89dd00ba96b5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.673867 Jul 14 14:35:33.850000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.853381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:33.857846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 80/128] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:33.859944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:33.876238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84742d05-df07-4ecd-8775-9742acc0cc5c tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:33.877383 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:33.877383 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:33.929978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=12,nova_api:INSERT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:33.937606 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84742d05-df07-4ecd-8775-9742acc0cc5c tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1724030588" status: 202 len: 0 microversion: 2.1 time: 0.071307 Jul 14 14:35:33.940544 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 81/129] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:33 2022] DELETE /compute/v2.1/flavors/1724030588 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:34.076066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:34.093654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f0ba1e0d-5381-406f-b9a1-569a6b4bad47 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1213 microversion: 2.1 time: 0.315027 Jul 14 14:35:34.094881 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 49/130] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1213 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:34.112243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ea9a5a6-5fd6-4005-b96a-f741e2c02757 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Calling method '.version_select at 0x7fdbf3bdb8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.113749 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.113749 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:34.115842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ea9a5a6-5fd6-4005-b96a-f741e2c02757 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '6f03ab9c2050476eadef3d20ef3df476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c59ae01bd47c78548b1a08114c9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ea9a5a6-5fd6-4005-b96a-f741e2c02757 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Request method failure captured: Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hosts/n-d-768852-23 HTTP/1.1 Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmrvaNvuo65kuIUkbrtz0HZJETgRgWiGlkXZfy4VpLdvL91OQSAZrT2aSjB_c0cReQhnDo7PBaTdf01fYQjlvqvxFLrrN__utq7d8TdiMKZyMEWlbiNQtrHp7e_8JyF4_NEcVkn9gGH5ECAlL54ENiIApd50vwipCPGHfTeUNqzjhk Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:34.121061 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 6f03ab9c2050476eadef3d20ef3df476 Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'n-d-768852-23'} Jul 14 14:35:34.122382 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:34.123122 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Jul 14 14:35:34.124227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.127544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ea9a5a6-5fd6-4005-b96a-f741e2c02757 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.130523 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ea9a5a6-5fd6-4005-b96a-f741e2c02757 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] 10.222.0.98 "GET /compute/v2.1/os-hosts/n-d-768852-23" status: 403 len: 109 microversion: 2.1 time: 0.032593 Jul 14 14:35:34.141861 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 50/131] 10.222.0.98 () {58 vars in 1169 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/os-hosts/n-d-768852-23 => generated 109 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:34.156667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ad8ebfb-cecd-483e-a3b6-18d7b1c75940 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.231435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ad8ebfb-cecd-483e-a3b6-18d7b1c75940 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.087359 Jul 14 14:35:34.234197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 51/132] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:34.255353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4cb2b84-8ea4-4a03-b5b9-bba56946a9c0 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Calling method '.version_select at 0x7fdbf3b288b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.276175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f4cb2b84-8ea4-4a03-b5b9-bba56946a9c0 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4cb2b84-8ea4-4a03-b5b9-bba56946a9c0 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:34.279306 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:35:34.280667 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.281996 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.283645 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.287742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4cb2b84-8ea4-4a03-b5b9-bba56946a9c0 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.289136 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4cb2b84-8ea4-4a03-b5b9-bba56946a9c0 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.053600 Jul 14 14:35:34.296691 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 52/133] 10.222.0.98 () {58 vars in 1190 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:34.308627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19283529-12b8-461c-9239-618fb04d5c85 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-813903211", "id": 470552260, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:34.311081 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.311081 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:34.359484 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19283529-12b8-461c-9239-618fb04d5c85 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.059474 Jul 14 14:35:34.369500 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 53/134] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:34 2022] POST /compute/v2.1/flavors => generated 434 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:34.386700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8a3270b-f3c6-42b2-9994-6564bbbec0ed tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Calling method '.version_select at 0x7fdbf3b28430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.387868 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.387868 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:34.391511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8a3270b-f3c6-42b2-9994-6564bbbec0ed tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '6f03ab9c2050476eadef3d20ef3df476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c59ae01bd47c78548b1a08114c9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8a3270b-f3c6-42b2-9994-6564bbbec0ed tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Request method failure captured: Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hosts/n-d-768852-23/shutdown HTTP/1.1 Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmrvaNvuo65kuIUkbrtz0HZJETgRgWiGlkXZfy4VpLdvL91OQSAZrT2aSjB_c0cReQhnDo7PBaTdf01fYQjlvqvxFLrrN__utq7d8TdiMKZyMEWlbiNQtrHp7e_8JyF4_NEcVkn9gGH5ECAlL54ENiIApd50vwipCPGHfTeUNqzjhk Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:34.404145 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 6f03ab9c2050476eadef3d20ef3df476 Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'n-d-768852-23'} Jul 14 14:35:34.407030 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:34.408661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Jul 14 14:35:34.412024 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.417675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8a3270b-f3c6-42b2-9994-6564bbbec0ed tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.422881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8a3270b-f3c6-42b2-9994-6564bbbec0ed tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] 10.222.0.98 "GET /compute/v2.1/os-hosts/n-d-768852-23/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.052125 Jul 14 14:35:34.431782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 54/135] 10.222.0.98 () {58 vars in 1196 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/os-hosts/n-d-768852-23/shutdown => generated 113 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:34.567580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b8844e5-69f9-4c36-acc1-78010a61a5ef tempest-FlavorsExtraSpecsTestJSON-169243391 tempest-FlavorsExtraSpecsTestJSON-169243391-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.591876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b8844e5-69f9-4c36-acc1-78010a61a5ef tempest-FlavorsExtraSpecsTestJSON-169243391 tempest-FlavorsExtraSpecsTestJSON-169243391-project] 10.222.0.98 "GET /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.648705 Jul 14 14:35:34.598715 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 82/136] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 14:35:33 2022] GET /compute/v2.1/flavors/1914331373/os-extra_specs => generated 66 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:34.612032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a9634b0-638c-4954-904b-45ed70dcd346 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.615361 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.615361 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:34.636009 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-5a9634b0-638c-4954-904b-45ed70dcd346 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] HTTP exception thrown: Access list not available for public flavors. Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a9634b0-638c-4954-904b-45ed70dcd346 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Request method failure captured: Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/flavors/470552260/os-flavor-access HTTP/1.1 Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmqg98lM4xAjRXbYj_RS3LCpS8EjxOFmWyOb0vleD7tNtcGuCSRZ1vgkPERDi_A55aSST5DPYQfzU4yWLE7KAb85BKLc3HJ3ThdK5Y5XvBjKMueQd2-TIl9oFjJQ1OLLThslg9-qQw_4hKrEBSvqZ-2eeXQuLwfON6Dl7qpzZdTeBI Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8b2be727a8f34a1d86c8c4a59cc48d90 Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:34.650825 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8b2be727a8f34a1d86c8c4a59cc48d90 Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 439726d211b24daba1ce6d4aa2473493 Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: exception: Access list not available for public flavors. Jul 14 14:35:34.652510 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '470552260'} Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Jul 14 14:35:34.653450 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.657187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a9634b0-638c-4954-904b-45ed70dcd346 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.658427 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5a9634b0-638c-4954-904b-45ed70dcd346 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/470552260/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.057228 Jul 14 14:35:34.659234 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 83/137] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/flavors/470552260/os-flavor-access => generated 91 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:34.678807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3938664a-4f5f-4761-a071-c43a3240f352 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Calling method '.version_select at 0x7fdbf3ac13a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.684113 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.684113 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:34.714765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-48259029-b0a5-46d8-829d-ddb35082d800 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-369788812", "id": 83887083, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:34.740459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3938664a-4f5f-4761-a071-c43a3240f352 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3938664a-4f5f-4761-a071-c43a3240f352 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:34.743507 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:35:34.745289 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:34.746143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 14 14:35:34.747597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:34.748745 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.751763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3938664a-4f5f-4761-a071-c43a3240f352 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.753084 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3938664a-4f5f-4761-a071-c43a3240f352 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.092414 Jul 14 14:35:34.760062 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 84/138] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:34.773587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68f9d637-55d0-46d8-ad27-a90b44f07b3c tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:34.787007 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.787007 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:34.802747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-48259029-b0a5-46d8-829d-ddb35082d800 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 442 microversion: 2.55 time: 0.365844 Jul 14 14:35:34.806605 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 55/139] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:35:34 2022] POST /compute/v2.1/flavors => generated 442 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:34.819259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b800a8db-90c4-4f8c-bebe-176b579ff155 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.821968 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.821968 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:34.855858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68f9d637-55d0-46d8-ad27-a90b44f07b3c tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.088751 Jul 14 14:35:34.879989 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 85/140] 10.222.0.98 () {60 vars in 1223 bytes} [Thu Jul 14 14:35:34 2022] POST /compute/v2.1/flavors/1914331373/os-extra_specs => generated 66 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:34.899781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b800a8db-90c4-4f8c-bebe-176b579ff155 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/470552260" status: 202 len: 0 microversion: 2.1 time: 0.087094 Jul 14 14:35:34.901626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f96b937b-d918-4510-ade2-afbb8b6c5bea tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Calling method '.version_select at 0x7fdbf3b678b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.902772 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:34.902772 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:34.904245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f96b937b-d918-4510-ade2-afbb8b6c5bea tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '6f03ab9c2050476eadef3d20ef3df476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c59ae01bd47c78548b1a08114c9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:34.904956 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 56/141] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:34 2022] DELETE /compute/v2.1/flavors/470552260 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f96b937b-d918-4510-ade2-afbb8b6c5bea tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Request method failure captured: Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hosts/n-d-768852-23/startup HTTP/1.1 Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmrvaNvuo65kuIUkbrtz0HZJETgRgWiGlkXZfy4VpLdvL91OQSAZrT2aSjB_c0cReQhnDo7PBaTdf01fYQjlvqvxFLrrN__utq7d8TdiMKZyMEWlbiNQtrHp7e_8JyF4_NEcVkn9gGH5ECAlL54ENiIApd50vwipCPGHfTeUNqzjhk Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:34.906971 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6f03ab9c2050476eadef3d20ef3df476 Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'n-d-768852-23'} Jul 14 14:35:34.908475 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:34.910931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Jul 14 14:35:34.912838 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:34.916072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f96b937b-d918-4510-ade2-afbb8b6c5bea tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:34.917314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f96b937b-d918-4510-ade2-afbb8b6c5bea tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] 10.222.0.98 "GET /compute/v2.1/os-hosts/n-d-768852-23/startup" status: 403 len: 110 microversion: 2.1 time: 0.031729 Jul 14 14:35:34.922577 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 86/142] 10.222.0.98 () {58 vars in 1193 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/os-hosts/n-d-768852-23/startup => generated 110 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:34.929737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:34.931249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:34.939325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.939991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:34.940866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:34.941297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.419616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c145498-f50a-471e-9d1c-874e31a16ecd tempest-FlavorsV255TestJSON-2107133985 tempest-FlavorsV255TestJSON-2107133985-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.444967 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8c145498-f50a-471e-9d1c-874e31a16ecd tempest-FlavorsV255TestJSON-2107133985 tempest-FlavorsV255TestJSON-2107133985-project] 10.222.0.98 "GET /compute/v2.1/flavors/83887083" status: 200 len: 442 microversion: 2.55 time: 0.538033 Jul 14 14:35:35.456510 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 57/143] 10.222.0.98 () {60 vars in 1192 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/flavors/83887083 => generated 442 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:35.470922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60984e7a-896e-4296-af08-9fcaab7c4aba tempest-FlavorsExtraSpecsTestJSON-169243391 tempest-FlavorsExtraSpecsTestJSON-169243391-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.497604 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60984e7a-896e-4296-af08-9fcaab7c4aba tempest-FlavorsExtraSpecsTestJSON-169243391 tempest-FlavorsExtraSpecsTestJSON-169243391-project] 10.222.0.98 "GET /compute/v2.1/flavors/1914331373/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.033910 Jul 14 14:35:35.498852 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 58/144] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:35:35 2022] GET /compute/v2.1/flavors/1914331373/os-extra_specs/hw:numa_nodes => generated 22 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:35.518059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c8c4177-31ef-489a-aa08-f42df82ec9f7 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.547650 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c8c4177-31ef-489a-aa08-f42df82ec9f7 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5807 microversion: 2.1 time: 0.044845 Jul 14 14:35:35.548966 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 59/145] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:35 2022] GET /compute/v2.1/flavors/detail => generated 5807 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:35.554338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7762cebe-52ec-4bb3-a1f0-aa87289e1d9b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Calling method '.version_select at 0x7fdbf3b28280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.556163 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:35.556163 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:35.573989 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-7762cebe-52ec-4bb3-a1f0-aa87289e1d9b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7762cebe-52ec-4bb3-a1f0-aa87289e1d9b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:35.579782 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'nonexistent_hostname'} Jul 14 14:35:35.581196 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:35.582238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Jul 14 14:35:35.584573 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:35.586704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7762cebe-52ec-4bb3-a1f0-aa87289e1d9b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:35.589569 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7762cebe-52ec-4bb3-a1f0-aa87289e1d9b tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.035410 Jul 14 14:35:35.590520 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 60/146] 10.222.0.98 () {58 vars in 1214 bytes} [Thu Jul 14 14:35:35 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:35.608533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:35.612045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:35.628669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.629469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.630494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:35.631105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:35.772221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:35.792449 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-662e2d9a-b508-4811-b2c0-a00fcdf8287a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1275 microversion: 2.1 time: 0.200903 Jul 14 14:35:35.803813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 61/147] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:35 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1275 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:35.818194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7ae8f8b-6fca-4931-b2c9-3b8eb2f46268 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] Action: 'update', calling method: .version_select at 0x7fdc01ea8dc0>, body: {"flavor": {"description": "new"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:35.841168 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:35.841168 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:35.882351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:35.898116 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52e1e3d2-f365-47ab-bca8-6c069a680959 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.970423 Jul 14 14:35:35.902032 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 87/148] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:34 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:35.918502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cc061c8-1495-421c-adde-bc4c8828765f tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:35.926767 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:35.926767 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:35.937849 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d7ae8f8b-6fca-4931-b2c9-3b8eb2f46268 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] 10.222.0.98 "PUT /compute/v2.1/flavors/83887083" status: 200 len: 443 microversion: 2.55 time: 0.126588 Jul 14 14:35:35.946867 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 62/149] 10.222.0.98 () {62 vars in 1212 bytes} [Thu Jul 14 14:35:35 2022] PUT /compute/v2.1/flavors/83887083 => generated 443 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:35.960289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-33815fbe-dba5-43c7-a98a-198ed78bf3fa tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2119638079", "id": 1748320836, "os-flavor-access:is_public": "False"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:35.972223 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:35.972223 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:36.022251 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3cc061c8-1495-421c-adde-bc4c8828765f tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.118645 Jul 14 14:35:36.023434 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 88/150] 10.222.0.98 () {60 vars in 1223 bytes} [Thu Jul 14 14:35:35 2022] POST /compute/v2.1/flavors/1914331373/os-extra_specs => generated 66 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:36.029552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-33815fbe-dba5-43c7-a98a-198ed78bf3fa tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.081049 Jul 14 14:35:36.030681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 63/151] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:35 2022] POST /compute/v2.1/flavors => generated 439 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:36.040078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfebe30a-3509-44bd-a42e-c04d7b07ed3f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3ac1d30>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.045040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae10397b-e6cd-4712-8229-8f71f68000c6 tempest-FlavorsV255TestJSON-2107133985 tempest-FlavorsV255TestJSON-2107133985-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfebe30a-3509-44bd-a42e-c04d7b07ed3f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/os-hosts/n-d-768852-23 HTTP/1.1 Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 51 Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:36.053345 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: {"status": "enable", "maintenance_mode": "invalid"} Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:35:36.054898 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'n-d-768852-23', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'disable', Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'Enable', Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'Disable', Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.055792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.057426 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.058627 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.058627 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:35:36.058627 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:35:36.058627 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.058627 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.060069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfebe30a-3509-44bd-a42e-c04d7b07ed3f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:36.061273 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfebe30a-3509-44bd-a42e-c04d7b07ed3f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-hosts/n-d-768852-23" status: 400 len: 199 microversion: 2.1 time: 0.036145 Jul 14 14:35:36.066628 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 89/152] 10.222.0.98 () {60 vars in 1189 bytes} [Thu Jul 14 14:35:36 2022] PUT /compute/v2.1/os-hosts/n-d-768852-23 => generated 199 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:35:36.076123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-740b0386-b394-44f6-a88e-51ef980377a0 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.099246 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-740b0386-b394-44f6-a88e-51ef980377a0 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.031093 Jul 14 14:35:36.107344 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 90/153] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors/1914331373/os-extra_specs => generated 66 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:36.125869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae10397b-e6cd-4712-8229-8f71f68000c6 tempest-FlavorsV255TestJSON-2107133985 tempest-FlavorsV255TestJSON-2107133985-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 6144 microversion: 2.55 time: 0.089778 Jul 14 14:35:36.136744 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 64/154] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors/detail => generated 6144 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:36.153922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4045c2be-e831-423c-a767-adf1a9ed2a63 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Action: 'update', calling method: .version_select at 0x7fdc000450d0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4045c2be-e831-423c-a767-adf1a9ed2a63 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/os-hosts/n-d-768852-23 HTTP/1.1 Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 51 Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:36.156719 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: {"status": "invalid", "maintenance_mode": "enable"} Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:36.158234 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'n-d-768852-23', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'disable', Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'Enable', Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'Disable', Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.159117 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.161099 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.162278 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.162278 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:35:36.162278 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:35:36.162278 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Jul 14 14:35:36.162278 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.168245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4045c2be-e831-423c-a767-adf1a9ed2a63 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:36.174197 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4045c2be-e831-423c-a767-adf1a9ed2a63 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-hosts/n-d-768852-23" status: 400 len: 189 microversion: 2.1 time: 0.035420 Jul 14 14:35:36.180750 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 65/155] 10.222.0.98 () {60 vars in 1189 bytes} [Thu Jul 14 14:35:36 2022] PUT /compute/v2.1/os-hosts/n-d-768852-23 => generated 189 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:35:36.202911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8bed9df2-9c00-4113-906e-30ae13ac26bd tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.205918 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.205918 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:36.314725 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8bed9df2-9c00-4113-906e-30ae13ac26bd tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "PUT /compute/v2.1/flavors/1914331373/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.132628 Jul 14 14:35:36.321564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 66/156] 10.222.0.98 () {60 vars in 1264 bytes} [Thu Jul 14 14:35:36 2022] PUT /compute/v2.1/flavors/1914331373/os-extra_specs/hw:numa_nodes => generated 22 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:36.334579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-42748962-d9a6-4196-b5f7-d76210946c69 tempest-FlavorsV255TestJSON-2107133985 tempest-FlavorsV255TestJSON-2107133985-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.389022 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-42748962-d9a6-4196-b5f7-d76210946c69 tempest-FlavorsV255TestJSON-2107133985 tempest-FlavorsV255TestJSON-2107133985-project] 10.222.0.98 "GET /compute/v2.1/flavors" status: 200 len: 3402 microversion: 2.55 time: 0.065749 Jul 14 14:35:36.403439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 67/157] 10.222.0.98 () {60 vars in 1165 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors => generated 3402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:36.420433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67ccf030-c920-491b-92af-024bc3a8ab02 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Action: 'update', calling method: .version_select at 0x7fdbf3e57af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.428850 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.428850 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:36.439992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67ccf030-c920-491b-92af-024bc3a8ab02 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '6f03ab9c2050476eadef3d20ef3df476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '990c59ae01bd47c78548b1a08114c9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67ccf030-c920-491b-92af-024bc3a8ab02 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Request method failure captured: Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/os-hosts/n-d-768852-23 HTTP/1.1 Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 50 Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmrvaNvuo65kuIUkbrtz0HZJETgRgWiGlkXZfy4VpLdvL91OQSAZrT2aSjB_c0cReQhnDo7PBaTdf01fYQjlvqvxFLrrN__utq7d8TdiMKZyMEWlbiNQtrHp7e_8JyF4_NEcVkn9gGH5ECAlL54ENiIApd50vwipCPGHfTeUNqzjhk Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:36.441983 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/990c59ae01bd47c78548b1a08114c9ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 990c59ae01bd47c78548b1a08114c9ae Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1925927527 Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 6f03ab9c2050476eadef3d20ef3df476 Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1925927527-project Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: {"status": "enable", "maintenance_mode": "enable"} Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 14 14:35:36.443403 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'n-d-768852-23', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:36.444352 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Jul 14 14:35:36.446793 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.448481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67ccf030-c920-491b-92af-024bc3a8ab02 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:36.456378 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67ccf030-c920-491b-92af-024bc3a8ab02 tempest-HostsAdminNegativeTestJSON-1925927527 tempest-HostsAdminNegativeTestJSON-1925927527-project] 10.222.0.98 "PUT /compute/v2.1/os-hosts/n-d-768852-23" status: 403 len: 111 microversion: 2.1 time: 0.050420 Jul 14 14:35:36.462866 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 68/158] 10.222.0.98 () {60 vars in 1189 bytes} [Thu Jul 14 14:35:36 2022] PUT /compute/v2.1/os-hosts/n-d-768852-23 => generated 111 bytes in 58 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:36.478085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2f836b5-e2af-4a0e-8c56-d44147eb5597 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.493204 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2f836b5-e2af-4a0e-8c56-d44147eb5597 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.028378 Jul 14 14:35:36.494375 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 69/159] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors/1914331373/os-extra_specs => generated 66 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:36.500875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4c0389aa-62ab-4e54-a7f3-8612b027def1 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.502011 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.502011 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:36.530517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e04fc2dd-c728-4ace-a1d7-73488a3d4703 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.532576 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.532576 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:36.537204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e04fc2dd-c728-4ace-a1d7-73488a3d4703 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'db565d2fc4e84662b84966271a080b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7498cccd6f46fd8a445d9f7455e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e04fc2dd-c728-4ace-a1d7-73488a3d4703 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Request method failure captured: Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/flavors/1748320836/action HTTP/1.1 Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 67 Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmmtTuj8q8viEgZYvt0WJig_x0uEkGTCfK1Tu1KjmPy5L5KzH6RNTnCodf9hBB4Mfr-ixNnYb4euQMElTIOPQPWYYYv0AWq5VNMSGqANP262UlNQSeKKn14Me0boBw7zmDfj4PMERcplmjfp07O5JInou6sTOrPzSqRcfTmwpC3gQU Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cb7498cccd6f46fd8a445d9f7455e31a Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1339531927 Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:36.540236 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1339531927 Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cb7498cccd6f46fd8a445d9f7455e31a Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1339531927 Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsAccessNegativeTestJSON-1339531927-project Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db565d2fc4e84662b84966271a080b52 Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1339531927-project Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: {"addTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} Jul 14 14:35:36.541785 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '1748320836', 'body': {'addTenantAccess': {'tenant': 'cb7498cccd6f46fd8a445d9f7455e31a'}}} Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:36.542520 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Jul 14 14:35:36.543573 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.550608 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4c0389aa-62ab-4e54-a7f3-8612b027def1 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/83887083" status: 202 len: 0 microversion: 2.55 time: 0.042999 Jul 14 14:35:36.554815 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 70/160] 10.222.0.98 () {60 vars in 1195 bytes} [Thu Jul 14 14:35:36 2022] DELETE /compute/v2.1/flavors/83887083 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:36.556565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e04fc2dd-c728-4ace-a1d7-73488a3d4703 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:36.561915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e04fc2dd-c728-4ace-a1d7-73488a3d4703 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] 10.222.0.98 "POST /compute/v2.1/flavors/1748320836/action" status: 403 len: 130 microversion: 2.1 time: 0.452960 Jul 14 14:35:36.566349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c72267bb-693c-46f2-9de0-2b09319ea41f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3b7daf0>, body: {"status": null, "maintenance_mode": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.567477 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 91/161] 10.222.0.98 () {60 vars in 1199 bytes} [Thu Jul 14 14:35:36 2022] POST /compute/v2.1/flavors/1748320836/action => generated 130 bytes in 459 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c72267bb-693c-46f2-9de0-2b09319ea41f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/os-hosts/n-d-768852-23 HTTP/1.1 Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 42 Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:36.569986 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: {"status": null, "maintenance_mode": null} Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 14 14:35:36.571355 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'n-d-768852-23', 'body': {'status': None, 'maintenance_mode': None}} Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'disable', Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'Enable', Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'Disable', Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'ENABLE', Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'DISABLE'], Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'type': 'string'} Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi None Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.572260 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.578655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c72267bb-693c-46f2-9de0-2b09319ea41f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c72267bb-693c-46f2-9de0-2b09319ea41f tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-hosts/n-d-768852-23" status: 400 len: 127 microversion: 2.1 time: 0.016075 Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 71/162] 10.222.0.98 () {60 vars in 1189 bytes} [Thu Jul 14 14:35:36 2022] PUT /compute/v2.1/os-hosts/n-d-768852-23 => generated 127 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:35:36.580234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0298cc2-b53a-4cde-823e-e8607f6d1ec7 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.587534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce0693ee-ca9c-4772-9367-1d20120051a9 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.589266 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.589266 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:36.614004 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0298cc2-b53a-4cde-823e-e8607f6d1ec7 tempest-FlavorsV255TestJSON-1765585331 tempest-FlavorsV255TestJSON-1765585331-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5711 microversion: 2.55 time: 0.039854 Jul 14 14:35:36.634658 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 72/163] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors/detail => generated 5711 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:36.650151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a73bbba5-313e-4ff0-8c88-787677eabbba tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.686512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce0693ee-ca9c-4772-9367-1d20120051a9 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1914331373/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.115673 Jul 14 14:35:36.689919 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 92/164] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:35:36 2022] DELETE /compute/v2.1/flavors/1914331373/os-extra_specs/hw:numa_nodes => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:36.690517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a73bbba5-313e-4ff0-8c88-787677eabbba tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1748320836" status: 202 len: 0 microversion: 2.1 time: 0.054030 Jul 14 14:35:36.695333 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 73/165] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:36 2022] DELETE /compute/v2.1/flavors/1748320836 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:36.701821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-544da9c9-1263-4541-8e3e-295e0205e1c7 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.706241 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.706241 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:36.708585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d9275c3-c22c-4865-a528-8af3557c7879 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3b678b0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.713049 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:36.713049 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:36.716574 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.hosts [None req-7d9275c3-c22c-4865-a528-8af3557c7879 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Enabling host nonexistent_hostname. Jul 14 14:35:36.743150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7d9275c3-c22c-4865-a528-8af3557c7879 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d9275c3-c22c-4865-a528-8af3557c7879 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Request method failure captured: Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 50 Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmvrtYLYElNx02gLlOIT8EwMIyYHedwvsucP_bJFgbpa7BaUKJfN10pgTQ7O9DN7ewtPRA46K1ut92ljuDSNDzAbAF-Q1xIX7OSY27hcxSgbl7dKv3yU2dxJ-qtwqjhYQmlCkjgELLX51UZfoa5G--QduTyTHLeaNudGvCS_ucwEqU Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:35:36.760521 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/49fd5ede998f41f6a19664edf06abd23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 49fd5ede998f41f6a19664edf06abd23 Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1363785004 Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: f5fdb5c974da4a3c87f8bd4dd2564487 Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1363785004-project-admin Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: {"status": "enable", "maintenance_mode": "enable"} Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: exception: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:36.762011 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5859, in targeted Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:35:36.763141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:36.764387 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Jul 14 14:35:36.765483 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:36.768181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d9275c3-c22c-4865-a528-8af3557c7879 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:36.769371 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d9275c3-c22c-4865-a528-8af3557c7879 tempest-HostsAdminNegativeTestJSON-1363785004 tempest-HostsAdminNegativeTestJSON-1363785004-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.076658 Jul 14 14:35:36.770662 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 93/166] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:35:36 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:35:36.779072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9575d7f-bc42-4e20-860f-2cf8b2dedb35 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.783692 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-544da9c9-1263-4541-8e3e-295e0205e1c7 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1914331373/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.063609 Jul 14 14:35:36.787803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 74/167] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:35:36 2022] DELETE /compute/v2.1/flavors/1914331373/os-extra_specs/hw:cpu_policy => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:35:36.793436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0215ab2-c19f-4bf9-9e48-ca695199ec36 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.813225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9575d7f-bc42-4e20-860f-2cf8b2dedb35 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.041016 Jul 14 14:35:36.814608 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 94/168] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:36.822334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:36.823521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:36.841876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:36.844991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:36.848132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:36.852696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:36.871506 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0215ab2-c19f-4bf9-9e48-ca695199ec36 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/1914331373/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.081865 Jul 14 14:35:36.876167 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 75/169] 10.222.0.98 () {58 vars in 1202 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/flavors/1914331373/os-extra_specs => generated 19 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:36.892968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-328af053-2efc-49b7-baca-4d39265ba578 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-34569542", "id": 767588731, "os-flavor-access:is_public": "False"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:36.955243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=74,nova_api:SAVEPOINT=4,nova_api:INSERT=6,nova_api:RELEASE=4,nova_api:DELETE=10,nova_api:UPDATE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:36.968239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-328af053-2efc-49b7-baca-4d39265ba578 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.088828 Jul 14 14:35:36.969149 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 76/170] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:36 2022] POST /compute/v2.1/flavors => generated 434 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:36.991608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-468d4731-09c2-4647-9e73-260ea22ab607 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:37.063905 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-468d4731-09c2-4647-9e73-260ea22ab607 tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1914331373" status: 202 len: 0 microversion: 2.1 time: 0.090176 Jul 14 14:35:37.066427 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 77/171] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:35:36 2022] DELETE /compute/v2.1/flavors/1914331373 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:37.081840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:37.083144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:37.100516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:37.103116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:37.105564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:37.106407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:37.120465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=43 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:37.803086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:37.860135 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5231a630-3641-4991-bbea-e2566b0272c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1275 microversion: 2.1 time: 1.019106 Jul 14 14:35:37.865705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 95/172] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:36 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1275 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:37.904589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28986f00-54df-4c83-9b6e-ab6935be59c3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:37.907113 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:37.907113 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:38.308026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:38.337584 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7e9ee5fa-0668-49a1-a764-068f9c854774 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.254541 Jul 14 14:35:38.341627 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 78/173] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:37 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:38.363210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7dccfb55-4394-4da4-ac7e-3e3b75f7a84f tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.484952 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7dccfb55-4394-4da4-ac7e-3e3b75f7a84f tempest-FlavorsExtraSpecsTestJSON-1788187865 tempest-FlavorsExtraSpecsTestJSON-1788187865-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.138833 Jul 14 14:35:38.488712 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 79/174] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:38.642752 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28986f00-54df-4c83-9b6e-ab6935be59c3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/767588731/action" status: 200 len: 96 microversion: 2.1 time: 0.772822 Jul 14 14:35:38.647447 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 96/175] 10.222.0.98 () {60 vars in 1196 bytes} [Thu Jul 14 14:35:37 2022] POST /compute/v2.1/flavors/767588731/action => generated 96 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:38.659787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4de2d894-4f50-486a-a84c-d370e8f54771 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:38.661488 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:38.661488 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:38.663021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4de2d894-4f50-486a-a84c-d370e8f54771 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'db565d2fc4e84662b84966271a080b52', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb7498cccd6f46fd8a445d9f7455e31a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4de2d894-4f50-486a-a84c-d370e8f54771 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Request method failure captured: Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/flavors/767588731/action HTTP/1.1 Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 70 Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmmtTuj8q8viEgZYvt0WJig_x0uEkGTCfK1Tu1KjmPy5L5KzH6RNTnCodf9hBB4Mfr-ixNnYb4euQMElTIOPQPWYYYv0AWq5VNMSGqANP262UlNQSeKKn14Me0boBw7zmDfj4PMERcplmjfp07O5JInou6sTOrPzSqRcfTmwpC3gQU Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cb7498cccd6f46fd8a445d9f7455e31a Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1339531927 Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:35:38.667344 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cb7498cccd6f46fd8a445d9f7455e31a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1339531927 Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cb7498cccd6f46fd8a445d9f7455e31a Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1339531927 Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FlavorsAccessNegativeTestJSON-1339531927-project Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: db565d2fc4e84662b84966271a080b52 Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1339531927-project Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: {"removeTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} Jul 14 14:35:38.668830 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '767588731', 'body': {'removeTenantAccess': {'tenant': 'cb7498cccd6f46fd8a445d9f7455e31a'}}} Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can( Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:35:38.669918 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Jul 14 14:35:38.671615 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:38.674277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4de2d894-4f50-486a-a84c-d370e8f54771 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:38.690609 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4de2d894-4f50-486a-a84c-d370e8f54771 tempest-FlavorsAccessNegativeTestJSON-1339531927 tempest-FlavorsAccessNegativeTestJSON-1339531927-project] 10.222.0.98 "POST /compute/v2.1/flavors/767588731/action" status: 403 len: 133 microversion: 2.1 time: 0.023391 Jul 14 14:35:38.711383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 80/176] 10.222.0.98 () {60 vars in 1196 bytes} [Thu Jul 14 14:35:38 2022] POST /compute/v2.1/flavors/767588731/action => generated 133 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:38.738781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e43a005-4afb-4447-b456-63fb37dc3e4f tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "cb7498cccd6f46fd8a445d9f7455e31a"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:38.742866 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:38.742866 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:38.880645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:38.881407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:38.902071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.909347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:38.911241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:38.915889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.038666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4e43a005-4afb-4447-b456-63fb37dc3e4f tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/767588731/action" status: 200 len: 21 microversion: 2.1 time: 0.334133 Jul 14 14:35:39.052314 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 97/177] 10.222.0.98 () {60 vars in 1196 bytes} [Thu Jul 14 14:35:38 2022] POST /compute/v2.1/flavors/767588731/action => generated 21 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:35:39.069359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21f79098-2e36-4e2e-996f-8c31a5865eb3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.073883 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:39.073883 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:39.168571 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21f79098-2e36-4e2e-996f-8c31a5865eb3 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/767588731" status: 202 len: 0 microversion: 2.1 time: 0.107666 Jul 14 14:35:39.171432 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 98/178] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:39 2022] DELETE /compute/v2.1/flavors/767588731 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:39.226171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c8e66e9-0dd2-4936-8a4c-5145603cdd9b tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.381476 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c8e66e9-0dd2-4936-8a4c-5145603cdd9b tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.194991 Jul 14 14:35:39.396520 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 99/179] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:39 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:39.430581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:39.435717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:39.463532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.471871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.481802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:39.487692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:39.739803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:39.756087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-806ac26d-de59-4123-8cd4-74dd425f5951 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1275 microversion: 2.1 time: 0.880920 Jul 14 14:35:39.756989 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 81/180] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:38 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1275 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:39.764122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c87c59a5-d831-4e5a-99e2-0b56e09ba1fd tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1173719386", "id": 852431899, "os-flavor-access:is_public": "False"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:39.775552 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:39.775552 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:39.833645 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c87c59a5-d831-4e5a-99e2-0b56e09ba1fd tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.073467 Jul 14 14:35:39.845944 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 82/181] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:39 2022] POST /compute/v2.1/flavors => generated 436 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:39.868439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d068b291-64d6-4591-bf91-a56a3e7f76a8 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "613e034ca44149c8b8597f01b6e20add"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:39.874563 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:39.874563 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:40.622362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:40.691788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d068b291-64d6-4591-bf91-a56a3e7f76a8 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] HTTP exception thrown: Flavor access not found for 35 / 613e034ca44149c8b8597f01b6e20add combination. Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d068b291-64d6-4591-bf91-a56a3e7f76a8 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Request method failure captured: Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/flavors/852431899/action HTTP/1.1 Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 70 Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmqg98lM4xAjRXbYj_RS3LCpS8EjxOFmWyOb0vleD7tNtcGuCSRZ1vgkPERDi_A55aSST5DPYQfzU4yWLE7KAb85BKLc3HJ3ThdK5Y5XvBjKMueQd2-TIl9oFjJQ1OLLThslg9-qQw_4hKrEBSvqZ-2eeXQuLwfON6Dl7qpzZdTeBI Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8b2be727a8f34a1d86c8c4a59cc48d90 Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:35:40.701072 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8b2be727a8f34a1d86c8c4a59cc48d90"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8b2be727a8f34a1d86c8c4a59cc48d90 Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846 Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 439726d211b24daba1ce6d4aa2473493 Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: {"removeTenantAccess": {"tenant": "613e034ca44149c8b8597f01b6e20add"}} Jul 14 14:35:40.703848 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: exception: Flavor access not found for 35 / 613e034ca44149c8b8597f01b6e20add combination. Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '852431899', 'body': {'removeTenantAccess': {'tenant': '613e034ca44149c8b8597f01b6e20add'}}} Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Jul 14 14:35:40.705350 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 35 / 613e034ca44149c8b8597f01b6e20add combination. Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 35 / 613e034ca44149c8b8597f01b6e20add combination. Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:40.707678 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:40.710274 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:40.710274 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:40.710274 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:40.710274 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:40.710274 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 35 / 613e034ca44149c8b8597f01b6e20add combination. Jul 14 14:35:40.710274 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:35:40.714905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d068b291-64d6-4591-bf91-a56a3e7f76a8 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Returning 404 to user: Flavor access not found for 35 / 613e034ca44149c8b8597f01b6e20add combination. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:40.717472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d068b291-64d6-4591-bf91-a56a3e7f76a8 tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/852431899/action" status: 404 len: 124 microversion: 2.1 time: 0.854764 Jul 14 14:35:40.717472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 83/182] 10.222.0.98 () {60 vars in 1196 bytes} [Thu Jul 14 14:35:39 2022] POST /compute/v2.1/flavors/852431899/action => generated 124 bytes in 856 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:35:40.762228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f98967cc-ca28-4057-9561-be844cfef9fe tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:40.769978 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:40.769978 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:40.905369 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f98967cc-ca28-4057-9561-be844cfef9fe tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/852431899" status: 202 len: 0 microversion: 2.1 time: 0.171766 Jul 14 14:35:40.913871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 84/183] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:35:40 2022] DELETE /compute/v2.1/flavors/852431899 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:35:40.957395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:40.958719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:41.031100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.042477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.054367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:41.056766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:41.349789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.376561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f70b46b-43bc-42ed-a55d-f0096d969074 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.969872 Jul 14 14:35:41.398742 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 100/184] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:39 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 2001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:41.409873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4ade2e6-00e2-4023-ae3c-c552e12abaff tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:41.477712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4ade2e6-00e2-4023-ae3c-c552e12abaff tempest-FlavorsAccessNegativeTestJSON-1985980846 tempest-FlavorsAccessNegativeTestJSON-1985980846-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.075152 Jul 14 14:35:41.493000 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 101/185] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:41.889640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:41.938884 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f34310f6-c9ab-4e04-a72f-fb65c9c9fae9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 1.018570 Jul 14 14:35:41.941478 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 85/186] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:40 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:42.418000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.419468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.441488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.447959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.453057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.460203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:42.965489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:42.966266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:42.970950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:42.992907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:42.998723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.002310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:43.006443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:43.007367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:43.371569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:43.424357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c18fee27-ecc8-4693-b40a-5cda6156809a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.013467 Jul 14 14:35:43.434932 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 102/187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:44.178589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:44.217386 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c0d0cf2-9f4b-4e46-bedd-824251527904 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 1.255671 Jul 14 14:35:44.236219 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 86/188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:42 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:44.460707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:44.464345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:44.499065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.500229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.504553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:44.506065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:44.921602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:44.942487 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6cbca168-5dd3-4407-b0ee-c5154e23c8a5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.497799 Jul 14 14:35:44.952195 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 103/189] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:44 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:45.248050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:45.249611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:45.265007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.265881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.266992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:45.268401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:45.996627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:46.006066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:46.040549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.055390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.056497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:46.056957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:46.484873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.501950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c7a8a6e-6ae1-42d5-96e0-39868e325d8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 1.258349 Jul 14 14:35:46.502945 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 87/190] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:45 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:46.581713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:46.638745 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d017ff9f-15ae-4399-a954-c1d8d8d2e4f7 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.672699 Jul 14 14:35:46.644037 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 104/191] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:45 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:47.283881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8b286852-5858-41c9-aca4-51a463777e5a req-2cac5474-49a3-4326-ab9d-4049a80052df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "859ce988-fadf-44f6-b941-5639f6ccd35f", "tag": "f5e94c64-02eb-45cc-b797-b9eae480e80a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:47.314970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b286852-5858-41c9-aca4-51a463777e5a req-2cac5474-49a3-4326-ab9d-4049a80052df service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.315898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b286852-5858-41c9-aca4-51a463777e5a req-2cac5474-49a3-4326-ab9d-4049a80052df service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.375854 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8b286852-5858-41c9-aca4-51a463777e5a req-2cac5474-49a3-4326-ab9d-4049a80052df service nova] Creating event network-changed:f5e94c64-02eb-45cc-b797-b9eae480e80a for instance 859ce988-fadf-44f6-b941-5639f6ccd35f on n-h2-768852-23 Jul 14 14:35:47.380184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b286852-5858-41c9-aca4-51a463777e5a req-2cac5474-49a3-4326-ab9d-4049a80052df service nova] Acquired lock "compute-rpcapi-router" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:35:47.391670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.394957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.396155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.396831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.433529 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.rpcapi [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 14:35:47.435177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] Releasing lock "compute-rpcapi-router" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:35:47.502062 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c52e34ec-47ba-42e6-8c84-70d78dce25a8 None None] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.878756 Jul 14 14:35:47.503138 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 88/192] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:35:47.558718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.564331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.596760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.599630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.605495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.607385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.662489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:47.663437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:47.690141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.690591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:47.694962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:47.699816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:48.303295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.315337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4363be25-8e43-4830-bbd2-ab2559060c84 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 0.780904 Jul 14 14:35:48.318197 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 105/193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:48.857987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:48.885999 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-276f7679-ec41-40b0-bd4b-00526c1b8c86 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 1.228432 Jul 14 14:35:48.886622 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 89/194] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:47 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 1230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:49.350402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.361843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.379705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.380548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.395387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.396093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.922316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:49.923455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:49.975809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.979512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:49.985163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:49.986162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:50.338729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.353584 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-586e771f-9e7c-4a13-8e2a-74efa8459397 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 1.008366 Jul 14 14:35:50.363685 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 106/195] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:50.810730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:50.822477 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5612ee66-5d1b-4714-ad8c-8828c01d608a tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.909225 Jul 14 14:35:50.828170 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 90/196] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:49 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:51.370468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.371373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.389511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.393202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.395579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.396307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.817319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:51.841538 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e6f3aa2-ea33-45f7-999d-5f69c16c1d53 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 0.475081 Jul 14 14:35:51.845488 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 107/197] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:51.873168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:51.875563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:51.893374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.896521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:51.899718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:51.906319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.411777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:52.425459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a2f8811-0021-4dc8-b790-772ff4170efc tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.577126 Jul 14 14:35:52.426518 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 108/198] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:51 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:52.640328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1c71c1b6-525e-46df-82db-3d627bae900f req-ca61565b-9200-4244-9f1e-0dfb04de497c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dd8dab-42b8-49a8-a534-17f8f6412910", "name": "network-vif-plugged", "status": "completed", "tag": "963a2ea5-9ce6-41e2-8268-421b027fb8c4"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:52.659261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1c71c1b6-525e-46df-82db-3d627bae900f req-ca61565b-9200-4244-9f1e-0dfb04de497c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.660353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1c71c1b6-525e-46df-82db-3d627bae900f req-ca61565b-9200-4244-9f1e-0dfb04de497c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:52.691584 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1c71c1b6-525e-46df-82db-3d627bae900f req-ca61565b-9200-4244-9f1e-0dfb04de497c service nova] Creating event network-vif-plugged:963a2ea5-9ce6-41e2-8268-421b027fb8c4 for instance 38dd8dab-42b8-49a8-a534-17f8f6412910 on n-h1-768852-23 Jul 14 14:35:52.701209 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1c71c1b6-525e-46df-82db-3d627bae900f req-ca61565b-9200-4244-9f1e-0dfb04de497c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.271454 Jul 14 14:35:52.704963 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 109/199] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:52.771373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9827fbdb-55c2-4cc2-9de9-19242622440a tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-370556479", "id": 1258010102, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:52.779533 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:52.779533 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:52.832297 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9827fbdb-55c2-4cc2-9de9-19242622440a tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 1.096385 Jul 14 14:35:52.836947 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 91/200] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:35:51 2022] POST /compute/v2.1/flavors => generated 467 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:35:52.977348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Calling method '.version_select at 0x7fdbf3bb6790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:52.981471 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:52.981471 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:52.989382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:52.990715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.030631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.031395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.045579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.046033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.055646 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ab5b12ac-3b10-42b0-b132-11f9903371dd tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.349247 Jul 14 14:35:53.061812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 110/201] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:52 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:53.067123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.068207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.081031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.082203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.083262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.084091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.284070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6bb8dfe0-451b-40dc-af6a-599dede14674 tempest-FlavorsV261TestJSON-3346240 tempest-FlavorsV261TestJSON-3346240-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.308252 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6bb8dfe0-451b-40dc-af6a-599dede14674 tempest-FlavorsV261TestJSON-3346240 tempest-FlavorsV261TestJSON-3346240-project] 10.222.0.98 "GET /compute/v2.1/flavors/1258010102" status: 200 len: 467 microversion: 2.61 time: 0.458900 Jul 14 14:35:53.318283 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 92/202] 10.222.0.98 () {60 vars in 1198 bytes} [Thu Jul 14 14:35:52 2022] GET /compute/v2.1/flavors/1258010102 => generated 467 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:53.323497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Calling method '.version_select at 0x7fdbf3b7ddc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.327778 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:53.327778 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:53.331320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.334063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.363437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.364259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.430912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.431618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.446045 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6af661e-4e6c-4c76-b614-62b983d2a119 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/n-h1-768852-23/servers" status: 200 len: 197 microversion: 2.1 time: 0.126283 Jul 14 14:35:53.454806 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 93/203] 10.222.0.98 () {58 vars in 1214 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/os-hypervisors/n-h1-768852-23/servers => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:53.474241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-463999b5-22d3-42dd-a048-102054708aae tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:53.477413 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:53.477413 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:53.524111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-463999b5-22d3-42dd-a048-102054708aae tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] 10.222.0.98 "PUT /compute/v2.1/flavors/1258010102" status: 200 len: 468 microversion: 2.61 time: 0.066290 Jul 14 14:35:53.524808 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 94/204] 10.222.0.98 () {62 vars in 1218 bytes} [Thu Jul 14 14:35:53 2022] PUT /compute/v2.1/flavors/1258010102 => generated 468 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:35:53.543445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:53.550935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:53.563573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.566330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:53.567177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:53.570468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.076985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:54.090175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4389ef23-8891-4a97-9ebb-678f8467dca5 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.556036 Jul 14 14:35:54.090781 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 95/205] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:54.101307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Calling method '.version_select at 0x7fdbf3b38310>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.102731 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:54.102731 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:54.104069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.116198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.147435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.156100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.178706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.180296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.199009 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2f7ab217-68c2-4836-b09d-fb4aefb55149 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.106320 Jul 14 14:35:54.200282 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 96/206] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:54.217270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8727c9f3-dd04-48d3-a5e9-0ccb3501b329 tempest-FlavorsV261TestJSON-3346240 tempest-FlavorsV261TestJSON-3346240-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.260165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8727c9f3-dd04-48d3-a5e9-0ccb3501b329 tempest-FlavorsV261TestJSON-3346240 tempest-FlavorsV261TestJSON-3346240-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.058238 Jul 14 14:35:54.268643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 97/207] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:54.276199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ac7f8af1-2f81-4641-9c5f-e4076274b3f9 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Calling method '.version_select at 0x7fdbf3b38550>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.281395 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:54.281395 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:54.283117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac7f8af1-2f81-4641-9c5f-e4076274b3f9 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.283855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac7f8af1-2f81-4641-9c5f-e4076274b3f9 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.318521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac7f8af1-2f81-4641-9c5f-e4076274b3f9 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:54.319086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac7f8af1-2f81-4641-9c5f-e4076274b3f9 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:54.340449 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ac7f8af1-2f81-4641-9c5f-e4076274b3f9 tempest-HypervisorAdminUnderV252Test-1040240177 tempest-HypervisorAdminUnderV252Test-1040240177-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/n-h1-768852-23/search" status: 200 len: 105 microversion: 2.1 time: 0.070169 Jul 14 14:35:54.341528 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 98/208] 10.222.0.98 () {58 vars in 1211 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/os-hypervisors/n-h1-768852-23/search => generated 105 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:54.354220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3beb367b-6f93-42fd-9398-6831f7d98a7f tempest-FlavorsV261TestJSON-3346240 tempest-FlavorsV261TestJSON-3346240-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.405567 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3beb367b-6f93-42fd-9398-6831f7d98a7f tempest-FlavorsV261TestJSON-3346240 tempest-FlavorsV261TestJSON-3346240-project] 10.222.0.98 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.062799 Jul 14 14:35:54.406175 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 99/209] 10.222.0.98 () {60 vars in 1165 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:35:54.439194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21a7138a-e613-4117-b406-b741feaa53af tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.440034 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:54.440034 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:35:54.504793 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21a7138a-e613-4117-b406-b741feaa53af tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1258010102" status: 202 len: 0 microversion: 2.61 time: 0.068928 Jul 14 14:35:54.505382 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 100/210] 10.222.0.98 () {60 vars in 1201 bytes} [Thu Jul 14 14:35:54 2022] DELETE /compute/v2.1/flavors/1258010102 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:35:54.514578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c79f7dcd-f3f6-464b-93ea-3cce6078da35 tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:54.566032 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c79f7dcd-f3f6-464b-93ea-3cce6078da35 tempest-FlavorsV261TestJSON-472876089 tempest-FlavorsV261TestJSON-472876089-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.055695 Jul 14 14:35:54.571387 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 101/211] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:35:54 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:35:54.799026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:54.808651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:54.840915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44a93184-5b3c-40ab-926a-ea816f68e4d1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 1.776027 Jul 14 14:35:54.843468 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 111/212] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:53 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:55.113334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.114054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.125689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.128718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.129839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.131969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.741497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:55.797435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ebdf3e5-6938-4b5c-a95d-093bf5afc9c8 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1338 microversion: 2.1 time: 0.691833 Jul 14 14:35:55.798528 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 102/213] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1338 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:55.859117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:55.861045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:55.865783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=8,nova_api:SAVEPOINT=5,nova_api:RELEASE=5,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:55.871920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.878956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:55.880194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:55.883358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.781856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:56.797866 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e78e73b1-7929-49d6-b45c-345f9f3f6819 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 0.943285 Jul 14 14:35:56.805340 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 112/214] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:55 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:56.854689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:56.861298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:56.953741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.962120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:56.982235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:56.983614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.428725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:35:57.838103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:57.844729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:57.871940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.876005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.879446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:57.882873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:57.926597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:57.978790 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b074ff7b-35d4-437e-bfd5-e37ae25ab951 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1487 microversion: 2.1 time: 1.140978 Jul 14 14:35:57.985046 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 103/215] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:56 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1487 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:35:58.014148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:58.018726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:35:58.031823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.032985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.034989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:35:58.036190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:35:58.571664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:35:58.597858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c007d03-d459-4fa8-86b3-0f2febddb556 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 0.767071 Jul 14 14:35:58.611318 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 113/216] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:57 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:35:59.458058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-762ca570-6e7f-4f38-a7da-23a312c8e3ce tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-961187817", "ram": 512, "vcpus": 1, "disk": 10, "id": 1638173698, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:35:59.462260 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:35:59.462260 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:35:59.490824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-762ca570-6e7f-4f38-a7da-23a312c8e3ce tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.886565 Jul 14 14:35:59.495748 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 114/217] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:35:58 2022] POST /compute/v2.1/flavors => generated 415 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:35:59.917456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19b7ce2a-7354-4836-adec-0d0d8b02cbab tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.935696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-19b7ce2a-7354-4836-adec-0d0d8b02cbab tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] HTTP exception thrown: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19b7ce2a-7354-4836-adec-0d0d8b02cbab tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Request method failure captured: Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/flavors/1638173698/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnLSnusXqh7c0AdupYMKRruA_WYIByYWs6bh5x3ajuKuxP5KC835albKkoXpsO_C9Jllve6z8f6MvDtXZ3MMK3sp--bKAj_JBVFH7zmV1zG9G3h_GTZKsOL_PwcU8dxtQSWD6coRfyRUxDk2AU_bpPTyiRfbFL0r4zLH5b6k88nhr8 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:35:59.937585 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a9cd2138240b448588764fa7c372209b Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:35:59.939173 n-d-768852-23 devstack@n-api.service[125965]: exception: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '1638173698', 'id': 'hw:cpu_thread_policy'} Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:35:59.940004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:35:59.941644 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:35:59.950641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19b7ce2a-7354-4836-adec-0d0d8b02cbab tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Returning 404 to user: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:35:59.951796 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-19b7ce2a-7354-4836-adec-0d0d8b02cbab tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] 10.222.0.98 "GET /compute/v2.1/flavors/1638173698/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.446734 Jul 14 14:35:59.953652 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 115/218] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/flavors/1638173698/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:35:59.970236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:35:59.972660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.010227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.012301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.015070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.020332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.056299 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-298bac9d-4a4c-41b9-a28c-e1bd14f24797 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1640 microversion: 2.1 time: 2.049962 Jul 14 14:36:00.071824 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 104/219] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:58 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1640 bytes in 2067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:00.080493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-fc896509-eed2-4cd3-8119-e5cae4a5fa8b req-0e14b113-de4d-492b-8508-2243fdd82e00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859ce988-fadf-44f6-b941-5639f6ccd35f", "name": "network-vif-plugged", "status": "completed", "tag": "f5e94c64-02eb-45cc-b797-b9eae480e80a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:00.094638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fc896509-eed2-4cd3-8119-e5cae4a5fa8b req-0e14b113-de4d-492b-8508-2243fdd82e00 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.099051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fc896509-eed2-4cd3-8119-e5cae4a5fa8b req-0e14b113-de4d-492b-8508-2243fdd82e00 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.118531 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fc896509-eed2-4cd3-8119-e5cae4a5fa8b req-0e14b113-de4d-492b-8508-2243fdd82e00 service nova] Creating event network-vif-plugged:f5e94c64-02eb-45cc-b797-b9eae480e80a for instance 859ce988-fadf-44f6-b941-5639f6ccd35f on n-h2-768852-23 Jul 14 14:36:00.128229 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-fc896509-eed2-4cd3-8119-e5cae4a5fa8b req-0e14b113-de4d-492b-8508-2243fdd82e00 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054860 Jul 14 14:36:00.130259 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 105/220] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:00.137030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d7e6b18-1cff-4495-a274-bde17f7e2e40 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:00.138960 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:00.138960 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:00.141317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d7e6b18-1cff-4495-a274-bde17f7e2e40 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a9cd2138240b448588764fa7c372209b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6b7871fcf4df79a177aba661ea860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d7e6b18-1cff-4495-a274-bde17f7e2e40 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Request method failure captured: Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/flavors/1638173698/os-extra_specs HTTP/1.1 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 66 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CnLSnusXqh7c0AdupYMKRruA_WYIByYWs6bh5x3ajuKuxP5KC835albKkoXpsO_C9Jllve6z8f6MvDtXZ3MMK3sp--bKAj_JBVFH7zmV1zG9G3h_GTZKsOL_PwcU8dxtQSWD6coRfyRUxDk2AU_bpPTyiRfbFL0r4zLH5b6k88nhr8 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:36:00.144349 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a9cd2138240b448588764fa7c372209b Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Jul 14 14:36:00.145481 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'flavor_id': '1638173698', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:36:00.146337 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Jul 14 14:36:00.147646 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.150746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d7e6b18-1cff-4495-a274-bde17f7e2e40 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:00.152058 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d7e6b18-1cff-4495-a274-bde17f7e2e40 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] 10.222.0.98 "POST /compute/v2.1/flavors/1638173698/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020115 Jul 14 14:36:00.159864 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 106/221] 10.222.0.98 () {60 vars in 1223 bytes} [Thu Jul 14 14:36:00 2022] POST /compute/v2.1/flavors/1638173698/os-extra_specs => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:00.166545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.168231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.181177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.182030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.183072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.184557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.228643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:00.472136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:00.665821 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7b9570e-be74-4814-b7c8-ec21c1583258 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "DELETE /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 204 len: 0 microversion: 2.1 time: 0.500461 Jul 14 14:36:00.667059 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 107/222] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:00 2022] DELETE /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:36:00.688175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38f5f033-cd8b-4794-bf45-12648c01911b tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:00.703677 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:00.703677 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:00.760272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:SAVEPOINT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:00.811353 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38f5f033-cd8b-4794-bf45-12648c01911b tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1638173698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.138919 Jul 14 14:36:00.812960 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 108/223] 10.222.0.98 () {60 vars in 1223 bytes} [Thu Jul 14 14:36:00 2022] POST /compute/v2.1/flavors/1638173698/os-extra_specs => generated 66 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:36:00.825651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.827179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:00.841443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.842552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.843687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.844509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:00.845360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:00.856835 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-585b8ab1-34c5-495f-857b-59e9b6ab70be tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 0.901735 Jul 14 14:36:00.864458 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 116/224] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:35:59 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:00.888899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2bdc622e-c66a-4b6e-8032-3b8b725327ac tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:00.890962 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:00.890962 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:00.900384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2bdc622e-c66a-4b6e-8032-3b8b725327ac tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a9cd2138240b448588764fa7c372209b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6b7871fcf4df79a177aba661ea860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2bdc622e-c66a-4b6e-8032-3b8b725327ac tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Request method failure captured: Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnLSnusXqh7c0AdupYMKRruA_WYIByYWs6bh5x3ajuKuxP5KC835albKkoXpsO_C9Jllve6z8f6MvDtXZ3MMK3sp--bKAj_JBVFH7zmV1zG9G3h_GTZKsOL_PwcU8dxtQSWD6coRfyRUxDk2AU_bpPTyiRfbFL0r4zLH5b6k88nhr8 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:36:00.903667 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a9cd2138240b448588764fa7c372209b Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:00.905339 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '1638173698', 'id': 'hw:numa_nodes'} Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:00.906193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Jul 14 14:36:00.907744 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:00.912152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2bdc622e-c66a-4b6e-8032-3b8b725327ac tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:00.914224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2bdc622e-c66a-4b6e-8032-3b8b725327ac tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] 10.222.0.98 "DELETE /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.045418 Jul 14 14:36:00.917785 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 117/225] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:36:00 2022] DELETE /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes => generated 124 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:00.935113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f88dff7d-b596-43f3-8b9c-7182b28579dd tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:00.943917 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:00.943917 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:01.028009 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f88dff7d-b596-43f3-8b9c-7182b28579dd tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors/1638173698/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.102736 Jul 14 14:36:01.033764 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 118/226] 10.222.0.98 () {60 vars in 1223 bytes} [Thu Jul 14 14:36:00 2022] POST /compute/v2.1/flavors/1638173698/os-extra_specs => generated 66 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:36:01.043957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f91754d-8b55-4909-b35c-2b2871c87091 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:01.045362 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:01.045362 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:01.046675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0f91754d-8b55-4909-b35c-2b2871c87091 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a9cd2138240b448588764fa7c372209b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1af6b7871fcf4df79a177aba661ea860', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f91754d-8b55-4909-b35c-2b2871c87091 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Request method failure captured: Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 22 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnLSnusXqh7c0AdupYMKRruA_WYIByYWs6bh5x3ajuKuxP5KC835albKkoXpsO_C9Jllve6z8f6MvDtXZ3MMK3sp--bKAj_JBVFH7zmV1zG9G3h_GTZKsOL_PwcU8dxtQSWD6coRfyRUxDk2AU_bpPTyiRfbFL0r4zLH5b6k88nhr8 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:36:01.048658 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1af6b7871fcf4df79a177aba661ea860"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1af6b7871fcf4df79a177aba661ea860 Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a9cd2138240b448588764fa7c372209b Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: {"hw:numa_nodes": "1"} Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:01.050266 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '1638173698', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:01.050962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Jul 14 14:36:01.052544 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.059197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f91754d-8b55-4909-b35c-2b2871c87091 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:01.076675 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f91754d-8b55-4909-b35c-2b2871c87091 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071 tempest-FlavorsExtraSpecsNegativeTestJSON-1613885071-project] 10.222.0.98 "PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.036816 Jul 14 14:36:01.077256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 119/227] 10.222.0.98 () {60 vars in 1264 bytes} [Thu Jul 14 14:36:01 2022] PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:36:01.139020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d821be38-1a23-4f13-a103-88fa80f0417a tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.181544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d821be38-1a23-4f13-a103-88fa80f0417a tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] HTTP exception thrown: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d821be38-1a23-4f13-a103-88fa80f0417a tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Request method failure captured: Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/flavors/1638173698/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnNmlikzWz1ysHmHMj3OuoN71kNvnK7jnr5agNC3P32EE0WvjaPi5Ja2hK0Mv4OPUBmpQFp-l18NkEgQduArv4PUxAnKdgKKNeXvuLiOQAJwvIcfEq3ciU3ZpQ2M_pXmdfFyzXVQeSqA9ED6PNjXo1b9HAfjFmKyTasqjnSxq9s8Xs Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 799dc90bf7044769839dcdd9b59b234e Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:36:01.188967 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 799dc90bf7044769839dcdd9b59b234e Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: d469489a18ed4f92808a3738f2a3b1d0 Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:01.191546 n-d-768852-23 devstack@n-api.service[125965]: exception: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '1638173698', 'id': 'hw:cpu_thread_policy'} Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:01.192805 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. Jul 14 14:36:01.196064 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.204332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d821be38-1a23-4f13-a103-88fa80f0417a tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Returning 404 to user: Flavor 1638173698 has no extra specs with key hw:cpu_thread_policy. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:01.211084 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d821be38-1a23-4f13-a103-88fa80f0417a tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1638173698/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.109590 Jul 14 14:36:01.216066 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 120/228] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:01 2022] DELETE /compute/v2.1/flavors/1638173698/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:01.233490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9da22c68-bf4b-47af-8f47-b7cf76f36347 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:01.238085 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-9da22c68-bf4b-47af-8f47-b7cf76f36347 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] HTTP exception thrown: Request body and URI mismatch Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9da22c68-bf4b-47af-8f47-b7cf76f36347 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Request method failure captured: Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 27 Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnNmlikzWz1ysHmHMj3OuoN71kNvnK7jnr5agNC3P32EE0WvjaPi5Ja2hK0Mv4OPUBmpQFp-l18NkEgQduArv4PUxAnKdgKKNeXvuLiOQAJwvIcfEq3ciU3ZpQ2M_pXmdfFyzXVQeSqA9ED6PNjXo1b9HAfjFmKyTasqjnSxq9s8Xs Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 799dc90bf7044769839dcdd9b59b234e Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:36:01.272835 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 799dc90bf7044769839dcdd9b59b234e Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: d469489a18ed4f92808a3738f2a3b1d0 Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: {"hw:cpu_policy": "shared"} Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:01.275488 n-d-768852-23 devstack@n-api.service[125965]: exception: Request body and URI mismatch Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '1638173698', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.277223 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.278978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:01.278978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:01.278978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Jul 14 14:36:01.278978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.289590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9da22c68-bf4b-47af-8f47-b7cf76f36347 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:01.291547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9da22c68-bf4b-47af-8f47-b7cf76f36347 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.066141 Jul 14 14:36:01.292797 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 121/229] 10.222.0.98 () {60 vars in 1264 bytes} [Thu Jul 14 14:36:01 2022] PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes => generated 73 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:36:01.313529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b06ec7b-a441-4b70-ab78-a2a46b966d1d tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b06ec7b-a441-4b70-ab78-a2a46b966d1d tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Request method failure captured: Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes HTTP/1.1 Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 49 Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnNmlikzWz1ysHmHMj3OuoN71kNvnK7jnr5agNC3P32EE0WvjaPi5Ja2hK0Mv4OPUBmpQFp-l18NkEgQduArv4PUxAnKdgKKNeXvuLiOQAJwvIcfEq3ciU3ZpQ2M_pXmdfFyzXVQeSqA9ED6PNjXo1b9HAfjFmKyTasqjnSxq9s8Xs Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 799dc90bf7044769839dcdd9b59b234e Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:36:01.329215 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/799dc90bf7044769839dcdd9b59b234e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 799dc90bf7044769839dcdd9b59b234e Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: d469489a18ed4f92808a3738f2a3b1d0 Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Jul 14 14:36:01.331325 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'flavor_id': '1638173698', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': ['string', Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'number']}}, Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance: Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Jul 14 14:36:01.332640 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.335073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:01.337715 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:01.337715 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:01.337715 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:36:01.337715 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:36:01.337715 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Jul 14 14:36:01.337715 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:01.345793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b06ec7b-a441-4b70-ab78-a2a46b966d1d tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:01.345793 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b06ec7b-a441-4b70-ab78-a2a46b966d1d tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.039507 Jul 14 14:36:01.352080 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 122/230] 10.222.0.98 () {60 vars in 1264 bytes} [Thu Jul 14 14:36:01 2022] PUT /compute/v2.1/flavors/1638173698/os-extra_specs/hw:numa_nodes => generated 117 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:36:01.377301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10dc3564-badb-4ed5-bdb2-59765644cc28 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.379183 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:01.379183 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:01.421971 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10dc3564-badb-4ed5-bdb2-59765644cc28 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1638173698" status: 202 len: 0 microversion: 2.1 time: 0.066341 Jul 14 14:36:01.427095 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 123/231] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:36:01 2022] DELETE /compute/v2.1/flavors/1638173698 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:36:01.442477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80f93839-f744-4aed-844e-8f43bc7d1b44 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.505319 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80f93839-f744-4aed-844e-8f43bc7d1b44 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539 tempest-FlavorsExtraSpecsNegativeTestJSON-2018963539-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.074203 Jul 14 14:36:01.506338 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 124/232] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:36:01 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:01.884777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:01.886156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:01.895973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.900750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:01.902171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:01.905463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:02.550509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:02.574729 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70fcc8a5-d68f-4142-ab8c-4c96cd3a23c1 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1493 microversion: 2.1 time: 1.759520 Jul 14 14:36:02.588130 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 109/233] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:00 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1493 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:03.285889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:03.337233 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5164a062-338e-45de-99e5-862fbf588a77 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1317 microversion: 2.1 time: 1.454996 Jul 14 14:36:03.339307 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 125/234] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:01 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1317 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:03.606991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:03.608143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:03.635587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.642487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:03.650886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:03.653349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.373445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:04.374628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:04.416548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.429935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.434742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:04.439397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:04.974862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:04.989390 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a057634e-a4b3-4f74-a77e-23ee7c534076 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1493 microversion: 2.1 time: 1.388332 Jul 14 14:36:05.005707 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 110/235] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:03 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1493 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:05.809927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:05.874918 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1dbc3af9-e156-46a6-9593-1e6b450dbea7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1466 microversion: 2.1 time: 1.510116 Jul 14 14:36:05.883439 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 126/236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:04 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1466 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:06.023301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:06.027890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:06.073648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.074582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.080684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:06.084228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:06.969303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a876582ed4d94e9da876592597aa1c06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e3e2e4d114865804976a40c6cac55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:07.095731 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dfbd2690-da93-40ea-83f4-45bb10bb1c7f tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 200 len: 1451 microversion: 2.1 time: 1.071196 Jul 14 14:36:07.108795 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 127/237] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:06 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 1451 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:07.171538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-70d23fd2-6899-41fd-862f-24b2ab69f3ca req-6f2de712-827f-4c80-b569-24740eebe7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38dd8dab-42b8-49a8-a534-17f8f6412910", "name": "network-vif-deleted", "tag": "963a2ea5-9ce6-41e2-8268-421b027fb8c4"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:07.234564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-70d23fd2-6899-41fd-862f-24b2ab69f3ca req-6f2de712-827f-4c80-b569-24740eebe7e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.235026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-70d23fd2-6899-41fd-862f-24b2ab69f3ca req-6f2de712-827f-4c80-b569-24740eebe7e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.299194 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-70d23fd2-6899-41fd-862f-24b2ab69f3ca req-6f2de712-827f-4c80-b569-24740eebe7e8 service nova] Creating event network-vif-deleted:963a2ea5-9ce6-41e2-8268-421b027fb8c4 for instance 38dd8dab-42b8-49a8-a534-17f8f6412910 on n-h1-768852-23 Jul 14 14:36:07.326372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-70d23fd2-6899-41fd-862f-24b2ab69f3ca req-6f2de712-827f-4c80-b569-24740eebe7e8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213398 Jul 14 14:36:07.327522 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 128/238] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:07.547901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:07.554329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:07.596476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.602368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:07.607818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:07.611407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.137102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:08.140508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:08.202167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.205365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.216499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:08.220354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:08.329801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] HTTP exception thrown: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Request method failure captured: Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 HTTP/1.1 Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmYG4Pe3ypXUdC2SmRokAE_3j-2FBuf8B3LFnrvPqHgFUuwAPgDLpbYlWH5nIxKO0bfGMeHUnpKkBl9WgFMRF3sQUsUk_K0bpuB56HAwasjdge6KWtZRHcLHFrKxJfIDl7z-72j8TFK1kz_oG0hx8puMnBGXhWSXV0yyMcxXwelypY Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4e1e3e2e4d114865804976a40c6cac55 Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:36:08.361802 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4e1e3e2e4d114865804976a40c6cac55 Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminTestJSON-466791402-project Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a876582ed4d94e9da876592597aa1c06 Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminTestJSON-466791402-project Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:08.364328 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '38dd8dab-42b8-49a8-a534-17f8f6412910'} Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:08.366510 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:08.369437 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:08.371301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Returning 404 to user: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:08.379598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8959a35c-beae-4d4c-b3c0-56cbdedc778d tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 404 len: 111 microversion: 2.1 time: 0.255541 Jul 14 14:36:08.381040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 129/239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:08 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 111 bytes in 259 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:09.157625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d40ad96-ad55-460c-a1fc-0007230bb9aa tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf3ac1820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.159881 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:09.159881 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:09.161514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d40ad96-ad55-460c-a1fc-0007230bb9aa tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.163189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d40ad96-ad55-460c-a1fc-0007230bb9aa tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.164845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d40ad96-ad55-460c-a1fc-0007230bb9aa tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.165909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d40ad96-ad55-460c-a1fc-0007230bb9aa tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.236545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d40ad96-ad55-460c-a1fc-0007230bb9aa tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.853986 Jul 14 14:36:09.237185 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 130/240] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:36:08 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:09.242385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-645158ff-b124-4d4d-8d96-f2e094e66086 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:09.244286 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:09.244286 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:09.258448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-645158ff-b124-4d4d-8d96-f2e094e66086 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.258894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-645158ff-b124-4d4d-8d96-f2e094e66086 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.425799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8856761-9d31-493d-9487-d16727d96867 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1619 microversion: 2.1 time: 3.521293 Jul 14 14:36:09.428658 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 111/241] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:05 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1619 bytes in 3525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:09.484944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-645158ff-b124-4d4d-8d96-f2e094e66086 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 300 microversion: 2.1 time: 0.246171 Jul 14 14:36:09.488228 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 131/242] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:36:09 2022] POST /compute/v2.1/os-aggregates/5/action => generated 300 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:09.508891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-feaf07b9-e1bf-4e3d-934b-1ff3560ffc56 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf3ac14c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:09.511977 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:09.511977 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:09.516492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feaf07b9-e1bf-4e3d-934b-1ff3560ffc56 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.517406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feaf07b9-e1bf-4e3d-934b-1ff3560ffc56 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.519420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feaf07b9-e1bf-4e3d-934b-1ff3560ffc56 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:09.521135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feaf07b9-e1bf-4e3d-934b-1ff3560ffc56 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:09.594419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-feaf07b9-e1bf-4e3d-934b-1ff3560ffc56 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.103783 Jul 14 14:36:09.595896 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 132/243] 10.222.0.98 () {58 vars in 1138 bytes} [Thu Jul 14 14:36:09 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:09.617746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b24823a2-b0ac-4e29-a39c-4bc6894c9577 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: .version_select at 0x7fdbf3b1eca0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-881845033", "policies": ["affinity"]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:09.776607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b24823a2-b0ac-4e29-a39c-4bc6894c9577 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:09.813106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b24823a2-b0ac-4e29-a39c-4bc6894c9577 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:10.093938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b24823a2-b0ac-4e29-a39c-4bc6894c9577 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:10.106238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b24823a2-b0ac-4e29-a39c-4bc6894c9577 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:10.111712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8125f59-c2bc-470e-9163-67ccf5269f72 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Action: 'create', calling method: .version_select at 0x7fdbf3bdb790>, body: {"keypair": {"name": "tempest-keypair-1913703295", "type": "ssh", "user_id": "a3cdaa06f78d4905a825ba969be0784c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwGmpHQ9MTu8GQtFVzm9CKyRaPV3iiP2Zvby5jhp5lPDUOdsc/VR+mVyxtx91sEgau0vBctglJhHZy7HCIZK2onjsrMUUooGBV3VAPBv9Bpn9OxAvfmQIvrxWzkL13svQ=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.133620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b24823a2-b0ac-4e29-a39c-4bc6894c9577 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.527896 Jul 14 14:36:10.134239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 133/244] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:36:09 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:10.154738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-09d5eed8-602d-4f8d-af87-9d1e550ec468 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.155597 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:10.155597 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:10.177469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d8125f59-c2bc-470e-9163-67ccf5269f72 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Getting quotas for project 91cb4b19113a426c82c7f40900b69e35. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:10.191726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d8125f59-c2bc-470e-9163-67ccf5269f72 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Getting quotas for user 81cd9d0b9d3744cc9d5da869109ba6eb and project 91cb4b19113a426c82c7f40900b69e35. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:10.227616 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-09d5eed8-602d-4f8d-af87-9d1e550ec468 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.080206 Jul 14 14:36:10.237352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 134/245] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:10.247114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63142abf-9140-4c50-b7ab-af3f45d955a3 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf3db61f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.255347 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:10.255347 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:10.258158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63142abf-9140-4c50-b7ab-af3f45d955a3 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.260879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63142abf-9140-4c50-b7ab-af3f45d955a3 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.263328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63142abf-9140-4c50-b7ab-af3f45d955a3 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.264482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63142abf-9140-4c50-b7ab-af3f45d955a3 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.279774 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8125f59-c2bc-470e-9163-67ccf5269f72 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.847802 Jul 14 14:36:10.290830 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 112/246] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:36:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 861 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:36:10.301421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4bc77d2e-33a1-40af-aa41-fda78ccf29c3 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-101634909"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.305375 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:10.305375 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:10.309885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-4bc77d2e-33a1-40af-aa41-fda78ccf29c3 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 5cd9bf96-55e6-4b85-8eaa-50449e1717cc for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:10.331540 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63142abf-9140-4c50-b7ab-af3f45d955a3 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.088660 Jul 14 14:36:10.334422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 135/247] 10.222.0.98 () {58 vars in 1144 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:36:10.356119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7d0f5e0-5f76-4694-87cf-36de2fea0ec9 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Action: 'create', calling method: .version_select at 0x7fdbf3ad5f70>, body: {"keypair": {"name": "tempest-keypair-1402970504", "type": "ssh", "user_id": "a3cdaa06f78d4905a825ba969be0784c", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQmWXkzR8RhUmNIxHKPCB4VXCbzXW3DWZgoYv7u60BOGsebb4PVuaYJeMvc+HVhVMv3fD8TN9NkgGcK4UXTvoywmonLAjdmRrgGme/INJIGyx53poJWWRqLBbMVfE2iJw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.366135 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4bc77d2e-33a1-40af-aa41-fda78ccf29c3 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.072244 Jul 14 14:36:10.369179 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 113/248] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:10.384924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77cb49fa-1ee7-42fb-b360-fa4d88071934 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.387915 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:10.387915 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:10.418067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a7d0f5e0-5f76-4694-87cf-36de2fea0ec9 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Getting quotas for project 91cb4b19113a426c82c7f40900b69e35. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:10.419164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77cb49fa-1ee7-42fb-b360-fa4d88071934 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.419923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77cb49fa-1ee7-42fb-b360-fa4d88071934 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:10.423029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:10.432674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a7d0f5e0-5f76-4694-87cf-36de2fea0ec9 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Getting quotas for user 81cd9d0b9d3744cc9d5da869109ba6eb and project 91cb4b19113a426c82c7f40900b69e35. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:10.531332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7d0f5e0-5f76-4694-87cf-36de2fea0ec9 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.194257 Jul 14 14:36:10.532887 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 136/249] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 197 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:36:10.538568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1690215834", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0937d67c-8842-4a46-9ce2-18fb43d96910"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.640011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77cb49fa-1ee7-42fb-b360-fa4d88071934 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.261448 Jul 14 14:36:10.642126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 114/250] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:10.650687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:10.654246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-82e40416-bc0e-40c3-877a-2e2ccf5a11f9 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Calling method '.version_select at 0x7fdbf39808b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:10.677293 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-82e40416-bc0e-40c3-877a-2e2ccf5a11f9 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "GET /compute/v2.1/os-keypairs/tempest-keypair-1913703295?user_id=a3cdaa06f78d4905a825ba969be0784c" status: 200 len: 512 microversion: 2.10 time: 0.033375 Jul 14 14:36:10.678959 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 115/251] 10.222.0.98 () {60 vars in 1339 bytes} [Thu Jul 14 14:36:10 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1913703295?user_id=a3cdaa06f78d4905a825ba969be0784c => generated 512 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:36:10.692528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b69ea82-33af-45b4-9714-d9fd388d0896 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.695434 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:10.695434 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:10.697057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b69ea82-33af-45b4-9714-d9fd388d0896 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '514824382c1f44c3a4cb77582c04c14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95e6cb6b271e40129098cf47adfb06e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b69ea82-33af-45b4-9714-d9fd388d0896 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Request method failure captured: Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-aggregates/9/action HTTP/1.1 Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 43 Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmYyOl1QA1i0VOdqHkgFjf9StlnYKcraDKDUbDXvglSHnAGeVJuTtJqb3JUsVVanCpSEO4LLbjA6bfWyYCGAN6o6YW1Sx9nc8rJ6l77FkVs6wrjxlZSCsiVdfFP7HYZ7TLFad1H-qvSVczWv-y5b8EfiLLyjp8zbL3D9H0X0N3Rt6s Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:36:10.699850 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95e6cb6b271e40129098cf47adfb06e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95e6cb6b271e40129098cf47adfb06e2 Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503 Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 514824382c1f44c3a4cb77582c04c14e Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1970767503-project Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: {"remove_host": {"host": "n-h1-768852-23"}} Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:36:10.701213 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9', 'body': {'remove_host': {'host': 'n-h1-768852-23'}}} Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:10.702032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Jul 14 14:36:10.703181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:10.707414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b69ea82-33af-45b4-9714-d9fd388d0896 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:10.709265 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b69ea82-33af-45b4-9714-d9fd388d0896 tempest-AggregatesAdminNegativeTestJSON-1970767503 tempest-AggregatesAdminNegativeTestJSON-1970767503-project] 10.222.0.98 "POST /compute/v2.1/os-aggregates/9/action" status: 403 len: 121 microversion: 2.1 time: 0.028777 Jul 14 14:36:10.711380 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 116/252] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/os-aggregates/9/action => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:36:10.718245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18edf421-3929-41eb-969c-65cd381d8485 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Action: 'create', calling method: .version_select at 0x7fdbf3980ca0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1538470347", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7+Hv5uwcHYKc1royeQQE9eP6m4V+kbpvi8ybjctJLUAEyUgS8ZMiavffXj5ZoRhpmU+37LW6fWgzx6DllnmocNET/mQEppamDX9dYCWnCVGEREMSk6aLVxqB+UxCI1qw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.740376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-18edf421-3929-41eb-969c-65cd381d8485 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Getting quotas for project 91cb4b19113a426c82c7f40900b69e35. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:10.747521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-18edf421-3929-41eb-969c-65cd381d8485 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Getting quotas for user 81cd9d0b9d3744cc9d5da869109ba6eb and project 91cb4b19113a426c82c7f40900b69e35. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:10.796337 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18edf421-3929-41eb-969c-65cd381d8485 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.082021 Jul 14 14:36:10.800654 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 117/253] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:36:10.825697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-30843d80-d27c-4c5c-ac8b-b2fb300f5105 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:10.842352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30843d80-d27c-4c5c-ac8b-b2fb300f5105 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:10.844269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30843d80-d27c-4c5c-ac8b-b2fb300f5105 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.068186 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-30843d80-d27c-4c5c-ac8b-b2fb300f5105 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 226 microversion: 2.1 time: 0.263644 Jul 14 14:36:11.082248 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 118/254] 10.222.0.98 () {60 vars in 1190 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/os-aggregates/9/action => generated 226 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:11.090847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0bd786e8-679d-4fab-9948-d9aebbd54b22 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Calling method '.version_select at 0x7fdbf3980040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.100549 n-d-768852-23 devstack@n-api.service[125966]: WARNING oslo_db.sqlalchemy.utils [None req-0bd786e8-679d-4fab-9948-d9aebbd54b22 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:36:11.119498 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0bd786e8-679d-4fab-9948-d9aebbd54b22 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "GET /compute/v2.1/os-keypairs?user_id=a3cdaa06f78d4905a825ba969be0784c" status: 200 len: 726 microversion: 2.10 time: 0.042951 Jul 14 14:36:11.128850 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 119/255] 10.222.0.98 () {60 vars in 1258 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/os-keypairs?user_id=a3cdaa06f78d4905a825ba969be0784c => generated 726 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:36:11.139863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18bedf85-5e98-4f8e-9e76-0d53d33ab260 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.143549 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:11.143549 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:11.227864 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18bedf85-5e98-4f8e-9e76-0d53d33ab260 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.096798 Jul 14 14:36:11.233529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 120/256] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:11 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:11.283880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6f6360bf-ec32-4fc8-a03c-b811c400b7d5 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Calling method '.version_select at 0x7fdbf3ad79d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.383140 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6f6360bf-ec32-4fc8-a03c-b811c400b7d5 tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1538470347" status: 204 len: 0 microversion: 2.10 time: 0.147596 Jul 14 14:36:11.384095 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 121/257] 10.222.0.98 () {60 vars in 1324 bytes} [Thu Jul 14 14:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1538470347 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:36:11.408701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50ab1854-68a0-40b9-ba6f-75a0a053607b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2073883764"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:11.411798 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:11.411798 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:11.416176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-50ab1854-68a0-40b9-ba6f-75a0a053607b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Generated uuid 3b320fee-3e88-498a-9043-240a3be8021b for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:11.467872 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50ab1854-68a0-40b9-ba6f-75a0a053607b tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.082260 Jul 14 14:36:11.469599 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 122/258] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:11.474897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:11.476742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:11.477491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:11.478124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:11.478791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:11.497173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b70edce5-999e-408f-91bb-49e2cb30d775 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdc0237f670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.502992 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:11.502992 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:11.509211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70edce5-999e-408f-91bb-49e2cb30d775 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.515231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70edce5-999e-408f-91bb-49e2cb30d775 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.520556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70edce5-999e-408f-91bb-49e2cb30d775 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.521231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70edce5-999e-408f-91bb-49e2cb30d775 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.583229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.587456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.590704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.591173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.666656 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b70edce5-999e-408f-91bb-49e2cb30d775 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.180073 Jul 14 14:36:11.678623 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 123/259] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:11.696077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a2888e5-0ea6-4c4d-ab5c-8fa78526573a tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Calling method '.version_select at 0x7fdbf39b2040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.725059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:11.750585 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0a2888e5-0ea6-4c4d-ab5c-8fa78526573a tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402970504?user_id=a3cdaa06f78d4905a825ba969be0784c" status: 204 len: 0 microversion: 2.10 time: 0.068280 Jul 14 14:36:11.753412 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 124/260] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:36:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1402970504?user_id=a3cdaa06f78d4905a825ba969be0784c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:36:11.760734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:11.762918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:11.778684 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:11.778684 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:11.813913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.813913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.822116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Going to run 2 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:11.835854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:11.882434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.887498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.924051 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.compute.aggregates [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Failed to remove host nonexist_host from aggregate 10. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 14 14:36:11.924742 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 10 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Request method failure captured: Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-aggregates/10/action HTTP/1.1 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 42 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmbbll2MmSCq9qoHb3XFxVohPLXOIPEbbd7RUl222AXghDxU5_9jkR1z3lujwOKmz1RTVRUJYOTD7TLc5t6Mw6m0KjbawByb4E1a45bPRgQ9iXNXdvpwlAVGt7Pk5wKI07aggn5dt60otqLEB1NW3-Ob_hSC76C0rZmVRF_oreOB1I Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:36:11.936964 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e17d7a3778d741e481f5a85e2e89f099"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e17d7a3778d741e481f5a85e2e89f099 Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-528605981 Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 36043899ed164e7489b8d8d25b27c802 Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: {"remove_host": {"host": "nonexist_host"}} Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:36:11.939726 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot remove host nonexist_host in aggregate 10 Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '10', 'body': {'remove_host': {'host': 'nonexist_host'}}} Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5868, in _get_service_in_cell_by_host Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5874, in _get_service_in_cell_by_host Jul 14 14:36:11.941856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6555, in remove_host_from_aggregate Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Jul 14 14:36:11.945636 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5876, in _get_service_in_cell_by_host Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 10 Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.950502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 10 Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 10 {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25875423-a0bb-4926-8c90-dcde0637e1da tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/10/action" status: 404 len: 94 microversion: 2.1 time: 0.186890 Jul 14 14:36:11.955676 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 125/261] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:11 2022] POST /compute/v2.1/os-aggregates/10/action => generated 94 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:11.970485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3aa37462-4f6c-4af0-9e97-969c1eae4daf tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf39b2160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:11.980567 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:11.980567 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:11.989263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3aa37462-4f6c-4af0-9e97-969c1eae4daf tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.990097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3aa37462-4f6c-4af0-9e97-969c1eae4daf tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:11.995728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3aa37462-4f6c-4af0-9e97-969c1eae4daf tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:11.997514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3aa37462-4f6c-4af0-9e97-969c1eae4daf tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.027452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125965) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 14 14:36:12.099411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:12.114926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:12.134255 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3aa37462-4f6c-4af0-9e97-969c1eae4daf tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.183522 Jul 14 14:36:12.146375 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 126/262] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:11 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:12.160673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f95a20d7-370e-4c2a-966b-b60365c2022d tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] Calling method '.version_select at 0x7fdc0237fb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.220593 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f95a20d7-370e-4c2a-966b-b60365c2022d tempest-KeyPairsV210TestJSON-1983921569 tempest-KeyPairsV210TestJSON-1983921569-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913703295?user_id=a3cdaa06f78d4905a825ba969be0784c" status: 204 len: 0 microversion: 2.10 time: 0.072148 Jul 14 14:36:12.225875 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 127/263] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:36:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913703295?user_id=a3cdaa06f78d4905a825ba969be0784c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:36:12.270055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a4916fe-a66b-4bcc-84aa-6403b76d0631 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.272065 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:12.272065 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:12.320884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:12.341905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:12.386719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a4916fe-a66b-4bcc-84aa-6403b76d0631 tempest-AggregatesAdminNegativeTestJSON-528605981 tempest-AggregatesAdminNegativeTestJSON-528605981-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.155347 Jul 14 14:36:12.392296 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 128/264] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:12 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:12.412182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=8ae7517a-302c-4bad-91ab-8df53f487e52,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:12.420505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-35442d4b-ea71-4f7a-b9c8-a511912540f5 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf39b2ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.422910 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:12.422910 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:12.437664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35442d4b-ea71-4f7a-b9c8-a511912540f5 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.438439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35442d4b-ea71-4f7a-b9c8-a511912540f5 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.440007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35442d4b-ea71-4f7a-b9c8-a511912540f5 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.440803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35442d4b-ea71-4f7a-b9c8-a511912540f5 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.583688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:RELEASE=2,nova_api:SAVEPOINT=1,nova_api:INSERT=6,nova_api:SELECT=83,nova_api:DELETE=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:12.618370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:12.634061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:12.683643 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-35442d4b-ea71-4f7a-b9c8-a511912540f5 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.288780 Jul 14 14:36:12.702303 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 129/265] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:36:12 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:12.724317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bd6ece2f-be12-4981-9053-5a4378a4f2ac tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-446653531"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:12.733107 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:12.733107 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:12.740833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-bd6ece2f-be12-4981-9053-5a4378a4f2ac tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid e18dadea-cad4-40dd-a09b-ff29e3d01dba for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:12.770947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:12.796425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:12.831770 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bd6ece2f-be12-4981-9053-5a4378a4f2ac tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.127199 Jul 14 14:36:12.839582 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 130/266] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:12 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:12.847438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eed2d7fb-08b6-4c66-a281-843a55a3ae88 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf3a48dc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:12.859145 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:12.859145 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:12.873476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed2d7fb-08b6-4c66-a281-843a55a3ae88 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.874093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed2d7fb-08b6-4c66-a281-843a55a3ae88 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.877392 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ffdc54fc-590a-4ed7-8e9f-8d29c2975afc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.342440 Jul 14 14:36:12.886145 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 137/267] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:10 2022] POST /compute/v2.1/servers => generated 32 bytes in 2352 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:36:12.905764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-840cc217-7c9b-4d92-85fe-9abcfa8d25dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:12.909452 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:12.909452 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:12.925454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-840cc217-7c9b-4d92-85fe-9abcfa8d25dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.940321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-840cc217-7c9b-4d92-85fe-9abcfa8d25dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:12.951493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed2d7fb-08b6-4c66-a281-843a55a3ae88 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:12.956359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed2d7fb-08b6-4c66-a281-843a55a3ae88 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.012023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eed2d7fb-08b6-4c66-a281-843a55a3ae88 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts/n-h1-768852-23" status: 200 len: 335 microversion: 2.1 time: 0.167447 Jul 14 14:36:13.016290 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 131/268] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 14:36:12 2022] GET /compute/v2.1/os-hosts/n-h1-768852-23 => generated 335 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:13.037327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:13.061020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:13.067802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Searching by: {'deleted': False, 'project_id': 'c9f14b1548c547608944442a8a351e56'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:36:13.156227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.156526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.157800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.158454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.453388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:36:13.468378 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-840cc217-7c9b-4d92-85fe-9abcfa8d25dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.579566 Jul 14 14:36:13.469868 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 138/269] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:12 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:13.482561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3e71215-52a9-4016-ba1e-c9555cad4281 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Calling method '.version_select at 0x7fdbf3981ee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:13.486317 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:13.486317 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:13.517245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e71215-52a9-4016-ba1e-c9555cad4281 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.517870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e71215-52a9-4016-ba1e-c9555cad4281 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.536816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e71215-52a9-4016-ba1e-c9555cad4281 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.539030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e71215-52a9-4016-ba1e-c9555cad4281 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.633644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3e71215-52a9-4016-ba1e-c9555cad4281 tempest-HostsAdminTestJSON-195537784 tempest-HostsAdminTestJSON-195537784-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hosts/n-h2-768852-23" status: 200 len: 471 microversion: 2.1 time: 0.159839 Jul 14 14:36:13.639635 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 139/270] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 14:36:13 2022] GET /compute/v2.1/os-hosts/n-h2-768852-23 => generated 471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:13.645232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8374ef10-acb2-4521-af48-9514abc6c0aa tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:13.646523 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:13.646523 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:13.668177 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8374ef10-acb2-4521-af48-9514abc6c0aa tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/11" status: 200 len: 243 microversion: 2.1 time: 0.032033 Jul 14 14:36:13.669124 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 140/271] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:13 2022] GET /compute/v2.1/os-aggregates/11 => generated 243 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:13.698959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3111c553-0420-44d8-a23d-7644a810c057 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:13.700875 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:13.700875 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:13.725286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3111c553-0420-44d8-a23d-7644a810c057 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:13.726549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3111c553-0420-44d8-a23d-7644a810c057 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:13.851237 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-742cfd49-685f-4c31-ad8e-7427f9052e35 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.828648 Jul 14 14:36:13.852949 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 132/272] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:36:13 2022] GET /compute/v2.1/servers => generated 1004 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:13.868155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68ef2ae6-9998-4ba0-a589-f7cbe34a2c23 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:13.870478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68ef2ae6-9998-4ba0-a589-f7cbe34a2c23 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:14.073664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68ef2ae6-9998-4ba0-a589-f7cbe34a2c23 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:14.103793 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68ef2ae6-9998-4ba0-a589-f7cbe34a2c23 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1219 microversion: 2.1 time: 0.225093 Jul 14 14:36:14.103793 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 133/273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:13 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1219 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:14.411021 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3111c553-0420-44d8-a23d-7644a810c057 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.716487 Jul 14 14:36:14.420746 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 141/274] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:13 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:14.431168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de8be7d5-a942-4e6c-aad7-1314bdacaa25 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:14.432455 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:14.432455 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:14.494930 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de8be7d5-a942-4e6c-aad7-1314bdacaa25 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.068560 Jul 14 14:36:14.498767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 134/275] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:14 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:14.509994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6ef980a-7b61-491b-a318-fc886e3500a5 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-271885463"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:14.512439 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:14.512439 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:14.513561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-b6ef980a-7b61-491b-a318-fc886e3500a5 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid 2e137e68-f4a5-48f8-aceb-799471c6837c for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:14.527731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:14.604013 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6ef980a-7b61-491b-a318-fc886e3500a5 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.094441 Jul 14 14:36:14.604743 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 142/276] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:14.619018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e2349a2-56d7-44ce-b1de-87c7992b8fb1 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:14.623752 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:14.623752 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:14.657557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e2349a2-56d7-44ce-b1de-87c7992b8fb1 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:14.658556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e2349a2-56d7-44ce-b1de-87c7992b8fb1 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.051179 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e2349a2-56d7-44ce-b1de-87c7992b8fb1 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.439454 Jul 14 14:36:15.062955 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 135/277] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:14 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:15.068048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ec60453-9be9-4ba0-b3eb-fb58549045d2 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:15.069015 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:15.069015 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:15.123978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ec60453-9be9-4ba0-b3eb-fb58549045d2 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.052257 Jul 14 14:36:15.124640 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 143/278] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:36:15 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:15.138477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:15.139711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:15.141275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e8a0d57-40c7-4f56-9131-abddaf5752ba tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:15.165879 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:15.165879 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:15.189845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.190510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.192005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.192884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.204231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e8a0d57-40c7-4f56-9131-abddaf5752ba tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.204821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e8a0d57-40c7-4f56-9131-abddaf5752ba tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:15.506317 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e8a0d57-40c7-4f56-9131-abddaf5752ba tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 227 microversion: 2.1 time: 0.368903 Jul 14 14:36:15.507882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 144/279] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:15 2022] POST /compute/v2.1/os-aggregates/12/action => generated 227 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:15.592075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:15.607840 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-463dae9d-20a8-4690-b294-0e1ed38841dd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1223 microversion: 2.1 time: 0.487847 Jul 14 14:36:15.608856 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 136/280] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:15 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1223 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:15.614261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ad3efa7-3cda-4df1-98ca-c00b9f3ca625 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:15.618827 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:15.618827 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:15.671292 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ad3efa7-3cda-4df1-98ca-c00b9f3ca625 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.061076 Jul 14 14:36:15.675522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 137/281] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:15 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:15.683199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-787c86e7-c8e1-4fd8-a075-8fed79696a20 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1803461001"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:15.685367 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:15.685367 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:15.688335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-787c86e7-c8e1-4fd8-a075-8fed79696a20 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid aa375490-eb93-4719-9ec1-306d8850c99c for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:15.767916 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-787c86e7-c8e1-4fd8-a075-8fed79696a20 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.086732 Jul 14 14:36:15.778785 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 138/282] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:15 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:15.809095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ec1701f-b74c-441c-a2a5-a0b08021f8c9 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:15.815452 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:15.815452 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:15.858471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ec1701f-b74c-441c-a2a5-a0b08021f8c9 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:15.861083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ec1701f-b74c-441c-a2a5-a0b08021f8c9 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.086869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Calling method '.version_select at 0x7fdc02048ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.088637 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:16.088637 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:16.090057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.090510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.121867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.122320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.193235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.194382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.236153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.237645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.268549 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ec1701f-b74c-441c-a2a5-a0b08021f8c9 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 244 microversion: 2.1 time: 0.481174 Jul 14 14:36:16.271064 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 139/283] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:15 2022] POST /compute/v2.1/os-aggregates/13/action => generated 244 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:16.297180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c593bb7b-3ed7-476c-896a-06916fff8c25 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:16.301083 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:16.301083 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:16.312676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.313128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.332137 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-348d4e16-daf0-446d-8fbb-a20ecf0cd6c9 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1842 microversion: 2.53 time: 0.822327 Jul 14 14:36:16.334105 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 145/284] 10.222.0.98 () {60 vars in 1242 bytes} [Thu Jul 14 14:36:15 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1842 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:16.336762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c593bb7b-3ed7-476c-896a-06916fff8c25 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.337553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c593bb7b-3ed7-476c-896a-06916fff8c25 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.394839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Calling method '.version_select at 0x7fdbf3d73a60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.396458 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:16.396458 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:16.403051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.403768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.467551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.468109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.579539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.582408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.639609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.642752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.705377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c593bb7b-3ed7-476c-896a-06916fff8c25 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/13/action" status: 200 len: 228 microversion: 2.1 time: 0.421095 Jul 14 14:36:16.708087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 140/285] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:16 2022] POST /compute/v2.1/os-aggregates/13/action => generated 228 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:16.729416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.731411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:16.740185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.741322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.750181 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5afb231-4233-4e62-ac31-ee436ee06c7f tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.379529 Jul 14 14:36:16.751472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 146/286] 10.222.0.98 () {60 vars in 1221 bytes} [Thu Jul 14 14:36:16 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:36:16.758537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-899e340e-2984-48f0-b247-d4c5c75bb819 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.759852 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:16.759852 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:16.760390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.760850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.761650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.762094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.828173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-899e340e-2984-48f0-b247-d4c5c75bb819 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.072891 Jul 14 14:36:16.829500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 147/287] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:16 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:16.865630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c08d534-8ac2-42a3-9e0b-d8d7d7446821 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Calling method '.version_select at 0x7fdbf3d734c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:16.874388 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:16.874388 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:16.883012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c08d534-8ac2-42a3-9e0b-d8d7d7446821 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:16.888042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c08d534-8ac2-42a3-9e0b-d8d7d7446821 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:16.908621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:17.027807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:17.030581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c08d534-8ac2-42a3-9e0b-d8d7d7446821 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:17.033582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c08d534-8ac2-42a3-9e0b-d8d7d7446821 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:17.044052 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43f4d54f-58cd-442c-859e-603940483f36 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1279 microversion: 2.1 time: 0.332735 Jul 14 14:36:17.046121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 141/288] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:16 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1279 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:17.060667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8dbdeac-b782-491a-b178-52332bc244dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2032833253"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:17.063799 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.063799 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:17.067443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-f8dbdeac-b782-491a-b178-52332bc244dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid 93b2a166-7cd7-4b53-8b2e-36ea39abab0c for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:17.093719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c08d534-8ac2-42a3-9e0b-d8d7d7446821 tempest-HypervisorAdminV253TestBase-1966905853 tempest-HypervisorAdminV253TestBase-1966905853-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/3f636459-3b55-4b65-8d34-e78254f2c956" status: 200 len: 795 microversion: 2.53 time: 0.248785 Jul 14 14:36:17.094372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 148/289] 10.222.0.98 () {60 vars in 1297 bytes} [Thu Jul 14 14:36:16 2022] GET /compute/v2.1/os-hypervisors/3f636459-3b55-4b65-8d34-e78254f2c956 => generated 795 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:36:17.196955 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8dbdeac-b782-491a-b178-52332bc244dc tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.146196 Jul 14 14:36:17.212071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 142/290] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:17.218665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-476a917f-3813-4efd-a322-2447ba412f84 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.223391 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.223391 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:17.338018 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-476a917f-3813-4efd-a322-2447ba412f84 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.128157 Jul 14 14:36:17.362710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b41a702f-9931-4f3f-8a8d-a68b079d06a6 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.364233 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.364233 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:17.368084 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 149/291] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:17 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 14 14:36:17.402413 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b41a702f-9931-4f3f-8a8d-a68b079d06a6 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b41a702f-9931-4f3f-8a8d-a68b079d06a6 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Request method failure captured: Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmbs04572nBNFArujdjdPkN7oyNsBK-w9eLp2bm7VU-IT3d055lOxUVrtaf-8G624y5HBwMpxmcKaQx2Bd8sdad0U1cRjDEcshHLozHEK4jN7LA6K_0E84lY_RGMlbIo4WnW8_OambOvrGgIL9Wp9zH67BlFSzOYPurSk7KKVGXPsQ Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:36:17.409135 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b7e3c609731c4325ab021b29b7a5fce7 Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: exception: Aggregate 14 could not be found. Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '14'} Jul 14 14:36:17.410494 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.411221 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 14 14:36:17.412987 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.414481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b41a702f-9931-4f3f-8a8d-a68b079d06a6 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:17.428120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b41a702f-9931-4f3f-8a8d-a68b079d06a6 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.061700 Jul 14 14:36:17.449799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43f0383f-cee5-48fb-a165-61ec9e264a9f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.451751 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 143/292] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:17 2022] GET /compute/v2.1/os-aggregates/14 => generated 78 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:17.487111 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.487111 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:17.542456 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-43f0383f-cee5-48fb-a165-61ec9e264a9f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] HTTP exception thrown: Aggregate 14 could not be found. Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43f0383f-cee5-48fb-a165-61ec9e264a9f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Request method failure captured: Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-aggregates/14 HTTP/1.1 Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbs04572nBNFArujdjdPkN7oyNsBK-w9eLp2bm7VU-IT3d055lOxUVrtaf-8G624y5HBwMpxmcKaQx2Bd8sdad0U1cRjDEcshHLozHEK4jN7LA6K_0E84lY_RGMlbIo4WnW8_OambOvrGgIL9Wp9zH67BlFSzOYPurSk7KKVGXPsQ Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:36:17.544947 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b7e3c609731c4325ab021b29b7a5fce7 Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: exception: Aggregate 14 could not be found. Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '14'} Jul 14 14:36:17.546296 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:36:17.547015 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 14 could not be found. Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 14 could not be found. Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.548114 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 14 could not be found. Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43f0383f-cee5-48fb-a165-61ec9e264a9f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Returning 404 to user: Aggregate 14 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43f0383f-cee5-48fb-a165-61ec9e264a9f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/14" status: 404 len: 78 microversion: 2.1 time: 0.107823 Jul 14 14:36:17.549236 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 150/293] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:17 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 78 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:17.565471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ac2f81b-cce5-4c7b-abab-2f5b1e4eed84 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-5233711", "name": "tempest-test_aggregate-25250275"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:17.607865 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.607865 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:17.609729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-3ac2f81b-cce5-4c7b-abab-2f5b1e4eed84 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid 543ab667-fc39-474a-acb8-69dd8e9e89b0 for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:17.701507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ac2f81b-cce5-4c7b-abab-2f5b1e4eed84 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 218 microversion: 2.1 time: 0.144069 Jul 14 14:36:17.706700 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 144/294] 10.222.0.98 () {60 vars in 1164 bytes} [Thu Jul 14 14:36:17 2022] POST /compute/v2.1/os-aggregates => generated 218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:17.717592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d23d8f52-5daa-4232-866b-9167513773d4 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.775820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d23d8f52-5daa-4232-866b-9167513773d4 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.061288 Jul 14 14:36:17.776820 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 151/295] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:17.791808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff0db3b2-de7f-4dcb-b8af-c47d5c056a5e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.793569 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.793569 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:17.808807 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ff0db3b2-de7f-4dcb-b8af-c47d5c056a5e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff0db3b2-de7f-4dcb-b8af-c47d5c056a5e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Request method failure captured: Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cmbs04572nBNFArujdjdPkN7oyNsBK-w9eLp2bm7VU-IT3d055lOxUVrtaf-8G624y5HBwMpxmcKaQx2Bd8sdad0U1cRjDEcshHLozHEK4jN7LA6K_0E84lY_RGMlbIo4WnW8_OambOvrGgIL9Wp9zH67BlFSzOYPurSk7KKVGXPsQ Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:36:17.811098 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b7e3c609731c4325ab021b29b7a5fce7 Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: exception: Aggregate 15 could not be found. Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '15'} Jul 14 14:36:17.812401 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6336, in get_aggregate Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.813115 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Jul 14 14:36:17.814155 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.817612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff0db3b2-de7f-4dcb-b8af-c47d5c056a5e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:17.821608 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff0db3b2-de7f-4dcb-b8af-c47d5c056a5e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.034652 Jul 14 14:36:17.824399 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 145/296] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:17 2022] GET /compute/v2.1/os-aggregates/15 => generated 78 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:17.836044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c9b0f81-4809-4dd3-9e08-039960d2ab30 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.839571 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.839571 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:17.873104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-9c9b0f81-4809-4dd3-9e08-039960d2ab30 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] HTTP exception thrown: Aggregate 15 could not be found. Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c9b0f81-4809-4dd3-9e08-039960d2ab30 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Request method failure captured: Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cmbs04572nBNFArujdjdPkN7oyNsBK-w9eLp2bm7VU-IT3d055lOxUVrtaf-8G624y5HBwMpxmcKaQx2Bd8sdad0U1cRjDEcshHLozHEK4jN7LA6K_0E84lY_RGMlbIo4WnW8_OambOvrGgIL9Wp9zH67BlFSzOYPurSk7KKVGXPsQ Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:36:17.879418 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5f0d3e417558482f8ad745ca722d94ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5f0d3e417558482f8ad745ca722d94ff Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1309580781 Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b7e3c609731c4325ab021b29b7a5fce7 Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminTestJSON-1309580781-project-admin Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: exception: Aggregate 15 could not be found. Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '15'} Jul 14 14:36:17.880821 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6389, in delete_aggregate Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:36:17.881635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 15 could not be found. Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 15 could not be found. Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:17.883022 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:17.884215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:17.884215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:17.884215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:17.884215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 15 could not be found. Jul 14 14:36:17.884215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:17.888902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c9b0f81-4809-4dd3-9e08-039960d2ab30 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Returning 404 to user: Aggregate 15 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:17.890019 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c9b0f81-4809-4dd3-9e08-039960d2ab30 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/15" status: 404 len: 78 microversion: 2.1 time: 0.060000 Jul 14 14:36:17.891157 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 152/297] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:17 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 78 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:36:17.902853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81aad6c5-3e87-407e-8954-e730f7b6cf1c tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1046601816"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:17.904271 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.904271 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:17.905253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-81aad6c5-3e87-407e-8954-e730f7b6cf1c tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid e4830dbc-2260-4c4f-9e47-26c2a0d0fdcc for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:17.966263 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81aad6c5-3e87-407e-8954-e730f7b6cf1c tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.067036 Jul 14 14:36:17.967557 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 146/298] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:17 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:17.980176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c8e0f6d-c736-4f6b-a1ca-26e6d3b51240 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:17.981990 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:17.981990 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:17.997546 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c8e0f6d-c736-4f6b-a1ca-26e6d3b51240 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 228 microversion: 2.1 time: 0.023622 Jul 14 14:36:18.002534 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 153/299] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:17 2022] GET /compute/v2.1/os-aggregates/16 => generated 228 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:18.014679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ba601afd-c3eb-424a-be5a-a16f495e814f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:18.017084 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:18.017084 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:18.057865 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ba601afd-c3eb-424a-be5a-a16f495e814f tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/16/action" status: 200 len: 266 microversion: 2.1 time: 0.047438 Jul 14 14:36:18.059258 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 147/300] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 14:36:18 2022] POST /compute/v2.1/os-aggregates/16/action => generated 266 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:18.085052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5f9f43a8-e006-4b08-878e-11077615f53e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.089284 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:18.089284 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:18.120512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.124577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:18.131863 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5f9f43a8-e006-4b08-878e-11077615f53e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/16" status: 200 len: 242 microversion: 2.1 time: 0.060791 Jul 14 14:36:18.135902 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 154/301] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:36:18 2022] GET /compute/v2.1/os-aggregates/16 => generated 242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:18.154450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.156256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.158512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9e9997e-2d0b-4754-ad74-dc42e1d35c87 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:18.158985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.160680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:18.165021 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:18.165021 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:18.273357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9e9997e-2d0b-4754-ad74-dc42e1d35c87 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.124942 Jul 14 14:36:18.276632 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 155/302] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:18 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Jul 14 14:36:18.301873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f41d0cc6-d5b8-4877-98ea-72c34e6c7c1d tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-126009088", "availability_zone": "tempest-test_az-1469350034"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:18.315795 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:18.315795 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:18.317748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-f41d0cc6-d5b8-4877-98ea-72c34e6c7c1d tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid cf495600-dd37-4319-973c-df966c957ed1 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:18.404522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:18.420772 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7ba51f6-4c0d-4bfc-975b-b80106909ae4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1277 microversion: 2.1 time: 0.333361 Jul 14 14:36:18.421711 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 148/303] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:18 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1277 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:18.447061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f41d0cc6-d5b8-4877-98ea-72c34e6c7c1d tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.162687 Jul 14 14:36:18.449412 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 156/304] 10.222.0.98 () {60 vars in 1164 bytes} [Thu Jul 14 14:36:18 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:18.483973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74de7a79-0a7d-41d9-9449-921ca85310da tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-126009088_new", "availability_zone": "tempest-test_az-1469350034_new"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:18.830792 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:18.830792 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:18.938847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74de7a79-0a7d-41d9-9449-921ca85310da tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:18.941949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74de7a79-0a7d-41d9-9449-921ca85310da tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.098837 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74de7a79-0a7d-41d9-9449-921ca85310da tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 336 microversion: 2.1 time: 0.636370 Jul 14 14:36:19.101715 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 149/305] 10.222.0.98 () {60 vars in 1172 bytes} [Thu Jul 14 14:36:18 2022] PUT /compute/v2.1/os-aggregates/17 => generated 336 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:19.114312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d037eae-161f-408f-8367-ceaa6e83a8ff tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.115106 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:19.115106 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:19.137810 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d037eae-161f-408f-8367-ceaa6e83a8ff tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.029346 Jul 14 14:36:19.142812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 157/306] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:19.157798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dbc48950-5960-4a24-bf0d-5d9f2f1a2868 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.159840 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:19.159840 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:19.215860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9,nova_api:DELETE=7,nova_api:UPDATE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:19.236229 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dbc48950-5960-4a24-bf0d-5d9f2f1a2868 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.084339 Jul 14 14:36:19.237975 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 150/307] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:19 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:19.259662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3f87ae6-0fe7-413b-9b9d-7c2186adc23e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-957035110"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:19.274519 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:19.274519 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:19.276642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.aggregate [None req-a3f87ae6-0fe7-413b-9b9d-7c2186adc23e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Generated uuid 83dbd56d-333a-4a5a-9c5a-d602aa014233 for aggregate {{(pid=125965) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 14:36:19.340768 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3f87ae6-0fe7-413b-9b9d-7c2186adc23e tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.093093 Jul 14 14:36:19.342611 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 158/308] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 14:36:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:19.355607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec46ca83-260f-489e-93ce-dc70d010a154 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.359493 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:19.359493 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:19.393761 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec46ca83-260f-489e-93ce-dc70d010a154 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.044034 Jul 14 14:36:19.394884 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 151/309] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:19.410899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-528bc321-a1c6-44e0-8d68-41dba5490c59 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.413060 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:19.413060 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:19.454988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.463797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.490981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.493124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.494940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.500166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.519205 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-528bc321-a1c6-44e0-8d68-41dba5490c59 tempest-AggregatesAdminTestJSON-1309580781 tempest-AggregatesAdminTestJSON-1309580781-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.115728 Jul 14 14:36:19.520152 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 159/310] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 14:36:19 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 14:36:19.544093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.550137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.580344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.586630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.588371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.592712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.671748 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] HTTP exception thrown: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Request method failure captured: Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 HTTP/1.1 Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmYG4Pe3ypXUdC2SmRokAE_3j-2FBuf8B3LFnrvPqHgFUuwAPgDLpbYlWH5nIxKO0bfGMeHUnpKkBl9WgFMRF3sQUsUk_K0bpuB56HAwasjdge6KWtZRHcLHFrKxJfIDl7z-72j8TFK1kz_oG0hx8puMnBGXhWSXV0yyMcxXwelypY Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4e1e3e2e4d114865804976a40c6cac55 Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:36:19.683438 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4e1e3e2e4d114865804976a40c6cac55 Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminTestJSON-466791402-project Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a876582ed4d94e9da876592597aa1c06 Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminTestJSON-466791402-project Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.685159 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '38dd8dab-42b8-49a8-a534-17f8f6412910'} Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:19.685931 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.686977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.689696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Returning 404 to user: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:19.693596 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20d3e8ab-f945-4165-891c-8bbbea94f156 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "DELETE /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 404 len: 111 microversion: 2.1 time: 0.166830 Jul 14 14:36:19.699221 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 160/311] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:19 2022] DELETE /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:36:19.727314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:19.728235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] [instance: 38dd8dab-42b8-49a8-a534-17f8f6412910] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:19.761430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.762285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.763992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:19.764552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:19.826585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] HTTP exception thrown: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Request method failure captured: Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 HTTP/1.1 Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmYG4Pe3ypXUdC2SmRokAE_3j-2FBuf8B3LFnrvPqHgFUuwAPgDLpbYlWH5nIxKO0bfGMeHUnpKkBl9WgFMRF3sQUsUk_K0bpuB56HAwasjdge6KWtZRHcLHFrKxJfIDl7z-72j8TFK1kz_oG0hx8puMnBGXhWSXV0yyMcxXwelypY Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4e1e3e2e4d114865804976a40c6cac55 Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:36:19.840463 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4e1e3e2e4d114865804976a40c6cac55"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4e1e3e2e4d114865804976a40c6cac55 Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-466791402 Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AggregatesAdminTestJSON-466791402-project Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a876582ed4d94e9da876592597aa1c06 Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AggregatesAdminTestJSON-466791402-project Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.841723 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '38dd8dab-42b8-49a8-a534-17f8f6412910'} Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:36:19.842391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. Jul 14 14:36:19.843481 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:36:19.844448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] Returning 404 to user: Instance 38dd8dab-42b8-49a8-a534-17f8f6412910 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:36:19.844448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a9c1ba6-5f8e-4de0-a8f8-7208294fee82 tempest-AggregatesAdminTestJSON-466791402 tempest-AggregatesAdminTestJSON-466791402-project] 10.222.0.98 "GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910" status: 404 len: 111 microversion: 2.1 time: 0.139377 Jul 14 14:36:19.847784 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 161/312] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/servers/38dd8dab-42b8-49a8-a534-17f8f6412910 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:36:19.912688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:19.938898 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36f3c17d-c35f-4e29-86f4-2e97bcb1ec5e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1277 microversion: 2.1 time: 0.490914 Jul 14 14:36:19.940283 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 152/313] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:19 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1277 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:20.963002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:20.969604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:21.016065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:21.028158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.030546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:21.033785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:21.664194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.814551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:22.847913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:22.883356 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dad24311-3db4-41fe-9d5e-07fa7e04d036 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 1.927708 Jul 14 14:36:22.888785 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 162/314] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:20 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 1935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:23.925970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:23.930682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:23.935475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:23.961894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.963234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:23.965906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:23.969239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.084042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:24.562570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:24.594075 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02be9b4e-cee3-4c52-9d3f-9416b20ea8d9 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 0.679902 Jul 14 14:36:24.595003 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 153/315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:23 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:24.782017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-096040b6-ed23-4cbf-9536-4bbacf1625cd req-e064bf6e-a967-444e-8769-d756f15e1347 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c489130c-3390-441e-8a0c-9ccdc783c8be", "tag": "3df1e062-8916-4cfc-b355-1f1fdf623d4d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:24.822552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-096040b6-ed23-4cbf-9536-4bbacf1625cd req-e064bf6e-a967-444e-8769-d756f15e1347 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:24.824665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-096040b6-ed23-4cbf-9536-4bbacf1625cd req-e064bf6e-a967-444e-8769-d756f15e1347 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:24.855693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-096040b6-ed23-4cbf-9536-4bbacf1625cd req-e064bf6e-a967-444e-8769-d756f15e1347 service nova] Creating event network-changed:3df1e062-8916-4cfc-b355-1f1fdf623d4d for instance c489130c-3390-441e-8a0c-9ccdc783c8be on n-h1-768852-23 Jul 14 14:36:24.867029 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-096040b6-ed23-4cbf-9536-4bbacf1625cd req-e064bf6e-a967-444e-8769-d756f15e1347 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095685 Jul 14 14:36:24.870699 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 163/316] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:25.638416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:25.651788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:25.667351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:25.668108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:25.669507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:25.670281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:26.193802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:26.200922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:26.240018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c49b1018-cd2d-4eef-802a-abda9553dbfe tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 0.607931 Jul 14 14:36:26.251492 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 154/317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:25 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:27.267957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:27.269329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:27.284752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.285508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.286480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.287081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.744895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-55934ee4-3315-4a88-806f-89f914c903d2 req-8c55e92e-5751-42bd-adf8-ee425e1082ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae7517a-302c-4bad-91ab-8df53f487e52", "tag": "c3a6b3cb-10c0-45a3-8e64-3425433c81f6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:27.801622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-55934ee4-3315-4a88-806f-89f914c903d2 req-8c55e92e-5751-42bd-adf8-ee425e1082ad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:27.805387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-55934ee4-3315-4a88-806f-89f914c903d2 req-8c55e92e-5751-42bd-adf8-ee425e1082ad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:27.867424 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-55934ee4-3315-4a88-806f-89f914c903d2 req-8c55e92e-5751-42bd-adf8-ee425e1082ad service nova] Creating event network-changed:c3a6b3cb-10c0-45a3-8e64-3425433c81f6 for instance 8ae7517a-302c-4bad-91ab-8df53f487e52 on n-h1-768852-23 Jul 14 14:36:27.880544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-55934ee4-3315-4a88-806f-89f914c903d2 req-8c55e92e-5751-42bd-adf8-ee425e1082ad service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144917 Jul 14 14:36:27.884299 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 155/318] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:28.072335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:28.085606 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2101765a-4dd3-4c08-b869-0e05254a90da tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 0.821346 Jul 14 14:36:28.096045 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 164/319] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:27 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:36:29.177532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1498714563", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:29.281052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:29.742824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c2c0863-ae11-4ae5-9185-a143d327e866 tempest-InstanceUsageAuditLogTestJSON-249239285 tempest-InstanceUsageAuditLogTestJSON-249239285-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.743908 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:29.743908 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:36:29.784298 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c2c0863-ae11-4ae5-9185-a143d327e866 tempest-InstanceUsageAuditLogTestJSON-249239285 tempest-InstanceUsageAuditLogTestJSON-249239285-project-admin] 10.222.0.98 "GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14 14:36:29" status: 200 len: 318 microversion: 2.1 time: 0.763500 Jul 14 14:36:29.791552 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 165/320] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-07-14%2014%3A36%3A29 => generated 318 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:29.796824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:29.805841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:29.817821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.823598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:29.824558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:29.825143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.561880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:30.562659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:30.578114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:30.579515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:30.580525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:30.633510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.634575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.637658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:30.638749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:30.713684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Getting quotas for project 5a041638b2ef4261b6f3f2fbf3ba06c7. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:30.746427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Getting quotas for user 80a79275009a41e38a6d41e10bc6c066 and project 5a041638b2ef4261b6f3f2fbf3ba06c7. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:30.795868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:30.811586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:31.094654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ebd7b6f-11ac-46d7-84cb-b8a098a01301 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.556429 Jul 14 14:36:31.104944 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 156/321] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:31.139556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5f3078a-7742-4932-a749-30817b58b044 tempest-InstanceUsageAuditLogTestJSON-249239285 tempest-InstanceUsageAuditLogTestJSON-249239285-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.144846 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:36:31.144846 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:36:31.237387 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5f3078a-7742-4932-a749-30817b58b044 tempest-InstanceUsageAuditLogTestJSON-249239285 tempest-InstanceUsageAuditLogTestJSON-249239285-project-admin] 10.222.0.98 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.129812 Jul 14 14:36:31.240364 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 157/322] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:31.250996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-407962a7-ea29-41ea-8d23-8ddbc5665864 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:31.273676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-407962a7-ea29-41ea-8d23-8ddbc5665864 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:31.636066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.644946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21daf895-e485-4c3c-83cb-0c30a2ee2ed0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 1.851935 Jul 14 14:36:31.657376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 166/323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:29 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:31.689226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-407962a7-ea29-41ea-8d23-8ddbc5665864 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:31.747222 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-407962a7-ea29-41ea-8d23-8ddbc5665864 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1220 microversion: 2.1 time: 0.503595 Jul 14 14:36:31.747992 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 158/324] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:31 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1220 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:32.685317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.686204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.704582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.705535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.709356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.711794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.766877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:32.768105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:32.781085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.781824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:32.783077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:32.796174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:33.003382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:33.019849 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8cdaf29-76be-4559-9eb6-d7a13437db58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1224 microversion: 2.1 time: 0.257297 Jul 14 14:36:33.020827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 159/325] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1224 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:34.110534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.135547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b2906f6-fc7a-42b2-b8cb-ed9bb19055d6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 1.454430 Jul 14 14:36:34.136202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 167/326] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:32 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:34.150973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:34.151979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:34.166500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.169807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.170657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.171294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.224612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26754f91-3512-4b70-99b9-0d9ac444b815 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '.version_select at 0x7fdbf3872a60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:34.466704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:34.476088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53580cb4-cc95-4b67-9502-cacdbea5bfb1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1280 microversion: 2.1 time: 0.335834 Jul 14 14:36:34.484194 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 168/327] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:34 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1280 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:34.511208 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26754f91-3512-4b70-99b9-0d9ac444b815 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464" status: 200 len: 371 microversion: 2.1 time: 0.743356 Jul 14 14:36:34.514553 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 160/328] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 14:36:33 2022] GET /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464 => generated 371 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:34.528563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0eaddb78-b7b9-4026-b192-5349c23becde tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3a2f040>, body: {"quota_set": {"ram": "5120"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:34.622557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8542119b-dcc0-4b5b-8f3f-8efd57d651cb req-ec785195-a352-4137-91cc-c51c3ae1829d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c489130c-3390-441e-8a0c-9ccdc783c8be", "name": "network-vif-plugged", "status": "completed", "tag": "3df1e062-8916-4cfc-b355-1f1fdf623d4d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:34.639517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8542119b-dcc0-4b5b-8f3f-8efd57d651cb req-ec785195-a352-4137-91cc-c51c3ae1829d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.640338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8542119b-dcc0-4b5b-8f3f-8efd57d651cb req-ec785195-a352-4137-91cc-c51c3ae1829d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.683643 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8542119b-dcc0-4b5b-8f3f-8efd57d651cb req-ec785195-a352-4137-91cc-c51c3ae1829d service nova] Creating event network-vif-plugged:3df1e062-8916-4cfc-b355-1f1fdf623d4d for instance c489130c-3390-441e-8a0c-9ccdc783c8be on n-h1-768852-23 Jul 14 14:36:34.699899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8542119b-dcc0-4b5b-8f3f-8efd57d651cb req-ec785195-a352-4137-91cc-c51c3ae1829d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080969 Jul 14 14:36:34.701277 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 161/329] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:34.798362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eaddb78-b7b9-4026-b192-5349c23becde tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.799186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eaddb78-b7b9-4026-b192-5349c23becde tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.800513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eaddb78-b7b9-4026-b192-5349c23becde tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:34.801198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eaddb78-b7b9-4026-b192-5349c23becde tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:34.844912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:DELETE=11 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:34.949733 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0eaddb78-b7b9-4026-b192-5349c23becde tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464" status: 200 len: 328 microversion: 2.1 time: 0.425134 Jul 14 14:36:34.968493 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 169/330] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:36:34 2022] PUT /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464 => generated 328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:36:34.975193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-299c1e23-0762-424f-b44a-05a07d12096b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:34.994485 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-299c1e23-0762-424f-b44a-05a07d12096b tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464" status: 202 len: 0 microversion: 2.1 time: 0.023581 Jul 14 14:36:34.995087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 162/331] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:36:34 2022] DELETE /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:36:35.006324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-11e92874-ea49-44cc-a2c0-0b770eca8a0e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '.version_select at 0x7fdbf397e1f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.104369 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-11e92874-ea49-44cc-a2c0-0b770eca8a0e tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464" status: 200 len: 371 microversion: 2.1 time: 0.102172 Jul 14 14:36:35.105320 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 170/332] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/os-quota-sets/02d5fe168a564052879bff6e9bd5f464 => generated 371 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:35.154531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:35.155479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:35.173653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.174979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.179596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:35.180377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:35.462883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-568d4e0d-3d46-4ed0-844f-02e410f4b2a0 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '.version_select at 0x7fdbf3907ee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.117021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.134801 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e3cdc18-ae38-4b78-a799-678bf523fcc4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1319 microversion: 2.1 time: 0.985273 Jul 14 14:36:36.148180 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 163/333] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1319 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:36.148180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:36.148180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:36.161981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.162509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.163868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:36.164428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:36.306315 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-568d4e0d-3d46-4ed0-844f-02e410f4b2a0 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.848297 Jul 14 14:36:36.314494 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 171/334] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:35 2022] GET /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3/defaults => generated 371 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:36.707298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:36.730603 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c8126b49-8597-4264-a62e-ca665333612d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1278 microversion: 2.1 time: 0.593663 Jul 14 14:36:36.731524 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 164/335] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:36 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1278 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:37.060661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b770bda0-d82e-4393-aa01-d5629313ccfc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3907af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:37.165507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:37.166333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:37.189926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.190376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.193306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.197307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.394426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b770bda0-d82e-4393-aa01-d5629313ccfc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.394915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b770bda0-d82e-4393-aa01-d5629313ccfc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.396106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b770bda0-d82e-4393-aa01-d5629313ccfc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:37.399586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b770bda0-d82e-4393-aa01-d5629313ccfc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:37.511737 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b770bda0-d82e-4393-aa01-d5629313ccfc tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e" status: 200 len: 328 microversion: 2.1 time: 0.456357 Jul 14 14:36:37.520637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 172/336] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:36:37 2022] PUT /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e => generated 328 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:37.700116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2098931085", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "7c3118c3-58de-439c-bb53-8c4407b089fe"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:37.815065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] validate_networks() for [('7c3118c3-58de-439c-bb53-8c4407b089fe', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:39.612123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:39.652344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa1fa64d-84fb-405b-ac29-f490087ef17c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1469 microversion: 2.1 time: 2.484838 Jul 14 14:36:39.670584 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 165/337] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:37 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1469 bytes in 2510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:39.688885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b934103-aca2-47b2-92fa-2bd0b0ca98ff tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '.version_select at 0x7fdbf38250d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.100116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:40.101257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:40.102264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:40.103112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:40.104664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:40.150101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.151117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.153088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.154300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.207426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:40.216696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for user aeb3928894284b77b4aea925a38470ba and project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:40.253724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:40.259966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:40.432478 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a141d0bc-66e4-46bc-8c8e-48a58127064d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.913442 Jul 14 14:36:40.438414 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 173/338] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:36:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:36:40.468817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:40.473670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:40.507598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.512078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.514050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:40.515795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:40.664419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:40.981108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:40.997908 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-76ccaaf7-ac8e-48a5-b65e-faf2e6d2ff91 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 0.554765 Jul 14 14:36:40.998525 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 174/339] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:40 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:41.012816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3cf60581-ae71-4d81-b2bd-43ffccc48305 req-c5abd315-d2c0-4016-ab8a-34e8e84f2bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae7517a-302c-4bad-91ab-8df53f487e52", "name": "network-vif-plugged", "status": "completed", "tag": "c3a6b3cb-10c0-45a3-8e64-3425433c81f6"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:41.044366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3cf60581-ae71-4d81-b2bd-43ffccc48305 req-c5abd315-d2c0-4016-ab8a-34e8e84f2bed service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.045125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3cf60581-ae71-4d81-b2bd-43ffccc48305 req-c5abd315-d2c0-4016-ab8a-34e8e84f2bed service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.080413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3cf60581-ae71-4d81-b2bd-43ffccc48305 req-c5abd315-d2c0-4016-ab8a-34e8e84f2bed service nova] Creating event network-vif-plugged:c3a6b3cb-10c0-45a3-8e64-3425433c81f6 for instance 8ae7517a-302c-4bad-91ab-8df53f487e52 on n-h1-768852-23 Jul 14 14:36:41.107866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b934103-aca2-47b2-92fa-2bd0b0ca98ff tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.109440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b934103-aca2-47b2-92fa-2bd0b0ca98ff tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.113706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b934103-aca2-47b2-92fa-2bd0b0ca98ff tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.115525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3cf60581-ae71-4d81-b2bd-43ffccc48305 req-c5abd315-d2c0-4016-ab8a-34e8e84f2bed service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110255 Jul 14 14:36:41.121013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b934103-aca2-47b2-92fa-2bd0b0ca98ff tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.124764 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 175/340] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:41.149425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.152606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.170229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.172219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.173547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:41.176955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:41.318979 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b934103-aca2-47b2-92fa-2bd0b0ca98ff tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e/detail" status: 200 len: 916 microversion: 2.1 time: 1.646161 Jul 14 14:36:41.333584 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 166/341] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:36:39 2022] GET /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e/detail => generated 916 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:41.357644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eca98a09-3e72-4630-a90f-237ac1e46727 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:41.364363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eca98a09-3e72-4630-a90f-237ac1e46727 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:41.883977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:41.908990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb02652a-b623-4450-98f8-e4eb8e091296 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1319 microversion: 2.1 time: 0.781947 Jul 14 14:36:41.913489 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 176/342] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1319 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:42.032045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.033198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:42.042764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eca98a09-3e72-4630-a90f-237ac1e46727 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.056885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eca98a09-3e72-4630-a90f-237ac1e46727 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.058452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.058799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eca98a09-3e72-4630-a90f-237ac1e46727 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.059214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.065010 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eca98a09-3e72-4630-a90f-237ac1e46727 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1262 microversion: 2.25 time: 0.727402 Jul 14 14:36:42.065609 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 167/343] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:41 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1262 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:42.082919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:42.084001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:42.479931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:42.521740 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38f8c187-e83d-4ce8-8bed-530f8a8e4d58 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 0.500570 Jul 14 14:36:42.532757 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 177/344] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:42.933444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3980c10>, body: {"quota_set": {"ram": "2048"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:42.975632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:42.977108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.016744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.020758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.027684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.029090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.489405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.499730 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a2f04f5-71de-4c8d-953b-10259cc2a003 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1319 microversion: 2.1 time: 0.542823 Jul 14 14:36:43.502960 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 178/345] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:42 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1319 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:43.509132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.510126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.523541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.524306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.525369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.526003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.633247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.648388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.651094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:43.652696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-48b553ca-5caa-4358-8f17-ce711861799a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1314 microversion: 2.25 time: 0.148306 Jul 14 14:36:43.654161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 179/346] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:43.661858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:43.677441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:43.694821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.695721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.696968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.697593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.971467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.972346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:43.973729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:43.974452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.207846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:44.208624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.212441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:44.218680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:44.484948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8fa2d1af-d589-4ce7-bb73-122732a2ff29 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e?user_id=1efa7a84824941a6a36fa1586ff886de" status: 200 len: 328 microversion: 2.1 time: 1.557823 Jul 14 14:36:44.491953 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 168/347] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:36:42 2022] PUT /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e?user_id=1efa7a84824941a6a36fa1586ff886de => generated 328 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:44.859329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:44.883213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a02e00df-f039-4273-970c-1cd32fbe0057 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 1.224889 Jul 14 14:36:44.886460 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 180/348] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:43 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:44.902206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e80de671-2007-4d63-86f2-bcd381cd733f tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '.version_select at 0x7fdbf3907c10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:45.084807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aaadef90-9b94-4cf1-a541-aa6a55819e24 tempest-ListImagesTestJSON-1346568102 tempest-ListImagesTestJSON-1346568102-project] Calling method '.version_select at 0x7fdbf37f8940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:45.214398 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aaadef90-9b94-4cf1-a541-aa6a55819e24 tempest-ListImagesTestJSON-1346568102 tempest-ListImagesTestJSON-1346568102-project] 10.222.0.98 "GET /compute/v2.1/images/882b5d60-a014-41cb-b7f7-f80f1fdee9e4" status: 200 len: 784 microversion: 2.1 time: 0.720600 Jul 14 14:36:45.215981 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 169/349] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:36:44 2022] GET /compute/v2.1/images/882b5d60-a014-41cb-b7f7-f80f1fdee9e4 => generated 784 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:45.227557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:45.231663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:45.257678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.258817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:45.260229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.260856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:45.575944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e80de671-2007-4d63-86f2-bcd381cd733f tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e?user_id=1efa7a84824941a6a36fa1586ff886de" status: 200 len: 370 microversion: 2.1 time: 0.683768 Jul 14 14:36:45.597230 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 181/350] 10.222.0.98 () {58 vars in 1322 bytes} [Thu Jul 14 14:36:44 2022] GET /compute/v2.1/os-quota-sets/47b89aafe8624cdd8678a7755dda641e?user_id=1efa7a84824941a6a36fa1586ff886de => generated 370 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:45.624658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:45.627302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:45.660706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.662418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:45.668290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:45.669206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.000385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.043569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.064899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.067345 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e48df9d3-9773-4d6a-964b-580aca43125c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1320 microversion: 2.25 time: 0.464958 Jul 14 14:36:46.080195 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 182/351] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:45 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1320 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:46.106861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16d13445-36f0-42c6-ae89-fb3a5010bdd8 tempest-ListImagesTestJSON-1346568102 tempest-ListImagesTestJSON-1346568102-project] Calling method '.version_select at 0x7fdbf3907f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:46.208946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.223629 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7af271f2-6119-4a9b-b790-b9daaf7f8d54 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1469 microversion: 2.1 time: 1.003959 Jul 14 14:36:46.232045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 170/352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:45 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1469 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:46.237046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-81a6367f-ef50-4171-9ca4-8af28e954cbe req-d0e0e62a-993f-489a-9a82-d3c2e012c182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57743d28-3e4f-4a30-9eba-7ff75f331659", "tag": "edcfe1b0-9192-4c6c-8916-522e5430c6e1"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:46.267906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81a6367f-ef50-4171-9ca4-8af28e954cbe req-d0e0e62a-993f-489a-9a82-d3c2e012c182 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.269370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81a6367f-ef50-4171-9ca4-8af28e954cbe req-d0e0e62a-993f-489a-9a82-d3c2e012c182 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.313850 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-81a6367f-ef50-4171-9ca4-8af28e954cbe req-d0e0e62a-993f-489a-9a82-d3c2e012c182 service nova] Creating event network-changed:edcfe1b0-9192-4c6c-8916-522e5430c6e1 for instance 57743d28-3e4f-4a30-9eba-7ff75f331659 on n-h2-768852-23 Jul 14 14:36:46.332359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-81a6367f-ef50-4171-9ca4-8af28e954cbe req-d0e0e62a-993f-489a-9a82-d3c2e012c182 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098746 Jul 14 14:36:46.335521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16d13445-36f0-42c6-ae89-fb3a5010bdd8 tempest-ListImagesTestJSON-1346568102 tempest-ListImagesTestJSON-1346568102-project] 10.222.0.98 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.241701 Jul 14 14:36:46.338337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 183/353] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:46 2022] GET /compute/v2.1/images => generated 445 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:46.346795 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 171/354] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:46.351352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:46.358886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:46.360666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:46.369655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.370466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Searching by: {'reservation_id': 'r-yol9datx', 'deleted': False, 'project_id': 'c9f14b1548c547608944442a8a351e56'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:36:46.386158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.389130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.389650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.390482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.390994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.391618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.395815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.401737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:46.671898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:36:46.828642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:46.840253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:46.841710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.324538 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9a02b564-560f-4378-b622-c1114479d703 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/detail?reservation_id=r-yol9datx" status: 200 len: 2931 microversion: 2.1 time: 0.976231 Jul 14 14:36:47.325260 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 172/355] 10.222.0.98 () {58 vars in 1196 bytes} [Thu Jul 14 14:36:46 2022] GET /compute/v2.1/servers/detail?reservation_id=r-yol9datx => generated 2931 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:47.331647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8aac55f5-2a63-4dd3-91da-ec63e502bfbb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Calling method '.version_select at 0x7fdbf38250d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.435780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:47.442838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:47.481696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f405725d-67b4-459a-97f3-035ee49820a2 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 1.137007 Jul 14 14:36:47.486003 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 184/356] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:46 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:47.525288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84dfa170-0224-425c-aff3-29f5e47e8799 tempest-ListImagesTestJSON-1346568102 tempest-ListImagesTestJSON-1346568102-project] Calling method '.version_select at 0x7fdbf3907ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.656822 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84dfa170-0224-425c-aff3-29f5e47e8799 tempest-ListImagesTestJSON-1346568102 tempest-ListImagesTestJSON-1346568102-project] 10.222.0.98 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.168797 Jul 14 14:36:47.660768 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 185/357] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:47.669164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:47.673419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:47.699260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.699756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:47.700562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:47.711850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:48.029630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8aac55f5-2a63-4dd3-91da-ec63e502bfbb tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3/defaults" status: 200 len: 371 microversion: 2.1 time: 0.702750 Jul 14 14:36:48.042476 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 173/358] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3/defaults => generated 371 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:48.066230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fc8c8aa-3b3a-4952-99d7-fe8a4ee9ee0e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:48.137741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.server_groups [None req-7fc8c8aa-3b3a-4952-99d7-fe8a4ee9ee0e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Querying cell 851d78d8-3f11-4b86-a356-449411903277(cell1) for 2 instances {{(pid=125966) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:36:48.140093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fc8c8aa-3b3a-4952-99d7-fe8a4ee9ee0e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:48.141232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fc8c8aa-3b3a-4952-99d7-fe8a4ee9ee0e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:48.265773 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fc8c8aa-3b3a-4952-99d7-fe8a4ee9ee0e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups/0937d67c-8842-4a46-9ce2-18fb43d96910" status: 200 len: 265 microversion: 2.1 time: 0.220880 Jul 14 14:36:48.266778 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 174/359] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:36:48 2022] GET /compute/v2.1/os-server-groups/0937d67c-8842-4a46-9ce2-18fb43d96910 => generated 265 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:48.623981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1797644098", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:48.775699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:48.792970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:48.798389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:48.800181 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aba2536f-a9ea-4d57-914d-e1c73ab23282 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1362 microversion: 2.25 time: 1.138284 Jul 14 14:36:48.803398 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 186/360] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:47 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1362 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:48.813185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f86ab10-8a75-4030-8a28-c24f418a9b75 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf39299d0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:48.880497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:49.087128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f86ab10-8a75-4030-8a28-c24f418a9b75 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:49.088065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f86ab10-8a75-4030-8a28-c24f418a9b75 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:49.090887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f86ab10-8a75-4030-8a28-c24f418a9b75 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:49.091897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f86ab10-8a75-4030-8a28-c24f418a9b75 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:49.633743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=15 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:49.845212 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f86ab10-8a75-4030-8a28-c24f418a9b75 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3" status: 200 len: 329 microversion: 2.1 time: 1.039935 Jul 14 14:36:49.860414 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 187/361] 10.222.0.98 () {60 vars in 1262 bytes} [Thu Jul 14 14:36:48 2022] PUT /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3 => generated 329 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:49.870122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:49.872189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:49.884646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:49.885914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:49.887767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:49.888977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:50.420958 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-009f293c-0884-49b4-a256-5451476dad52 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 200 len: 1622 microversion: 2.1 time: 0.557956 Jul 14 14:36:50.421634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 188/362] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:49 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 1622 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:50.427046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:50.427577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:50.440570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:50.441056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:50.441989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:50.442811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.013705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:51.014638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:51.014787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:51.015120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:51.015817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:51.023982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:51.050379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.052934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.054797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.055602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.083033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:51.113671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Getting quotas for project 37c6e6fc4a9e4a8ab44ea9b14b7eefc5. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:51.114696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f26aa349-ff66-4472-a0ae-23550723d95d tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 0.690593 Jul 14 14:36:51.125141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Getting quotas for user 82254dd6dfcc4f2f96995a0133a901b4 and project 37c6e6fc4a9e4a8ab44ea9b14b7eefc5. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:51.137689 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 189/363] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:50 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:51.160616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b0bce9eb-3ec3-4c79-b4cc-3639c99539a6 req-1a8e8e6e-c110-4b19-9d9b-cac958f7c780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d0e571-c557-48c6-90e4-e442642d46c5", "tag": "6ba63c73-6333-45d6-bc42-bdcb5d30ae36"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:51.168105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:51.181127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:51.197636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b0bce9eb-3ec3-4c79-b4cc-3639c99539a6 req-1a8e8e6e-c110-4b19-9d9b-cac958f7c780 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.201321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b0bce9eb-3ec3-4c79-b4cc-3639c99539a6 req-1a8e8e6e-c110-4b19-9d9b-cac958f7c780 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.257757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b0bce9eb-3ec3-4c79-b4cc-3639c99539a6 req-1a8e8e6e-c110-4b19-9d9b-cac958f7c780 service nova] Creating event network-changed:6ba63c73-6333-45d6-bc42-bdcb5d30ae36 for instance 26d0e571-c557-48c6-90e4-e442642d46c5 on n-h1-768852-23 Jul 14 14:36:51.306932 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b0bce9eb-3ec3-4c79-b4cc-3639c99539a6 req-1a8e8e6e-c110-4b19-9d9b-cac958f7c780 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165065 Jul 14 14:36:51.310335 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 190/364] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:51.313602 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-131de0b0-e199-460d-925c-4073f853f3ec tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.045561 Jul 14 14:36:51.318204 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 175/365] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:36:51.331085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8331c56a-a78a-4807-ae19-446c0dc385c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3753c10>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:51.332875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:51.333656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:51.352720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.353177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.354001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.356679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.553591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8331c56a-a78a-4807-ae19-446c0dc385c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.559253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8331c56a-a78a-4807-ae19-446c0dc385c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:51.560728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8331c56a-a78a-4807-ae19-446c0dc385c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:51.561412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8331c56a-a78a-4807-ae19-446c0dc385c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.022068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:52.053005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:52.061522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:52.067509 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67998055-ec0b-4eab-8a09-b6934e752fa0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1362 microversion: 2.25 time: 0.751522 Jul 14 14:36:52.074188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 191/366] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:51 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1362 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:52.092069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:52.097470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:52.121707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:52.133017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.142356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:52.143565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.401106 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8331c56a-a78a-4807-ae19-446c0dc385c6 tempest-QuotasAdminTestJSON-255202823 tempest-QuotasAdminTestJSON-255202823-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3" status: 200 len: 329 microversion: 2.1 time: 1.076111 Jul 14 14:36:52.412788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 176/367] 10.222.0.98 () {60 vars in 1262 bytes} [Thu Jul 14 14:36:51 2022] PUT /compute/v2.1/os-quota-sets/c2b5bf90e58d4785a6caeea427f690b3 => generated 329 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:52.412788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-818f0f81-fd7e-4225-a8c3-671759d0b4ed tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:52.412788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-818f0f81-fd7e-4225-a8c3-671759d0b4ed tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:52.742674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-818f0f81-fd7e-4225-a8c3-671759d0b4ed tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:52.758775 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-818f0f81-fd7e-4225-a8c3-671759d0b4ed tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1222 microversion: 2.1 time: 0.349596 Jul 14 14:36:52.775090 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 177/368] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:52 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1222 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:52.808409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:52.816481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:52.833210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:52.840728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:52.840728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:52.840728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:53.776800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20e1cef7-10dd-4cb7-aa68-5eaaef0d1b81 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1622 microversion: 2.1 time: 1.700071 Jul 14 14:36:53.782382 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 192/369] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:52 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1622 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:53.822671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:53.829040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:53.866247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.871784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:53.874304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:53.878166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:54.258031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.286354 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d23fd4bd-9dda-4bf7-9c44-691df77198d9 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 1.498953 Jul 14 14:36:54.296434 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 178/370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:52 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 1521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:54.301732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:54.302273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:54.320116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:54.323672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:54.324678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:54.325130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:54.733707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.775631 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63aacd9f-8c91-412d-b20b-8ea129c7bba2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1282 microversion: 2.1 time: 0.472987 Jul 14 14:36:54.780065 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 179/371] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:54 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1282 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:54.794302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-874452d9-3f83-4475-b7d3-6c2ad0c57675 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: .version_select at 0x7fdbf366d670>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-318214023", "policies": ["anti-affinity"]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:54.844388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.883820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=75 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:54.895782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-874452d9-3f83-4475-b7d3-6c2ad0c57675 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:54.897806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.904583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:54.909272 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-452d3919-22f7-4896-bd5d-c6c7dddfc78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1362 microversion: 2.25 time: 1.122689 Jul 14 14:36:54.924710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-874452d9-3f83-4475-b7d3-6c2ad0c57675 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:54.925889 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 193/372] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:53 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1362 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:54.947080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=17,nova_api:UPDATE=14 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:55.041725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-874452d9-3f83-4475-b7d3-6c2ad0c57675 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:55.051792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-874452d9-3f83-4475-b7d3-6c2ad0c57675 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:55.088616 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-874452d9-3f83-4475-b7d3-6c2ad0c57675 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.305227 Jul 14 14:36:55.089815 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 180/373] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:36:54 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:55.331371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:55.336799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-23adc808-2139-4e4f-857a-9d1ec78ffd3c req-b06e1273-982d-43af-901f-568b18be5a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57743d28-3e4f-4a30-9eba-7ff75f331659", "name": "network-vif-plugged", "status": "completed", "tag": "edcfe1b0-9192-4c6c-8916-522e5430c6e1"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:55.342779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:55.382660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-23adc808-2139-4e4f-857a-9d1ec78ffd3c req-b06e1273-982d-43af-901f-568b18be5a11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.383555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-23adc808-2139-4e4f-857a-9d1ec78ffd3c req-b06e1273-982d-43af-901f-568b18be5a11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:55.402488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.403089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:55.405791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:55.407419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:55.441944 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-23adc808-2139-4e4f-857a-9d1ec78ffd3c req-b06e1273-982d-43af-901f-568b18be5a11 service nova] Creating event network-vif-plugged:edcfe1b0-9192-4c6c-8916-522e5430c6e1 for instance 57743d28-3e4f-4a30-9eba-7ff75f331659 on n-h2-768852-23 Jul 14 14:36:55.455978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-23adc808-2139-4e4f-857a-9d1ec78ffd3c req-b06e1273-982d-43af-901f-568b18be5a11 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128328 Jul 14 14:36:55.462343 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 181/374] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:55.579301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1508688320", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "fe23445d-06fc-4f11-a147-7964616168d2"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:55.788513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:36:55.959086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:55.978011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4ccd8bd-aae4-4cf3-a3b3-a36d28accf88 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1320 microversion: 2.1 time: 0.671399 Jul 14 14:36:55.979118 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 194/375] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:55 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1320 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:55.993226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:55.994024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:56.007659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.008219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.009157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.009690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.255435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:56.289218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73d223a6-5868-4722-bcfd-98bcb55d407a tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1280 microversion: 2.1 time: 0.308459 Jul 14 14:36:56.291897 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 195/376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:55 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1280 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:56.324893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:56.328961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:56.359256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.361535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.364483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:56.368478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:56.865802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:56.906759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:56.915320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:56.919864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-98d7994b-e179-4425-b727-be48a666e01f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1362 microversion: 2.25 time: 0.624366 Jul 14 14:36:56.935256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 196/377] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:56 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1362 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:57.228872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c40f1ace-6fd3-44e7-8409-a2d2529d8164 tempest-AbsoluteLimitsTestJSON-677523721 tempest-AbsoluteLimitsTestJSON-677523721-project] Calling method '.version_select at 0x7fdbf3d734c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:57.273260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=67 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:57.282526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c40f1ace-6fd3-44e7-8409-a2d2529d8164 tempest-AbsoluteLimitsTestJSON-677523721 tempest-AbsoluteLimitsTestJSON-677523721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.285316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c40f1ace-6fd3-44e7-8409-a2d2529d8164 tempest-AbsoluteLimitsTestJSON-677523721 tempest-AbsoluteLimitsTestJSON-677523721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.289223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c40f1ace-6fd3-44e7-8409-a2d2529d8164 tempest-AbsoluteLimitsTestJSON-677523721 tempest-AbsoluteLimitsTestJSON-677523721-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.290314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c40f1ace-6fd3-44e7-8409-a2d2529d8164 tempest-AbsoluteLimitsTestJSON-677523721 tempest-AbsoluteLimitsTestJSON-677523721-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.365680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:36:57.367552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:36:57.368735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:36:57.369790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:36:57.370943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:36:57.374383 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c40f1ace-6fd3-44e7-8409-a2d2529d8164 tempest-AbsoluteLimitsTestJSON-677523721 tempest-AbsoluteLimitsTestJSON-677523721-project] 10.222.0.98 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.444499 Jul 14 14:36:57.389016 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 197/378] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:36:56 2022] GET /compute/v2.1/limits => generated 511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:57.400387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:57.401983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:57.427358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.428670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.430675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.431859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.444159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.448624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.460998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:57.463454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:57.554683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:57.565135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:57.595324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Going to run 2 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:36:57.599631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:57.696105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=125966) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Jul 14 14:36:57.773888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:57.782435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:57.954578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:57.975235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:58.045315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=405f671c-074b-4192-9e92-ff6c4c4103e2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:36:58.139719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:58.154043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8556823e-d002-48de-985a-d842971e840a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1469 microversion: 2.1 time: 0.763581 Jul 14 14:36:58.155776 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 198/379] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:57 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1469 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:58.171805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:58.175747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:58.195940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.198331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.202000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.202801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.322273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:58.333420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:58.432772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:58.441759 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43edb477-8df6-44ab-8d7e-3bf3f551e1e4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1280 microversion: 2.1 time: 0.283710 Jul 14 14:36:58.443132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:36:58.446894 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 199/380] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:58 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1280 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:36:58.458832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:58.462013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:58.464892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'server_group_members'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:36:58.478189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.479041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.480576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:58.484785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:58.617654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-261db7ee-8844-4053-be8e-c0886986e041 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.052016 Jul 14 14:36:58.620010 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 182/381] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:36:55 2022] POST /compute/v2.1/servers => generated 32 bytes in 3056 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:36:59.278788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:59.279183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:59.293092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.295550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:59.297381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.299519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:59.309646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=81 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:59.373703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:36:59.663620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:59.699920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:59.703050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:59.709140 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-784fd899-36bf-4f2a-8b62-f270c9c56564 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1362 microversion: 2.25 time: 1.254312 Jul 14 14:36:59.710366 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 200/382] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:36:58 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1362 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:36:59.724132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:59.733660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:36:59.739616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Searching by: {'deleted': False, 'project_id': 'c9f14b1548c547608944442a8a351e56'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:36:59.786536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1eca6fb1-d693-4a8b-a3b2-3b73ddb7b32d tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] 10.222.0.98 "DELETE /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 204 len: 0 microversion: 2.1 time: 1.163308 Jul 14 14:36:59.790448 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 183/383] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:36:58 2022] DELETE /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 0 bytes in 1169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:36:59.797652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.798102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:59.804744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.805514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:59.824181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0e5ab642-d325-43ec-ab27-4d8213155702 req-a8d6efe1-0ddd-4b82-a1b8-dff6ce5bad60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d0e571-c557-48c6-90e4-e442642d46c5", "name": "network-vif-plugged", "status": "completed", "tag": "6ba63c73-6333-45d6-bc42-bdcb5d30ae36"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:36:59.842999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:36:59.869160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e5ab642-d325-43ec-ab27-4d8213155702 req-a8d6efe1-0ddd-4b82-a1b8-dff6ce5bad60 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.870006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e5ab642-d325-43ec-ab27-4d8213155702 req-a8d6efe1-0ddd-4b82-a1b8-dff6ce5bad60 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:59.931716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0e5ab642-d325-43ec-ab27-4d8213155702 req-a8d6efe1-0ddd-4b82-a1b8-dff6ce5bad60 service nova] Creating event network-vif-plugged:6ba63c73-6333-45d6-bc42-bdcb5d30ae36 for instance 26d0e571-c557-48c6-90e4-e442642d46c5 on n-h1-768852-23 Jul 14 14:36:59.942673 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0e5ab642-d325-43ec-ab27-4d8213155702 req-a8d6efe1-0ddd-4b82-a1b8-dff6ce5bad60 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146448 Jul 14 14:36:59.944452 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 184/384] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:36:59.955959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:36:59.957367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:36:59.970886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.971788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:36:59.973495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:36:59.974310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:00.119630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:00.492030 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d5ec44f-f5dd-44cb-b7f8-a85d649a0d7a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.778248 Jul 14 14:37:00.494400 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 201/385] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:36:59 2022] GET /compute/v2.1/servers => generated 1666 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:00.508956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:00.510977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:00.536896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:00.540165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:00.542925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:00.543991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.030497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:01.044334 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b040e6cc-98ff-4fad-89c6-60c1db030cc4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1475 microversion: 2.1 time: 0.547877 Jul 14 14:37:01.045316 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 202/386] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:00 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1475 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:01.059853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:01.063450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:01.090425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.091459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.094011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.094680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.481758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:01.498836 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-78c6edb2-8a3c-4d5f-bb8d-c627e5a810bf tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1223 microversion: 2.1 time: 0.452322 Jul 14 14:37:01.530711 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 203/387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:01 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1223 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:01.551214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:01.560118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:01.599738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.605302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.613000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:01.613685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:01.632492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:02.775845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:02.787195 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1c54ed4-cd39-495b-8f75-7230a793f329 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 2.840814 Jul 14 14:37:02.791736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 185/388] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:36:59 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 2846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:02.808035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:02.808945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:02.821177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.822851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:02.829549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:02.830451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.304410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:03.317252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:03.320274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:03.331419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee156a3b-46b0-46b3-9068-0de814dea5f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1362 microversion: 2.25 time: 1.791424 Jul 14 14:37:03.338459 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 204/389] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:01 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1362 bytes in 1807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:03.377377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:03.378447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:03.426744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:03.427227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.428661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:03.429106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.817106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:03.842090 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c3c2d1ab-90b0-4b5c-a1cc-65b38cb9317e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1277 microversion: 2.1 time: 0.502378 Jul 14 14:37:03.857802 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 205/390] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:03 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1277 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:03.871617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:03.872251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:03.891523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:03.892454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:03.895257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:03.909339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:04.375410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:04.395799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81e50fbb-89ce-42d0-9e9c-f72b3ed34c84 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1475 microversion: 2.1 time: 1.599254 Jul 14 14:37:04.397400 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 186/391] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:02 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1475 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:04.423426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:04.432109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:04.479210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:04.481100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:04.482896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:04.484027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.061059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:05.077516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c12fdcaa-754e-413f-af03-71c1331ea835 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 1.217009 Jul 14 14:37:05.079452 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 206/392] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:03 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:05.100690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.114975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.139076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.139945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.141426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.142125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.221879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:05.256374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:05.266985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:05.284373 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24d7c3ff-f719-47fa-a9b3-8b5eb6165ac6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1558 microversion: 2.25 time: 0.870436 Jul 14 14:37:05.299858 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 187/393] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:04 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1558 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:05.564116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:05.579454 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c50a55b0-e1d6-45bb-9221-80424b544b3c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1277 microversion: 2.1 time: 0.496334 Jul 14 14:37:05.593364 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 207/394] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:05 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1277 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:05.605404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.606462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.621828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.643705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.645510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.646293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.973302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:05.976280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:05.984267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.985186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:05.986192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:05.986819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:06.507172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:06.532928 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-81563be5-2ea8-43c9-894c-ab23f176c988 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 200 len: 1475 microversion: 2.1 time: 0.937888 Jul 14 14:37:06.533727 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 208/395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:05 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 1475 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:06.546444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:06.550127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:06.569622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:06.570418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:06.571490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:06.572162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.057568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:07.065670 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f591d443-36cd-4570-90d8-fc2ee605e2f4 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 0.530665 Jul 14 14:37:07.066284 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 209/396] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:06 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:07.079949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bfd0af32-c444-410b-9595-fdf7accdf237 req-b15f3af2-5306-4bb7-976c-4fcdbc4b6f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57743d28-3e4f-4a30-9eba-7ff75f331659", "name": "network-vif-deleted", "tag": "edcfe1b0-9192-4c6c-8916-522e5430c6e1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:07.101958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bfd0af32-c444-410b-9595-fdf7accdf237 req-b15f3af2-5306-4bb7-976c-4fcdbc4b6f2c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.102485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bfd0af32-c444-410b-9595-fdf7accdf237 req-b15f3af2-5306-4bb7-976c-4fcdbc4b6f2c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.130686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bfd0af32-c444-410b-9595-fdf7accdf237 req-b15f3af2-5306-4bb7-976c-4fcdbc4b6f2c service nova] Creating event network-vif-deleted:edcfe1b0-9192-4c6c-8916-522e5430c6e1 for instance 57743d28-3e4f-4a30-9eba-7ff75f331659 on n-h2-768852-23 Jul 14 14:37:07.137061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bfd0af32-c444-410b-9595-fdf7accdf237 req-b15f3af2-5306-4bb7-976c-4fcdbc4b6f2c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060769 Jul 14 14:37:07.141620 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 210/397] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:07.155192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.160432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:07.186297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.192187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.195675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.203966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.299577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:07.485337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:07.498530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=15 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:07.501868 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-89f15b89-cac7-400c-a594-699f23dca4b6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1277 microversion: 2.1 time: 0.356763 Jul 14 14:37:07.508097 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 211/398] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1277 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:07.562753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:07.563613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:07.577493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.581487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.582833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.583681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.628184 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] HTTP exception thrown: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Request method failure captured: Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 HTTP/1.1 Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnpjkoC2U0V5vgdl3I_BxfDqT9CE_kUBtLWvC2aoOCwwCKSUoIYb7mUCdVIm0hcX_9sBS6_ZR2TA1ZiWA-KfFIqS3OpQqpysVavRkZj-EDUeUtt5dsuyNyAamJX1TLcSBp6rBAgVneErl1yfcczFe5-dTHkUXB0liNm7pOkSMSW_xo Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:37:07.632588 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 80a79275009a41e38a6d41e10bc6c066 Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:07.634264 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '57743d28-3e4f-4a30-9eba-7ff75f331659'} Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:07.635097 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:07.636414 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:07.641728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Returning 404 to user: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:07.643112 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b7cbd31-6036-478d-8719-8574afac0024 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 404 len: 111 microversion: 2.1 time: 0.084901 Jul 14 14:37:07.646480 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 212/399] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:07 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:37:07.661105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7b26197d-fc63-4f6e-a493-6a9af19d3fee req-4fc4645d-d006-4ff5-a225-01b10df45f5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5825652f-8c70-4e1d-8122-73b0060140ca", "tag": "f2eafc9b-533f-4dae-8e52-4589bd08f6fd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:07.685625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7b26197d-fc63-4f6e-a493-6a9af19d3fee req-4fc4645d-d006-4ff5-a225-01b10df45f5a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:07.688111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7b26197d-fc63-4f6e-a493-6a9af19d3fee req-4fc4645d-d006-4ff5-a225-01b10df45f5a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:07.723937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7b26197d-fc63-4f6e-a493-6a9af19d3fee req-4fc4645d-d006-4ff5-a225-01b10df45f5a service nova] Creating event network-changed:f2eafc9b-533f-4dae-8e52-4589bd08f6fd for instance 5825652f-8c70-4e1d-8122-73b0060140ca on n-h2-768852-23 Jul 14 14:37:07.736171 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7b26197d-fc63-4f6e-a493-6a9af19d3fee req-4fc4645d-d006-4ff5-a225-01b10df45f5a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083752 Jul 14 14:37:07.736964 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 213/400] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:07.956834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-37642310", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:08.054046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:08.090835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid 26d0e571-c557-48c6-90e4-e442642d46c5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:08.172036 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b009924-7dd1-4b1d-92b8-497a1fd99f91 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 2053 microversion: 2.25 time: 2.862991 Jul 14 14:37:08.172932 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 188/401] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:05 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 2053 bytes in 2865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:37:08.179105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:08.180218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:08.187569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.188392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.189444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:08.190161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:08.495165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=29 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:09.001559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:09.002296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:09.002507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:09.003206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:09.003992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:09.038442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:09.039970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.041249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:09.041947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.053917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=13 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:09.071463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Getting quotas for project 5a041638b2ef4261b6f3f2fbf3ba06c7. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:09.079422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Getting quotas for user 80a79275009a41e38a6d41e10bc6c066 and project 5a041638b2ef4261b6f3f2fbf3ba06c7. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:09.100196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:09.104900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:09.149660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:09.168983 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e590a3b-dcd6-47f5-a817-0f23bec59dc2 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 0.989505 Jul 14 14:37:09.169713 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 189/402] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:08 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:09.178003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:09.178636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:09.184975 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b26b65f9-d8c7-468b-9d96-05432b56a7d1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233876 Jul 14 14:37:09.194063 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 214/403] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:37:09.198917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:09.200399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.202501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:09.204516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.206068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:09.207141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:09.220280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:09.221110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.222194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:09.222879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:09.357959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:09.378692 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f08f1c2-737c-4d30-96eb-7475c01fdca4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1277 microversion: 2.1 time: 0.180711 Jul 14 14:37:09.379391 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 215/404] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:09 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:09.792073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20f80974-eb12-4c1b-88f0-b28ab0ea699c tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] Action: 'create', calling method: .version_select at 0x7fdbf3866550>, body: {"security_group": {"name": "tempest-securitygroup-1673546841", "description": "tempest-description-244092680"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:09.970260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid 26d0e571-c557-48c6-90e4-e442642d46c5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:10.004887 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1d92fbca-3cec-4df2-b0eb-58c19f90d787 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 2053 microversion: 2.25 time: 0.833774 Jul 14 14:37:10.012709 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 190/405] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:09 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 2053 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:10.024107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.027690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:10.048819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.050027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.060561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.061095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.270881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:10.282344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ffcbdde-6046-4c23-9b60-9f7706ac2749 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1222 microversion: 2.1 time: 0.267636 Jul 14 14:37:10.284225 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 191/406] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1222 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:10.296834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de200bd2-0eb2-465d-bbe1-f1d3ff50cc93 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.299592 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:37:10.299592 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:37:10.301681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de200bd2-0eb2-465d-bbe1-f1d3ff50cc93 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.302762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de200bd2-0eb2-465d-bbe1-f1d3ff50cc93 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.305378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de200bd2-0eb2-465d-bbe1-f1d3ff50cc93 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.306947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de200bd2-0eb2-465d-bbe1-f1d3ff50cc93 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.400830 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de200bd2-0eb2-465d-bbe1-f1d3ff50cc93 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.110212 Jul 14 14:37:10.402724 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 192/407] 10.222.0.98 () {60 vars in 1216 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:37:10.410144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.420262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:10.427446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.428041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.429053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.429651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.945169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:10.957478 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ddb27cee-008e-4832-8f47-8d9b418a2471 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 0.552821 Jul 14 14:37:10.961218 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 193/408] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:10.974573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:10.975300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:10.992144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.994870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:10.997887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:10.999627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.180060 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20f80974-eb12-4c1b-88f0-b28ab0ea699c tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.788598 Jul 14 14:37:12.182478 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 216/409] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:09 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:12.204009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": "auto"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:12.205239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:12.226443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.233031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.242527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.243231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.254016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:12.291148 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71bb47e1-9624-42a7-b49f-794ff060ed9a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1319 microversion: 2.1 time: 1.327868 Jul 14 14:37:12.296285 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 194/410] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:10 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1319 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:12.315514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.317540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:12.331334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.331966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.334770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.335537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.703927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:12.739528 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8433ab12-682a-47ac-b474-ed7cc3646b1f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1276 microversion: 2.1 time: 0.424958 Jul 14 14:37:12.744513 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 195/411] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1276 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:12.788495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:12.790186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:12.818893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.822917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:12.831431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:12.832966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:13.022416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'flavor' on Instance uuid 26d0e571-c557-48c6-90e4-e442642d46c5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:13.174826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Going to try to live migrate instance to n-h2-768852-23 {{(pid=125965) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:37:13.910706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:13.934682 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e042eb7e-ddf3-4a8b-a974-3e4600394249 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 1.174815 Jul 14 14:37:13.941762 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 196/412] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:12 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:13.967681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ce6ba74-ff76-4888-995e-5e7f465276a2 tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] Action: 'create', calling method: .version_select at 0x7fdbf36103a0>, body: {"security_group": {"name": "tempest-securitygroup-1414636962", "description": "tempest-description-630915621"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:15.596610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2ce6ba74-ff76-4888-995e-5e7f465276a2 tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.652140 Jul 14 14:37:15.601418 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 197/413] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:15.635219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:15.636623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:15.687198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:15.723343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:15.726737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:15.727931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:16.640892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:16.661350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e529b4e-4b7a-4baa-b060-d1ecf74a5496 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1319 microversion: 2.1 time: 1.058076 Jul 14 14:37:16.662443 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 198/414] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:15 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1319 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:16.668058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:16.669021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:16.682807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:16.683894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:16.691628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:16.692386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.086105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:17.090127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:17.118077 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1b97f7a-29cd-4876-bef7-5dd9b413b36f tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1276 microversion: 2.1 time: 0.453889 Jul 14 14:37:17.122661 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 199/415] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:16 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1276 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:17.153054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:17.154479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:17.176372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:17.186730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.192981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:17.194788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:17.957748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:17.994469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9c222f3-52ea-4cdd-8aad-84aca3ff72b8 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 0.867482 Jul 14 14:37:17.996325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 200/416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:17 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:18.031525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-be221984-0567-4efd-ad17-ef91966cbd41 req-71aa6cbb-9ec6-4d2c-94d4-a800ef6f1d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "405f671c-074b-4192-9e92-ff6c4c4103e2", "tag": "ea893d0c-2968-4846-af6f-0af1e1bf79f5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:18.054178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-be221984-0567-4efd-ad17-ef91966cbd41 req-71aa6cbb-9ec6-4d2c-94d4-a800ef6f1d14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.055341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-be221984-0567-4efd-ad17-ef91966cbd41 req-71aa6cbb-9ec6-4d2c-94d4-a800ef6f1d14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.090545 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-be221984-0567-4efd-ad17-ef91966cbd41 req-71aa6cbb-9ec6-4d2c-94d4-a800ef6f1d14 service nova] Creating event network-changed:ea893d0c-2968-4846-af6f-0af1e1bf79f5 for instance 405f671c-074b-4192-9e92-ff6c4c4103e2 on n-h1-768852-23 Jul 14 14:37:18.118462 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-be221984-0567-4efd-ad17-ef91966cbd41 req-71aa6cbb-9ec6-4d2c-94d4-a800ef6f1d14 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105108 Jul 14 14:37:18.125597 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 201/417] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:18.149463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c9341aac-f960-4b76-94f8-dafa2ce9b5e0 req-7f7654c2-3cb1-4e7e-ac3d-3170ae61602e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81f0b0a2-c53c-4559-bb48-31b8a10d23a9", "tag": "e787f9f6-4bc3-4b82-8c72-f2eaf8b43935"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:18.176097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c9341aac-f960-4b76-94f8-dafa2ce9b5e0 req-7f7654c2-3cb1-4e7e-ac3d-3170ae61602e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.181394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c9341aac-f960-4b76-94f8-dafa2ce9b5e0 req-7f7654c2-3cb1-4e7e-ac3d-3170ae61602e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.222511 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c9341aac-f960-4b76-94f8-dafa2ce9b5e0 req-7f7654c2-3cb1-4e7e-ac3d-3170ae61602e service nova] Creating event network-changed:e787f9f6-4bc3-4b82-8c72-f2eaf8b43935 for instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 on n-h2-768852-23 Jul 14 14:37:18.230731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c9341aac-f960-4b76-94f8-dafa2ce9b5e0 req-7f7654c2-3cb1-4e7e-ac3d-3170ae61602e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100734 Jul 14 14:37:18.231798 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 202/418] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:18.451700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-945b1e27-1922-4483-a7af-05e051a6f68a tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] Action: 'create', calling method: .version_select at 0x7fdbf367e040>, body: {"security_group": {"name": "tempest-securitygroup-1390612936", "description": "tempest-description-1127866044"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:18.697854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7a2e80bc-d586-4632-89e1-daa698e70a7d tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5/action" status: 202 len: 0 microversion: 2.25 time: 6.513310 Jul 14 14:37:18.712420 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 217/419] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:37:12 2022] POST /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5/action => generated 0 bytes in 6529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:18.726007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:18.728082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:18.747806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.748635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:18.750085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:18.752902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:19.071720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:19.092317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:19.795063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:19.806102 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7046ce3d-e38f-494c-b81a-8251bac72881 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1319 microversion: 2.1 time: 1.091803 Jul 14 14:37:19.807111 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 218/420] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:18 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1319 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:19.816638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:19.818351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:19.822547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=85 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:19.835591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:19.836243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:19.837135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:19.837501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.015704 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-945b1e27-1922-4483-a7af-05e051a6f68a tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.779715 Jul 14 14:37:20.032006 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 203/421] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:18 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:20.052501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9d499274-a761-4a71-b131-5ab8b5d3240c req-8c8eb531-d459-4b52-baff-1c89eda611bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5825652f-8c70-4e1d-8122-73b0060140ca", "name": "network-vif-plugged", "status": "completed", "tag": "f2eafc9b-533f-4dae-8e52-4589bd08f6fd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:20.072678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9d499274-a761-4a71-b131-5ab8b5d3240c req-8c8eb531-d459-4b52-baff-1c89eda611bf service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.074904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9d499274-a761-4a71-b131-5ab8b5d3240c req-8c8eb531-d459-4b52-baff-1c89eda611bf service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.100474 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9d499274-a761-4a71-b131-5ab8b5d3240c req-8c8eb531-d459-4b52-baff-1c89eda611bf service nova] Creating event network-vif-plugged:f2eafc9b-533f-4dae-8e52-4589bd08f6fd for instance 5825652f-8c70-4e1d-8122-73b0060140ca on n-h2-768852-23 Jul 14 14:37:20.106402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9d499274-a761-4a71-b131-5ab8b5d3240c req-8c8eb531-d459-4b52-baff-1c89eda611bf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072823 Jul 14 14:37:20.108012 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 204/422] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:20.114262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:20.115459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:20.123160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.123915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.124955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.125590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.324833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:20.714824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.724394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.726342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.727778 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e459fca3-6954-43b8-b229-ab3fdb70dbf6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1568 microversion: 2.25 time: 0.618225 Jul 14 14:37:20.730545 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 205/423] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:20 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1568 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:20.736203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:20.737093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:20.757141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.757752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.758722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:20.759220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:20.924221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:20.952886 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29bd0f66-ad4f-42b1-b763-6fbfe1f29dec tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 1.143300 Jul 14 14:37:20.969323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 219/424] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:19 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:20.985836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5324877-c7f8-47eb-90d8-b57e7df5be56 tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] Action: 'create', calling method: .version_select at 0x7fdbf36008b0>, body: {"security_group": {"name": "tempest-securitygroup-1636628534", "description": "tempest-description-880324447"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:21.042330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:21.051525 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-766f6894-7e1c-485f-9c5a-b1712b9e8503 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1322 microversion: 2.1 time: 0.319443 Jul 14 14:37:21.065578 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 206/425] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:20 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1322 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:21.168666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-927061854", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "ee03bffb-17d6-47bc-b312-096b88b6e925"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:21.290989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] validate_networks() for [('ee03bffb-17d6-47bc-b312-096b88b6e925', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:22.256497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5324877-c7f8-47eb-90d8-b57e7df5be56 tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.284752 Jul 14 14:37:22.261207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 220/426] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:20 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:22.292598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:22.297644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:22.314550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:22.315455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:22.316834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:22.318188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.230911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:23.235588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:23.245515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:23.258510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:23.280720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:23.323854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.325474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.325474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.325829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.343742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:23.352893 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bda4ae3a-f42a-4df9-b093-47da77981a5b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1319 microversion: 2.1 time: 1.080197 Jul 14 14:37:23.363678 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 221/427] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:22 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1319 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:23.369833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:23.372134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:23.375540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:23.392037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for user 038556a90129478eb04699f574ea7e1b and project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:23.411319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.415881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.420307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.421649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.426198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:23.428829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:23.558363 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-765cdda8-ef81-4267-befb-ccf6c9ba8711 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.490778 Jul 14 14:37:23.564459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 207/428] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:23.583524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:23.584892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:23.607110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.608526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:23.611289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:23.612435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.422263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.458187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c49a602a-ff27-493f-ad9b-e79f91ead701 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 0.889559 Jul 14 14:37:24.460330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 208/429] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:23 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:24.473735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:24.475667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:24.487570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.492087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.493263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:24.493870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:24.498649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.513066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.514703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:24.520064 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c06abb4d-0978-4729-99d1-06a3c15547dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1568 microversion: 2.25 time: 1.152612 Jul 14 14:37:24.523779 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 222/430] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:23 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1568 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:24.550025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1cd39c1f-1da0-435d-a85d-7d7711fee6d4 tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] Calling method '.version_select at 0x7fdbf3635dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.480129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:26.490571 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e76365f-0d68-4e11-8581-46d755d26b5f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1471 microversion: 2.1 time: 2.028427 Jul 14 14:37:26.511626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 209/431] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:24 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1471 bytes in 2036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:26.511626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2e1196dd-d6be-44d9-b642-14d78850be6a req-65912c0d-3659-4842-bc8a-79c6bb935bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d0e571-c557-48c6-90e4-e442642d46c5", "name": "network-vif-unplugged", "status": "completed", "tag": "6ba63c73-6333-45d6-bc42-bdcb5d30ae36"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:26.551647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2e1196dd-d6be-44d9-b642-14d78850be6a req-65912c0d-3659-4842-bc8a-79c6bb935bf1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.552095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2e1196dd-d6be-44d9-b642-14d78850be6a req-65912c0d-3659-4842-bc8a-79c6bb935bf1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.593714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2e1196dd-d6be-44d9-b642-14d78850be6a req-65912c0d-3659-4842-bc8a-79c6bb935bf1 service nova] Creating event network-vif-unplugged:6ba63c73-6333-45d6-bc42-bdcb5d30ae36 for instance 26d0e571-c557-48c6-90e4-e442642d46c5 on n-h1-768852-23 Jul 14 14:37:26.609347 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2e1196dd-d6be-44d9-b642-14d78850be6a req-65912c0d-3659-4842-bc8a-79c6bb935bf1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110262 Jul 14 14:37:26.609983 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 210/432] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:26.616301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.617011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:26.644991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.645443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.646231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.646702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.783983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:26.792494 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4759f60c-54f3-499b-8f4d-d7d2e5d11114 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1262 microversion: 2.1 time: 0.181214 Jul 14 14:37:26.798648 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 211/433] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1262 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:26.804346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:26.804957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:26.846403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.849001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:26.851040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:26.852920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.521698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:27.547702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-254257a5-7107-45c0-af00-ec7b13d0e269 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1319 microversion: 2.1 time: 0.747351 Jul 14 14:37:27.548732 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 212/434] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:26 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1319 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:27.592792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-20737fa6-5588-4936-908b-b96f73a1e2d7 req-8558d27b-494c-49c1-9c46-133f78bec65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa3115d-60a4-498c-8010-7f8475c650c1", "tag": "39648df0-6f29-4a29-a8f6-8e76b0b9fe19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:27.617377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-20737fa6-5588-4936-908b-b96f73a1e2d7 req-8558d27b-494c-49c1-9c46-133f78bec65e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.621548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-20737fa6-5588-4936-908b-b96f73a1e2d7 req-8558d27b-494c-49c1-9c46-133f78bec65e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.657868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-20737fa6-5588-4936-908b-b96f73a1e2d7 req-8558d27b-494c-49c1-9c46-133f78bec65e service nova] Creating event network-changed:39648df0-6f29-4a29-a8f6-8e76b0b9fe19 for instance 6aa3115d-60a4-498c-8010-7f8475c650c1 on n-h2-768852-23 Jul 14 14:37:27.672089 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-20737fa6-5588-4936-908b-b96f73a1e2d7 req-8558d27b-494c-49c1-9c46-133f78bec65e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105921 Jul 14 14:37:27.682677 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 213/435] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:27.688614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:27.689671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:27.697933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.698796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:27.704699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:27.705612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.032352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.062679 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2fae8fa-7e97-44c6-941f-3213bcc99084 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 0.377993 Jul 14 14:37:28.096104 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 214/436] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:27 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:28.113071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:28.117129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:28.130700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.132083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.133843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:28.134895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:28.694864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.724861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.728376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:28.731429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18fd60f6-dbb2-4f0f-8c5d-99b516f6c5a2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1568 microversion: 2.25 time: 0.633262 Jul 14 14:37:28.733308 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 215/437] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:28 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1568 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:29.142433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9f9c893-3e4d-4ab6-9cba-c19d45d8a355 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:29.144028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d9f9c893-3e4d-4ab6-9cba-c19d45d8a355 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] [instance: fff6773d-b6b2-4b71-ba62-c867f67d7985] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.163764 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d9f9c893-3e4d-4ab6-9cba-c19d45d8a355 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] HTTP exception thrown: Instance fff6773d-b6b2-4b71-ba62-c867f67d7985 could not be found. Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9f9c893-3e4d-4ab6-9cba-c19d45d8a355 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Request method failure captured: Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/fff6773d-b6b2-4b71-ba62-c867f67d7985/action HTTP/1.1 Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 15 Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cn_dkfoYY2FthAHVb5R_p6uOzm9wHJkNvHy12N_fzf7SDaA1Ndb2fSKBADaIW90nqygo5V9-alJ6ViuZve7NfoLaph-BhCuGpsYYYUf-KkRxJNe1ROQJvE5o7KdOpGzmCtNU4bdtn3mGKOWQRivSrt_jZw-QsuZJu4iVvKqBXl9yDk Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:37:29.180124 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ffd977efd139496dad278ed5933f8379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ffd977efd139496dad278ed5933f8379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 3f1be8b33b93467197f8902f4c740ca1 Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: {"migrate": {}} Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:37:29.182819 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance fff6773d-b6b2-4b71-ba62-c867f67d7985 could not be found. Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'fff6773d-b6b2-4b71-ba62-c867f67d7985', 'body': {'migrate': {}}} Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fff6773d-b6b2-4b71-ba62-c867f67d7985 could not be found. Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:29.184502 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fff6773d-b6b2-4b71-ba62-c867f67d7985 could not be found. Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fff6773d-b6b2-4b71-ba62-c867f67d7985 could not be found. Jul 14 14:37:29.186906 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:29.190395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9f9c893-3e4d-4ab6-9cba-c19d45d8a355 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Returning 404 to user: Instance fff6773d-b6b2-4b71-ba62-c867f67d7985 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:29.199194 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d9f9c893-3e4d-4ab6-9cba-c19d45d8a355 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/fff6773d-b6b2-4b71-ba62-c867f67d7985/action" status: 404 len: 111 microversion: 2.1 time: 0.453631 Jul 14 14:37:29.211847 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 216/438] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:28 2022] POST /compute/v2.1/servers/fff6773d-b6b2-4b71-ba62-c867f67d7985/action => generated 111 bytes in 468 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:29.228350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.233221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.276959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.288630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.290714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.291892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.430042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:29.448949 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9af89257-2fdd-4433-963e-d6ef9690211e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1268 microversion: 2.1 time: 0.235137 Jul 14 14:37:29.453393 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 217/439] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1268 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:29.469538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-651a0a6c-daa1-4d35-9f96-ff16f3b4404f req-026cb381-d417-477b-8697-9b2ef96eb68a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f0b0a2-c53c-4559-bb48-31b8a10d23a9", "name": "network-vif-plugged", "status": "completed", "tag": "e787f9f6-4bc3-4b82-8c72-f2eaf8b43935"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:29.481081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-651a0a6c-daa1-4d35-9f96-ff16f3b4404f req-026cb381-d417-477b-8697-9b2ef96eb68a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.481946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-651a0a6c-daa1-4d35-9f96-ff16f3b4404f req-026cb381-d417-477b-8697-9b2ef96eb68a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.510597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-651a0a6c-daa1-4d35-9f96-ff16f3b4404f req-026cb381-d417-477b-8697-9b2ef96eb68a service nova] Creating event network-vif-plugged:e787f9f6-4bc3-4b82-8c72-f2eaf8b43935 for instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 on n-h2-768852-23 Jul 14 14:37:29.523914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-651a0a6c-daa1-4d35-9f96-ff16f3b4404f req-026cb381-d417-477b-8697-9b2ef96eb68a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069130 Jul 14 14:37:29.527708 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 218/440] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:29.533664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:29.541140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:29.559864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.560690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:29.561750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:29.562402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.204332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:30.290097 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-83400b08-d382-44f0-8769-f4e999a6612b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1319 microversion: 2.1 time: 0.760595 Jul 14 14:37:30.294273 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 219/441] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:29 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:30.305198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-79472f93-50b2-4a91-8fe3-ae67cd2aaebc req-1836c042-628c-4b77-85c2-fadf865edfdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d0e571-c557-48c6-90e4-e442642d46c5", "tag": "6ba63c73-6333-45d6-bc42-bdcb5d30ae36"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:30.327577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:30.348934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-79472f93-50b2-4a91-8fe3-ae67cd2aaebc req-1836c042-628c-4b77-85c2-fadf865edfdb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.354296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-79472f93-50b2-4a91-8fe3-ae67cd2aaebc req-1836c042-628c-4b77-85c2-fadf865edfdb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.380008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-79472f93-50b2-4a91-8fe3-ae67cd2aaebc req-1836c042-628c-4b77-85c2-fadf865edfdb service nova] Creating event network-changed:6ba63c73-6333-45d6-bc42-bdcb5d30ae36 for instance 26d0e571-c557-48c6-90e4-e442642d46c5 on n-h1-768852-23 Jul 14 14:37:30.392549 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-79472f93-50b2-4a91-8fe3-ae67cd2aaebc req-1836c042-628c-4b77-85c2-fadf865edfdb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096676 Jul 14 14:37:30.394294 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 220/442] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:30.400220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:30.400934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:30.424717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.425330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:30.426198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:30.428752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:31.467608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:31.481915 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-607a9d00-f7fc-48a6-b5e8-f4daf5e18263 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 1.082577 Jul 14 14:37:31.501223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 221/443] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:30 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:31.519721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-528757961", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:31.663902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:32.253975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:32.254958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:32.256187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:32.256769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:32.257373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:32.285745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.290380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.291919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.294290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.340367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Getting quotas for project 37c6e6fc4a9e4a8ab44ea9b14b7eefc5. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:32.350902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Getting quotas for user 82254dd6dfcc4f2f96995a0133a901b4 and project 37c6e6fc4a9e4a8ab44ea9b14b7eefc5. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:32.375864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:32.382816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:32.510773 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d3d49c72-b083-4be0-926f-dbf678f82f11 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.007900 Jul 14 14:37:32.516821 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 222/444] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:32.527567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:32.528761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:32.559902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.560642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:32.562109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:32.563241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.029031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.057717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.063438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.066151 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94144e98-2f67-40b7-979b-4f2e9a05ef7d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1568 microversion: 2.25 time: 0.552082 Jul 14 14:37:33.067249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 223/445] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:32 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1568 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:33.087156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.088327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.095053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.095808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.096820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.097481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.118710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.324779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.355156 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78b62b13-bb10-45a7-ae54-57b13671ab0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.274402 Jul 14 14:37:33.362392 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 224/446] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:33.379001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:33.384582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=5 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:33.388737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:33.406601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.418559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.420804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:33.422098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:33.869733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:33.913937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02c0d8ac-4208-4a07-aa6c-c373a10606ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1468 microversion: 2.1 time: 0.545487 Jul 14 14:37:33.915145 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 225/447] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:33 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1468 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:34.049912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f763351f-2f70-4bcd-9587-a91cc69fe3a6 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf35da040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-346798132", "description": "tempest-description-2009248191"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:34.352746 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f763351f-2f70-4bcd-9587-a91cc69fe3a6 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.431373 Jul 14 14:37:34.366912 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 226/448] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:34.382080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-40c56a2f-5a21-4c7c-950b-1383d22158bd req-434c6a7d-bed5-4154-96ec-f62efb8f4d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405f671c-074b-4192-9e92-ff6c4c4103e2", "name": "network-vif-plugged", "status": "completed", "tag": "ea893d0c-2968-4846-af6f-0af1e1bf79f5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:34.420221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-40c56a2f-5a21-4c7c-950b-1383d22158bd req-434c6a7d-bed5-4154-96ec-f62efb8f4d7d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.421417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-40c56a2f-5a21-4c7c-950b-1383d22158bd req-434c6a7d-bed5-4154-96ec-f62efb8f4d7d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.469675 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-40c56a2f-5a21-4c7c-950b-1383d22158bd req-434c6a7d-bed5-4154-96ec-f62efb8f4d7d service nova] Creating event network-vif-plugged:ea893d0c-2968-4846-af6f-0af1e1bf79f5 for instance 405f671c-074b-4192-9e92-ff6c4c4103e2 on n-h1-768852-23 Jul 14 14:37:34.487859 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-40c56a2f-5a21-4c7c-950b-1383d22158bd req-434c6a7d-bed5-4154-96ec-f62efb8f4d7d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114341 Jul 14 14:37:34.490566 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 227/449] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:34.507206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:34.510072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:34.512451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:34.546015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.547167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:34.550315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:34.552244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.166430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.190423 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c250d56-e5d2-4892-85fc-a2c16f2ed42e tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 0.696529 Jul 14 14:37:35.191914 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 228/450] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:34 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:35.204159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.205748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.221213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.222688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.225058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.226316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.393689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.440070 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d63ad5c-eb0a-4923-a109-4c286a9a7716 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1281 microversion: 2.1 time: 0.232145 Jul 14 14:37:35.463356 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 229/451] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1281 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:35.491259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.492733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.525096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.526124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.527182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.527889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.780290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:35.789824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3300775c-3ffe-48d6-aea8-5d1b101d5f71 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 200 len: 1319 microversion: 2.1 time: 0.329401 Jul 14 14:37:35.792300 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 230/452] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:35.799524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:35.800401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:35.815038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.816488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:35.819412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:35.820616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.230189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.246747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.265440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:36.294366 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c9b9d53-9863-41d3-aea4-aefb5b35cd87 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1568 microversion: 2.25 time: 0.486481 Jul 14 14:37:36.305234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 231/453] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:35 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1568 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:36.331089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-41a493b0-ebff-474d-b45b-3dd687b00fb7 req-60537bb6-0506-476d-8027-e1226e7b9349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d0e571-c557-48c6-90e4-e442642d46c5", "name": "network-vif-unplugged", "status": "completed", "tag": "6ba63c73-6333-45d6-bc42-bdcb5d30ae36"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:36.392120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-41a493b0-ebff-474d-b45b-3dd687b00fb7 req-60537bb6-0506-476d-8027-e1226e7b9349 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:36.393405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-41a493b0-ebff-474d-b45b-3dd687b00fb7 req-60537bb6-0506-476d-8027-e1226e7b9349 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:36.453691 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41a493b0-ebff-474d-b45b-3dd687b00fb7 req-60537bb6-0506-476d-8027-e1226e7b9349 service nova] Creating event network-vif-unplugged:6ba63c73-6333-45d6-bc42-bdcb5d30ae36 for instance 26d0e571-c557-48c6-90e4-e442642d46c5 on n-h1-768852-23 Jul 14 14:37:36.464921 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-41a493b0-ebff-474d-b45b-3dd687b00fb7 req-60537bb6-0506-476d-8027-e1226e7b9349 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156876 Jul 14 14:37:36.466427 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 232/454] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:36.478498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4c3afdb6-5d09-463d-a6b4-bfeb54975e13 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf35950d0>, body: {"security_group_rule": {"parent_group_id": "d6690952-ffc7-40de-b1ae-ce8fafed2b9d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:37.195160 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4c3afdb6-5d09-463d-a6b4-bfeb54975e13 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.726581 Jul 14 14:37:37.196299 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 233/455] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:37:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:37.209088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.210020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.218642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.219210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.220090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.221249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.676695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:37.702636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a835b8fc-e5e7-44fa-9b8a-e56489daec2f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.503269 Jul 14 14:37:37.707236 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 234/456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:37.719610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:37.721167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:37.740915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.744019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:37.746514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:37.747484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.301627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.312630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-869e9451-0c87-40b0-b364-b87ebaa3fb2b tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 0.603136 Jul 14 14:37:38.314002 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 235/457] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:37 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:38.322272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:38.322894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:38.335110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.335892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.337029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.337906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.431463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:38.441981 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c5a1650-d48d-493f-a081-82e23a71038e tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1279 microversion: 2.1 time: 0.124639 Jul 14 14:37:38.461253 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 236/458] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:38 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1279 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:38.467703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e9f06162-9f34-4cfb-be2b-52fba861fb81 req-85b72c97-d373-4959-89b0-8bfa91ffad37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa3115d-60a4-498c-8010-7f8475c650c1", "name": "network-vif-plugged", "status": "completed", "tag": "39648df0-6f29-4a29-a8f6-8e76b0b9fe19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:38.481560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e9f06162-9f34-4cfb-be2b-52fba861fb81 req-85b72c97-d373-4959-89b0-8bfa91ffad37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.482762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e9f06162-9f34-4cfb-be2b-52fba861fb81 req-85b72c97-d373-4959-89b0-8bfa91ffad37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.509995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e9f06162-9f34-4cfb-be2b-52fba861fb81 req-85b72c97-d373-4959-89b0-8bfa91ffad37 service nova] Creating event network-vif-plugged:39648df0-6f29-4a29-a8f6-8e76b0b9fe19 for instance 6aa3115d-60a4-498c-8010-7f8475c650c1 on n-h2-768852-23 Jul 14 14:37:38.527079 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e9f06162-9f34-4cfb-be2b-52fba861fb81 req-85b72c97-d373-4959-89b0-8bfa91ffad37 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063028 Jul 14 14:37:38.528550 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 237/459] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:38.545277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:38.547030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:38.561978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.562922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:38.565437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:38.566165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.147782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.156892 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24601896-03c6-4a10-848b-bf7eb38467d2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 200 len: 1469 microversion: 2.1 time: 0.623379 Jul 14 14:37:39.157635 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 238/460] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:38 2022] GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 1469 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:39.164085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-88851eba-9d7a-4b0d-9831-c0a0f05b8540 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf354b820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1270922425", "description": "tempest-description-766855364"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:39.286537 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1cd39c1f-1da0-435d-a85d-7d7711fee6d4 tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] 10.222.0.98 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11806 microversion: 2.1 time: 14.747932 Jul 14 14:37:39.288149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 223/461] 10.222.0.98 () {58 vars in 1190 bytes} [Thu Jul 14 14:37:24 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11806 bytes in 14752 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:37:39.307131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.309567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.323025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.323805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.325182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.325963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.492825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-88851eba-9d7a-4b0d-9831-c0a0f05b8540 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.329555 Jul 14 14:37:39.493038 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 239/462] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:39 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:39.501151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-616d7688-07bf-4fd6-9ba4-b6ab6fe63191 req-27ecfffd-ec29-454b-a05b-6800b5c58fa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1c9f04-7d06-489f-a719-417c45f7ecaa", "tag": "cb666f3c-3c5d-4e61-ba94-a69732fa4ee5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:39.520582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-616d7688-07bf-4fd6-9ba4-b6ab6fe63191 req-27ecfffd-ec29-454b-a05b-6800b5c58fa3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.522798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-616d7688-07bf-4fd6-9ba4-b6ab6fe63191 req-27ecfffd-ec29-454b-a05b-6800b5c58fa3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.561092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-616d7688-07bf-4fd6-9ba4-b6ab6fe63191 req-27ecfffd-ec29-454b-a05b-6800b5c58fa3 service nova] Creating event network-changed:cb666f3c-3c5d-4e61-ba94-a69732fa4ee5 for instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa on n-h1-768852-23 Jul 14 14:37:39.571425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-616d7688-07bf-4fd6-9ba4-b6ab6fe63191 req-27ecfffd-ec29-454b-a05b-6800b5c58fa3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074569 Jul 14 14:37:39.572853 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 240/463] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:39.588843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.588843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:39.600540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.601086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.601957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.602651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.841426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.843380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.870402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a113481-2f28-479a-8965-36126767b53c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.294962 Jul 14 14:37:39.882893 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 241/464] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:39.883344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.889413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.892184 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-234aab1c-1b34-4d26-a50b-13f211f4ec90 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1558 microversion: 2.25 time: 0.596024 Jul 14 14:37:39.895432 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 224/465] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1558 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:39.909830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:39.919983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:39.922329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Searching by: {'reservation_id': 'r-prv00c5u', 'deleted': False, 'project_id': 'c9f14b1548c547608944442a8a351e56'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:37:39.943437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.946774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:39.951742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:39.952704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.149234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bca3796c-de02-4d53-8978-252f49715a5b tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.160914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bca3796c-de02-4d53-8978-252f49715a5b tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.284233 Jul 14 14:37:40.169339 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 242/466] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:40.174497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8dd95200-982b-45cf-9577-4a0ee6d31275 tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] Calling method '.version_select at 0x7fdbf3610820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.212403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:37:40.398563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.416672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.417863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.486832 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8dd95200-982b-45cf-9577-4a0ee6d31275 tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.315830 Jul 14 14:37:40.487860 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 243/467] 10.222.0.98 () {58 vars in 1190 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:40.493911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.495873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:40.507888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.508733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.509805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.510503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.735483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.746811 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22cf2645-5964-439c-b16c-585f4d0f29b5 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1318 microversion: 2.1 time: 0.257443 Jul 14 14:37:40.749690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 244/468] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:40.756631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.757538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:40.765005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.765824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.767443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.768190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.842176 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad6ec9ee-fbbb-4001-bf94-6b9c9b20259f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/detail?reservation_id=r-prv00c5u" status: 200 len: 2930 microversion: 2.1 time: 0.944690 Jul 14 14:37:40.843075 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 225/469] 10.222.0.98 () {58 vars in 1196 bytes} [Thu Jul 14 14:37:39 2022] GET /compute/v2.1/servers/detail?reservation_id=r-prv00c5u => generated 2930 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:40.848349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bca2dc28-ebb0-4fdd-84d8-046063ee59bd tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf3600280>, body: {"security_group_rule": {"parent_group_id": "b080ed82-8b05-454d-948b-6bb79802a6ba", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:40.955987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:40.965294 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6ed0ae2-c2b1-41ef-8162-903afbf2d49f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1321 microversion: 2.1 time: 0.213041 Jul 14 14:37:40.979569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 245/470] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:40.979569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b2b1023-fa11-462a-bb58-dfa91ca4ae9a tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '.version_select at 0x7fdbf354bee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:40.979569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b2b1023-fa11-462a-bb58-dfa91ca4ae9a tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:40.979569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b2b1023-fa11-462a-bb58-dfa91ca4ae9a tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:40.991565 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b2b1023-fa11-462a-bb58-dfa91ca4ae9a tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 684 microversion: 2.25 time: 0.024220 Jul 14 14:37:40.992194 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 246/471] 10.222.0.98 () {60 vars in 1183 bytes} [Thu Jul 14 14:37:40 2022] GET /compute/v2.1/os-migrations => generated 684 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:37:41.112806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ec25e5c-0eaa-46bf-8a0d-ce232387f7c7 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-690963422", "id": 737895153, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:41.114881 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:37:41.114881 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:37:41.142412 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ec25e5c-0eaa-46bf-8a0d-ce232387f7c7 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 421 microversion: 2.1 time: 0.148762 Jul 14 14:37:41.150391 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 247/472] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:40 2022] POST /compute/v2.1/flavors => generated 421 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:41.156286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0cb4c339-cb8f-475b-9f63-fc0b9aa58844 tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] Calling method '.version_select at 0x7fdbf354b550>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.465746 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0cb4c339-cb8f-475b-9f63-fc0b9aa58844 tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/42cafb1c-5557-4acf-96e8-6fbca507a1f2" status: 202 len: 0 microversion: 2.1 time: 0.314082 Jul 14 14:37:41.471774 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 248/473] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:41 2022] DELETE /compute/v2.1/os-security-groups/42cafb1c-5557-4acf-96e8-6fbca507a1f2 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:41.491807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c00495f-9e30-43cb-9b85-b0b4b868677b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.519932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.server_groups [None req-2c00495f-9e30-43cb-9b85-b0b4b868677b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Querying cell 851d78d8-3f11-4b86-a356-449411903277(cell1) for 2 instances {{(pid=125966) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:37:41.521865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c00495f-9e30-43cb-9b85-b0b4b868677b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.522582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c00495f-9e30-43cb-9b85-b0b4b868677b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.570614 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c00495f-9e30-43cb-9b85-b0b4b868677b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups/fe23445d-06fc-4f11-a147-7964616168d2" status: 200 len: 270 microversion: 2.1 time: 0.091343 Jul 14 14:37:41.572117 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 249/474] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/os-server-groups/fe23445d-06fc-4f11-a147-7964616168d2 => generated 270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:41.577827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.578989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:41.595008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.595864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.597982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.598644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.635135 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bca2dc28-ebb0-4fdd-84d8-046063ee59bd tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.790743 Jul 14 14:37:41.637135 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 226/475] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:37:40 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:41.643604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.644592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:41.664271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.664998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.666011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:41.667803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:41.859720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:41.875992 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4e55544-e7ff-4d37-ada1-a49e4d08c73e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.302489 Jul 14 14:37:41.876599 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 250/476] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:41.882804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25917d43-727a-4357-94a4-3c7d47288741 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:41.908069 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25917d43-727a-4357-94a4-3c7d47288741 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.030223 Jul 14 14:37:41.912291 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 251/477] 10.222.0.98 () {58 vars in 1181 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:41.913715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aeaf41b8-eff8-4557-89d2-1aaf1cff100b tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] Calling method '.version_select at 0x7fdbf35da790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.294311 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aeaf41b8-eff8-4557-89d2-1aaf1cff100b tempest-SecurityGroupsTestAdminJSON-628087373 tempest-SecurityGroupsTestAdminJSON-628087373-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/178bc95d-a65e-4bf4-b08e-b78381dc6c1f" status: 202 len: 0 microversion: 2.1 time: 0.382436 Jul 14 14:37:42.300721 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 252/478] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:41 2022] DELETE /compute/v2.1/os-security-groups/178bc95d-a65e-4bf4-b08e-b78381dc6c1f => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:42.309528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.310483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.328659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:42.332100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.332715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.349003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.350233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.372753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:42.545200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:42.566328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d930244e-1a47-48a3-bf82-308b442e4dbb tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1621 microversion: 2.1 time: 0.268823 Jul 14 14:37:42.580063 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 253/479] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1621 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:42.625464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid 26d0e571-c557-48c6-90e4-e442642d46c5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:42.638104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae205d2f-7fc8-4d3f-9451-4620cd39ee79 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf354bf70>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-450372218", "description": "tempest-description-1359545997"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:42.759400 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15bb2c22-2278-40f1-bc83-3d99c46b1391 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 2053 microversion: 2.25 time: 1.120968 Jul 14 14:37:42.763738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 227/480] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:41 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 2053 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:42.768689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:42.769316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:42.794386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.794963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:42.795752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:42.796196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.085162 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae205d2f-7fc8-4d3f-9451-4620cd39ee79 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.472741 Jul 14 14:37:43.098716 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 254/481] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:42 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:43.118255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ac39a85-b223-4541-b3ce-982a10d0940b tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1170789593", "id": 1978985474, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:43.121599 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:37:43.121599 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:37:43.156937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ac39a85-b223-4541-b3ce-982a10d0940b tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.054307 Jul 14 14:37:43.162692 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 255/482] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:43 2022] POST /compute/v2.1/flavors => generated 425 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:43.168266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.168882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:43.179347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.180065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.181453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.181888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.329224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:43.362310 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62702a1c-91d2-4a85-b4a3-a3242ffa6132 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1468 microversion: 2.1 time: 0.593963 Jul 14 14:37:43.366059 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 228/483] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:42 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1468 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:43.377716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9369a91b-039d-4927-8f76-bd0ab12daaf9 req-d653cce8-6f0c-4c19-ae22-f366c17b267b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0630b9a9-788e-4202-94b8-4fe204b5c1c8", "tag": "8f6fdf55-7f1e-43aa-a34e-8a2a04b1916a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:43.398981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9369a91b-039d-4927-8f76-bd0ab12daaf9 req-d653cce8-6f0c-4c19-ae22-f366c17b267b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.400166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9369a91b-039d-4927-8f76-bd0ab12daaf9 req-d653cce8-6f0c-4c19-ae22-f366c17b267b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.432533 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9369a91b-039d-4927-8f76-bd0ab12daaf9 req-d653cce8-6f0c-4c19-ae22-f366c17b267b service nova] Creating event network-changed:8f6fdf55-7f1e-43aa-a34e-8a2a04b1916a for instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 on n-h2-768852-23 Jul 14 14:37:43.442776 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9369a91b-039d-4927-8f76-bd0ab12daaf9 req-d653cce8-6f0c-4c19-ae22-f366c17b267b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073820 Jul 14 14:37:43.444441 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 229/484] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:43.454688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63487fa4-ca7b-4906-b24c-f08f0c2501d4 tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] Calling method '.version_select at 0x7fdbf361b5e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.458415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:43.477612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f607cefc-9293-42f4-a508-1cc2b5e84f51 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1321 microversion: 2.1 time: 0.313209 Jul 14 14:37:43.479681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 256/485] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:43.488788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.491351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:43.506669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.507665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.509432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.510316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.713105 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a7e88cb-4f75-4728-865d-17918880b852 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 200 len: 1622 microversion: 2.1 time: 0.231481 Jul 14 14:37:43.714482 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 257/486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 1622 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:43.734607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:43.735864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:43.773003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.773915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.775081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:43.778142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:43.864520 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63487fa4-ca7b-4906-b24c-f08f0c2501d4 tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/2a53720d-9287-4feb-9974-e62331f4c276" status: 202 len: 0 microversion: 2.1 time: 0.417077 Jul 14 14:37:43.870297 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 230/487] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:43 2022] DELETE /compute/v2.1/os-security-groups/2a53720d-9287-4feb-9974-e62331f4c276 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:43.886004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1019053705", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "7c3118c3-58de-439c-bb53-8c4407b089fe"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:44.035859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] validate_networks() for [('7c3118c3-58de-439c-bb53-8c4407b089fe', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:44.089811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:44.104064 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc235b22-2d6a-4c47-9542-d4673f9acdb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.387913 Jul 14 14:37:44.104823 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 258/488] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:43 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:44.112065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9821c12-3e0d-45a5-a161-7529967211fa tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf35a3670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1716757576", "description": "tempest-description-1173913701"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:44.358995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e9821c12-3e0d-45a5-a161-7529967211fa tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.251583 Jul 14 14:37:44.367756 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 259/489] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:44 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:44.373973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6731563b-209e-49f3-aba2-f142444ccdbf tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:44.384065 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6731563b-209e-49f3-aba2-f142444ccdbf tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.014112 Jul 14 14:37:44.384827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 260/490] 10.222.0.98 () {58 vars in 1181 bytes} [Thu Jul 14 14:37:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:37:44.397866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:44.399991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:44.410770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.411608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.412989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.413756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.542235 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2266accf-042d-4bac-881f-184e6c87aa2e tempest-DeleteServersAdminTestJSON-1393229119 tempest-DeleteServersAdminTestJSON-1393229119-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1/action" status: 202 len: 0 microversion: 2.1 time: 0.155689 Jul 14 14:37:44.547378 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 261/491] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:44 2022] POST /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:44.555877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7354aa2a-518c-471c-91c7-d5bc0bd358af tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] Calling method '.version_select at 0x7fdbf35958b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:44.613198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:44.614103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:44.616094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:44.616094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:44.616432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:44.628807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.629256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.630182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:44.631169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:44.656819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:44.669702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for user aeb3928894284b77b4aea925a38470ba and project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:44.690339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:44.695952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:44.769760 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06e25281-df6e-46e4-837d-3eb63c2eaad9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.897021 Jul 14 14:37:44.776011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 231/492] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:37:44.781821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-702326249", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "859ce988-fadf-44f6-b941-5639f6ccd35f"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:44.875501 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7354aa2a-518c-471c-91c7-d5bc0bd358af tempest-SecurityGroupsTestAdminJSON-1301998714 tempest-SecurityGroupsTestAdminJSON-1301998714-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/8c17696e-5805-4277-ade0-7f1cf6a96a7d" status: 202 len: 0 microversion: 2.1 time: 0.325818 Jul 14 14:37:44.876515 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 262/493] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:44 2022] DELETE /compute/v2.1/os-security-groups/8c17696e-5805-4277-ade0-7f1cf6a96a7d => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:44.899959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:44.907186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e594f82-ad02-4a14-a2b2-6bb4eae0ef29 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf36bd820>, body: {"security_group_rule": {"parent_group_id": "877443b1-8d2b-4c9f-b05e-15397abc7d69", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "888eb45f-5b9c-4f3f-9e85-b660b578405d"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:45.496577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:45.497003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:45.498417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:45.499042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:45.499674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:45.518814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.519805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.523517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.524232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.524866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e594f82-ad02-4a14-a2b2-6bb4eae0ef29 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.646529 Jul 14 14:37:45.527463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 263/494] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:37:44 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:45.540536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-35471eac-806a-4b2f-90df-c2287eb05aef tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Action: 'create', calling method: .version_select at 0x7fdbf35a3820>, body: {"keypair": {"name": "tempest-keypair-135405226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFk0kL2JnVUBRrfheGH0nO9KQ2iADJmyeZJ6V5g1eVwWHXxeRZV+7ltanQmwOueGG0DG7pxmEc9BmSVFo2qPLPFfEAVPgfOQ2DsOjFDIWWwR5ljl2VNO9ni4/gfLB2ut6w=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:45.577632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:45.587006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:45.588609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-35471eac-806a-4b2f-90df-c2287eb05aef tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Getting quotas for project ab3c7bb172ef49c6a5154aee18c8a1bd. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:45.596738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-35471eac-806a-4b2f-90df-c2287eb05aef tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Getting quotas for user 160fe1ec6b2d45e48990558af381a0ef and project ab3c7bb172ef49c6a5154aee18c8a1bd. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:45.620049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:45.622972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:45.636544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-35471eac-806a-4b2f-90df-c2287eb05aef tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104826 Jul 14 14:37:45.645003 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 264/495] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:37:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:45.654876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.656413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:45.671471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.672844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.674693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.677663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.734214 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7054cf79-cb17-42e3-9216-0c2f4847ff2c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.960039 Jul 14 14:37:45.741928 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 232/496] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:45.751209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:45.765529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:45.781682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.790334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.792064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.793562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.942130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:45.942971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:45.943849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lazy-loading 'fault' on Instance uuid 6aa3115d-60a4-498c-8010-7f8475c650c1 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:46.100814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.130243 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1939661e-bd17-43be-86fe-a1714276d198 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1321 microversion: 2.1 time: 0.482402 Jul 14 14:37:46.132987 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 265/497] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:45 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:46.158002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:46.161006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:46.167749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:46.197018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.199765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.203092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.205535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.351728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.382620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cae8f344-ac6f-4237-af94-3d07f52491f0 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1451 microversion: 2.1 time: 0.638194 Jul 14 14:37:46.399503 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 233/498] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:45 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1451 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:46.420600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:46.422085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:46.433907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.447554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.448362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.451896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.454273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:46.454845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.455710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.461445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67a49b3a-c386-49ae-86b8-863ac23df098 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1258 microversion: 2.25 time: 0.326393 Jul 14 14:37:46.485387 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 266/499] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:46 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1258 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:46.497260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e134771f-c4df-4d00-a7c4-6135fd9b602f req-42201a68-fec7-4ad3-97bd-6c2e287e3a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1c9f04-7d06-489f-a719-417c45f7ecaa", "name": "network-vif-plugged", "status": "completed", "tag": "cb666f3c-3c5d-4e61-ba94-a69732fa4ee5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:46.520777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e134771f-c4df-4d00-a7c4-6135fd9b602f req-42201a68-fec7-4ad3-97bd-6c2e287e3a1a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:46.525411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e134771f-c4df-4d00-a7c4-6135fd9b602f req-42201a68-fec7-4ad3-97bd-6c2e287e3a1a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:46.566828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e134771f-c4df-4d00-a7c4-6135fd9b602f req-42201a68-fec7-4ad3-97bd-6c2e287e3a1a service nova] Creating event network-vif-plugged:cb666f3c-3c5d-4e61-ba94-a69732fa4ee5 for instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa on n-h1-768852-23 Jul 14 14:37:46.582616 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e134771f-c4df-4d00-a7c4-6135fd9b602f req-42201a68-fec7-4ad3-97bd-6c2e287e3a1a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093271 Jul 14 14:37:46.586927 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 267/500] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:46.600324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6fb57698-5118-4f6e-b78a-674fe819979b tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf36bd430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-166413375", "description": "tempest-description-1795400165"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:46.995496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:47.008468 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6fb57698-5118-4f6e-b78a-674fe819979b tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.418700 Jul 14 14:37:47.009758 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 268/501] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:46 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:47.020643 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3660625a-bebd-4ff0-81c4-9dd0ee8a8e2a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.619116 Jul 14 14:37:47.022219 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 234/502] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:46 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:47.038078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.038876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.046208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.048893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.051213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.057385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.058823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.060014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.081882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.082704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.085209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.086090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.174385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:37:47.291807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:47.310359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-86631261-003d-42ed-ae24-59a8882520fd tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1220 microversion: 2.1 time: 0.298748 Jul 14 14:37:47.325581 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 269/503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1220 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:47.345653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bca46135-8118-4ce2-bf20-59ce45f06bcd tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf36bd430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1615935938", "description": "tempest-description-547574901"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:47.585989 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-81388d35-a314-4679-94dc-a08d4cdba83a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 204 len: 0 microversion: 2.1 time: 0.549502 Jul 14 14:37:47.588911 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 235/504] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:47 2022] DELETE /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:37:47.602548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.604125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.616218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.617059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.618663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.619746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.809062 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bca46135-8118-4ce2-bf20-59ce45f06bcd tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.479945 Jul 14 14:37:47.819732 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 270/505] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:47 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:47.830417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:47.831691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:47.843425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.844196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.845683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:47.847446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:47.991010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.005775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.008004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.009558 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5152b057-f3f3-415c-b738-70c963c727b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1320 microversion: 2.25 time: 0.188044 Jul 14 14:37:48.022492 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 271/506] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1320 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:48.024831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:48.025628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:48.035995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.037676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.039247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.040285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.094451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.095352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.097003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lazy-loading 'fault' on Instance uuid 6aa3115d-60a4-498c-8010-7f8475c650c1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:48.171435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.192062 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-448cbad1-7694-4f78-9225-9273388b5582 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1321 microversion: 2.1 time: 0.598537 Jul 14 14:37:48.195678 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 236/507] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:47 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1321 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:48.205538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-413f1344-e000-4afd-9725-133ddc09da1f tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf3600700>, body: {"security_group_rule": {"parent_group_id": "1ce7df79-100b-40b7-bff0-8422d0474c8c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ef611ae9-457d-48ee-99d3-fe2452d2b99c"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:48.759003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:48.778621 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9cb499e4-4e32-4d86-be26-a64266ea2473 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1457 microversion: 2.1 time: 0.759480 Jul 14 14:37:48.779434 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 272/508] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:48 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1457 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:48.784362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:48.785046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:48.806001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.806337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.807396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.808329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:48.959948 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-413f1344-e000-4afd-9725-133ddc09da1f tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.762128 Jul 14 14:37:48.962441 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 237/509] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:37:48 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:48.977147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:48.978204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:48.997736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:48.999135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.002056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.004463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.197991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.211569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9883ebd2-0d3f-4404-8bab-0e1c4e85628b tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1268 microversion: 2.1 time: 0.247388 Jul 14 14:37:49.227308 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 238/510] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:48 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1268 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:49.252316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-574f4bc1-de48-48bf-9177-e62f46a4c936 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf3600700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:49.649064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:49.662889 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9742e81-a89a-4d7b-bf21-200dfd102113 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1310 microversion: 2.1 time: 0.882272 Jul 14 14:37:49.666627 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 273/511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:48 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1310 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:49.685333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:49.687619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:49.710239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.711415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:49.716504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:49.717195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.268320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.283667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.292672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.295916 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-88119a7f-fdc1-4995-bd1c-8d83db89337e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 0.624207 Jul 14 14:37:50.296537 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 274/512] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:49 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:50.310462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:50.313543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:50.327379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.329303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.330372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.330983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.643193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:50.662779 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b08f6e71-6d50-46cc-a230-4ff4a1dc1b05 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1321 microversion: 2.1 time: 0.360685 Jul 14 14:37:50.677843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 275/513] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:50 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:50.693169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:50.693878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:50.712717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.713162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.714193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.718346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.818392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:50.821395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:50.823027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lazy-loading 'fault' on Instance uuid 6aa3115d-60a4-498c-8010-7f8475c650c1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:51.232074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:51.250072 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-078f1cef-0013-4fa9-ae66-1eab5f85b56c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1457 microversion: 2.1 time: 0.570884 Jul 14 14:37:51.250681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 276/514] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:50 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1457 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:51.272982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.275843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:51.294059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.297470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.299710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.301411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.424510 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-574f4bc1-de48-48bf-9177-e62f46a4c936 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/ef611ae9-457d-48ee-99d3-fe2452d2b99c" status: 202 len: 0 microversion: 2.1 time: 2.206677 Jul 14 14:37:51.425498 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 239/515] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:37:49 2022] DELETE /compute/v2.1/os-security-groups/ef611ae9-457d-48ee-99d3-fe2452d2b99c => generated 0 bytes in 2209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:51.439705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.443446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:51.471947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.473073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.475815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.480400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.609581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:51.618247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:51.623609 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b7ea54b-d3f6-4e0c-8d33-633736393567 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1274 microversion: 2.1 time: 0.360617 Jul 14 14:37:51.634559 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 277/516] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1274 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:51.641583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3c3598fe-491a-4659-a9e1-f9bb05156891 req-8b8b5c9b-9af3-437d-be58-5c8ae2dfe5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0630b9a9-788e-4202-94b8-4fe204b5c1c8", "name": "network-vif-plugged", "status": "completed", "tag": "8f6fdf55-7f1e-43aa-a34e-8a2a04b1916a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:51.651443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3c3598fe-491a-4659-a9e1-f9bb05156891 req-8b8b5c9b-9af3-437d-be58-5c8ae2dfe5e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.651954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3c3598fe-491a-4659-a9e1-f9bb05156891 req-8b8b5c9b-9af3-437d-be58-5c8ae2dfe5e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.665922 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3c3598fe-491a-4659-a9e1-f9bb05156891 req-8b8b5c9b-9af3-437d-be58-5c8ae2dfe5e0 service nova] Creating event network-vif-plugged:8f6fdf55-7f1e-43aa-a34e-8a2a04b1916a for instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 on n-h2-768852-23 Jul 14 14:37:51.671306 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3c3598fe-491a-4659-a9e1-f9bb05156891 req-8b8b5c9b-9af3-437d-be58-5c8ae2dfe5e0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035262 Jul 14 14:37:51.672270 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 278/517] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:51.679783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:51.680729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:51.689009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.690384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:51.692077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:51.692525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.132148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.148457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.151245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.153470 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4403a788-0054-4e07-a22a-e6a4de51dfc7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 0.479178 Jul 14 14:37:52.154551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 279/518] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:52.161765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e11f8bda-1033-49c9-9504-91c24b0d633d tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf34bde50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:52.301354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:52.325278 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77df1fbd-29d8-40d4-b05a-6cd6f385527e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1493 microversion: 2.1 time: 0.891466 Jul 14 14:37:52.338483 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e11f8bda-1033-49c9-9504-91c24b0d633d tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/1ce7df79-100b-40b7-bff0-8422d0474c8c" status: 200 len: 247 microversion: 2.1 time: 0.174255 Jul 14 14:37:52.343980 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 280/519] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:37:52 2022] GET /compute/v2.1/os-security-groups/1ce7df79-100b-40b7-bff0-8422d0474c8c => generated 247 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:52.357887 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 240/520] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:51 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1493 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:52.371783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1975978769", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "1978985474", "adminPass": "***", "networks": [{"uuid": "02d32ddc-95fa-401c-bc9d-d973a1871005"}], "security_groups": [{"name": "tempest-securitygroup--1695330696"}], "key_name": "tempest-keypair-135405226", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:52.589015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1983904014", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": "none"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:52.728657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:52.729643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:52.730404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:52.732644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:52.733744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:52.761141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.762657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.763793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.764242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.769387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] validate_networks() for [('02d32ddc-95fa-401c-bc9d-d973a1871005', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:37:52.791755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Getting quotas for project b1c0e8ba57d34db18ed461dc962a5e83. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:52.796920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Getting quotas for user 0fcd19b670624ba3afda2975aef28523 and project b1c0e8ba57d34db18ed461dc962a5e83. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:52.816117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:52.819724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:52.898856 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51a45f7f-95db-4465-b901-b4349a7c41ad tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.558364 Jul 14 14:37:52.900267 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 281/521] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:37:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:37:52.913540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:52.914940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:52.946781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.948884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:52.951505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:52.958611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.523122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.568185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-068a7ab8-e622-4eab-96b2-44b37857ea72 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1321 microversion: 2.1 time: 0.658757 Jul 14 14:37:53.584908 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 282/522] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:52 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1321 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:53.599903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:53.604737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:53.624218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.625014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.626455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.636664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.770295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:53.771352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:53.771352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lazy-loading 'fault' on Instance uuid 6aa3115d-60a4-498c-8010-7f8475c650c1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:53.910880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80a79275009a41e38a6d41e10bc6c066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a041638b2ef4261b6f3f2fbf3ba06c7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:53.930089 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d76f60b9-675c-4ec4-81db-f938effb71c1 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 200 len: 1308 microversion: 2.1 time: 0.343238 Jul 14 14:37:53.934442 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 283/523] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:53 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 1308 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:53.955521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e74d6351-8aa9-4af5-807c-80037edb55bc tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf36bd550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-125266058", "description": "tempest-description-1997487464"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:54.703744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e74d6351-8aa9-4af5-807c-80037edb55bc tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.764966 Jul 14 14:37:54.708045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 284/524] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:37:53 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:54.829690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:37:54.830708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:37:54.832099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:37:54.833955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:37:54.837665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:37:54.855345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.856492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.858626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.860158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.899869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Getting quotas for project ab3c7bb172ef49c6a5154aee18c8a1bd. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:37:54.907885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Getting quotas for user 160fe1ec6b2d45e48990558af381a0ef and project ab3c7bb172ef49c6a5154aee18c8a1bd. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:37:54.928155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:37:54.930925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:37:54.948331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:54.950329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:54.968028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.969013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:54.971059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:54.972623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.016953 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7ec311c-a858-449d-92b4-3e1b70c403d1 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.655838 Jul 14 14:37:55.018700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 241/525] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:37:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 2661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:37:55.028815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.030003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.042196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.042880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.045129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.045129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.282984 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc9423bb-c846-4fe1-8721-3e21c8ae8388 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1646 microversion: 2.1 time: 0.566049 Jul 14 14:37:55.284633 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 285/526] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:54 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1646 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:55.295868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b3e85889-30c6-41f9-b18d-8d5d1b6067e8 req-56a3892a-7be3-4584-a22a-f49fba844504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa3115d-60a4-498c-8010-7f8475c650c1", "name": "network-vif-deleted", "tag": "39648df0-6f29-4a29-a8f6-8e76b0b9fe19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:55.316532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b3e85889-30c6-41f9-b18d-8d5d1b6067e8 req-56a3892a-7be3-4584-a22a-f49fba844504 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.319044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b3e85889-30c6-41f9-b18d-8d5d1b6067e8 req-56a3892a-7be3-4584-a22a-f49fba844504 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.346451 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b3e85889-30c6-41f9-b18d-8d5d1b6067e8 req-56a3892a-7be3-4584-a22a-f49fba844504 service nova] Creating event network-vif-deleted:39648df0-6f29-4a29-a8f6-8e76b0b9fe19 for instance 6aa3115d-60a4-498c-8010-7f8475c650c1 on n-h2-768852-23 Jul 14 14:37:55.357921 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b3e85889-30c6-41f9-b18d-8d5d1b6067e8 req-56a3892a-7be3-4584-a22a-f49fba844504 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070482 Jul 14 14:37:55.359650 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 286/527] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:55.386200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:55.388939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.434034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.434844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.436286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.437084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.538363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.561628 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3e72f28-554c-4d41-9c0f-4c93f2cd9725 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.540848 Jul 14 14:37:55.563361 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 242/528] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:55.583561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.585032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.596042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.596910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.598092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.599523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.797058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.833642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.837340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:55.849680 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9eefa447-c491-40b6-a4c8-4caa99dfe423 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "PUT /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1419 microversion: 2.75 time: 0.486534 Jul 14 14:37:55.850655 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 287/529] 10.222.0.98 () {62 vars in 1296 bytes} [Thu Jul 14 14:37:55 2022] PUT /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1419 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:55.857622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:55.858250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:55.875679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.876443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:55.877279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:55.883488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.141993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.158452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41d854b9-878f-4e70-a4d1-8bd7c25a0f34 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1471 microversion: 2.1 time: 0.306071 Jul 14 14:37:56.163891 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 288/530] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:56.174096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8962a35-f196-4d28-bf52-08dbd6ba589c tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf344e820>, body: {"security_group_rule": {"parent_group_id": "a3275b46-2fb7-4e5b-9f2b-a96ef68235f9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:56.214728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.235780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.240631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.254057 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d975e382-56fb-4ca8-91f9-523f9d977389 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 0.678711 Jul 14 14:37:56.255174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 243/531] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:55 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:56.284357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.285804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.298909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.299754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.301931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.303631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.313438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:56.354890 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] HTTP exception thrown: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Request method failure captured: Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 HTTP/1.1 Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnpjkoC2U0V5vgdl3I_BxfDqT9CE_kUBtLWvC2aoOCwwCKSUoIYb7mUCdVIm0hcX_9sBS6_ZR2TA1ZiWA-KfFIqS3OpQqpysVavRkZj-EDUeUtt5dsuyNyAamJX1TLcSBp6rBAgVneErl1yfcczFe5-dTHkUXB0liNm7pOkSMSW_xo Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:37:56.358726 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 80a79275009a41e38a6d41e10bc6c066 Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.361673 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6aa3115d-60a4-498c-8010-7f8475c650c1'} Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:56.364194 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.376682 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.382801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Returning 404 to user: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:56.382801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8faf7644-9c95-4ba9-ab9e-3d9521d5458a tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 404 len: 111 microversion: 2.1 time: 0.092725 Jul 14 14:37:56.382801 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 244/532] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:56.398490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.399700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.413329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.413795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.414949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.415700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.535007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.551643 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16997623-874f-4ab3-a3b7-c22cc60d430c tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1260 microversion: 2.1 time: 0.177994 Jul 14 14:37:56.555257 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 245/533] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:56.561636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8962a35-f196-4d28-bf52-08dbd6ba589c tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.395265 Jul 14 14:37:56.562638 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 289/534] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:37:56 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:56.573828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.575557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.578167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.579214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.589236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.590485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.590712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.591491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.592059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.592797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.592993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.593911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.714203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.730108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.731768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:56.737557 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45778ea5-6134-4b56-8930-b732adabc084 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1417 microversion: 2.75 time: 0.172981 Jul 14 14:37:56.738437 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 290/535] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1417 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:56.743217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:56.743788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.750331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.751068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.752056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.752490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.780115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lazy-loading 'flavor' on Instance uuid 0630b9a9-788e-4202-94b8-4fe204b5c1c8 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:56.816069 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d041996b-1f96-4b37-b089-f90957ef0a54 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1646 microversion: 2.1 time: 0.257867 Jul 14 14:37:56.817389 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 246/536] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1646 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:56.827423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.828804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.843213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.843924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.845303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.846218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.870514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] HTTP exception thrown: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Request method failure captured: Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 HTTP/1.1 Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnpjkoC2U0V5vgdl3I_BxfDqT9CE_kUBtLWvC2aoOCwwCKSUoIYb7mUCdVIm0hcX_9sBS6_ZR2TA1ZiWA-KfFIqS3OpQqpysVavRkZj-EDUeUtt5dsuyNyAamJX1TLcSBp6rBAgVneErl1yfcczFe5-dTHkUXB0liNm7pOkSMSW_xo Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:37:56.873482 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 80a79275009a41e38a6d41e10bc6c066 Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.875204 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6aa3115d-60a4-498c-8010-7f8475c650c1'} Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:56.876480 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:56.878343 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:56.880709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Returning 404 to user: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:56.880709 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c2e6165-aa5e-413d-a913-c89460233c18 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 404 len: 111 microversion: 2.1 time: 0.056621 Jul 14 14:37:56.880709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 247/537] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:56 2022] DELETE /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:56.886568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5cb8c4b7-fea6-4610-aa8b-4d1ebba86757 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Action: 'create', calling method: .version_select at 0x7fdbf3435f70>, body: {"security_group_rule": {"parent_group_id": "a3275b46-2fb7-4e5b-9f2b-a96ef68235f9", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:56.911912 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a4b692f-042f-4efa-bb19-e04713c04c20 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8/action" status: 202 len: 0 microversion: 2.1 time: 0.171097 Jul 14 14:37:56.913337 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 291/538] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:56 2022] POST /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:56.923810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:56.925227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:56.936527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.937311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:56.939328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:56.939328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.176189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:57.195805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45ccef8b-e3e1-4943-a376-c9ea510d3565 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.279642 Jul 14 14:37:57.197066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 292/539] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:56 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:57.204518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22f31671-1292-4ac2-814a-58b7b0d8fe6e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.206479 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:37:57.206479 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:37:57.209534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f31671-1292-4ac2-814a-58b7b0d8fe6e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.210779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f31671-1292-4ac2-814a-58b7b0d8fe6e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.212317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f31671-1292-4ac2-814a-58b7b0d8fe6e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.213139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f31671-1292-4ac2-814a-58b7b0d8fe6e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.225830 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5cb8c4b7-fea6-4610-aa8b-4d1ebba86757 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.346792 Jul 14 14:37:57.234150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 248/540] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:37:56 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:57.245679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.248081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 6aa3115d-60a4-498c-8010-7f8475c650c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.258972 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22f31671-1292-4ac2-814a-58b7b0d8fe6e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.059411 Jul 14 14:37:57.260067 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 293/541] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:57.262237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.263127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.264898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.265797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.266338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.267130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.280665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.280824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.282050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.282789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.295374 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] HTTP exception thrown: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Request method failure captured: Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 HTTP/1.1 Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnpjkoC2U0V5vgdl3I_BxfDqT9CE_kUBtLWvC2aoOCwwCKSUoIYb7mUCdVIm0hcX_9sBS6_ZR2TA1ZiWA-KfFIqS3OpQqpysVavRkZj-EDUeUtt5dsuyNyAamJX1TLcSBp6rBAgVneErl1yfcczFe5-dTHkUXB0liNm7pOkSMSW_xo Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:37:57.298478 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 80a79275009a41e38a6d41e10bc6c066 Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:57.300270 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6aa3115d-60a4-498c-8010-7f8475c650c1'} Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:57.300962 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. Jul 14 14:37:57.307980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:37:57.312176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Returning 404 to user: Instance 6aa3115d-60a4-498c-8010-7f8475c650c1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:57.312176 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5cf5acc-750f-49db-8025-71c27b93217c tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1" status: 404 len: 111 microversion: 2.1 time: 0.072754 Jul 14 14:37:57.312176 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 249/542] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/6aa3115d-60a4-498c-8010-7f8475c650c1 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:57.315723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ae59b15-848c-482d-a2cb-de2889883b92 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf3435310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.411376 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ae59b15-848c-482d-a2cb-de2889883b92 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/a3275b46-2fb7-4e5b-9f2b-a96ef68235f9" status: 200 len: 664 microversion: 2.1 time: 0.106463 Jul 14 14:37:57.413141 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 250/543] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/os-security-groups/a3275b46-2fb7-4e5b-9f2b-a96ef68235f9 => generated 664 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:57.425634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": true, "disk_over_commit": false}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:57.427874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.438264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.439094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.440554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.441374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.493564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lazy-loading 'flavor' on Instance uuid 4e1c9f04-7d06-489f-a719-417c45f7ecaa {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:37:57.520354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Going to try to live migrate instance to n-h2-768852-23 {{(pid=125965) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:37:57.535031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:57.776517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25ca08e5-8b06-4d0f-8bc7-b3711bf278b3 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1632 microversion: 2.1 time: 0.514347 Jul 14 14:37:57.791307 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 294/544] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1632 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:57.797455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:57.798710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:57.811860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.812724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:57.813939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:57.814706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.095598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.105730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.107425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:58.108606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0aa55d06-220a-4d08-aada-33a63bf9bb07 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 0.318128 Jul 14 14:37:58.109400 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 295/545] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:57 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:58.115439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:58.116157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:58.127816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.128611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.130311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.131456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.159899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] HTTP exception thrown: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Request method failure captured: Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 HTTP/1.1 Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CnpjkoC2U0V5vgdl3I_BxfDqT9CE_kUBtLWvC2aoOCwwCKSUoIYb7mUCdVIm0hcX_9sBS6_ZR2TA1ZiWA-KfFIqS3OpQqpysVavRkZj-EDUeUtt5dsuyNyAamJX1TLcSBp6rBAgVneErl1yfcczFe5-dTHkUXB0liNm7pOkSMSW_xo Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:37:58.164579 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 80a79275009a41e38a6d41e10bc6c066 Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:58.167148 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '57743d28-3e4f-4a30-9eba-7ff75f331659'} Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:58.169673 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:58.174787 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:58.185371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Returning 404 to user: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:58.185371 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b84884aa-49aa-45ef-81ca-3064faf0b2f3 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "DELETE /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 404 len: 111 microversion: 2.1 time: 0.056365 Jul 14 14:37:58.185371 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 296/546] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:37:58 2022] DELETE /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:58.185371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8969ba40-1858-4afc-bcfe-638c664da92d req-c4012b62-dc65-4707-adb2-b22a3671dc9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9124379-a3fd-4713-95b4-58082d5fbfd5", "tag": "bfb56fd2-1132-4057-9a78-9ff419df67a8"}, {"name": "network-changed", "server_uuid": "ece38b80-f3ff-4714-a1ca-8f4cb86f0f21", "tag": "aded7d27-3ced-4c1c-8e26-b68d8b0ba5bd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:37:58.196804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8969ba40-1858-4afc-bcfe-638c664da92d req-c4012b62-dc65-4707-adb2-b22a3671dc9a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.197654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8969ba40-1858-4afc-bcfe-638c664da92d req-c4012b62-dc65-4707-adb2-b22a3671dc9a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:58.222934 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8969ba40-1858-4afc-bcfe-638c664da92d req-c4012b62-dc65-4707-adb2-b22a3671dc9a service nova] Creating event network-changed:bfb56fd2-1132-4057-9a78-9ff419df67a8 for instance e9124379-a3fd-4713-95b4-58082d5fbfd5 on n-h1-768852-23 Jul 14 14:37:58.223497 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8969ba40-1858-4afc-bcfe-638c664da92d req-c4012b62-dc65-4707-adb2-b22a3671dc9a service nova] Creating event network-changed:aded7d27-3ced-4c1c-8e26-b68d8b0ba5bd for instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 on n-h1-768852-23 Jul 14 14:37:58.231223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8969ba40-1858-4afc-bcfe-638c664da92d req-c4012b62-dc65-4707-adb2-b22a3671dc9a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060475 Jul 14 14:37:58.232583 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 297/547] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:37:58.241450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-472faf4c-714a-45dc-a67e-3980e7914bca tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf344e5e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:58.971637 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-472faf4c-714a-45dc-a67e-3980e7914bca tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-group-rules/697280a5-f931-4739-9ffb-ea62341a00cf" status: 202 len: 0 microversion: 2.1 time: 0.737377 Jul 14 14:37:58.972682 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 298/548] 10.222.0.98 () {58 vars in 1286 bytes} [Thu Jul 14 14:37:58 2022] DELETE /compute/v2.1/os-security-group-rules/697280a5-f931-4739-9ffb-ea62341a00cf => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:37:58.985627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:58.986985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:58.998792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:58.999662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.001183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.001967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.118228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:59.128049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-58a16b60-5129-44f5-aa22-4c8a2f6744a2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1322 microversion: 2.1 time: 0.153878 Jul 14 14:37:59.128657 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 299/549] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:58 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:59.133562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.134187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.140930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.141383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.142188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.142651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.168833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:37:59.255450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:59.281610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:59.286044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:59.294640 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c959769-d91d-4690-896c-59efd6493038 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1417 microversion: 2.75 time: 0.164854 Jul 14 14:37:59.295247 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 300/550] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1417 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:37:59.300299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.300921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] [instance: 57743d28-3e4f-4a30-9eba-7ff75f331659] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.308328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.309088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.310074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.310681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.329154 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] HTTP exception thrown: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Request method failure captured: Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 HTTP/1.1 Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CnpjkoC2U0V5vgdl3I_BxfDqT9CE_kUBtLWvC2aoOCwwCKSUoIYb7mUCdVIm0hcX_9sBS6_ZR2TA1ZiWA-KfFIqS3OpQqpysVavRkZj-EDUeUtt5dsuyNyAamJX1TLcSBp6rBAgVneErl1yfcczFe5-dTHkUXB0liNm7pOkSMSW_xo Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:37:59.330995 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5a041638b2ef4261b6f3f2fbf3ba06c7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5a041638b2ef4261b6f3f2fbf3ba06c7 Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-91679596 Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 80a79275009a41e38a6d41e10bc6c066 Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersAdminTestJSON-91679596-project Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:59.339748 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '57743d28-3e4f-4a30-9eba-7ff75f331659'} Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:37:59.342394 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. Jul 14 14:37:59.347156 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:37:59.350095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] Returning 404 to user: Instance 57743d28-3e4f-4a30-9eba-7ff75f331659 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:37:59.350095 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f694247-afa8-4272-a25d-7615497877c4 tempest-DeleteServersAdminTestJSON-91679596 tempest-DeleteServersAdminTestJSON-91679596-project] 10.222.0.98 "GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659" status: 404 len: 111 microversion: 2.1 time: 0.036255 Jul 14 14:37:59.350095 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 301/551] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/57743d28-3e4f-4a30-9eba-7ff75f331659 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:37:59.350095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.350095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:37:59.351108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.351108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.351108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:37:59.351108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:37:59.945309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:37:59.962987 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a27060b-63cd-4003-a7c3-42dd7e61b337 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.627668 Jul 14 14:37:59.980559 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 302/552] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:37:59.992997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:37:59.994425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:00.006471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:00.007733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:00.009467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:00.010744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:00.447909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-acfae439-e828-4b66-8040-cd9cb1c2c42e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1615 microversion: 2.1 time: 0.465148 Jul 14 14:38:00.450007 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 303/553] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:37:59 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1615 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:00.460409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cbd60e58-4ab7-4610-8e4e-1227d8643545 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf34bd550>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:01.125617 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cbd60e58-4ab7-4610-8e4e-1227d8643545 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/a3275b46-2fb7-4e5b-9f2b-a96ef68235f9" status: 202 len: 0 microversion: 2.1 time: 0.673356 Jul 14 14:38:01.127652 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 304/554] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:00 2022] DELETE /compute/v2.1/os-security-groups/a3275b46-2fb7-4e5b-9f2b-a96ef68235f9 => generated 0 bytes in 677 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:01.159318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-820a2ce1-4e95-41eb-b9f6-14751f3a9fd8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa/action" status: 202 len: 0 microversion: 2.1 time: 3.740305 Jul 14 14:38:01.160976 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 251/555] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:37:57 2022] POST /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa/action => generated 0 bytes in 3747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:01.170403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:01.171722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:01.182929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:01.191640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:01.209481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.210331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.214732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.215787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.217182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.217968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.223337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.224151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.554188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:01.574824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e23408cd-1816-49b0-8694-de76b14dbaf3 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.411838 Jul 14 14:38:01.583212 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 252/556] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:01 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:01.617660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:01.620017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:01.660831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.661658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:01.663074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:01.673858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.118686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.126996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.138854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.146746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.150822 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57ea0903-3f33-4ff5-871c-8ec0073bca66 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 1.012226 Jul 14 14:38:02.155264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.166820 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 305/557] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:01 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:02.171972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:02.173050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.178827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.185069 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8476b374-71f7-4bfe-9bba-d402c86326ed tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1438 microversion: 2.75 time: 0.582960 Jul 14 14:38:02.188990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.196496 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 253/558] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:01 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1438 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:02.200978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.202164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.205211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.206856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.210935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.245930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.248278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.249828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.250532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.364077 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] HTTP exception thrown: Cannot 'migrate' instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 while it is in vm_state suspended Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Request method failure captured: Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8/action HTTP/1.1 Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 15 Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cn_dkfoYY2FthAHVb5R_p6uOzm9wHJkNvHy12N_fzf7SDaA1Ndb2fSKBADaIW90nqygo5V9-alJ6ViuZve7NfoLaph-BhCuGpsYYYUf-KkRxJNe1ROQJvE5o7KdOpGzmCtNU4bdtn3mGKOWQRivSrt_jZw-QsuZJu4iVvKqBXl9yDk Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:38:02.366638 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ffd977efd139496dad278ed5933f8379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ffd977efd139496dad278ed5933f8379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 3f1be8b33b93467197f8902f4c740ca1 Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: {"migrate": {}} Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:38:02.369380 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot 'migrate' instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 while it is in vm_state suspended Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0630b9a9-788e-4202-94b8-4fe204b5c1c8', 'body': {'migrate': {}}} Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 in vm_state suspended. Cannot resize while the instance is in this state. Jul 14 14:38:02.370995 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 while it is in vm_state suspended Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.373369 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 while it is in vm_state suspended Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Returning 409 to user: Cannot 'migrate' instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 while it is in vm_state suspended {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-170331df-91ac-49e1-8855-d7e10fb1fa7e tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8/action" status: 409 len: 148 microversion: 2.1 time: 0.201460 Jul 14 14:38:02.375712 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 306/559] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:02 2022] POST /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8/action => generated 148 bytes in 203 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:38:02.376745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-408fb349-fb20-435b-9fcb-eb2e96875d9a req-133ea12e-f9f2-464c-8ca9-4f279004f9ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721a7dad-ae26-4f27-91f7-e71bd1adfad3", "tag": "be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:02.385990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-408fb349-fb20-435b-9fcb-eb2e96875d9a req-133ea12e-f9f2-464c-8ca9-4f279004f9ca service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.386438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-408fb349-fb20-435b-9fcb-eb2e96875d9a req-133ea12e-f9f2-464c-8ca9-4f279004f9ca service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.401090 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-408fb349-fb20-435b-9fcb-eb2e96875d9a req-133ea12e-f9f2-464c-8ca9-4f279004f9ca service nova] Creating event network-changed:be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5 for instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 on n-h2-768852-23 Jul 14 14:38:02.406627 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-408fb349-fb20-435b-9fcb-eb2e96875d9a req-133ea12e-f9f2-464c-8ca9-4f279004f9ca service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034623 Jul 14 14:38:02.407358 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 307/560] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:02.414383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf35a3b80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.535031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:38:02.535031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Neutron security group ef611ae9-457d-48ee-99d3-fe2452d2b99c not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:38:02.535393 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] HTTP exception thrown: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.535393 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Request method failure captured: Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/ef611ae9-457d-48ee-99d3-fe2452d2b99c HTTP/1.1 Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CorILPWOo1c78aV21hIQIRmioOwZUuhS51-J5Oh_Ru6Skl9_8Zqg1HASDay1xFJyFbICagJ7tr4tFS8va7N8z0fixoR_UrUE_58fwvTlO8v7CQKE4wLdxizPHoKRZPth6ujkMmJk9cyfRnlbQ41_6Ln58uQLZbrUrIJ2fFgB2ufPYs Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 60ce739658f145558450d454a2928bec Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-452284804 Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:02.557337 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/60ce739658f145558450d454a2928bec"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_60ce739658f145558450d454a2928bec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/60ce739658f145558450d454a2928bec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/60ce739658f145558450d454a2928bec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupRulesTestJSON-452284804 Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 60ce739658f145558450d454a2928bec Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-452284804 Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupRulesTestJSON-452284804-project Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ef291d4288eb481dac5564aaeaa81717 Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupRulesTestJSON-452284804-project Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] Jul 14 14:38:02.565071 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ef611ae9-457d-48ee-99d3-fe2452d2b99c'} Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:02.567005 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:38:02.572215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.577511 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Returning 404 to user: Security group ef611ae9-457d-48ee-99d3-fe2452d2b99c does not exist Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-eaa22282-b976-433b-b9ec-cf01bcbdb5cb'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c10c60ad-2a8c-44ea-aae5-fe1484a0f748 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/ef611ae9-457d-48ee-99d3-fe2452d2b99c" status: 404 len: 194 microversion: 2.1 time: 0.150319 Jul 14 14:38:02.582786 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 308/561] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:02 2022] DELETE /compute/v2.1/os-security-groups/ef611ae9-457d-48ee-99d3-fe2452d2b99c => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:02.588130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:02.588130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.588130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.588130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.588993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.588993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.662245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.687895 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fde27093-c97e-4a0f-9f93-dfd63021fa8f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.489537 Jul 14 14:38:02.688969 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 254/562] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:02.713108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:02.716549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:02.730326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.731395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.733296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:02.734083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:02.811673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:02.884006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:02.884216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:02.884728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:02.885367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:02.886270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:02.987010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:02.993489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:03.008347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.020899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4858035-a90b-4fc2-8546-861bdc76c40f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.459013 Jul 14 14:38:03.021932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.023801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.025960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.026541 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 309/563] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:02 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:03.047596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fee4380b-c4d7-4714-8005-eecbdad06275 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fee4380b-c4d7-4714-8005-eecbdad06275 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Request method failure captured: Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca/action HTTP/1.1 Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 39 Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cn_dkfoYY2FthAHVb5R_p6uOzm9wHJkNvHy12N_fzf7SDaA1Ndb2fSKBADaIW90nqygo5V9-alJ6ViuZve7NfoLaph-BhCuGpsYYYUf-KkRxJNe1ROQJvE5o7KdOpGzmCtNU4bdtn3mGKOWQRivSrt_jZw-QsuZJu4iVvKqBXl9yDk Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:38:03.057577 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ffd977efd139496dad278ed5933f8379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ffd977efd139496dad278ed5933f8379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 3f1be8b33b93467197f8902f4c740ca1 Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: {"os-resetState": {"state": "invalid"}} Jul 14 14:38:03.060388 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '5825652f-8c70-4e1d-8122-73b0060140ca', 'body': {'os-resetState': {'state': 'invalid'}}} Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:03.064057 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:38:03.068140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Jul 14 14:38:03.072196 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.076035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fee4380b-c4d7-4714-8005-eecbdad06275 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:03.077413 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fee4380b-c4d7-4714-8005-eecbdad06275 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca/action" status: 400 len: 144 microversion: 2.1 time: 0.048963 Jul 14 14:38:03.080481 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 310/564] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:03 2022] POST /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca/action => generated 144 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:38:03.104594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1acfd278-921d-4ac1-99d8-93ddc770b4eb tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf3243e50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:03.244262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.262642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.266051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.276027 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec8905d8-1c33-45da-9049-c344a8550661 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "POST /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b/action" status: 202 len: 1495 microversion: 2.75 time: 0.585246 Jul 14 14:38:03.276786 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 255/565] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:38:02 2022] POST /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b/action => generated 1495 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:38:03.291081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:03.291977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:03.299921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.301453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.302737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.303678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.605326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:03.639975 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-115a1e75-efad-4e7e-ab48-f719b2298cdd tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.361372 Jul 14 14:38:03.643727 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 256/566] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:03 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:03.656126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6e31ccc-abd6-4312-b76e-181330a2dba6 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6e31ccc-abd6-4312-b76e-181330a2dba6 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Request method failure captured: Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca/action HTTP/1.1 Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 31 Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cn_dkfoYY2FthAHVb5R_p6uOzm9wHJkNvHy12N_fzf7SDaA1Ndb2fSKBADaIW90nqygo5V9-alJ6ViuZve7NfoLaph-BhCuGpsYYYUf-KkRxJNe1ROQJvE5o7KdOpGzmCtNU4bdtn3mGKOWQRivSrt_jZw-QsuZJu4iVvKqBXl9yDk Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:38:03.679052 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ffd977efd139496dad278ed5933f8379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ffd977efd139496dad278ed5933f8379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 3f1be8b33b93467197f8902f4c740ca1 Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: {"os-resetState": {"state": 1}} Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:38:03.682411 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '5825652f-8c70-4e1d-8122-73b0060140ca', 'body': {'os-resetState': {'state': 1}}} Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 1 Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:03.684158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Jul 14 14:38:03.687305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:03.691491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6e31ccc-abd6-4312-b76e-181330a2dba6 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:03.691491 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6e31ccc-abd6-4312-b76e-181330a2dba6 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca/action" status: 400 len: 120 microversion: 2.1 time: 0.033983 Jul 14 14:38:03.691491 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 257/567] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:03 2022] POST /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca/action => generated 120 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:38:03.700794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:03.702446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:03.722593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.724184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.726541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:03.727518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:03.954893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1acfd278-921d-4ac1-99d8-93ddc770b4eb tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/1ce7df79-100b-40b7-bff0-8422d0474c8c" status: 202 len: 0 microversion: 2.1 time: 0.872580 Jul 14 14:38:03.971189 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 311/568] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:03 2022] DELETE /compute/v2.1/os-security-groups/1ce7df79-100b-40b7-bff0-8422d0474c8c => generated 0 bytes in 876 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:04.000003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.005933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:04.022927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.024558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:04.035739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.036812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.040854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.042551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.046476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.046881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.058426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e18b1d3-268c-4379-b294-d4845eb2e78b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 0.356593 Jul 14 14:38:04.064247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 258/569] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:03 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:04.095666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00e9c474-0a3d-4c1a-b133-133e15a39f76 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:04.101197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-00e9c474-0a3d-4c1a-b133-133e15a39f76 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Failed to fetch instance by id 999 {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:38:04.101728 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-00e9c474-0a3d-4c1a-b133-133e15a39f76 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] HTTP exception thrown: Instance 999 could not be found. Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00e9c474-0a3d-4c1a-b133-133e15a39f76 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Request method failure captured: Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 37 Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cn_dkfoYY2FthAHVb5R_p6uOzm9wHJkNvHy12N_fzf7SDaA1Ndb2fSKBADaIW90nqygo5V9-alJ6ViuZve7NfoLaph-BhCuGpsYYYUf-KkRxJNe1ROQJvE5o7KdOpGzmCtNU4bdtn3mGKOWQRivSrt_jZw-QsuZJu4iVvKqBXl9yDk Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:38:04.115768 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ffd977efd139496dad278ed5933f8379"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ffd977efd139496dad278ed5933f8379"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ffd977efd139496dad278ed5933f8379"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: ffd977efd139496dad278ed5933f8379 Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2009435190 Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 3f1be8b33b93467197f8902f4c740ca1 Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2009435190-project-admin Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: {"os-resetState": {"state": "error"}} Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:38:04.117510 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 999 could not be found. Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:04.118336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 14 14:38:04.119581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:04.122534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00e9c474-0a3d-4c1a-b133-133e15a39f76 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:04.122534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00e9c474-0a3d-4c1a-b133-133e15a39f76 tempest-ServersAdminNegativeTestJSON-2009435190 tempest-ServersAdminNegativeTestJSON-2009435190-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.056979 Jul 14 14:38:04.125407 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 259/570] 10.222.0.98 () {60 vars in 1178 bytes} [Thu Jul 14 14:38:04 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:38:04.145307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.147572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:04.167180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.167980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.169093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.180476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.260323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.286789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.290282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.321292 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eda7a9fc-2722-4280-9d71-a96974c2c2a1 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.347566 Jul 14 14:38:04.340120 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 312/571] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:03 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:04.361231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17440f6d-9758-4414-9df8-aa072f6db5a0 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf3243820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.526783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:04.543084 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eaebaf21-85a5-4761-b1bc-4d9a8e735cb3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.414762 Jul 14 14:38:04.544348 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 260/572] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:04 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:04.554849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:04.556557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:04.569661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.570554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.572195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:04.573192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:04.882977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:04.920837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=20 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:05.172153 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17440f6d-9758-4414-9df8-aa072f6db5a0 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/888eb45f-5b9c-4f3f-9e85-b660b578405d" status: 202 len: 0 microversion: 2.1 time: 0.829667 Jul 14 14:38:05.180432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:05.180787 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 313/573] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:04 2022] DELETE /compute/v2.1/os-security-groups/888eb45f-5b9c-4f3f-9e85-b660b578405d => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:05.191320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0d4be1ad-4249-4064-8ca4-d089dd4d8cae req-dffeed85-4dd6-4dbd-a8f4-c77548914a9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9124379-a3fd-4713-95b4-58082d5fbfd5", "name": "network-vif-plugged", "status": "completed", "tag": "bfb56fd2-1132-4057-9a78-9ff419df67a8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:05.200258 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bdc5e4fb-78a5-4d49-8df1-085df267e56b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.653744 Jul 14 14:38:05.201350 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 261/574] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:04 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:05.220180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:05.221046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:05.229201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0d4be1ad-4249-4064-8ca4-d089dd4d8cae req-dffeed85-4dd6-4dbd-a8f4-c77548914a9f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.230319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0d4be1ad-4249-4064-8ca4-d089dd4d8cae req-dffeed85-4dd6-4dbd-a8f4-c77548914a9f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.259788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0d4be1ad-4249-4064-8ca4-d089dd4d8cae req-dffeed85-4dd6-4dbd-a8f4-c77548914a9f service nova] Creating event network-vif-plugged:bfb56fd2-1132-4057-9a78-9ff419df67a8 for instance e9124379-a3fd-4713-95b4-58082d5fbfd5 on n-h1-768852-23 Jul 14 14:38:05.261543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.262359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.263898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.264671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.268666 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0d4be1ad-4249-4064-8ca4-d089dd4d8cae req-dffeed85-4dd6-4dbd-a8f4-c77548914a9f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093015 Jul 14 14:38:05.270605 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 314/575] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:05.289203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:05.293079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:05.311532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.313885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.315722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.317598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.359840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:05.392729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:05.584955 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a099c946-33ea-4c96-8279-54ca7b059fe7 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 204 len: 0 microversion: 2.1 time: 0.380556 Jul 14 14:38:05.590286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 262/576] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:05 2022] DELETE /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:05.604994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:05.609442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:05.627652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.628480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.630622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:05.631703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:05.766593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:05.776663 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8db6ab5-78c1-41a6-8421-3b294eac5748 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.501831 Jul 14 14:38:05.777882 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 315/577] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:05 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:05.783467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d050f2d0-cf7c-4db8-8c02-85ee8d3778e4 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf3442790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.148130 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d050f2d0-cf7c-4db8-8c02-85ee8d3778e4 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/877443b1-8d2b-4c9f-b05e-15397abc7d69" status: 202 len: 0 microversion: 2.1 time: 0.368504 Jul 14 14:38:06.150238 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 316/578] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:05 2022] DELETE /compute/v2.1/os-security-groups/877443b1-8d2b-4c9f-b05e-15397abc7d69 => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:06.166593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.168480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:06.182603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.186343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.188574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.191038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.265821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.284347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.286849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.293205 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21eb80db-7832-4eba-93d3-a0bd9cb32379 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1362 microversion: 2.25 time: 0.703619 Jul 14 14:38:06.294519 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 263/579] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:05 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:06.299586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.305808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:06.322653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.337362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.337936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.338938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.340064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.342516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.345407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.362914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f757ab2-552c-469f-bf58-20c694e69ee0 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.210652 Jul 14 14:38:06.364208 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 317/580] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:06.377226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.378247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:06.392800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.393171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.394291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.396828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.609269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.628586 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d9b2cd0-6807-477c-b4d4-be6dd8156556 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1468 microversion: 2.1 time: 0.261565 Jul 14 14:38:06.631236 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 318/581] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1468 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:06.648112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-932d77c5-f628-4ce8-a086-aeaea68b1bb1 req-a97973ad-0582-429e-9de3-98d351dce29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1c9f04-7d06-489f-a719-417c45f7ecaa", "name": "network-vif-unplugged", "status": "completed", "tag": "cb666f3c-3c5d-4e61-ba94-a69732fa4ee5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:06.670003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-932d77c5-f628-4ce8-a086-aeaea68b1bb1 req-a97973ad-0582-429e-9de3-98d351dce29b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.671083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-932d77c5-f628-4ce8-a086-aeaea68b1bb1 req-a97973ad-0582-429e-9de3-98d351dce29b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.680502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.705359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-932d77c5-f628-4ce8-a086-aeaea68b1bb1 req-a97973ad-0582-429e-9de3-98d351dce29b service nova] Creating event network-vif-unplugged:cb666f3c-3c5d-4e61-ba94-a69732fa4ee5 for instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa on n-h1-768852-23 Jul 14 14:38:06.714099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c383eda-1e83-4020-bff1-bf272f20a772 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.416814 Jul 14 14:38:06.718347 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 264/582] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:06.724946 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-932d77c5-f628-4ce8-a086-aeaea68b1bb1 req-a97973ad-0582-429e-9de3-98d351dce29b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083076 Jul 14 14:38:06.727729 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 319/583] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:06.738468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6af1ca1e-c43b-4c13-9e59-134f839e63f2 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf33125e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.742838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.744211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:06.757055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.757843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.766025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:06.766987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:06.980956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:06.989723 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.259375 Jul 14 14:38:06.996109 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 320/584] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:06.996109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:06.996109 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bb27948-d39b-405a-9109-e1f113c52fb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001097 Jul 14 14:38:06.996109 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 321/585] 10.222.0.98 () {56 vars in 885 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:38:07.010951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.011749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:07.018514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.018877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.020264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.020264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.048021 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6af1ca1e-c43b-4c13-9e59-134f839e63f2 tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/b080ed82-8b05-454d-948b-6bb79802a6ba" status: 202 len: 0 microversion: 2.1 time: 0.327431 Jul 14 14:38:07.049206 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 265/586] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:06 2022] DELETE /compute/v2.1/os-security-groups/b080ed82-8b05-454d-948b-6bb79802a6ba => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:07.064750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f7f1a84-d596-4e41-8483-d3ce9abbbdce tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] Calling method '.version_select at 0x7fdbf3312e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.225066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:07.375322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.400252 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64f2525d-3f00-4e5d-b1f9-6e5b101f80f2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.397642 Jul 14 14:38:07.401637 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 322/587] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:06 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:07.416977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.418158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:07.462611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.464199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.465818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.466632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.809291 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f7f1a84-d596-4e41-8483-d3ce9abbbdce tempest-SecurityGroupRulesTestJSON-452284804 tempest-SecurityGroupRulesTestJSON-452284804-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/d6690952-ffc7-40de-b1ae-ce8fafed2b9d" status: 202 len: 0 microversion: 2.1 time: 0.754676 Jul 14 14:38:07.810567 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 266/588] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:07 2022] DELETE /compute/v2.1/os-security-groups/d6690952-ffc7-40de-b1ae-ce8fafed2b9d => generated 0 bytes in 757 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:38:07.817472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6aa381e0-b0c6-43bf-b208-90be5fa4e589 req-d14669e2-2dc6-42db-88c8-3de678723532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece38b80-f3ff-4714-a1ca-8f4cb86f0f21", "name": "network-vif-plugged", "status": "completed", "tag": "aded7d27-3ced-4c1c-8e26-b68d8b0ba5bd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:07.840338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6aa381e0-b0c6-43bf-b208-90be5fa4e589 req-d14669e2-2dc6-42db-88c8-3de678723532 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.841282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6aa381e0-b0c6-43bf-b208-90be5fa4e589 req-d14669e2-2dc6-42db-88c8-3de678723532 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.890354 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6aa381e0-b0c6-43bf-b208-90be5fa4e589 req-d14669e2-2dc6-42db-88c8-3de678723532 service nova] Creating event network-vif-plugged:aded7d27-3ced-4c1c-8e26-b68d8b0ba5bd for instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 on n-h1-768852-23 Jul 14 14:38:07.898627 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6aa381e0-b0c6-43bf-b208-90be5fa4e589 req-d14669e2-2dc6-42db-88c8-3de678723532 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086458 Jul 14 14:38:07.904659 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 267/589] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:07.913225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.914011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:07.922069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.922955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.923854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:07.924460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:07.962995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.976134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.978344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:07.979947 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d115047-eac7-44ad-89e2-7228a8fb6839 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1559 microversion: 2.25 time: 0.574150 Jul 14 14:38:07.981102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 323/590] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:07 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1559 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:07.990033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:07.992700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.007638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.008479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.010222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.011008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.215580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.227668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.231192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.247133 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7a062b2b-8117-43df-bb58-2389a62190c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.340285 Jul 14 14:38:08.248867 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 268/591] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:07 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:08.258036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.259639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.277605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.278227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.279203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.279955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.615998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.631617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:08.642444 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-14afe3f8-82ca-4e81-b016-91c0d87ad3cc tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1468 microversion: 2.1 time: 0.659761 Jul 14 14:38:08.647761 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 324/592] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:07 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1468 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:08.655074 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43e2755c-4367-4c06-b506-45b4bbeacc0d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.402738 Jul 14 14:38:08.659485 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 269/593] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:08.670352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.674157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.680126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:08.691987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.692513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.693327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.693758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.696198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:08.739060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.743299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:08.745268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:08.748283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.075000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:09.104727 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc544f96-5457-449b-a39a-468c44c59950 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 2054 microversion: 2.25 time: 0.454858 Jul 14 14:38:09.105973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 325/594] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 2054 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:09.122153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.122923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.132815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.133561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.134643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.135342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.143891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.163925 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-427fd532-6b31-40e0-a82d-3e10726205ec tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.502630 Jul 14 14:38:09.165099 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 270/595] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:08 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:09.173251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-29cf391d-fde6-45a4-9611-39d8e174d0dc req-c2d55429-f469-421d-a164-df9e67ec987e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e1c9f04-7d06-489f-a719-417c45f7ecaa", "tag": "cb666f3c-3c5d-4e61-ba94-a69732fa4ee5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:09.184619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-29cf391d-fde6-45a4-9611-39d8e174d0dc req-c2d55429-f469-421d-a164-df9e67ec987e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.185038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-29cf391d-fde6-45a4-9611-39d8e174d0dc req-c2d55429-f469-421d-a164-df9e67ec987e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.223613 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-29cf391d-fde6-45a4-9611-39d8e174d0dc req-c2d55429-f469-421d-a164-df9e67ec987e service nova] Creating event network-changed:cb666f3c-3c5d-4e61-ba94-a69732fa4ee5 for instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa on n-h1-768852-23 Jul 14 14:38:09.253635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-29cf391d-fde6-45a4-9611-39d8e174d0dc req-c2d55429-f469-421d-a164-df9e67ec987e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083929 Jul 14 14:38:09.255498 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 271/596] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:09.276287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.277640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.296396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.296861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.297655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.298095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.430553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.434351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:09.447816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-741d9c41-18e2-485f-b164-bc592c41bb5f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.340461 Jul 14 14:38:09.458685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 326/597] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:09.465020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.465909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.474681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.475445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.476792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.477411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.605967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:09.629279 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16074df4-94f0-434a-80d0-0443f98c1345 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 2054 microversion: 2.25 time: 0.363900 Jul 14 14:38:09.630637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 272/598] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 2054 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:09.647550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7453bf3d-8603-40e4-ae07-d07fd9e7fd73 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.647778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.649211 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:09.649211 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:09.650814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7453bf3d-8603-40e4-ae07-d07fd9e7fd73 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.651371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7453bf3d-8603-40e4-ae07-d07fd9e7fd73 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.652223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7453bf3d-8603-40e4-ae07-d07fd9e7fd73 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.653103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7453bf3d-8603-40e4-ae07-d07fd9e7fd73 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.671253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.677390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.681985 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7453bf3d-8603-40e4-ae07-d07fd9e7fd73 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038281 Jul 14 14:38:09.683204 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 273/599] 10.222.0.98 () {60 vars in 1216 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:38:09.688609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.689370 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9db53b0c-99dc-4511-bea1-1a60cb467188 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.227571 Jul 14 14:38:09.689990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.691734 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 327/600] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:09.697776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.698514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.699672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.700281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.704229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.707989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.721778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.722921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.726562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.727710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.747751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.748416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.748888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lazy-loading 'fault' on Instance uuid 0630b9a9-788e-4202-94b8-4fe204b5c1c8 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:09.805010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:09.813846 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-357962c2-a6aa-42a0-8c50-8986ad4a2d99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 200 len: 1311 microversion: 2.1 time: 0.128871 Jul 14 14:38:09.814458 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 274/601] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 1311 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:09.819733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:09.820352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.828047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.828506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.829312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.829759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.918403 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-920ae1e2-18ef-4368-bb53-5008dc39fc41 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5/action" status: 202 len: 0 microversion: 2.25 time: 0.102640 Jul 14 14:38:09.922357 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 275/602] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:38:09 2022] POST /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:09.929065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-10e7ee28-ca7c-4467-90ca-c81231999e43 req-e9c91272-c155-4681-aed9-969a221c63ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721a7dad-ae26-4f27-91f7-e71bd1adfad3", "name": "network-vif-plugged", "status": "completed", "tag": "be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:09.938366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-10e7ee28-ca7c-4467-90ca-c81231999e43 req-e9c91272-c155-4681-aed9-969a221c63ce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.939090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-10e7ee28-ca7c-4467-90ca-c81231999e43 req-e9c91272-c155-4681-aed9-969a221c63ce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.952829 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-10e7ee28-ca7c-4467-90ca-c81231999e43 req-e9c91272-c155-4681-aed9-969a221c63ce service nova] Creating event network-vif-plugged:be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5 for instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 on n-h2-768852-23 Jul 14 14:38:09.958240 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-10e7ee28-ca7c-4467-90ca-c81231999e43 req-e9c91272-c155-4681-aed9-969a221c63ce service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033902 Jul 14 14:38:09.958861 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 276/603] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:09.964485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:09.965407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:09.972563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.972819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:09.974450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:09.975127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.230006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:10.272053 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb678c16-e2e8-4cb0-a402-d36bafcf3671 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 2059 microversion: 2.25 time: 0.311629 Jul 14 14:38:10.281042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.283410 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 277/604] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 2059 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:10.289764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.290393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.292151 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-58a9b979-4e1d-4e57-a804-704e34982005 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1316 microversion: 2.1 time: 0.597829 Jul 14 14:38:10.303382 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 328/605] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:09 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1316 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:10.312124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.312953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.313844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.314368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.476818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.478445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.497122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.499717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.504364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.506356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.529653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.573011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7a56fb3-2332-4af0-b339-5adb70445dfa tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.287733 Jul 14 14:38:10.579689 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 278/606] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:10.713912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.714531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.722946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.723835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.724595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.725041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.838946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.850891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.852651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:10.860826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5bc6b3a7-0a30-466b-957f-d7449d96c8a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.150681 Jul 14 14:38:10.861824 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 279/607] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:10.881830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.883168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 0630b9a9-788e-4202-94b8-4fe204b5c1c8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.891570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.892176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.893131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.893665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.899468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:10.911161 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] HTTP exception thrown: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 could not be found. Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Request method failure captured: Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 HTTP/1.1 Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cn95sbl_62WTOw7HEXBsdlWf1LVFEA3BKqlwDGwXjPKO_AxJe4vAOD29EsU0N-5FKAK9mj5Z1019Te5ClylzF0kXe6RiUjckOdsbABRwZaUU-49-LKvmkwsxuTTdSbgjleQX2LnzV5rWnvALv7bj-YYeQulF5Ync4g1MKU7gJfmONQ Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 37c6e6fc4a9e4a8ab44ea9b14b7eefc5 Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1623919731 Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:10.913049 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1623919731 Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 37c6e6fc4a9e4a8ab44ea9b14b7eefc5 Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1623919731 Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersAdminNegativeTestJSON-1623919731-project Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 82254dd6dfcc4f2f96995a0133a901b4 Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1623919731-project Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 could not be found. Jul 14 14:38:10.915550 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '0630b9a9-788e-4202-94b8-4fe204b5c1c8'} Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 could not be found. Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:10.917556 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 could not be found. Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 could not be found. Jul 14 14:38:10.921948 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:10.925208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Returning 404 to user: Instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:10.925208 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d11ea4d5-09b7-4c28-8716-544dca542b99 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8" status: 404 len: 111 microversion: 2.1 time: 0.044700 Jul 14 14:38:10.925208 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 280/608] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/servers/0630b9a9-788e-4202-94b8-4fe204b5c1c8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:10.926047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:10.927171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:10.935073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.935598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.936800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:10.936800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:10.970336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:11.070530 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1057f6b9-600e-4d80-a447-cdd0c1c4a75f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 204 len: 0 microversion: 2.1 time: 0.148863 Jul 14 14:38:11.071346 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 281/609] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:10 2022] DELETE /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:38:11.081760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:11.082562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:11.089716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.090161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.091172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.091673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.160462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.187180 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0522b6e4-f930-4183-ae49-11c475ad51e8 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.721447 Jul 14 14:38:11.205462 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 329/610] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:10 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:11.275887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ecceecce-8336-453f-9800-85c73b1576dc req-5988f87c-1b1d-4c56-a6d6-0567dc341612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0630b9a9-788e-4202-94b8-4fe204b5c1c8", "name": "network-vif-deleted", "tag": "8f6fdf55-7f1e-43aa-a34e-8a2a04b1916a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:11.278808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.291123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ecceecce-8336-453f-9800-85c73b1576dc req-5988f87c-1b1d-4c56-a6d6-0567dc341612 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.291963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ecceecce-8336-453f-9800-85c73b1576dc req-5988f87c-1b1d-4c56-a6d6-0567dc341612 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.295549 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22ddf508-07d6-44ed-9ddd-29302c07dd2f tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1477 microversion: 2.1 time: 0.217934 Jul 14 14:38:11.296931 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 282/611] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:11 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1477 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:11.307511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:11.309232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:11.315318 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ecceecce-8336-453f-9800-85c73b1576dc req-5988f87c-1b1d-4c56-a6d6-0567dc341612 service nova] Creating event network-vif-deleted:8f6fdf55-7f1e-43aa-a34e-8a2a04b1916a for instance 0630b9a9-788e-4202-94b8-4fe204b5c1c8 on n-h2-768852-23 Jul 14 14:38:11.320864 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ecceecce-8336-453f-9800-85c73b1576dc req-5988f87c-1b1d-4c56-a6d6-0567dc341612 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051884 Jul 14 14:38:11.321857 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 330/612] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:11.324843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.325738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.327387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:11.328100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:11.328274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.329356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.335974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.336504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.337280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.337623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.538112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:11.561332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e6769f3-7dfe-40ea-9bdf-a6dff6c2a968 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 2039 microversion: 2.25 time: 0.262552 Jul 14 14:38:11.562759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 283/613] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:11 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 2039 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:11.585727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": "auto"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:11.589024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:11.602736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.603570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.605065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.605857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.666062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'flavor' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:11.692237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Going to try to live migrate instance to n-h2-768852-23 {{(pid=125965) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:38:11.781075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:11.801409 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-acb984a9-194a-4f8a-ba77-b3c5afaf2ab6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1465 microversion: 2.1 time: 0.478210 Jul 14 14:38:11.810925 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 331/614] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:11 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1465 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:11.810925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:11.810925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:11.827894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.828662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:11.829460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:11.830070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.409208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.435039 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-040d85ac-769d-4b68-bf17-c999c9319ef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.627326 Jul 14 14:38:12.444041 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 332/615] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:11 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:12.454395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.456200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:12.472379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.472936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.476111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.476732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.714096 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c6ccae84-ece4-46e5-a8b4-378ef40dabaf tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1618 microversion: 2.1 time: 0.268402 Jul 14 14:38:12.715039 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 333/616] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1618 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:12.720355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.721086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:12.729095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.729858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.730988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.731641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.890145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.901014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.904730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:12.913367 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2550bbd5-9e26-4c00-a3c8-dc341e9f22dd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.196945 Jul 14 14:38:12.914383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 334/617] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:12.920824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:12.921977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:12.931095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.932620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:12.933807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:12.934576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:13.376337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.400898 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-933f9399-70e1-4e2d-8b77-a2ed1e31f1a0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1390 microversion: 2.1 time: 0.484865 Jul 14 14:38:13.401410 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 335/618] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:12 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1390 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:13.411902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:13.418944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:13.428942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:13.429742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:13.430471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:13.430910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:13.762412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:13.799307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b1d7bde-a275-4548-80e0-a39512ee5160 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1477 microversion: 2.1 time: 0.396047 Jul 14 14:38:13.805833 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 336/619] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:13 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1477 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:13.823142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1574690326", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["859ce988-fadf-44f6-b941-5639f6ccd35f"]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:13.989421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:14.610893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:14.611972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:14.614596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:14.615543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:14.616479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:14.640192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.641416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.643021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.644095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.692179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:14.701046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:14.728560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:14.735690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:14.804238 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9ff3253-e165-4709-86b6-5b2a3861dcb8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996425 Jul 14 14:38:14.806144 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 337/620] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:38:14.815946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:14.822510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:14.829957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.830721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:14.832018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:14.832928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.126689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:15.136917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0e1955b-fcdf-4a2a-bbf1-9827d80a27e6 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.330942 Jul 14 14:38:15.141892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 338/621] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:14 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:15.153362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:15.157003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:15.166133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.166977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.168385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.169542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.461799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:15.482615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:15.497825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:15.508871 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7e2de03-f807-466f-9fee-aa59f302e9ff tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.364304 Jul 14 14:38:15.510448 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 339/622] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:15 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:15.807655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba38980f-a3b9-4672-b5e7-d2ff83b6789b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5/action" status: 202 len: 0 microversion: 2.25 time: 4.228909 Jul 14 14:38:15.816053 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 284/623] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:38:11 2022] POST /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5/action => generated 0 bytes in 4239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:15.843966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:15.846529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:15.863516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.865356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.867106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.868244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.901248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf326a3a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:15.911115 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:15.911115 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:15.914091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.916340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:15.988037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:15.989317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.035397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.040422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.067127 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7e9ca189-5493-46ef-9811-d734908b836b tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.554791 Jul 14 14:38:16.075550 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 340/624] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:15 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:16.088895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6d350874-9fe6-452a-afdd-a7391d979257 req-8dce16f4-000a-4dee-8f57-cfbae1e65608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1c9f04-7d06-489f-a719-417c45f7ecaa", "name": "network-vif-unplugged", "status": "completed", "tag": "cb666f3c-3c5d-4e61-ba94-a69732fa4ee5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:16.123738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6d350874-9fe6-452a-afdd-a7391d979257 req-8dce16f4-000a-4dee-8f57-cfbae1e65608 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.136736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6d350874-9fe6-452a-afdd-a7391d979257 req-8dce16f4-000a-4dee-8f57-cfbae1e65608 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.178696 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6d350874-9fe6-452a-afdd-a7391d979257 req-8dce16f4-000a-4dee-8f57-cfbae1e65608 service nova] Creating event network-vif-unplugged:cb666f3c-3c5d-4e61-ba94-a69732fa4ee5 for instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa on n-h1-768852-23 Jul 14 14:38:16.192012 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6d350874-9fe6-452a-afdd-a7391d979257 req-8dce16f4-000a-4dee-8f57-cfbae1e65608 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114012 Jul 14 14:38:16.198596 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 341/625] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:16.218370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.219616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:16.258108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.258860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.260304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.261078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.319437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.350650 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3730fd1c-eb51-4902-8bfd-6017da363e78 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1590 microversion: 2.1 time: 0.524754 Jul 14 14:38:16.352792 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 285/626] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:15 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1590 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:16.369289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.370791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:16.385843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.387599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.391165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.404797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.584415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.589161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.590227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lazy-loading 'fault' on Instance uuid 5825652f-8c70-4e1d-8122-73b0060140ca {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:16.628064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.656812 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81421746-a3ea-48ad-a153-8afbb6e298d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1269 microversion: 2.1 time: 0.455806 Jul 14 14:38:16.658611 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 342/627] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1269 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:16.710812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c2bcfca9-2dfc-40c3-a7b3-140ebec234de req-d904a020-cdad-4a49-9721-8098b2ed6768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5825652f-8c70-4e1d-8122-73b0060140ca", "name": "network-vif-deleted", "tag": "f2eafc9b-533f-4dae-8e52-4589bd08f6fd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:16.719582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82254dd6dfcc4f2f96995a0133a901b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c6e6fc4a9e4a8ab44ea9b14b7eefc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:16.736327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-700a75bc-f492-442d-99bb-836f6d8d4ebb tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 200 len: 1312 microversion: 2.1 time: 0.380806 Jul 14 14:38:16.741586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c2bcfca9-2dfc-40c3-a7b3-140ebec234de req-d904a020-cdad-4a49-9721-8098b2ed6768 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.742461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c2bcfca9-2dfc-40c3-a7b3-140ebec234de req-d904a020-cdad-4a49-9721-8098b2ed6768 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.752017 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 286/628] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 1312 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:16.765553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.766806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:16.770678 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c2bcfca9-2dfc-40c3-a7b3-140ebec234de req-d904a020-cdad-4a49-9721-8098b2ed6768 service nova] Creating event network-vif-deleted:f2eafc9b-533f-4dae-8e52-4589bd08f6fd for instance 5825652f-8c70-4e1d-8122-73b0060140ca on n-h2-768852-23 Jul 14 14:38:16.778350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c2bcfca9-2dfc-40c3-a7b3-140ebec234de req-d904a020-cdad-4a49-9721-8098b2ed6768 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117758 Jul 14 14:38:16.780075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.781288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.781498 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 343/629] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:16.785000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.787362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.793625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf326aa60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.794660 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:16.794660 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:16.796178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.798308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.818531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.820438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.842084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.843017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.854442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8be36983-73f3-4c48-a2e8-a59294ccd15f tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1510 microversion: 2.1 time: 0.071123 Jul 14 14:38:16.855917 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 344/630] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1510 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:16.862428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:16.863618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:16.874666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.875641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:16.876763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:16.877414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.026013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.039753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.041251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.042465 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb5d8d7d-9693-4ae0-8231-326484a2100c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.288891 Jul 14 14:38:17.044958 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 287/631] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:17.050961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.052088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:17.077887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.078897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.080060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.080952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.215824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b46e2902-e020-490a-8fdf-d8a2c51b2810 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.168604 Jul 14 14:38:17.216563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 288/632] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3/os-interface => generated 285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:17.226400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.228165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:17.242506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:17.258783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.262414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.263964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.268895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.762509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.791781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.796093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:17.806185 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c689f77d-e476-4315-be7b-f58b3ea43630 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.585270 Jul 14 14:38:17.815824 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 289/633] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:17.827681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf3435940>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.828690 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:17.828690 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:17.830029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.830568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.865731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.866171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.882535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.892875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.915197 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d290c0cb-56a2-4ab2-91e6-aa9d04082092 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.097903 Jul 14 14:38:17.918132 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 290/634] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:17.928121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:17.944144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:17.975593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.985772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:17.989800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:17.999812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.195063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:18.211925 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4a57bed-a7d0-457f-8f13-3d41da53ee81 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 1.354238 Jul 14 14:38:18.213191 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 345/635] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:16 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:18.240636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.242177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] [instance: 5825652f-8c70-4e1d-8122-73b0060140ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:18.259953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.261969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.265060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.266200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.280164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:18.310866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] HTTP exception thrown: Instance 5825652f-8c70-4e1d-8122-73b0060140ca could not be found. Jul 14 14:38:18.313477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Request method failure captured: Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca HTTP/1.1 Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cn95sbl_62WTOw7HEXBsdlWf1LVFEA3BKqlwDGwXjPKO_AxJe4vAOD29EsU0N-5FKAK9mj5Z1019Te5ClylzF0kXe6RiUjckOdsbABRwZaUU-49-LKvmkwsxuTTdSbgjleQX2LnzV5rWnvALv7bj-YYeQulF5Ync4g1MKU7gJfmONQ Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 37c6e6fc4a9e4a8ab44ea9b14b7eefc5 Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1623919731 Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:18.321278 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/37c6e6fc4a9e4a8ab44ea9b14b7eefc5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1623919731 Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 37c6e6fc4a9e4a8ab44ea9b14b7eefc5 Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1623919731 Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminNegativeTestJSON-1623919731-project Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 82254dd6dfcc4f2f96995a0133a901b4 Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1623919731-project Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 5825652f-8c70-4e1d-8122-73b0060140ca could not be found. Jul 14 14:38:18.324216 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '5825652f-8c70-4e1d-8122-73b0060140ca'} Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5825652f-8c70-4e1d-8122-73b0060140ca could not be found. Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:18.325888 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5825652f-8c70-4e1d-8122-73b0060140ca could not be found. Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5825652f-8c70-4e1d-8122-73b0060140ca could not be found. Jul 14 14:38:18.328462 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:18.345741 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-926f1baa-29bd-4387-aa81-5338da1bb107 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1275 microversion: 2.1 time: 0.422238 Jul 14 14:38:18.350863 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 291/636] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:17 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1275 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:18.364921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] Returning 404 to user: Instance 5825652f-8c70-4e1d-8122-73b0060140ca could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:18.367001 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f68a4b89-e902-4515-935b-3136ee195f87 tempest-ServersAdminNegativeTestJSON-1623919731 tempest-ServersAdminNegativeTestJSON-1623919731-project] 10.222.0.98 "GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca" status: 404 len: 111 microversion: 2.1 time: 0.152242 Jul 14 14:38:18.373774 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 346/637] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/servers/5825652f-8c70-4e1d-8122-73b0060140ca => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:18.376970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-51e68c9d-c188-4da4-bc12-1e45105de4a1 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf3435ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.378922 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:18.378922 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:18.381964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51e68c9d-c188-4da4-bc12-1e45105de4a1 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.382773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51e68c9d-c188-4da4-bc12-1e45105de4a1 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.388274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.389967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:18.408549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.409871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.413565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.415757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.487155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51e68c9d-c188-4da4-bc12-1e45105de4a1 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.490537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51e68c9d-c188-4da4-bc12-1e45105de4a1 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.516117 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-51e68c9d-c188-4da4-bc12-1e45105de4a1 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.162910 Jul 14 14:38:18.530962 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 292/638] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:18.538600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1fe0f3ce-44d4-462d-bb55-262594b50768 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf336ba60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.541213 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:18.541213 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:18.542651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fe0f3ce-44d4-462d-bb55-262594b50768 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.543520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fe0f3ce-44d4-462d-bb55-262594b50768 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.576579 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1fe0f3ce-44d4-462d-bb55-262594b50768 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 267 microversion: 2.1 time: 0.043579 Jul 14 14:38:18.588123 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 293/639] 10.222.0.98 () {58 vars in 1178 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 267 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:18.597410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf3406ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.599608 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:18.599608 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:18.602088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.602766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.641783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.642923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.650670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:18.668738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.669879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.684628 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-725fa1b7-6fd1-439a-adbd-f40893357d05 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.093945 Jul 14 14:38:18.694869 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 294/640] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:18.704851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8d4a256-59fe-41dd-a2da-3d5082eb6e97 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf3435ee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.706910 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:18.706910 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:18.710108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8d4a256-59fe-41dd-a2da-3d5082eb6e97 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.711436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8d4a256-59fe-41dd-a2da-3d5082eb6e97 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.755447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8d4a256-59fe-41dd-a2da-3d5082eb6e97 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.757167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8d4a256-59fe-41dd-a2da-3d5082eb6e97 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.774617 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8d4a256-59fe-41dd-a2da-3d5082eb6e97 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.077322 Jul 14 14:38:18.789804 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 295/641] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:18.804305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d6b76cbe-002f-4157-8998-e7796cbb5865 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf36cfa60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.809392 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:18.809392 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:18.812421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6b76cbe-002f-4157-8998-e7796cbb5865 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.813939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6b76cbe-002f-4157-8998-e7796cbb5865 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.846908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6b76cbe-002f-4157-8998-e7796cbb5865 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.848888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6b76cbe-002f-4157-8998-e7796cbb5865 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.862904 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d6b76cbe-002f-4157-8998-e7796cbb5865 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 761 microversion: 2.1 time: 0.068663 Jul 14 14:38:18.876818 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 296/642] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/os-hypervisors/2 => generated 761 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:18.881962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:18.882227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:18.891129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.891628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.892484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:18.894170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:18.996887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.007592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.010045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.011702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5f2c6ba-9f91-4636-bf7e-7f55ed7de409 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.636004 Jul 14 14:38:19.012757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 347/643] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:19.022441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Calling method '.version_select at 0x7fdbf34bd0d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:19.026447 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:19.026447 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:19.029361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.031249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.058758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.059453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.072357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.072990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.073589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.086551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.103528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.112199 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e87058c7-3c0e-403f-9757-a4a524d28936 tempest-HypervisorAdminTestJSON-1572637932 tempest-HypervisorAdminTestJSON-1572637932-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.092793 Jul 14 14:38:19.113952 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 348/644] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 14:38:19 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:19.116369 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2410a6b-ed56-41e1-be58-df5c4a63ae30 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.246220 Jul 14 14:38:19.118260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 297/645] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:18 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:19.253054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:19.254000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:19.282770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.283490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.285590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.287059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.399521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:19.401737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:19.423736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.424652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.427183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:19.428508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:19.662987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:19.693718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:19.704596 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5453bcb6-fe18-4e2b-90ef-a412a8da490f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1275 microversion: 2.1 time: 0.342793 Jul 14 14:38:19.706064 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 298/646] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:19 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1275 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:20.054153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:20.054907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:20.066219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.066927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.070863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.072328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.080174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.092674 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3acd3afd-104d-4ea4-a16e-f7ebfc19c8b0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1503 microversion: 2.1 time: 0.852565 Jul 14 14:38:20.093969 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 349/647] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:19 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1503 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:20.154617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:20.156225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:20.176962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:20.199822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.200663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.202306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.203122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.429517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.474147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.485663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.509872 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3104c53e-3848-48ad-92a6-96e42c27f47b tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.362064 Jul 14 14:38:20.515578 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 350/648] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:20 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:38:20.597994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:20.605999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:20.617644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.618390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.620637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.621437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.632930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.675424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.684084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:20.688704 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63e0ba8b-072d-4298-974c-5de73bb5086b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.652319 Jul 14 14:38:20.691214 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 299/649] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:20 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:38:20.702472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-902f282a-13e7-484e-8d38-a8a00131738a req-63a7ec02-4df6-49a5-9752-9217b83a5bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "721a7dad-ae26-4f27-91f7-e71bd1adfad3", "tag": "be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:20.727893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-902f282a-13e7-484e-8d38-a8a00131738a req-63a7ec02-4df6-49a5-9752-9217b83a5bfe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.728350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-902f282a-13e7-484e-8d38-a8a00131738a req-63a7ec02-4df6-49a5-9752-9217b83a5bfe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.757372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-902f282a-13e7-484e-8d38-a8a00131738a req-63a7ec02-4df6-49a5-9752-9217b83a5bfe service nova] Creating event network-changed:be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5 for instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 on n-h2-768852-23 Jul 14 14:38:20.763186 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-902f282a-13e7-484e-8d38-a8a00131738a req-63a7ec02-4df6-49a5-9752-9217b83a5bfe service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067864 Jul 14 14:38:20.764598 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 300/650] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:20.772449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:20.773248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:20.782257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.782608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:20.784071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:20.784071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.175749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:21.195258 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3cd074d-5996-487c-a00a-04b16719f5fa tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.429291 Jul 14 14:38:21.197074 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 301/651] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:20 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:21.212796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.213736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.230492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.232221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.234952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.236598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.534218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:21.547395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5c9afaa-a625-438d-b318-8cad434a44f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1493 microversion: 2.1 time: 0.346034 Jul 14 14:38:21.562598 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 302/652] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1493 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:21.581512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.583440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.594084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.594540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.595372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.596490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.645941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:21.677550 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7332e41a-a307-44df-966a-4994f08ee2c7 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 200 len: 1590 microversion: 2.1 time: 1.092866 Jul 14 14:38:21.680254 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 351/653] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:20 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 1590 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:21.711174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4a33faa-fd33-41a7-8716-eaab6237887a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '.version_select at 0x7fdbf3f00a60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.740533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4a33faa-fd33-41a7-8716-eaab6237887a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.741302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4a33faa-fd33-41a7-8716-eaab6237887a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.755797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:21.763888 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4a33faa-fd33-41a7-8716-eaab6237887a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 1175 microversion: 2.1 time: 0.063487 Jul 14 14:38:21.772252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 352/654] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/os-migrations => generated 1175 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:21.780181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:21.782003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:21.789231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.790555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.791229 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1e4fb2a-f500-422b-ad9d-30bcd898dd5c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.226904 Jul 14 14:38:21.792582 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 303/655] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:21.810951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:21.811865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:21.818733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.819919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.823178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.827343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.836178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.836976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:21.837946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:21.838497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:22.107660 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-49ad458d-6dd2-4763-a399-c9a92fea3a1a tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1646 microversion: 2.1 time: 0.301431 Jul 14 14:38:22.122300 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 304/656] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1646 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:22.227243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:22.228374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:22.283045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:22.285480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:22.292358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:22.294404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.110884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.125620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.127478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.129606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-150f146f-08a6-47a6-b1a1-bea7a9be5c8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 1.355497 Jul 14 14:38:23.142813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 353/657] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:21 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:23.153948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1679830510", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "ee03bffb-17d6-47bc-b312-096b88b6e925"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:23.311668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] validate_networks() for [('ee03bffb-17d6-47bc-b312-096b88b6e925', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:23.870187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:23.893804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-58ccd221-c177-47eb-8ff1-8c989245f9c6 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 1.674394 Jul 14 14:38:23.897732 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 305/658] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:22 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:23.918211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:23.919927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:23.933652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.934644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:23.936586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:23.937445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.310273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.334273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.345465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.365199 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-40f5a9f2-d452-4095-adde-6d0549598453 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.465102 Jul 14 14:38:24.381918 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 306/659] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:23 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:24.401546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:24.402767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:24.433448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.434344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.435958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:24.436750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:24.670735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:24.725123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:24.981624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:24.998416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.000299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.001765 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c6e58835-1668-4435-b298-5576fc346df6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.618384 Jul 14 14:38:25.002564 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 307/660] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:24 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:25.013111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:25.013406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:25.032232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.032680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.033492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.033936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.325103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.335437 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2c084ee-bc60-4012-936a-f5dc6c16b185 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.331441 Jul 14 14:38:25.336968 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 308/661] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:25 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:25.393564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:25.396264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:25.397523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:25.397523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:25.397881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:25.409515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.410493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.412372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.412693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.437201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:25.443172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for user 038556a90129478eb04699f574ea7e1b and project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:25.457910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:25.461019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:25.550809 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-871c095d-d39a-44e0-8a37-0ae1d8262ecb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.403785 Jul 14 14:38:25.554936 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 354/662] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:38:25.573540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:25.575309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:25.606458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.616213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.620964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:25.622231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:25.728437 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-977a8e0e-0d98-4170-b68b-889051e480d7 tempest-TenantUsagesNegativeTestJSON-206897961 tempest-TenantUsagesNegativeTestJSON-206897961-project-admin] 10.222.0.98 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-13T14%3A38%3A25.131192&end=2022-07-15T14%3A38%3A25.131192" status: 404 len: 112 microversion: - time: 0.389781 Jul 14 14:38:25.756202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 309/663] 10.222.0.98 () {58 vars in 1315 bytes} [Thu Jul 14 14:38:25 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-07-13T14%3A38%3A25.131192&end=2022-07-15T14%3A38%3A25.131192 => generated 112 bytes in 416 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:38:25.772660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-519c9886-1522-44a1-ad0c-29b1b672e75e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:25.773831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-519c9886-1522-44a1-ad0c-29b1b672e75e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:25.932136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-519c9886-1522-44a1-ad0c-29b1b672e75e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:25.958213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-519c9886-1522-44a1-ad0c-29b1b672e75e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1211 microversion: 2.1 time: 0.200053 Jul 14 14:38:25.962019 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 310/664] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:25 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1211 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:25.982534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6b3d6814-b1c3-451a-b215-4c415d6a4f08 req-2ba5f3f0-742b-463a-bd2e-e8caacb1669a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8239eb66-b366-4119-b7d2-27f8faa6f57d", "tag": "240e91e9-b919-4b5a-8483-848ef3c0a01f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:26.027516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6b3d6814-b1c3-451a-b215-4c415d6a4f08 req-2ba5f3f0-742b-463a-bd2e-e8caacb1669a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.038486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6b3d6814-b1c3-451a-b215-4c415d6a4f08 req-2ba5f3f0-742b-463a-bd2e-e8caacb1669a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.080504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.088274 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6b3d6814-b1c3-451a-b215-4c415d6a4f08 req-2ba5f3f0-742b-463a-bd2e-e8caacb1669a service nova] Creating event network-changed:240e91e9-b919-4b5a-8483-848ef3c0a01f for instance 8239eb66-b366-4119-b7d2-27f8faa6f57d on n-h1-768852-23 Jul 14 14:38:26.092942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.094710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.112247 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8652da5b-27d8-48fd-9394-7b9f8940f6c2 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.553046 Jul 14 14:38:26.119341 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 355/665] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:25 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:26.125984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ddb2c77-3beb-4abb-a59c-cda83016d066 tempest-TenantUsagesNegativeTestJSON-206897961 tempest-TenantUsagesNegativeTestJSON-206897961-project-admin] Calling method '.version_select at 0x7fdbf3243670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.143229 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-6ddb2c77-3beb-4abb-a59c-cda83016d066 tempest-TenantUsagesNegativeTestJSON-206897961 tempest-TenantUsagesNegativeTestJSON-206897961-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Jul 14 14:38:26.145686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6b3d6814-b1c3-451a-b215-4c415d6a4f08 req-2ba5f3f0-742b-463a-bd2e-e8caacb1669a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173586 Jul 14 14:38:26.147524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 311/666] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ddb2c77-3beb-4abb-a59c-cda83016d066 tempest-TenantUsagesNegativeTestJSON-206897961 tempest-TenantUsagesNegativeTestJSON-206897961-project-admin] Request method failure captured: Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-simple-tenant-usage/4db5c049426148339bc9e18e701d5d3c?start=2022-07-15T14%3A38%3A25.131192&end=2022-07-13T14%3A38%3A25.131192 HTTP/1.1 Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpgFkbdLvRIcRyOoJBKTwm6fV440rnDG4a-qgbb9X0yjG2b1xxV5a9wXiN-BbZquOWC0KMs8BouAFPkYy8wPbtE1wGKwIhQeUT6xYbZSTOmrffAXHL55ysLt9PBE1yYq--0GuxK09kH9ArEFSsqA0YPNIdoW2JiQKNitd5ZT8B_77k Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f004aa61dbd14b7d9984f9367a4c5949 Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-206897961 Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:38:26.149630 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f004aa61dbd14b7d9984f9367a4c5949"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f004aa61dbd14b7d9984f9367a4c5949"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f004aa61dbd14b7d9984f9367a4c5949"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f004aa61dbd14b7d9984f9367a4c5949"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-206897961 Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f004aa61dbd14b7d9984f9367a4c5949 Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-206897961 Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TenantUsagesNegativeTestJSON-206897961-project-admin Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 08af42beb9cc4e6eaaeb0e99fcc7bd0a Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-206897961-project-admin Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid start time. The start time cannot occur after the end time. Jul 14 14:38:26.152637 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '4db5c049426148339bc9e18e701d5d3c'} Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 14:38:26.154836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ddb2c77-3beb-4abb-a59c-cda83016d066 tempest-TenantUsagesNegativeTestJSON-206897961 tempest-TenantUsagesNegativeTestJSON-206897961-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:26.164904 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ddb2c77-3beb-4abb-a59c-cda83016d066 tempest-TenantUsagesNegativeTestJSON-206897961 tempest-TenantUsagesNegativeTestJSON-206897961-project-admin] 10.222.0.98 "GET /compute/v2.1/os-simple-tenant-usage/4db5c049426148339bc9e18e701d5d3c?start=2022-07-15T14%3A38%3A25.131192&end=2022-07-13T14%3A38%3A25.131192" status: 400 len: 111 microversion: 2.1 time: 0.030673 Jul 14 14:38:26.167046 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 356/667] 10.222.0.98 () {58 vars in 1411 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/os-simple-tenant-usage/4db5c049426148339bc9e18e701d5d3c?start=2022-07-15T14%3A38%3A25.131192&end=2022-07-13T14%3A38%3A25.131192 => generated 111 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:38:26.184152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.185974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:26.214175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.215520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.217214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.218214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.589780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.602267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.604260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.606444 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef3ed0a5-d0fb-420b-b1c6-c45c2cf35001 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.456414 Jul 14 14:38:26.621762 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 312/668] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:26.641839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.643533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:26.659816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.661440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.663068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.665047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.733423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12d06844-7e69-41d6-b248-45a4cdccc3e2 tempest-TenantUsagesNegativeTestJSON-304313895 tempest-TenantUsagesNegativeTestJSON-304313895-project] Calling method '.version_select at 0x7fdbf32738b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.736541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12d06844-7e69-41d6-b248-45a4cdccc3e2 tempest-TenantUsagesNegativeTestJSON-304313895 tempest-TenantUsagesNegativeTestJSON-304313895-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '86fb7c8f2aa741aa887f7bb1a1c19f3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4db5c049426148339bc9e18e701d5d3c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12d06844-7e69-41d6-b248-45a4cdccc3e2 tempest-TenantUsagesNegativeTestJSON-304313895 tempest-TenantUsagesNegativeTestJSON-304313895-project] Request method failure captured: Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A38%3A25.131192&end=2022-07-15T14%3A38%3A25.131192&detailed=1 HTTP/1.1 Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpfP4ZXHuXCs6k_xIGzK3a5UWsk7OddUCZGnElzXNt_Cd56o1A-sCKwrNvvP74cR9paQWTnVUE_-H84wnRni2-JqeeFlJ-NVbIGecT4C8vVWVqsaPJqquo13O_W9kMM9OYL_MagPYY75KK7k8J-x3H9FEDmFPUlkebsStFN8Pb8VxE Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4db5c049426148339bc9e18e701d5d3c Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-304313895 Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:26.742415 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4db5c049426148339bc9e18e701d5d3c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4db5c049426148339bc9e18e701d5d3c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4db5c049426148339bc9e18e701d5d3c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4db5c049426148339bc9e18e701d5d3c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-304313895 Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4db5c049426148339bc9e18e701d5d3c Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-304313895 Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TenantUsagesNegativeTestJSON-304313895-project Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 86fb7c8f2aa741aa887f7bb1a1c19f3a Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-304313895-project Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: action_args: {} Jul 14 14:38:26.743876 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:26.744695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:26.745824 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:26.746963 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Jul 14 14:38:26.746963 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:26.748105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12d06844-7e69-41d6-b248-45a4cdccc3e2 tempest-TenantUsagesNegativeTestJSON-304313895 tempest-TenantUsagesNegativeTestJSON-304313895-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:26.751442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12d06844-7e69-41d6-b248-45a4cdccc3e2 tempest-TenantUsagesNegativeTestJSON-304313895 tempest-TenantUsagesNegativeTestJSON-304313895-project] 10.222.0.98 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A38%3A25.131192&end=2022-07-15T14%3A38%3A25.131192&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.588311 Jul 14 14:38:26.764326 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 357/669] 10.222.0.98 () {58 vars in 1334 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A38%3A25.131192&end=2022-07-15T14%3A38%3A25.131192&detailed=1 => generated 123 bytes in 602 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:26.795285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-81df72fc-0f7e-4c42-8700-58d25d4bc0a1 req-16e67e66-eda4-4707-9830-8deb0e162895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9124379-a3fd-4713-95b4-58082d5fbfd5", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb56fd2-1132-4057-9a78-9ff419df67a8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:26.852322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81df72fc-0f7e-4c42-8700-58d25d4bc0a1 req-16e67e66-eda4-4707-9830-8deb0e162895 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:26.852972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81df72fc-0f7e-4c42-8700-58d25d4bc0a1 req-16e67e66-eda4-4707-9830-8deb0e162895 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:26.901626 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-81df72fc-0f7e-4c42-8700-58d25d4bc0a1 req-16e67e66-eda4-4707-9830-8deb0e162895 service nova] Creating event network-vif-unplugged:bfb56fd2-1132-4057-9a78-9ff419df67a8 for instance e9124379-a3fd-4713-95b4-58082d5fbfd5 on n-h1-768852-23 Jul 14 14:38:26.916290 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-81df72fc-0f7e-4c42-8700-58d25d4bc0a1 req-16e67e66-eda4-4707-9830-8deb0e162895 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.132476 Jul 14 14:38:26.918618 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 358/670] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:26.979992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4c2c0317-6d1a-4fda-861c-9d518de83e15 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:26.987866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4c2c0317-6d1a-4fda-861c-9d518de83e15 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:27.111797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.123306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67c52766-bfed-4fd8-af27-45610e1afece tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.501962 Jul 14 14:38:27.127402 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 313/671] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:27.141748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:27.143562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:27.169188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.170758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.174689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.175568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.302412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4c2c0317-6d1a-4fda-861c-9d518de83e15 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.320451 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4c2c0317-6d1a-4fda-861c-9d518de83e15 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1211 microversion: 2.1 time: 0.345895 Jul 14 14:38:27.321463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 359/672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:26 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1211 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:27.407255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.423208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.427587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:27.436715 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67fdf641-b635-46e7-90c1-52737ec511f8 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.299256 Jul 14 14:38:27.438231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 314/673] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:27 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:38:27.659596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:27.677761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:27.718664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.720387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:27.722181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:27.723951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.164375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.172181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:28.208648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.222245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.229857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.232741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.281305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:28.698919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.725873 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3b23a59-b455-4bbd-b703-0af3e75589b1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.576813 Jul 14 14:38:28.728305 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 315/674] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:28.738189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.739758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:28.748455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.749301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.750436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.751117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.864151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.865390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.881127 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1022d448-93b2-4fa2-b82f-0621242aeb78 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1281 microversion: 2.1 time: 0.150316 Jul 14 14:38:28.881847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.882452 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 316/675] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1281 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:28.894451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:28.899039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:28.899373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:28.900450 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e643031-462e-4972-baf7-d419a4e68fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 1.273237 Jul 14 14:38:28.901073 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 360/676] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:27 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:28.916794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.917244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.918501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.919152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:28.970114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8b1caa3c-25d7-4fb7-82da-31495b963ab2 req-a936755e-aecf-4c90-bc64-466db1aa38ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9124379-a3fd-4713-95b4-58082d5fbfd5", "tag": "bfb56fd2-1132-4057-9a78-9ff419df67a8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:28.989989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b1caa3c-25d7-4fb7-82da-31495b963ab2 req-a936755e-aecf-4c90-bc64-466db1aa38ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:28.990556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b1caa3c-25d7-4fb7-82da-31495b963ab2 req-a936755e-aecf-4c90-bc64-466db1aa38ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:29.026164 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8b1caa3c-25d7-4fb7-82da-31495b963ab2 req-a936755e-aecf-4c90-bc64-466db1aa38ab service nova] Creating event network-changed:bfb56fd2-1132-4057-9a78-9ff419df67a8 for instance e9124379-a3fd-4713-95b4-58082d5fbfd5 on n-h1-768852-23 Jul 14 14:38:29.039132 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8b1caa3c-25d7-4fb7-82da-31495b963ab2 req-a936755e-aecf-4c90-bc64-466db1aa38ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073441 Jul 14 14:38:29.041357 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 361/677] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:29.046447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:29.059014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:29.060712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:29.072349 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ae95af65-578d-4533-9d5b-c6fd0a4de42f tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.187437 Jul 14 14:38:29.075827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 317/678] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:28 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:29.769395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:29.772988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:29.803626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:29.811344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:29.813648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:29.814975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.587918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd8de897-1cb8-4406-9401-d2813d6c6e3f tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Calling method '.version_select at 0x7fdbf336bdc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:30.589122 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:30.589122 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:30.590620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bd8de897-1cb8-4406-9401-d2813d6c6e3f tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'b85e650a3f01453689cd189bbd5f9467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e64dd29f7a471da6f7d60e9c00b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd8de897-1cb8-4406-9401-d2813d6c6e3f tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Request method failure captured: Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpkKMZmRhxIatzPYZ_3TJ0ufRlG-qsXDZPhXFZnQ24iDJEeHMpXqv0YCXv6tRHNxkGtSvdJcK3Z84zeNpHC4TAZKnBwjy8SqD1UmlCf87yLyrr3zr5jyhhehuIp_WBStLYFVcYsd8EeKb9yxqAmz0Evnq76AyeFHF4x3U1ynWY96zA Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:30.596728 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b85e650a3f01453689cd189bbd5f9467 Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:38:30.600239 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._detail(req) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:30.601868 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Jul 14 14:38:30.605150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:30.609724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd8de897-1cb8-4406-9401-d2813d6c6e3f tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:30.609724 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd8de897-1cb8-4406-9401-d2813d6c6e3f tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.712270 Jul 14 14:38:30.616985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 318/679] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 14:38:29 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 724 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:30.624597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:30.630969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:30.648140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.648824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.649959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.650525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.911523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:30.934124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4da79a5-5ab2-42a6-95f9-8a1d060dd788 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 1.176541 Jul 14 14:38:30.939798 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 362/680] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:29 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:30.960456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:30.964155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:30.981556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.982366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:30.984219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:30.985319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.226390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.251365 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5445dd72-f7ba-47e2-8700-50afd5173d61 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 0.632424 Jul 14 14:38:31.265344 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 319/681] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:30 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:31.292315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:31.293508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:31.307304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:31.308445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.312626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:31.313483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.398721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.411621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.414082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.416316 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ee944c1b-5a69-44cc-9b3e-06ad0c7af442 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.471567 Jul 14 14:38:31.417794 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 363/682] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:30 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:31.433355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c215e61-2873-4c0b-9186-92e7a82ed5ba tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Calling method '.version_select at 0x7fdbf326aa60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:31.436325 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:31.436325 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:31.441480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5c215e61-2873-4c0b-9186-92e7a82ed5ba tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'b85e650a3f01453689cd189bbd5f9467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e64dd29f7a471da6f7d60e9c00b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c215e61-2873-4c0b-9186-92e7a82ed5ba tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Request method failure captured: Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpkKMZmRhxIatzPYZ_3TJ0ufRlG-qsXDZPhXFZnQ24iDJEeHMpXqv0YCXv6tRHNxkGtSvdJcK3Z84zeNpHC4TAZKnBwjy8SqD1UmlCf87yLyrr3zr5jyhhehuIp_WBStLYFVcYsd8EeKb9yxqAmz0Evnq76AyeFHF4x3U1ynWY96zA Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:31.446663 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b85e650a3f01453689cd189bbd5f9467 Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: action_args: {} Jul 14 14:38:31.448565 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._index(req) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:31.449324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Jul 14 14:38:31.450417 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:31.459842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c215e61-2873-4c0b-9186-92e7a82ed5ba tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:31.461803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c215e61-2873-4c0b-9186-92e7a82ed5ba tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.042569 Jul 14 14:38:31.463106 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 364/683] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:31 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:31.475964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08d00194-3709-4237-8ef9-2d23c7df94b6 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Calling method '.version_select at 0x7fdbf35959d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:31.478841 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:31.478841 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:31.480700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-08d00194-3709-4237-8ef9-2d23c7df94b6 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'b85e650a3f01453689cd189bbd5f9467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e64dd29f7a471da6f7d60e9c00b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08d00194-3709-4237-8ef9-2d23c7df94b6 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Request method failure captured: Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpkKMZmRhxIatzPYZ_3TJ0ufRlG-qsXDZPhXFZnQ24iDJEeHMpXqv0YCXv6tRHNxkGtSvdJcK3Z84zeNpHC4TAZKnBwjy8SqD1UmlCf87yLyrr3zr5jyhhehuIp_WBStLYFVcYsd8EeKb9yxqAmz0Evnq76AyeFHF4x3U1ynWY96zA Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:31.483439 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b85e650a3f01453689cd189bbd5f9467 Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: action_args: {} Jul 14 14:38:31.484732 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:31.485514 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Jul 14 14:38:31.486590 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:31.492890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08d00194-3709-4237-8ef9-2d23c7df94b6 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:31.494790 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08d00194-3709-4237-8ef9-2d23c7df94b6 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.023691 Jul 14 14:38:31.505736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 365/684] 10.222.0.98 () {58 vars in 1178 bytes} [Thu Jul 14 14:38:31 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:38:31.670389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.701935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.705738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:31.730760 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7bea050-b3a2-4efe-8115-5845a10ffe1c tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.446645 Jul 14 14:38:31.755307 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 320/685] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:31 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:31.917087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Calling method '.version_select at 0x7fdbf3aeb940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:31.923218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:31.925295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.964034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:31.965261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:31.972815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:31.974137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:32.006122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.006972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.011755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.018279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.022441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.023470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.049923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6dacb3aa-45bc-48f0-b6ab-dbeebdfe799f tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.535888 Jul 14 14:38:32.063315 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 366/686] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:31 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:32.075379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61e6b8d2-72b6-4ded-a5ce-5820798ac676 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Calling method '.version_select at 0x7fdbf32739d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.089069 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:32.089069 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:32.094642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-61e6b8d2-72b6-4ded-a5ce-5820798ac676 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'b85e650a3f01453689cd189bbd5f9467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e64dd29f7a471da6f7d60e9c00b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61e6b8d2-72b6-4ded-a5ce-5820798ac676 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Request method failure captured: Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpkKMZmRhxIatzPYZ_3TJ0ufRlG-qsXDZPhXFZnQ24iDJEeHMpXqv0YCXv6tRHNxkGtSvdJcK3Z84zeNpHC4TAZKnBwjy8SqD1UmlCf87yLyrr3zr5jyhhehuIp_WBStLYFVcYsd8EeKb9yxqAmz0Evnq76AyeFHF4x3U1ynWY96zA Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:32.103985 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b85e650a3f01453689cd189bbd5f9467 Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '1'} Jul 14 14:38:32.106998 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:32.108899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Jul 14 14:38:32.111494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.125749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61e6b8d2-72b6-4ded-a5ce-5820798ac676 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:32.125749 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-61e6b8d2-72b6-4ded-a5ce-5820798ac676 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.060008 Jul 14 14:38:32.126616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 367/687] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:32.151896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a468086-39d4-4c97-8902-8f724ea00fe8 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Calling method '.version_select at 0x7fdbf3753280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.158442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-9a468086-39d4-4c97-8902-8f724ea00fe8 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] HTTP exception thrown: Hypervisor with ID 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad' could not be found. Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a468086-39d4-4c97-8902-8f724ea00fe8 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Request method failure captured: Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hypervisors/f3dd3a9f-fb9d-468b-999a-6cf402c25fad/uptime HTTP/1.1 Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CplBl0yhycxwPhya9fB6FPiirtdHaC4UJVwcWaMlRLyJrMKhQz9SeihYzV1rb6IddqJR1HxJO-45uPG64ygdIZZVbei9ZNVKMVOu_vKNaqqFQqgYLycN9t63WegOzwywslSmjEOu3pUAdTFQT8kuya2u1WYEnvRCEptInP0NuB67kc Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 78147ddf28bb4ccb9ebf752102fe5b50 Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-76949309 Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:38:32.184431 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-76949309 Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 78147ddf28bb4ccb9ebf752102fe5b50 Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-76949309 Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 23c92b4996ae4b5cab30c56786225383 Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: exception: Hypervisor with ID 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad' could not be found. Jul 14 14:38:32.186919 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad'} Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad' Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 14 14:38:32.191464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad' could not be found. Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:32.200004 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad' could not be found. Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.203750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a468086-39d4-4c97-8902-8f724ea00fe8 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Returning 404 to user: Hypervisor with ID 'f3dd3a9f-fb9d-468b-999a-6cf402c25fad' could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:32.209917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9a468086-39d4-4c97-8902-8f724ea00fe8 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/f3dd3a9f-fb9d-468b-999a-6cf402c25fad/uptime" status: 404 len: 123 microversion: 2.1 time: 0.059052 Jul 14 14:38:32.218202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 368/688] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/os-hypervisors/f3dd3a9f-fb9d-468b-999a-6cf402c25fad/uptime => generated 123 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:32.228343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Calling method '.version_select at 0x7fdbf32730d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.230886 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:32.230886 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:32.233953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.235083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.287419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.287999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.300053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.301014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.308812 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1883f960-9275-4b33-b6a6-a886b221a9dd tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.088361 Jul 14 14:38:32.310054 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 369/689] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:32.315186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.316546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:32.323799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.324796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.325979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.326622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.695157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.711501 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3f56be4-6dbe-460b-a85f-0025edb109cb tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.746012 Jul 14 14:38:32.731355 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 321/690] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:31 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:32.741656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f218ae4-c0e7-4091-a01b-7b037ad0a287 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Calling method '.version_select at 0x7fdbf33e1700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.743894 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:32.743894 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:38:32.746757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7f218ae4-c0e7-4091-a01b-7b037ad0a287 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'b85e650a3f01453689cd189bbd5f9467', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e64dd29f7a471da6f7d60e9c00b9f8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f218ae4-c0e7-4091-a01b-7b037ad0a287 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Request method failure captured: Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpkKMZmRhxIatzPYZ_3TJ0ufRlG-qsXDZPhXFZnQ24iDJEeHMpXqv0YCXv6tRHNxkGtSvdJcK3Z84zeNpHC4TAZKnBwjy8SqD1UmlCf87yLyrr3zr5jyhhehuIp_WBStLYFVcYsd8EeKb9yxqAmz0Evnq76AyeFHF4x3U1ynWY96zA Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:32.750698 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/00e64dd29f7a471da6f7d60e9c00b9f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 00e64dd29f7a471da6f7d60e9c00b9f8 Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860 Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b85e650a3f01453689cd189bbd5f9467 Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1179102860-project Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '1'} Jul 14 14:38:32.753331 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:32.754894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Jul 14 14:38:32.759976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:32.765340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:32.766283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f218ae4-c0e7-4091-a01b-7b037ad0a287 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:32.768019 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a609c29-cbb9-4261-8454-c28768d0c212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 0.456675 Jul 14 14:38:32.768820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7f218ae4-c0e7-4091-a01b-7b037ad0a287 tempest-HypervisorAdminNegativeTestJSON-1179102860 tempest-HypervisorAdminNegativeTestJSON-1179102860-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.034471 Jul 14 14:38:32.770710 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 322/691] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:32.779835 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 370/692] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:32.781253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.782723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:32.787346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:32.788513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:32.795076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.795855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.796784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.797562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.798240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.799515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:32.809519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:32.809981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.061124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.087401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.094348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.114923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f413dbcd-64f0-40e9-ae65-853c1d5c8779 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.331735 Jul 14 14:38:33.116362 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 371/693] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:33.125797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69752b5f-b76b-4f80-8903-e35db84dbe65 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Calling method '.version_select at 0x7fdbf3243700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:33.132095 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:33.132095 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:33.139473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-69752b5f-b76b-4f80-8903-e35db84dbe65 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] HTTP exception thrown: Hypervisor with ID '8ce63968-c16f-41db-b7f8-1fb9e8000093' could not be found. Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69752b5f-b76b-4f80-8903-e35db84dbe65 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Request method failure captured: Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hypervisors/8ce63968-c16f-41db-b7f8-1fb9e8000093 HTTP/1.1 Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CplBl0yhycxwPhya9fB6FPiirtdHaC4UJVwcWaMlRLyJrMKhQz9SeihYzV1rb6IddqJR1HxJO-45uPG64ygdIZZVbei9ZNVKMVOu_vKNaqqFQqgYLycN9t63WegOzwywslSmjEOu3pUAdTFQT8kuya2u1WYEnvRCEptInP0NuB67kc Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 78147ddf28bb4ccb9ebf752102fe5b50 Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-76949309 Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:38:33.151787 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/78147ddf28bb4ccb9ebf752102fe5b50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-76949309 Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 78147ddf28bb4ccb9ebf752102fe5b50 Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-76949309 Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 23c92b4996ae4b5cab30c56786225383 Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: exception: Hypervisor with ID '8ce63968-c16f-41db-b7f8-1fb9e8000093' could not be found. Jul 14 14:38:33.154992 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '8ce63968-c16f-41db-b7f8-1fb9e8000093'} Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi value = int(str(value)) Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '8ce63968-c16f-41db-b7f8-1fb9e8000093' Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Jul 14 14:38:33.156624 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._show(req, id) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:38:33.160717 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '8ce63968-c16f-41db-b7f8-1fb9e8000093' could not be found. Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '8ce63968-c16f-41db-b7f8-1fb9e8000093' could not be found. Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:33.165822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69752b5f-b76b-4f80-8903-e35db84dbe65 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] Returning 404 to user: Hypervisor with ID '8ce63968-c16f-41db-b7f8-1fb9e8000093' could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:33.170350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-69752b5f-b76b-4f80-8903-e35db84dbe65 tempest-HypervisorAdminNegativeTestJSON-76949309 tempest-HypervisorAdminNegativeTestJSON-76949309-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/8ce63968-c16f-41db-b7f8-1fb9e8000093" status: 404 len: 123 microversion: 2.1 time: 0.051891 Jul 14 14:38:33.195522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 372/694] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 14:38:33 2022] GET /compute/v2.1/os-hypervisors/8ce63968-c16f-41db-b7f8-1fb9e8000093 => generated 123 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:33.306073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.333063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.341462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:33.342732 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2626717-1040-460d-808f-07b01c3874b8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.570158 Jul 14 14:38:33.351181 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 323/695] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:32 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:33.669931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-73b9b25f-1797-475c-90a6-c1840cfa791f req-28734631-3065-424d-9903-be31fd7868ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18214402-1f83-4d57-bec8-4da01f6dd94b", "tag": "0aec2091-5fb0-4ec6-93e8-855eee85736e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:33.703488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-73b9b25f-1797-475c-90a6-c1840cfa791f req-28734631-3065-424d-9903-be31fd7868ac service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.709662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-73b9b25f-1797-475c-90a6-c1840cfa791f req-28734631-3065-424d-9903-be31fd7868ac service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.744052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:33.746230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:33.766773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.770226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.770658 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-73b9b25f-1797-475c-90a6-c1840cfa791f req-28734631-3065-424d-9903-be31fd7868ac service nova] Creating event network-changed:0aec2091-5fb0-4ec6-93e8-855eee85736e for instance 18214402-1f83-4d57-bec8-4da01f6dd94b on n-h2-768852-23 Jul 14 14:38:33.772247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.776082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.799152 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-73b9b25f-1797-475c-90a6-c1840cfa791f req-28734631-3065-424d-9903-be31fd7868ac service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127110 Jul 14 14:38:33.808234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 373/696] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:33.819637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:33.828232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:33.872106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.874832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:33.877897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:33.882759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.558507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:34.576001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-45cd1528-e743-485c-a62b-2bbd845a71a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.836214 Jul 14 14:38:34.578466 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 324/697] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:33 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:34.595857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:34.596578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:34.614956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.616105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.619369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.619938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.793161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:34.803960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:34.813904 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a42b201f-e971-48e2-bf98-c374b11481ff tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 1.003292 Jul 14 14:38:34.814755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 374/698] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:33 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:34.821261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:34.822605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:34.832048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.834647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:34.836479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:34.837138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.025424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.061200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.061200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.080171 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e7ed430-d48b-41f8-91e7-0b7dc483b8bd tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1447 microversion: 2.75 time: 0.499296 Jul 14 14:38:35.094320 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 325/699] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:34 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1447 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:35.112476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1cbe1ec7-4da7-4034-8f8b-76164dcc7c06 req-ce6bfedf-2e1f-42e1-b24b-e83d608c808e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9124379-a3fd-4713-95b4-58082d5fbfd5", "name": "network-vif-unplugged", "status": "completed", "tag": "bfb56fd2-1132-4057-9a78-9ff419df67a8"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:35.148438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1cbe1ec7-4da7-4034-8f8b-76164dcc7c06 req-ce6bfedf-2e1f-42e1-b24b-e83d608c808e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.149298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1cbe1ec7-4da7-4034-8f8b-76164dcc7c06 req-ce6bfedf-2e1f-42e1-b24b-e83d608c808e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.176521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1cbe1ec7-4da7-4034-8f8b-76164dcc7c06 req-ce6bfedf-2e1f-42e1-b24b-e83d608c808e service nova] Creating event network-vif-unplugged:bfb56fd2-1132-4057-9a78-9ff419df67a8 for instance e9124379-a3fd-4713-95b4-58082d5fbfd5 on n-h1-768852-23 Jul 14 14:38:35.194905 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1cbe1ec7-4da7-4034-8f8b-76164dcc7c06 req-ce6bfedf-2e1f-42e1-b24b-e83d608c808e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092697 Jul 14 14:38:35.198133 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 326/700] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:35.428070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:35.609893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:35.611371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:35.628558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.630031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.635347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.637557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.835560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.858704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.860442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:35.861743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-46efc988-b687-4052-b432-8e07c20b2984 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 1.045292 Jul 14 14:38:35.862223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 375/701] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:34 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:35.882353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:35.882992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:35.905746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.906216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.907030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:35.907517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:35.956915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:36.105926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.133426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b585e3f-e0f4-4a0a-baf6-55eb2b1544f5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.514629 Jul 14 14:38:36.139941 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 327/702] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:35 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:36.153225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.154192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:36.170974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.173879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.183533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.184963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.466993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.481372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.483484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.515450 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e607c1c-5a4f-414b-a0ec-3c5184323637 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1465 microversion: 2.75 time: 0.357855 Jul 14 14:38:36.516536 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 328/703] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1465 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:36.894973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:36.895764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:36.908055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.912152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.917034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:36.922381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:36.958210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:36.968561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fb0a7dae-4f9c-42a1-85c8-7d6a4a497b68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 1.105201 Jul 14 14:38:36.969163 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 376/704] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:35 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:37.156055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.157031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:37.169376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.174393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.178637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.179522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.237559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.276513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.288051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.297230 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8abd4467-4c75-469d-bb56-7efbf037c3dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.404304 Jul 14 14:38:37.298242 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 329/705] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:36 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:38:37.314974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:37.554887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.555639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:37.573381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.574377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.580831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.581300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:37.733327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.747043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.748661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.764254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:37.766349 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4dd72837-0a1b-418f-a21d-18ea999b18aa tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1453 microversion: 2.75 time: 0.216449 Jul 14 14:38:37.767605 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 330/706] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1453 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:37.779068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:37.813836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a72a3797-dacb-45bf-958f-1804f4932e25 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.665224 Jul 14 14:38:37.815827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 377/707] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:38:37.963575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-42ecaa49-de7d-40a1-bd9b-1f9e78464574 req-e1e054a8-f311-4f10-ab30-992cfa727f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8239eb66-b366-4119-b7d2-27f8faa6f57d", "name": "network-vif-plugged", "status": "completed", "tag": "240e91e9-b919-4b5a-8483-848ef3c0a01f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:37.986296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:37.987138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-42ecaa49-de7d-40a1-bd9b-1f9e78464574 req-e1e054a8-f311-4f10-ab30-992cfa727f66 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:37.987392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:37.989294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-42ecaa49-de7d-40a1-bd9b-1f9e78464574 req-e1e054a8-f311-4f10-ab30-992cfa727f66 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.002646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.003104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.004867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.008150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.021404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-42ecaa49-de7d-40a1-bd9b-1f9e78464574 req-e1e054a8-f311-4f10-ab30-992cfa727f66 service nova] Creating event network-vif-plugged:240e91e9-b919-4b5a-8483-848ef3c0a01f for instance 8239eb66-b366-4119-b7d2-27f8faa6f57d on n-h1-768852-23 Jul 14 14:38:38.034561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-42ecaa49-de7d-40a1-bd9b-1f9e78464574 req-e1e054a8-f311-4f10-ab30-992cfa727f66 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075665 Jul 14 14:38:38.038393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 331/708] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:38.333127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:38.337148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:38.404160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.405138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.417131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:38.435208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:38.482970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:38.497639 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05cfd0bb-007e-41ad-a3bd-34397da53dd4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 0.515188 Jul 14 14:38:38.510957 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 378/709] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:37 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:39.102771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.138504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.157889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.164004 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-291b6b47-92e8-4195-8d18-1e5f76f4d9e2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1569 microversion: 2.25 time: 0.838575 Jul 14 14:38:39.171037 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 332/710] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:38 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1569 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:39.215358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Calling method '.version_select at 0x7fdbf326a9d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.232020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.235521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.247738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.248566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.249762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.250554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.286823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:38:39.287526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Neutron security group 02cae2b2-b835-47b5-8c04-4131b6f28096 not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:38:39.288264 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] HTTP exception thrown: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.288264 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Request method failure captured: Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/02cae2b2-b835-47b5-8c04-4131b6f28096 HTTP/1.1 Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpuWTj5acBQuk3nlaI-jGbSmvk61MLFXoIgP6CJ5SkekVrXQf-rZtB27LsMxu8PjPTxRPffk-Zesy30yx6KwIfdNdWLajk5uWLQKX_7ab8FrbFfK20_auGJe-HwMnJGMv4OciQZ6qNj6QRrzA3nkXTs0alancgmud1zEHLZk4tqEUg Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:39.291009 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75c2a95595ca475ab6a5850654026798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75c2a95595ca475ab6a5850654026798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a1dd9b84cff64f8f825579378817247e Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] Jul 14 14:38:39.292417 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '02cae2b2-b835-47b5-8c04-4131b6f28096'} Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:39.293198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:38:39.297081 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.299227 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Returning 404 to user: Security group 02cae2b2-b835-47b5-8c04-4131b6f28096 does not exist Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-3e15794d-a672-4dfb-949f-f2c2b86b208d'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cdcff791-c0ab-4289-8d64-4f451de4d2c9 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/02cae2b2-b835-47b5-8c04-4131b6f28096" status: 404 len: 194 microversion: 2.1 time: 0.572062 Jul 14 14:38:39.302268 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 379/711] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:38 2022] DELETE /compute/v2.1/os-security-groups/02cae2b2-b835-47b5-8c04-4131b6f28096 => generated 194 bytes in 574 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:38:39.303656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.307300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.321712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.322174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.328604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.329071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.421212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.444172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.446412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.480650 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2dad1efd-46bf-4e3d-8e7d-5aa419897911 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1453 microversion: 2.75 time: 0.302324 Jul 14 14:38:39.499606 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 333/712] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1453 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:39.512140 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d89ebe9-3a47-477d-8a54-f82157f29a32 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.010947 Jul 14 14:38:39.512961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 334/713] 10.222.0.98 () {58 vars in 1163 bytes} [Thu Jul 14 14:38:39 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:38:39.525546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.526514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:39.534279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.535142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.536360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:39.537155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:39.558556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.571409 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00f01405-c513-456a-8ab6-7317f94329ba tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.271943 Jul 14 14:38:39.582659 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 380/714] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:39.595031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-edd5822f-5ea6-4822-86ae-1e639277da95 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Calling method '.version_select at 0x7fdbf35a3af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:39.897203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:39.910231 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94bdd371-764a-41ac-8b6e-eed5334a5549 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 0.389502 Jul 14 14:38:39.912166 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 335/715] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:40.182403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.183394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:40.192946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.199874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.205175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.205973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.274168 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-edd5822f-5ea6-4822-86ae-1e639277da95 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.685843 Jul 14 14:38:40.275188 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 381/716] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:38:39 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:40.314257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:40.422043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bc56c03-65df-489b-87a3-14075e8d3c2d tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Calling method '.version_select at 0x7fdbf3442dc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.584886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.624301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.631759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:40.637224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cba4f4ac-0158-44eb-bb8a-8e2a1d71f496 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1544 microversion: 2.25 time: 0.456997 Jul 14 14:38:40.655937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 336/717] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1544 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:40.665826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.666455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:40.704145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.705317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.710756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.714506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.772151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-3bc56c03-65df-489b-87a3-14075e8d3c2d tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:38:40.772908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3bc56c03-65df-489b-87a3-14075e8d3c2d tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] HTTP exception thrown: Insufficient rights for removing default security group. Jul 14 14:38:40.772908 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bc56c03-65df-489b-87a3-14075e8d3c2d tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Request method failure captured: Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/112f7779-9d2a-4bda-9723-af209e684a9f HTTP/1.1 Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CpuWTj5acBQuk3nlaI-jGbSmvk61MLFXoIgP6CJ5SkekVrXQf-rZtB27LsMxu8PjPTxRPffk-Zesy30yx6KwIfdNdWLajk5uWLQKX_7ab8FrbFfK20_auGJe-HwMnJGMv4OciQZ6qNj6QRrzA3nkXTs0alancgmud1zEHLZk4tqEUg Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:38:40.774773 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75c2a95595ca475ab6a5850654026798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75c2a95595ca475ab6a5850654026798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a1dd9b84cff64f8f825579378817247e Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: exception: Insufficient rights for removing default security group. Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] Jul 14 14:38:40.777736 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '112f7779-9d2a-4bda-9723-af209e684a9f'} Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:40.779413 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Jul 14 14:38:40.793346 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:40.796649 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bc56c03-65df-489b-87a3-14075e8d3c2d tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Returning 400 to user: Insufficient rights for removing default security group. Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-323f7a6e-9d6a-4767-a5dc-e2de7f0af5b6'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3bc56c03-65df-489b-87a3-14075e8d3c2d tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/112f7779-9d2a-4bda-9723-af209e684a9f" status: 400 len: 182 microversion: 2.1 time: 0.361763 Jul 14 14:38:40.799379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 382/718] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:38:40 2022] DELETE /compute/v2.1/os-security-groups/112f7779-9d2a-4bda-9723-af209e684a9f => generated 182 bytes in 370 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:38:40.803303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:40.809621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:40.842724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.844936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:40.850824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:40.859250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.082525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:41.103955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:41.109258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:41.129058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e3c199b-f448-4c2a-bbc2-eba3f4e02221 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1438 microversion: 2.75 time: 0.469411 Jul 14 14:38:41.132055 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 337/719] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1438 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:41.162150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af5bb788-c60e-4389-b65c-5dba6b6f7307 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '.version_select at 0x7fdbf336b4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.167987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af5bb788-c60e-4389-b65c-5dba6b6f7307 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.173515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af5bb788-c60e-4389-b65c-5dba6b6f7307 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.175109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:41.206668 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af5bb788-c60e-4389-b65c-5dba6b6f7307 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 1532 microversion: 2.25 time: 0.053467 Jul 14 14:38:41.209371 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 338/720] 10.222.0.98 () {60 vars in 1183 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/os-migrations => generated 1532 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:41.224311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Calling method '.version_select at 0x7fdbf33f83a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.225693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7d2b5ae-1508-4893-9ce7-ccd0d588f1db tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1317 microversion: 2.1 time: 0.437836 Jul 14 14:38:41.286583 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 383/721] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:40 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:41.307992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.314827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:41.335870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.337108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.338943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.340345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.698044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:41.709455 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54d3268d-fffb-428a-931f-0941b4d8d8d8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 0.421572 Jul 14 14:38:41.725760 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 384/722] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:41.880697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:38:41.885114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Neutron security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:38:41.886207 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] HTTP exception thrown: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.886207 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Request method failure captured: Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-security-groups/ab18a96d-9f1a-4b43-9077-4c8a9b2920ea HTTP/1.1 Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpuWTj5acBQuk3nlaI-jGbSmvk61MLFXoIgP6CJ5SkekVrXQf-rZtB27LsMxu8PjPTxRPffk-Zesy30yx6KwIfdNdWLajk5uWLQKX_7ab8FrbFfK20_auGJe-HwMnJGMv4OciQZ6qNj6QRrzA3nkXTs0alancgmud1zEHLZk4tqEUg Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:41.895619 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75c2a95595ca475ab6a5850654026798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75c2a95595ca475ab6a5850654026798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a1dd9b84cff64f8f825579378817247e Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] Jul 14 14:38:41.897292 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'ab18a96d-9f1a-4b43-9077-4c8a9b2920ea'} Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:41.898198 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:38:41.899666 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.901011 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] Jul 14 14:38:41.902434 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:41.916292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Returning 404 to user: Security group ab18a96d-9f1a-4b43-9077-4c8a9b2920ea does not exist Jul 14 14:38:41.916292 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-df7a3b5d-6636-40ce-aa61-ae6a8e29aaff'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:41.918535 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-542bac6d-e48e-4418-92c0-a10c45781156 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/ab18a96d-9f1a-4b43-9077-4c8a9b2920ea" status: 404 len: 194 microversion: 2.1 time: 0.707522 Jul 14 14:38:41.919605 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 339/723] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/os-security-groups/ab18a96d-9f1a-4b43-9077-4c8a9b2920ea => generated 194 bytes in 709 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:41.927964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:41.931604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:41.953466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.958486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:41.960089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:41.960766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.293370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:42.323712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edb7fef1-ff41-41a4-896f-02394e3a9087 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 2039 microversion: 2.25 time: 0.402626 Jul 14 14:38:42.324337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 340/724] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:41 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 2039 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:42.358016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:42.358016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:42.389966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.390584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.391780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.392220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.478641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4ae8691-bd75-4879-9c4e-8e390f4cc825 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Calling method '.version_select at 0x7fdbf3627670>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.566971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:42.568656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:42.569223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:42.573084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:42.575263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:42.619617 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4ae8691-bd75-4879-9c4e-8e390f4cc825 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 371 microversion: 2.1 time: 0.280772 Jul 14 14:38:42.627018 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 341/725] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 371 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:42.636246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-94506229-05d6-4972-b612-1aeb5b7395c4 req-2412082b-db69-4afb-9ec5-2af5b87b6696 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18214402-1f83-4d57-bec8-4da01f6dd94b", "name": "network-vif-plugged", "status": "completed", "tag": "0aec2091-5fb0-4ec6-93e8-855eee85736e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:42.646192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94506229-05d6-4972-b612-1aeb5b7395c4 req-2412082b-db69-4afb-9ec5-2af5b87b6696 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.646875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94506229-05d6-4972-b612-1aeb5b7395c4 req-2412082b-db69-4afb-9ec5-2af5b87b6696 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.662508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-94506229-05d6-4972-b612-1aeb5b7395c4 req-2412082b-db69-4afb-9ec5-2af5b87b6696 service nova] Creating event network-vif-plugged:0aec2091-5fb0-4ec6-93e8-855eee85736e for instance 18214402-1f83-4d57-bec8-4da01f6dd94b on n-h2-768852-23 Jul 14 14:38:42.679580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:42.680168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-94506229-05d6-4972-b612-1aeb5b7395c4 req-2412082b-db69-4afb-9ec5-2af5b87b6696 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046806 Jul 14 14:38:42.681754 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 342/726] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:42.687453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Action: 'update', calling method: .version_select at 0x7fdbf3312310>, body: {"security_group": {"name": "tempest-sg-296113419", "description": "tempest-description-1708020285"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:42.690794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.692121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.693974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.695151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.846460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:38:42.847334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Neutron security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:38:42.848326 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] HTTP exception thrown: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.848326 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Request method failure captured: Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/os-security-groups/0ce169d7-c2e5-4af1-9613-6942a0a12334 HTTP/1.1 Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 101 Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpuWTj5acBQuk3nlaI-jGbSmvk61MLFXoIgP6CJ5SkekVrXQf-rZtB27LsMxu8PjPTxRPffk-Zesy30yx6KwIfdNdWLajk5uWLQKX_7ab8FrbFfK20_auGJe-HwMnJGMv4OciQZ6qNj6QRrzA3nkXTs0alancgmud1zEHLZk4tqEUg Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:42.851913 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75c2a95595ca475ab6a5850654026798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75c2a95595ca475ab6a5850654026798"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75c2a95595ca475ab6a5850654026798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 75c2a95595ca475ab6a5850654026798 Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713 Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a1dd9b84cff64f8f825579378817247e Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1416170713-project Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: {"security_group": {"name": "tempest-sg-296113419", "description": "tempest-description-1708020285"}} Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:38:42.853529 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '0ce169d7-c2e5-4af1-9613-6942a0a12334', 'body': {'security_group': {'name': 'tempest-sg-296113419', 'description': 'tempest-description-1708020285'}}} Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:38:42.854549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:38:42.855852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] Jul 14 14:38:42.857240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] Jul 14 14:38:42.858689 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:42.860963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] Returning 404 to user: Security group 0ce169d7-c2e5-4af1-9613-6942a0a12334 does not exist Jul 14 14:38:42.860963 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-91697b57-06a8-429e-a9aa-fbcb2486cfd1'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:42.862469 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d16a6445-92bd-4de5-af4b-3d7082c4b599 tempest-SecurityGroupsNegativeTestJSON-1416170713 tempest-SecurityGroupsNegativeTestJSON-1416170713-project] 10.222.0.98 "PUT /compute/v2.1/os-security-groups/0ce169d7-c2e5-4af1-9613-6942a0a12334" status: 404 len: 194 microversion: 2.1 time: 0.179489 Jul 14 14:38:42.863563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 343/727] 10.222.0.98 () {60 vars in 1289 bytes} [Thu Jul 14 14:38:42 2022] PUT /compute/v2.1/os-security-groups/0ce169d7-c2e5-4af1-9613-6942a0a12334 => generated 194 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:42.873825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:42.876252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:42.908999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.910958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:42.913388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:42.914341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.010202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:43.053738 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b8c3c44-5ab3-4c18-9e7b-3fb8ceb6ba75 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b/action" status: 202 len: 1944 microversion: 2.75 time: 1.326393 Jul 14 14:38:43.055046 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 385/728] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:38:41 2022] POST /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b/action => generated 1944 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:38:43.072842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc27dba8-e8b8-4423-b3e2-b168ed1fac15 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Action: 'create', calling method: .version_select at 0x7fdbf3610160>, body: {"keypair": {"name": "tempest-keypair-1766830501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5dw7JhPlFASalh+604lzagUcE9Srneou4k/55Nu63PSqX/sdqOpwIS7HKB2n4pYHvj10n9Kitb1X5woVZFjhugMEKi3I+9kwSjEzZrAG+RfY4jO61nHf8fSUPC2c0Ciw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:43.102543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cc27dba8-e8b8-4423-b3e2-b168ed1fac15 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:43.112058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cc27dba8-e8b8-4423-b3e2-b168ed1fac15 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for user aeb3928894284b77b4aea925a38470ba and project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:43.170455 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc27dba8-e8b8-4423-b3e2-b168ed1fac15 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.106092 Jul 14 14:38:43.171588 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 386/729] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:38:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:38:43.217951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-298a7232-411c-4096-b7b9-6f04087fd6fc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3243700>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:43.406210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298a7232-411c-4096-b7b9-6f04087fd6fc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.408962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298a7232-411c-4096-b7b9-6f04087fd6fc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.412941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298a7232-411c-4096-b7b9-6f04087fd6fc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.414083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-298a7232-411c-4096-b7b9-6f04087fd6fc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.452313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:43.505444 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-298a7232-411c-4096-b7b9-6f04087fd6fc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 328 microversion: 2.1 time: 0.332141 Jul 14 14:38:43.506598 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 387/730] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:43 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:43.513044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.515082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:43.524139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.524981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.527179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.528292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.677704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:43.696062 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b72a4e7b-d644-4f28-85b7-24adddaab438 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1467 microversion: 2.1 time: 0.831137 Jul 14 14:38:43.698830 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 344/731] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:42 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1467 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:43.712466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.713355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:43.733062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.733596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.734427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.735025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.917619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:43.932824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e91e2f5b-98fc-42ed-811b-25d88c7efcc0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1311 microversion: 2.1 time: 0.423517 Jul 14 14:38:43.934060 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 388/732] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1311 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:43.956417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:43.957879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:43.966025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.966469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:43.967290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:43.967726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:44.069948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:44.110729 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52e6de14-af64-487d-a258-75af60d1a862 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.410317 Jul 14 14:38:44.125379 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 345/733] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:44.328687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-356426404", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:44.386478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:44.513371 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4247c817-b01f-4e38-b5c5-fbe75bfcdd75 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1620 microversion: 2.1 time: 0.563361 Jul 14 14:38:44.516185 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 389/734] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:43 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1620 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:44.683922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1432097098", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "859ce988-fadf-44f6-b941-5639f6ccd35f"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:44.773920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:45.074572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:45.075633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:45.077096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:45.078857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:45.079947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:45.095287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.096022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.099060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.100256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.126123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Getting quotas for project 6c8c4c31f9c94da6bb55cfbba495ca48. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:45.133901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Getting quotas for user 4b7661853e1a40c499c74bfdc76ec97a and project 6c8c4c31f9c94da6bb55cfbba495ca48. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:45.156875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.utils [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] cores quota exceeded for 6c8c4c31f9c94da6bb55cfbba495ca48, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125965) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 14 14:38:45.158939 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Request method failure captured: Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 144 Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpvBWKYC8dvDqtztrA3T9VxlCmT0JhtNwxWAy6aadR5JTNnq33CpyOTPNs1DcBP92sZO3_qRBlbH0PZqYPSD4wDgFXrxjNW4STUFDgCbcG6TPDw5R-cPQM3Ld6HE5-xpQr6p36c_gZOHeGGYH-dbf79uYrPAtdm1_60VqQIlaR63FE Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:45.166654 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4b7661853e1a40c499c74bfdc76ec97a Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-356426404", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} Jul 14 14:38:45.168583 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-356426404', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452'}}} Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 14:38:45.169549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:45.170781 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.173595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:45.175391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:45.175391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:45.175391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:45.175391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:45.175391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Jul 14 14:38:45.175391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:45.177894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:45.179088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a8d9bd4e-8236-470f-893b-3ddfccdc0597 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.052349 Jul 14 14:38:45.183585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 346/735] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:44 2022] POST /compute/v2.1/servers => generated 111 bytes in 1057 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:45.189250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:45.190418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:45.198602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.199044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.200237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.200826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.584303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:45.599821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:45.604293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:45.604587 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5718786-575d-4edd-a37d-1130ba421e11 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1495 microversion: 2.1 time: 0.412831 Jul 14 14:38:45.607393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 347/736] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:45 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1495 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:45.614977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:45.614977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:45.614977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:45.626915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:45.629462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:45.647034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.647846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.648964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.650814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.653911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.655288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.657692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.660046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.706597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:45.718380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Getting quotas for user cdac1d4106674c7ab0cfe39939de9d7b and project c9f14b1548c547608944442a8a351e56. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:45.766426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:45.783576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:45.895092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:45.932030 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f9fcfe65-eae0-4a75-b0a4-795cfc264119 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.315208 Jul 14 14:38:45.933799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2f87736c-3c86-46c6-abc4-0ad6da7d09f8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.254607 Jul 14 14:38:45.937385 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 348/737] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:45 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:45.943959 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 390/738] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:38:45.956049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f213f7c5-7382-4d43-a02d-83dd1da05418 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31ac310>, body: {"quota_set": {"cores": 20}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:45.956682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:45.957278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:45.975066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.976999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:45.980881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:45.981431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.108195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f213f7c5-7382-4d43-a02d-83dd1da05418 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.109380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f213f7c5-7382-4d43-a02d-83dd1da05418 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.110477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f213f7c5-7382-4d43-a02d-83dd1da05418 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.111906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f213f7c5-7382-4d43-a02d-83dd1da05418 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.238510 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f213f7c5-7382-4d43-a02d-83dd1da05418 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 329 microversion: 2.1 time: 0.286508 Jul 14 14:38:46.247625 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 349/739] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:45 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 329 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:46.266476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1a9c070-9bba-43a9-872e-ebc923d5a46f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.267534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1a9c070-9bba-43a9-872e-ebc923d5a46f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.393277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1a9c070-9bba-43a9-872e-ebc923d5a46f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:46.409955 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1a9c070-9bba-43a9-872e-ebc923d5a46f tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1217 microversion: 2.1 time: 0.157160 Jul 14 14:38:46.411675 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0420bb81-a4e2-4851-9867-5cd2404ad0a5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1648 microversion: 2.1 time: 0.466143 Jul 14 14:38:46.412398 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 350/740] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1217 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:46.413561 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 391/741] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:45 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1648 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:46.420484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c334509-294b-400c-a1da-82973a2e62b3 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Calling method '.version_select at 0x7fdbf31a9f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.438548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.454793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:46.486618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.487087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.487944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.488474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.578722 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4c334509-294b-400c-a1da-82973a2e62b3 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 371 microversion: 2.1 time: 0.163680 Jul 14 14:38:46.580222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 351/742] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:46.592644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8207f369-cb9b-422b-baec-d7876399b151 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31a9670>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:46.737499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8207f369-cb9b-422b-baec-d7876399b151 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.738112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8207f369-cb9b-422b-baec-d7876399b151 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.739874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8207f369-cb9b-422b-baec-d7876399b151 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.740478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8207f369-cb9b-422b-baec-d7876399b151 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.858668 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8207f369-cb9b-422b-baec-d7876399b151 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 328 microversion: 2.1 time: 0.269924 Jul 14 14:38:46.860524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 352/743] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:46 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 328 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:46.920889 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e50b186c-459f-4926-b350-39eda89fed96 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1648 microversion: 2.1 time: 0.485976 Jul 14 14:38:46.935986 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 392/744] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1648 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:46.943217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e82354f-36a3-4d22-b291-ad2245a41807 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.944949 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:38:46.944949 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:38:46.946530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e82354f-36a3-4d22-b291-ad2245a41807 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.947183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e82354f-36a3-4d22-b291-ad2245a41807 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.948230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e82354f-36a3-4d22-b291-ad2245a41807 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:46.948731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e82354f-36a3-4d22-b291-ad2245a41807 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:46.949834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-862708034", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:46.978812 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e82354f-36a3-4d22-b291-ad2245a41807 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.039789 Jul 14 14:38:46.989296 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 393/745] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:46.997802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:46.998524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.022406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.022879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.024320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.024320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.040739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:47.146385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:47.155472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:47.220461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d621b26-583e-4e8f-9f6c-0c993fb84553 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.228611 Jul 14 14:38:47.221909 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 394/746] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:46 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:47.228746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:47.229826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.249651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.250516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.251654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.252308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.356144 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-013b4eb8-8f45-453a-9a54-73cf3d6d9827 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b/action" status: 202 len: 0 microversion: 2.1 time: 0.130681 Jul 14 14:38:47.356885 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 395/747] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:47 2022] POST /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:47.370102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.371028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.390686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.392355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.396869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.398176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.721389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:47.722196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:47.722423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:47.722873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:47.723334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:47.738965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.748991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.750279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.751873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.802399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Getting quotas for project 6c8c4c31f9c94da6bb55cfbba495ca48. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:47.810447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Getting quotas for user 4b7661853e1a40c499c74bfdc76ec97a and project 6c8c4c31f9c94da6bb55cfbba495ca48. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:47.841065 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ee2db5b3-6d08-4127-98ef-a1ac1700d4b4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1653 microversion: 2.1 time: 0.476101 Jul 14 14:38:47.841910 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 396/748] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:47 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1653 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:47.847843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:47.848770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:47.849648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.utils [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] instances quota exceeded for 6c8c4c31f9c94da6bb55cfbba495ca48, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125965) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 14 14:38:47.856591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.857317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.857586 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:38:47.858615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:47.859297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Request method failure captured: Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 144 Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpvBWKYC8dvDqtztrA3T9VxlCmT0JhtNwxWAy6aadR5JTNnq33CpyOTPNs1DcBP92sZO3_qRBlbH0PZqYPSD4wDgFXrxjNW4STUFDgCbcG6TPDw5R-cPQM3Ld6HE5-xpQr6p36c_gZOHeGGYH-dbf79uYrPAtdm1_60VqQIlaR63FE Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:47.861617 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4b7661853e1a40c499c74bfdc76ec97a Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-862708034", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} Jul 14 14:38:47.863773 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-862708034', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452'}}} Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 14:38:47.864862 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:47.866129 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.867608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:47.869075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:47.870883 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-772b128d-3038-4392-827f-8f3a20f2f431 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.936841 Jul 14 14:38:47.883563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 353/749] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:46 2022] POST /compute/v2.1/servers => generated 119 bytes in 951 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:38:47.893975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86ede5fe-f1ba-4cae-843c-b184771b107c tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31a9430>, body: {"quota_set": {"instances": 10}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:48.049373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:48.069167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ede5fe-f1ba-4cae-843c-b184771b107c tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.071102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ede5fe-f1ba-4cae-843c-b184771b107c tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.072355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ede5fe-f1ba-4cae-843c-b184771b107c tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.079799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ede5fe-f1ba-4cae-843c-b184771b107c tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.259558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:48.284561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-589d4e08-b4f5-4550-8dd8-14725be65ba7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1277 microversion: 2.1 time: 0.441197 Jul 14 14:38:48.288171 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 397/750] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:47 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1277 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:48.299773 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86ede5fe-f1ba-4cae-843c-b184771b107c tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 329 microversion: 2.1 time: 0.409682 Jul 14 14:38:48.302729 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 354/751] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:47 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 329 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:48.303737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.321351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:48.331617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cae8ba8a-4c3a-43be-80ec-f753a7479606 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Calling method '.version_select at 0x7fdbf31a91f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:48.340597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.341313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.342313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.342958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.598217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cae8ba8a-4c3a-43be-80ec-f753a7479606 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 371 microversion: 2.1 time: 0.275917 Jul 14 14:38:48.600161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 355/752] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:38:48.615506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-64f05a4a-8256-4973-8076-14bbae4188bc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31a9e50>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:48.705347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:48.757148 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c191233-f7d1-4ad6-9e33-d258515f8970 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.467494 Jul 14 14:38:48.770951 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 398/753] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:48 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:48.783025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-4961249", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "7c3118c3-58de-439c-bb53-8c4407b089fe"}], "security_groups": [{"name": "tempest-securitygroup--193506750"}], "key_name": "tempest-keypair-1766830501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:48.872615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64f05a4a-8256-4973-8076-14bbae4188bc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.873997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64f05a4a-8256-4973-8076-14bbae4188bc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:48.875255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64f05a4a-8256-4973-8076-14bbae4188bc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:48.879718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64f05a4a-8256-4973-8076-14bbae4188bc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.010839 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-64f05a4a-8256-4973-8076-14bbae4188bc tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 325 microversion: 2.1 time: 0.404066 Jul 14 14:38:49.013056 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 356/754] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:48 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 325 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:49.021999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:49.024183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:49.041962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:49.043487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.045448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:49.046696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:49.377434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] validate_networks() for [('7c3118c3-58de-439c-bb53-8c4407b089fe', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:50.524590 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e68aac5a-e819-4eb3-b714-6cee727a53f5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1633 microversion: 2.1 time: 1.509580 Jul 14 14:38:50.537525 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 357/755] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:49 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1633 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:50.557473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-969223992", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:50.751904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:51.441773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:51.442517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:51.443223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:51.444794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:51.445436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:51.470264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.471745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.475544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.478354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.540755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:51.540755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:51.541701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:51.541701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:51.542352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:51.565510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.567415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Getting quotas for project 6c8c4c31f9c94da6bb55cfbba495ca48. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:51.569209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.570478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.570713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.579000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Getting quotas for user 4b7661853e1a40c499c74bfdc76ec97a and project 6c8c4c31f9c94da6bb55cfbba495ca48. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:51.614804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.utils [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] ram quota exceeded for 6c8c4c31f9c94da6bb55cfbba495ca48, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=125965) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Jul 14 14:38:51.615799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Request method failure captured: Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 144 Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpvBWKYC8dvDqtztrA3T9VxlCmT0JhtNwxWAy6aadR5JTNnq33CpyOTPNs1DcBP92sZO3_qRBlbH0PZqYPSD4wDgFXrxjNW4STUFDgCbcG6TPDw5R-cPQM3Ld6HE5-xpQr6p36c_gZOHeGGYH-dbf79uYrPAtdm1_60VqQIlaR63FE Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:51.618121 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4b7661853e1a40c499c74bfdc76ec97a Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-969223992", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} Jul 14 14:38:51.619778 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-969223992', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452'}}} Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 14:38:51.620629 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1676, in _create_instance Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1348, in _provision_instances Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:51.621915 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.623463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:51.624988 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:51.624988 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:51.624988 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:38:51.624988 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:38:51.624988 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Jul 14 14:38:51.624988 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:51.627680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:51.629291 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a03cca1c-1b57-4841-acb5-4ddaa12675c6 tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.080356 Jul 14 14:38:51.631689 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 358/756] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 1084 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:51.635863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:51.643884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for user aeb3928894284b77b4aea925a38470ba and project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:51.645633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:51.648601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:51.663591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.666575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.667728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.669632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.683185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:51.694548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:51.826104 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c6a17a70-dc8a-44f3-84fa-2d3bbac1f90f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.25 time: 3.052229 Jul 14 14:38:51.828162 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 399/757] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:38:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 3056 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:38:51.851113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:51.852292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:51.862106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.862806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:51.864154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:51.864788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.041981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:52.072716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-195b8037-a726-4235-80f8-d3a37cd65030 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.236409 Jul 14 14:38:52.074947 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 400/758] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:51 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:52.154159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-966836338", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "849b71fc-e412-4904-8684-f09bf3d0d560"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:52.217937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] validate_networks() for [('849b71fc-e412-4904-8684-f09bf3d0d560', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:52.229835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:52.244554 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d464c8d1-5d0f-47c0-8668-45f444d5264d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1317 microversion: 2.1 time: 0.611437 Jul 14 14:38:52.246665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 359/759] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:51 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1317 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:52.260142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-768852-23", "block_migration": true, "disk_over_commit": false}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:52.262718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:52.270959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.272896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.274046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:52.274628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:52.324944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lazy-loading 'flavor' on Instance uuid 18214402-1f83-4d57-bec8-4da01f6dd94b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:52.342749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Going to try to live migrate instance to n-h1-768852-23 {{(pid=125965) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:38:54.901308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:38:54.907545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:38:54.909114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:38:54.910635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:38:54.911821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:38:54.957028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.958094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:54.972010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:54.974969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.022975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Getting quotas for project 597ba1a6e8624db1841a02a6f544039d. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:38:55.041908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Getting quotas for user 2cd356b55fa24209a77907ca05fc0315 and project 597ba1a6e8624db1841a02a6f544039d. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:38:55.072773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:38:55.088277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:38:55.283173 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6e17e0c-1c78-4594-aec7-4af44a1405d7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.206790 Jul 14 14:38:55.294520 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 401/760] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 3208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:38:55.304824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db8ef16d-0aa3-48ca-b723-ba64e9a96697 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31d93a0>, body: {"quota_set": {"ram": 51200}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:55.969312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db8ef16d-0aa3-48ca-b723-ba64e9a96697 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:55.984975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db8ef16d-0aa3-48ca-b723-ba64e9a96697 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:55.989626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db8ef16d-0aa3-48ca-b723-ba64e9a96697 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:55.990386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db8ef16d-0aa3-48ca-b723-ba64e9a96697 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.280915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d05e537d-ebfd-41fa-926d-dc69dfa5e044 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b/action" status: 202 len: 0 microversion: 2.1 time: 4.011554 Jul 14 14:38:56.282125 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 360/761] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:38:52 2022] POST /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b/action => generated 0 bytes in 4035 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:38:56.327557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=11,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:56.331782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:56.334408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:56.386767 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db8ef16d-0aa3-48ca-b723-ba64e9a96697 tempest-QuotasAdminNegativeTest-1106950112 tempest-QuotasAdminNegativeTest-1106950112-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 200 len: 329 microversion: 2.1 time: 1.089578 Jul 14 14:38:56.389935 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 402/762] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:55 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 329 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:56.400537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:56.401711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:56.417073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.417883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.418560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.420262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.422204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.423352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.453149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.454305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.684103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:56.731161 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-655cbd66-79f4-4842-aa3f-f18e2d455ea5 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.336702 Jul 14 14:38:56.732167 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 403/763] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:56 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:56.738959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:56.739796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:56.757287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.757820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.758935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.759741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.886995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:56.899093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:38:56.919760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:56.922257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:56.924224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6faebcc6-7c92-4a18-9ba1-767f246ffd06 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1341 microversion: 2.25 time: 0.640120 Jul 14 14:38:56.931221 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 361/764] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:56 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1341 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:56.946647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:56.947550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:56.977567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.981240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:56.987516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:56.988587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.090779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:38:57.345043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:57.360044 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe58d38e-945f-4aa0-8f5c-799528d58f09 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1317 microversion: 2.1 time: 0.626691 Jul 14 14:38:57.361392 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 404/765] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:56 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1317 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:57.386637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-95c5281d-c002-4af1-a052-3ec0939ddb25 req-32120694-af73-45c4-9097-d66da2d19113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31672544-a4cf-4127-9f05-eaad6e51587f", "tag": "2ccc4eaf-f66d-452b-b349-368ba4bc20ea"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:57.418457 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad65c291-3f3b-4451-b303-5493ff91017e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 204 len: 0 microversion: 2.1 time: 0.482164 Jul 14 14:38:57.419641 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 362/766] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:38:56 2022] DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:38:57.424472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-95c5281d-c002-4af1-a052-3ec0939ddb25 req-32120694-af73-45c4-9097-d66da2d19113 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.427642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-95c5281d-c002-4af1-a052-3ec0939ddb25 req-32120694-af73-45c4-9097-d66da2d19113 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.451409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:57.453557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:57.500222 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-95c5281d-c002-4af1-a052-3ec0939ddb25 req-32120694-af73-45c4-9097-d66da2d19113 service nova] Creating event network-changed:2ccc4eaf-f66d-452b-b349-368ba4bc20ea for instance 31672544-a4cf-4127-9f05-eaad6e51587f on n-h2-768852-23 Jul 14 14:38:57.501560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.505856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.511961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.512750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.545427 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-95c5281d-c002-4af1-a052-3ec0939ddb25 req-32120694-af73-45c4-9097-d66da2d19113 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169888 Jul 14 14:38:57.546621 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 405/767] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:38:57.585505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:57.590880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:57.652842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.655629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.679088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:57.679939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:57.929099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:57.942339 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b20f903c-b846-4fed-b4aa-4fa69c844a80 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1227 microversion: 2.1 time: 0.518092 Jul 14 14:38:57.946614 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 363/768] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:57 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1227 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:57.957310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f0e61a70-204e-4d43-9363-fd080c5846ac tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Action: 'update', calling method: .version_select at 0x7fdbf33f80d0>, body: {"quota_set": {"ram": 0}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:57.961363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f0e61a70-204e-4d43-9363-fd080c5846ac tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '4b7661853e1a40c499c74bfdc76ec97a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8c4c31f9c94da6bb55cfbba495ca48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f0e61a70-204e-4d43-9363-fd080c5846ac tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Request method failure captured: Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 HTTP/1.1 Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 25 Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CpvBWKYC8dvDqtztrA3T9VxlCmT0JhtNwxWAy6aadR5JTNnq33CpyOTPNs1DcBP92sZO3_qRBlbH0PZqYPSD4wDgFXrxjNW4STUFDgCbcG6TPDw5R-cPQM3Ld6HE5-xpQr6p36c_gZOHeGGYH-dbf79uYrPAtdm1_60VqQIlaR63FE Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:38:57.967959 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6c8c4c31f9c94da6bb55cfbba495ca48"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 6c8c4c31f9c94da6bb55cfbba495ca48 Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-77399545 Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4b7661853e1a40c499c74bfdc76ec97a Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-QuotasAdminNegativeTest-77399545-project Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: {"quota_set": {"ram": 0}} Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 14 14:38:57.969752 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6c8c4c31f9c94da6bb55cfbba495ca48', 'body': {'quota_set': {'ram': 0}}} Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:38:57.970826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:57.972340 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:38:57.974391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:38:57.974391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:38:57.974391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:38:57.974391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:38:57.974391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Jul 14 14:38:57.974391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:38:57.993072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f0e61a70-204e-4d43-9363-fd080c5846ac tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:38:57.998280 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f0e61a70-204e-4d43-9363-fd080c5846ac tempest-QuotasAdminNegativeTest-77399545 tempest-QuotasAdminNegativeTest-77399545-project] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48" status: 403 len: 116 microversion: 2.1 time: 0.046879 Jul 14 14:38:58.005252 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 364/769] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:38:57 2022] PUT /compute/v2.1/os-quota-sets/6c8c4c31f9c94da6bb55cfbba495ca48 => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:38:58.042609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-509963092", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "737895153", "adminPass": "***", "networks": [{"uuid": "02d32ddc-95fa-401c-bc9d-d973a1871005"}], "security_groups": [{"name": "tempest-securitygroup--1695330696"}], "key_name": "tempest-keypair-135405226", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:38:58.512018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] validate_networks() for [('02d32ddc-95fa-401c-bc9d-d973a1871005', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:38:58.583128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:58.591917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc3636a1-b8d2-4895-964c-ea7c9379d330 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 1.043453 Jul 14 14:38:58.592546 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 406/770] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:57 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:38:58.627562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:58.628842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:58.656631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:58.657228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:58.661296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:58.662106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:58.948160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:38:59.003768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-353051a1-d5ea-41c7-8d54-dc90884e0ed6 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.393036 Jul 14 14:38:59.004763 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 407/771] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:58 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:59.027647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:59.027647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:59.039225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.040182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.041694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.042644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.659024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:59.691783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:59.698958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:38:59.702076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43cd73a6-d4e3-48e6-b540-dcc4e1b2278a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.693032 Jul 14 14:38:59.702990 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 408/772] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:38:59 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:38:59.726243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:38:59.727477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:38:59.738730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.739462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:38:59.740731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:38:59.741584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.395927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:00.397448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:00.399675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:00.400920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:00.401937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:00.433189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.433928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.434993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.435929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.496823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Getting quotas for project ab3c7bb172ef49c6a5154aee18c8a1bd. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:00.509487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Getting quotas for user 160fe1ec6b2d45e48990558af381a0ef and project ab3c7bb172ef49c6a5154aee18c8a1bd. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:00.552630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:00.558000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:00.732927 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bef50855-cd32-45e3-8662-af53dbc9aab9 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.715279 Jul 14 14:39:00.744924 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 365/773] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:38:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 2730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:00.763830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:00.780501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:00.785793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:00.797940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.798457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.799634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.800481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.830132 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44f8d5d3-836c-4cae-b948-63b68c1bf4ee tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1317 microversion: 2.1 time: 1.125142 Jul 14 14:39:00.848072 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 409/774] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:38:59 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1317 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:00.871374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:00.872837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:00.887024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.887844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:00.889594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:00.890947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.330835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:01.347623 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2decef92-3d31-4ac6-abb6-25d5f85b5825 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 0.491953 Jul 14 14:39:01.348827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 410/775] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:00 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:01.353900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:01.357355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:01.375964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.382205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.383828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.384667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.469566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:01.626482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:01.637261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:01.662377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9486f940-c8ce-443e-bd3d-c06194330b2e tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.312085 Jul 14 14:39:01.663382 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 411/776] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:01 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:01.677725 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-004501dc-4a87-4489-803a-59da16cc3adf tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1289 microversion: 2.1 time: 0.925665 Jul 14 14:39:01.682019 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 366/777] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:00 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1289 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:01.687053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:01.688876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:01.702805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.703675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.704847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.705557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.711231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:01.717387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:01.744036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.751011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:01.756946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:01.762971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.003621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.022302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.025524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.035654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0497192e-e821-4e1d-86ad-94860655c809 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.362797 Jul 14 14:39:02.037436 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 412/778] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:01 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:02.062321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ca650aa6-f9b5-4299-8a8a-3bd19d9973c5 req-7cd34e83-d2cc-4bb3-a2bb-5da217e6edc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18214402-1f83-4d57-bec8-4da01f6dd94b", "name": "network-vif-unplugged", "status": "completed", "tag": "0aec2091-5fb0-4ec6-93e8-855eee85736e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:02.079757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ca650aa6-f9b5-4299-8a8a-3bd19d9973c5 req-7cd34e83-d2cc-4bb3-a2bb-5da217e6edc7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.080565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ca650aa6-f9b5-4299-8a8a-3bd19d9973c5 req-7cd34e83-d2cc-4bb3-a2bb-5da217e6edc7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.115178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ca650aa6-f9b5-4299-8a8a-3bd19d9973c5 req-7cd34e83-d2cc-4bb3-a2bb-5da217e6edc7 service nova] Creating event network-vif-unplugged:0aec2091-5fb0-4ec6-93e8-855eee85736e for instance 18214402-1f83-4d57-bec8-4da01f6dd94b on n-h2-768852-23 Jul 14 14:39:02.130502 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ca650aa6-f9b5-4299-8a8a-3bd19d9973c5 req-7cd34e83-d2cc-4bb3-a2bb-5da217e6edc7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089937 Jul 14 14:39:02.138265 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 413/779] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:02.140096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.150104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aaaa3d7d-6222-41db-a0d4-7689197eff6f tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1265 microversion: 2.1 time: 0.463686 Jul 14 14:39:02.150700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 367/780] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:01 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1265 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:02.151932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:02.153431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:02.168086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.169966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.171881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.173090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.374457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:02.375625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:02.383180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.384034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.386257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.387246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.487689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:02.498616 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1be008f9-aef7-4ec2-9a48-e2c9c29a8fd0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1317 microversion: 2.1 time: 0.356071 Jul 14 14:39:02.499237 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 414/781] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:02 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:02.685255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:02.686271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:02.702286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.703565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.705471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.706303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.852727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:02.888598 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e59d9af3-e274-4d66-96ca-490d1ffb3381 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.208565 Jul 14 14:39:02.889511 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 415/782] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:02 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:39:02.902867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:02.907446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:02.928653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.929111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:02.929925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:02.930366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.189348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:03.202143 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50bb354b-99c4-4fda-91d2-900c2db18b45 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 0.832614 Jul 14 14:39:03.208282 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 368/783] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:02 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:03.227149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.236522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.254594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.255385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.256423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.262681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.619106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:03.651987 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a50e7407-302f-4dbf-9fd3-fef92ab41740 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.760234 Jul 14 14:39:03.667581 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 416/784] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:02 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:03.682337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:03.683894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:03.701595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.702953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.705014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.706230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.849275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:03.868262 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0967285e-13c3-4e84-81ed-36a6087297ba tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1319 microversion: 2.1 time: 0.198001 Jul 14 14:39:03.879919 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 417/785] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:03.886971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0c1b8450-6f78-443b-b83a-a23942f6e2cc req-a0b5c3f9-96cc-4869-83da-398a7ab57677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:03.913221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0c1b8450-6f78-443b-b83a-a23942f6e2cc req-a0b5c3f9-96cc-4869-83da-398a7ab57677 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:03.919353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0c1b8450-6f78-443b-b83a-a23942f6e2cc req-a0b5c3f9-96cc-4869-83da-398a7ab57677 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:03.953555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0c1b8450-6f78-443b-b83a-a23942f6e2cc req-a0b5c3f9-96cc-4869-83da-398a7ab57677 service nova] Creating event network-changed:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h1-768852-23 Jul 14 14:39:03.985287 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0c1b8450-6f78-443b-b83a-a23942f6e2cc req-a0b5c3f9-96cc-4869-83da-398a7ab57677 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101057 Jul 14 14:39:03.992333 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 418/786] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:04.012122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.013136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.030833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.032912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.036941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.038167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.263098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.284022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.288994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.291832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-543e8fba-565f-460d-92c3-c08765ae48ba tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 1.081516 Jul 14 14:39:04.308811 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 369/787] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:04.323172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.324579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.352593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.353266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.354467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.355188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.625361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:04.655175 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-975c5b97-9e66-4988-ac6d-38d67b1cc8af tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.339758 Jul 14 14:39:04.658776 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 370/788] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:04 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:04.667385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3186b20d-75e5-44c4-873b-f9c34db10509 req-6a5a4133-62d6-40d4-8d90-dc10a3ac8de2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18214402-1f83-4d57-bec8-4da01f6dd94b", "tag": "0aec2091-5fb0-4ec6-93e8-855eee85736e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:04.672551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:04.685018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3186b20d-75e5-44c4-873b-f9c34db10509 req-6a5a4133-62d6-40d4-8d90-dc10a3ac8de2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.685293 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95c2dde0-fb29-471a-9c6f-ff1a46b34e59 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1317 microversion: 2.1 time: 0.688292 Jul 14 14:39:04.686457 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 419/789] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:03 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1317 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:04.688056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3186b20d-75e5-44c4-873b-f9c34db10509 req-6a5a4133-62d6-40d4-8d90-dc10a3ac8de2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.696898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.699014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.706814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.707613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.709165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.710623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.720350 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3186b20d-75e5-44c4-873b-f9c34db10509 req-6a5a4133-62d6-40d4-8d90-dc10a3ac8de2 service nova] Creating event network-changed:0aec2091-5fb0-4ec6-93e8-855eee85736e for instance 18214402-1f83-4d57-bec8-4da01f6dd94b on n-h2-768852-23 Jul 14 14:39:04.736052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3186b20d-75e5-44c4-873b-f9c34db10509 req-6a5a4133-62d6-40d4-8d90-dc10a3ac8de2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074543 Jul 14 14:39:04.748905 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 371/790] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:04.758767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-728a1891-afca-4979-bd10-97dbe4fbeae6 req-f5092c8d-794e-4d8a-907c-7318945a2391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31672544-a4cf-4127-9f05-eaad6e51587f", "name": "network-vif-plugged", "status": "completed", "tag": "2ccc4eaf-f66d-452b-b349-368ba4bc20ea"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:04.774620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-728a1891-afca-4979-bd10-97dbe4fbeae6 req-f5092c8d-794e-4d8a-907c-7318945a2391 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.774978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-728a1891-afca-4979-bd10-97dbe4fbeae6 req-f5092c8d-794e-4d8a-907c-7318945a2391 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.791098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-728a1891-afca-4979-bd10-97dbe4fbeae6 req-f5092c8d-794e-4d8a-907c-7318945a2391 service nova] Creating event network-vif-plugged:2ccc4eaf-f66d-452b-b349-368ba4bc20ea for instance 31672544-a4cf-4127-9f05-eaad6e51587f on n-h2-768852-23 Jul 14 14:39:04.797657 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-728a1891-afca-4979-bd10-97dbe4fbeae6 req-f5092c8d-794e-4d8a-907c-7318945a2391 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046902 Jul 14 14:39:04.798584 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 372/791] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:04.806252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:04.807410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:04.815470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:04.819223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.820146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:04.821187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:04.822068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.614211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:05.632286 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-936ac49c-ad92-4d17-b168-0dd0ec8b1193 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.832009 Jul 14 14:39:05.633040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 373/792] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:04 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:05.660731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:05.664560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:05.694500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.695723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:05.697584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:05.699250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.064367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:06.192064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.201817 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-61eb6271-f739-43cd-98ca-65ee02addeb4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 1.513477 Jul 14 14:39:06.216502 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 420/793] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:04 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:06.232017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.232958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:06.249189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.250016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.250836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.251495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.372331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=38 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:06.537916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.558568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-64e26431-32ef-471c-92a3-510047fd8577 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 0.918096 Jul 14 14:39:06.560069 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 374/794] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:05 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:06.585293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.588978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:06.623140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.627428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.630346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.632990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.740344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.757143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.762585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:06.772868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bbe79e75-0858-44f2-ab02-e05df61bc2c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.544769 Jul 14 14:39:06.777767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 421/795] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:06 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:06.791491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:06.792622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:06.816921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.817721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.819729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:06.820805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:06.922728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:06.983884 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-668e12d6-7195-408d-b1ec-13b513d6807d tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.421095 Jul 14 14:39:06.987667 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 375/796] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:06 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:07.012244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-34ce287a-0612-4bbe-9b3b-9fe48cad3d70 req-e92cf16b-5377-4134-9438-f666f4499ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721a7dad-ae26-4f27-91f7-e71bd1adfad3", "name": "network-vif-deleted", "tag": "be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:07.037854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-34ce287a-0612-4bbe-9b3b-9fe48cad3d70 req-e92cf16b-5377-4134-9438-f666f4499ba0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.038359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-34ce287a-0612-4bbe-9b3b-9fe48cad3d70 req-e92cf16b-5377-4134-9438-f666f4499ba0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.077459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-34ce287a-0612-4bbe-9b3b-9fe48cad3d70 req-e92cf16b-5377-4134-9438-f666f4499ba0 service nova] Creating event network-vif-deleted:be9207d9-f74b-47ef-bfe3-6c9ba6efa3a5 for instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 on n-h2-768852-23 Jul 14 14:39:07.088068 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-34ce287a-0612-4bbe-9b3b-9fe48cad3d70 req-e92cf16b-5377-4134-9438-f666f4499ba0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097261 Jul 14 14:39:07.092370 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 376/797] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:07.105133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:07.116103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:07.129262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.129719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:07.130528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:07.130966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.415725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:08.448168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c87ad613-2add-4e2b-9a6b-d547351966d5 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 1.353132 Jul 14 14:39:08.449128 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 377/798] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:07 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:08.485659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.486851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:08.515027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.516515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.521712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.522845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.860332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:08.895811 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3292de3-2fd5-4d36-89c2-bfe7e30158a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1317 microversion: 2.1 time: 2.101987 Jul 14 14:39:08.903429 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 422/799] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:06 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1317 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:08.928129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:08.930917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:08.952898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.954097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.955815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:08.956889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:08.980879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:09.017833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50c33eb6-4f2c-411e-b432-45c569913815 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 0.553891 Jul 14 14:39:09.034543 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 378/800] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:08 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:09.048515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:09.053361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:09.101453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.102214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.103238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.111291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.465386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:09.473360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:09.477852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:09.479984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:09.481721 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d815465f-534a-4a0c-8e3a-9f50705f4ace tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.437095 Jul 14 14:39:09.495422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 379/801] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:09 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:09.502147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:09.504068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:09.518770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.520246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.521369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.522207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.656164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:09.696726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-937b5449-fca7-4480-a8ce-cc239f27a029 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.199429 Jul 14 14:39:09.698722 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 380/802] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:09 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:09.710070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-94e38e85-1cc8-4a86-bfcb-904f3d0c7c11 req-8804b965-6f66-438c-b3db-72e2679f0d23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12", "tag": "5f8c4ef4-941b-455f-aa93-b927a9680207"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:09.725751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94e38e85-1cc8-4a86-bfcb-904f3d0c7c11 req-8804b965-6f66-438c-b3db-72e2679f0d23 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.726942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94e38e85-1cc8-4a86-bfcb-904f3d0c7c11 req-8804b965-6f66-438c-b3db-72e2679f0d23 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.748987 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-94e38e85-1cc8-4a86-bfcb-904f3d0c7c11 req-8804b965-6f66-438c-b3db-72e2679f0d23 service nova] Creating event network-changed:5f8c4ef4-941b-455f-aa93-b927a9680207 for instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 on n-h1-768852-23 Jul 14 14:39:09.759839 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-94e38e85-1cc8-4a86-bfcb-904f3d0c7c11 req-8804b965-6f66-438c-b3db-72e2679f0d23 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058112 Jul 14 14:39:09.762857 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 381/803] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:09.776098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-82ae2442-71c9-4d9c-8c42-dd5c65dcfc7e req-8c152af9-d3fc-49d9-a802-22857573a7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18214402-1f83-4d57-bec8-4da01f6dd94b", "name": "network-vif-unplugged", "status": "completed", "tag": "0aec2091-5fb0-4ec6-93e8-855eee85736e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:09.794013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-82ae2442-71c9-4d9c-8c42-dd5c65dcfc7e req-8c152af9-d3fc-49d9-a802-22857573a7e7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.795675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-82ae2442-71c9-4d9c-8c42-dd5c65dcfc7e req-8c152af9-d3fc-49d9-a802-22857573a7e7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.821124 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-82ae2442-71c9-4d9c-8c42-dd5c65dcfc7e req-8c152af9-d3fc-49d9-a802-22857573a7e7 service nova] Creating event network-vif-unplugged:0aec2091-5fb0-4ec6-93e8-855eee85736e for instance 18214402-1f83-4d57-bec8-4da01f6dd94b on n-h2-768852-23 Jul 14 14:39:09.841701 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-82ae2442-71c9-4d9c-8c42-dd5c65dcfc7e req-8c152af9-d3fc-49d9-a802-22857573a7e7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072248 Jul 14 14:39:09.844047 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 382/804] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:09.855543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:09.856956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:09.870808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.873865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:09.875239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:09.876113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:10.151975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:10.166768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3559191b-0f0b-48d9-897a-4365418e3290 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 1.261381 Jul 14 14:39:10.172797 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 423/805] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:08 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:10.181286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:10.200000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-118c8be4-af54-4bb4-8407-6859ebac0305 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.353849 Jul 14 14:39:10.201040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 383/806] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:09 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:10.211745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:10.212712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:10.220194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:10.221044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:10.222166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:10.223426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:10.405238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-1179313087", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:10.466616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:10.470548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=16 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:10.483134 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d18f473-ec78-491c-be88-106298aec937 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1467 microversion: 2.1 time: 0.280376 Jul 14 14:39:10.484189 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 384/807] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:10 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1467 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:10.494395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:10.495821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:10.506229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:10.508013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:10.509055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:10.510654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:10.511911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:10.541407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=64 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:10.777126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:10.787248 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1bab0dcf-9cf5-4065-aa7d-c5fe2e0c7007 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 0.300268 Jul 14 14:39:10.788161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 385/808] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:10 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:10.796307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:10.797734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:10.806585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:10.807122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:10.808030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:10.808418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.301104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:11.317969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:11.319527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:11.320725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:11.323649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:11.325019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:11.346486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:11.356817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:11.358865 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-638c9cf7-952e-48a1-88c1-6a959d168fc9 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.567803 Jul 14 14:39:11.369565 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 386/809] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:10 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:11.370925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.371901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.378008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.379261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.403586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:11.410280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:11.420996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.421458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.422282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.422719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.435695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Getting quotas for project f1dc5d177b084cfab1e0d4d9d1715fa3. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:11.466309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Getting quotas for user 679429de8da0408b93541374e89ce606 and project f1dc5d177b084cfab1e0d4d9d1715fa3. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:11.486328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:11.489931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:11.556559 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2f646009-51c4-49be-9607-79268d8c35ce tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.382212 Jul 14 14:39:11.558384 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 424/810] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:39:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:11.570636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:11.573092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:11.584453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.584901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.586034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.586786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.800918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:11.830983 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11c5a01f-ab0a-452d-b72e-c7042eae6f59 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.271275 Jul 14 14:39:11.833455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28844382-e163-49f6-821d-12a90e2bdd98 tempest-ServersOnMultiNodesTest-96177250 tempest-ServersOnMultiNodesTest-96177250-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1620 microversion: 2.1 time: 0.459851 Jul 14 14:39:11.836126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 425/812] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:11 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:11.836263 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 387/812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:11 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1620 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:11.841240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:11.842313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:11.850398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.851510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.852450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:11.852685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.853087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:11.853439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.874551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.874551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:11.876443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:11.876710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.554041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:12.586551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-079e3d38-a74f-4cf0-8c6e-335115081324 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.748396 Jul 14 14:39:12.591857 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 388/813] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:11 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:12.653990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:12.660253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:12.676764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:12.678217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.679978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:12.680954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.880813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:12.895814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9e1c10ec-a0df-4295-b6ca-7eeff0f0dcc5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1219 microversion: 2.1 time: 0.270075 Jul 14 14:39:12.896765 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 389/814] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:12 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1219 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:12.910394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:12.911038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:12.926612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:12.927064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.927910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:12.928349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:12.981475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:12.993170 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55abeaa2-e0a8-4ac8-a1a1-5495f5e27992 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 1.155869 Jul 14 14:39:12.994515 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 426/815] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:11 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:13.011449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:13.012278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:13.024225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.025117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.026892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.027590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.093169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:13.193360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:13.236950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-28a20263-45f2-411e-aec5-4233ab90df62 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 204 len: 0 microversion: 2.1 time: 0.239474 Jul 14 14:39:13.236950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 427/816] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:12 2022] DELETE /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:13.256276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:13.257964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:13.285130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.289150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.292088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.293009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.415153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.424032 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-963e8a31-f633-41a7-8b79-8d5559d427db tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1505 microversion: 2.1 time: 0.525739 Jul 14 14:39:13.424832 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 390/817] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:12 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:13.431242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-aa03e51f-e596-40ff-a353-bd0bb23afa09 req-65e658aa-7a55-4e50-9c33-f66f73820e80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3911a3e7-b736-4f7b-beac-e479f8461261", "tag": "e30d7cb5-3480-4ef2-94d6-1746f82d4903"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:13.440691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aa03e51f-e596-40ff-a353-bd0bb23afa09 req-65e658aa-7a55-4e50-9c33-f66f73820e80 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.441685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aa03e51f-e596-40ff-a353-bd0bb23afa09 req-65e658aa-7a55-4e50-9c33-f66f73820e80 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.465503 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-aa03e51f-e596-40ff-a353-bd0bb23afa09 req-65e658aa-7a55-4e50-9c33-f66f73820e80 service nova] Creating event network-changed:e30d7cb5-3480-4ef2-94d6-1746f82d4903 for instance 3911a3e7-b736-4f7b-beac-e479f8461261 on n-h2-768852-23 Jul 14 14:39:13.473756 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-aa03e51f-e596-40ff-a353-bd0bb23afa09 req-65e658aa-7a55-4e50-9c33-f66f73820e80 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045354 Jul 14 14:39:13.474394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 391/818] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:13.485056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:13.489391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:13.506502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.509188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.510045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.510506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.693011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:13.703519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.727075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.732076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:13.733586 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8ad4f85-1f4d-4218-876c-56c93fd6e9e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.493320 Jul 14 14:39:13.739023 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 428/819] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:13 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:13.749989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-198e2156-cf6b-408c-a314-997815c07b6e req-e0737cf2-0c35-4f34-a547-f17463c3775e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "name": "network-vif-plugged", "status": "completed", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:13.766884 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14955778-8b10-44a5-9e8b-ef45e7e9e181 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.281874 Jul 14 14:39:13.771419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-198e2156-cf6b-408c-a314-997815c07b6e req-e0737cf2-0c35-4f34-a547-f17463c3775e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.772097 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 392/820] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:13 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:13.776200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-198e2156-cf6b-408c-a314-997815c07b6e req-e0737cf2-0c35-4f34-a547-f17463c3775e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.794865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:13.796978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:13.806032 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-198e2156-cf6b-408c-a314-997815c07b6e req-e0737cf2-0c35-4f34-a547-f17463c3775e service nova] Creating event network-vif-plugged:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h1-768852-23 Jul 14 14:39:13.822500 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-198e2156-cf6b-408c-a314-997815c07b6e req-e0737cf2-0c35-4f34-a547-f17463c3775e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079802 Jul 14 14:39:13.824602 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 429/821] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:13.826662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.828125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.830002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.836618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.842231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:13.843054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:13.875704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.876194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:13.877106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:13.877885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.216496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.230750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.232909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a84412a1-1391-4ee0-b0f5-2f4303edc9c7 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1473 microversion: 2.1 time: 0.458572 Jul 14 14:39:14.245405 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d276e177-40c1-48a6-b2b5-e489f3029246 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.419048 Jul 14 14:39:14.248126 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 393/822] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:13 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1473 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:14.251253 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 430/823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:13 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:14.262204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.263675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:14.266118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.271929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:14.277070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.278238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.279675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.280706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.284437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.285988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.287586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.288461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.396642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.416120 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23d35658-8ae9-45f0-8280-5d2d0065f6f5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1275 microversion: 2.1 time: 0.166270 Jul 14 14:39:14.416747 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 394/824] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1275 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:14.455157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.457218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:14.471845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.473336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.474907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.475846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.608350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.628289 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d625b41-677b-4764-894a-b0046710ace2 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 0.374737 Jul 14 14:39:14.630149 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 431/825] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:14.710400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:14.725773 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc17a63b-dc98-4c68-9f78-73c508f58628 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1480 microversion: 2.1 time: 0.278413 Jul 14 14:39:14.727311 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 395/826] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1480 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:14.744999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-954ce669-a7ab-4eb4-abcb-34d9d6132b77 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '.version_select at 0x7fdbf327bb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.748975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954ce669-a7ab-4eb4-abcb-34d9d6132b77 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.750712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954ce669-a7ab-4eb4-abcb-34d9d6132b77 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.770403 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-954ce669-a7ab-4eb4-abcb-34d9d6132b77 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 1566 microversion: 2.1 time: 0.030059 Jul 14 14:39:14.772416 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 432/827] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/os-migrations => generated 1566 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:14.781906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.785772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:14.788755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:14.790350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:14.803720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.804587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.804850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.805733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.807628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.809109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:14.809559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:14.810486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.081277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:15.112511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:15.119577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:15.123691 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-560df19c-347a-4d5a-bd8b-29a91be9ab6a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.351809 Jul 14 14:39:15.148523 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 396/828] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:15.166095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:15.168321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:15.200681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.201460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.202944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.204075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.497186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:15.512197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:15.609633 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6f3eef1-f841-4002-ab16-ad56987787cd tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1931 microversion: 2.75 time: 0.458924 Jul 14 14:39:15.629542 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 397/829] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:15 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1931 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:15.649610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:15.650438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:15.664296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.665131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.666515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.667735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.767577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71a25dc3-4b45-4fe6-aabb-e4252d5b5e5e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1633 microversion: 2.1 time: 0.982393 Jul 14 14:39:15.771757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 433/830] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:14 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1633 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:15.792078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:15.798602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:15.825745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.825745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.830242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:15.830722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:15.987050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:16.013123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4d67a31c-4b82-49a8-ac9e-408493d397b8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1473 microversion: 2.1 time: 0.375836 Jul 14 14:39:16.014776 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 398/831] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:15 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1473 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:16.025781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:16.026903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:16.038784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.039692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.041543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.042648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.223674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:16.238641 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e6144ff-2ad4-4d49-8aee-c29fa54d310a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1281 microversion: 2.1 time: 0.221617 Jul 14 14:39:16.242378 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 399/832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:16 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1281 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:16.253693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:16.255245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:16.269972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.271047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.272506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.273474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.541180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:16.577352 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a0e91c29-3e6e-4d8f-accb-1cfbf31a2e97 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 0.332391 Jul 14 14:39:16.579741 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 400/833] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:16 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:16.592186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9556e7e3-70a9-47a3-a9c2-a2564c911fde tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Action: 'create', calling method: .version_select at 0x7fdbf3143ee0>, body: {"keypair": {"name": "tempest-keypair-1180841770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1tgvzIfFfdPHc6vJBrlXUv0Vb8KwBXLQQI6Db+mAcqEIZIGhG0fd68yM3y78HShJCsCsitakjXL+8C/w5GUgercEFe3NtijkiIPH3a7z5+frRlQrwQ1pCfkeZ5nVwefw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:16.632000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-9556e7e3-70a9-47a3-a9c2-a2564c911fde tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for project c46a694ba42e4d1ba55d161224195378. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:16.637833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-9556e7e3-70a9-47a3-a9c2-a2564c911fde tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for user 038556a90129478eb04699f574ea7e1b and project c46a694ba42e4d1ba55d161224195378. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:16.677014 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9556e7e3-70a9-47a3-a9c2-a2564c911fde tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.095354 Jul 14 14:39:16.677963 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 401/834] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:39:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:16.696093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f275a82d-6548-4884-b63f-66cb58d58500 req-bc625b1e-1a6d-4701-ae53-68465d064d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12", "name": "network-vif-plugged", "status": "completed", "tag": "5f8c4ef4-941b-455f-aa93-b927a9680207"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:16.716311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f275a82d-6548-4884-b63f-66cb58d58500 req-bc625b1e-1a6d-4701-ae53-68465d064d13 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.717221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f275a82d-6548-4884-b63f-66cb58d58500 req-bc625b1e-1a6d-4701-ae53-68465d064d13 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.735546 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f275a82d-6548-4884-b63f-66cb58d58500 req-bc625b1e-1a6d-4701-ae53-68465d064d13 service nova] Creating event network-vif-plugged:5f8c4ef4-941b-455f-aa93-b927a9680207 for instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 on n-h1-768852-23 Jul 14 14:39:16.742183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f275a82d-6548-4884-b63f-66cb58d58500 req-bc625b1e-1a6d-4701-ae53-68465d064d13 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062537 Jul 14 14:39:16.747313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 402/835] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:16.755242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:16.756709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:16.765913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.766801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:16.767989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:16.768616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.056901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.096818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.116521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.123676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29b18687-61fd-4a81-a858-dcaebcdcaad8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1408 microversion: 2.25 time: 0.369833 Jul 14 14:39:17.134993 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 403/836] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:16 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1408 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:17.139317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:17.139988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:17.159962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.160882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.161965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.162704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.285545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:17.293072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.308777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-48de08d2-1c04-444d-a565-7572edb6ceb4 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 1.533803 Jul 14 14:39:17.323322 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4c608a8-888b-4b94-868e-2a7489bc23e3 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1937 microversion: 2.75 time: 0.188098 Jul 14 14:39:17.323322 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 404/837] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:17 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1937 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:17.323322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:17.323322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:17.326614 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 434/838] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:15 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 1554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:17.346743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.347836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.350523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.352032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.352594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:17.354965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:17.374489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.375163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.380181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.380868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.593272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:17.610799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e674eaf9-0e7e-4de0-88d5-adf92bda389f tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1281 microversion: 2.1 time: 0.272630 Jul 14 14:39:17.623317 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 435/839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:17 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:17.623317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:17.623317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:17.643289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.644640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.646884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:17.647294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:17.991655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.012147 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b28492d6-d08c-4a97-a558-e8c34f99efd1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1473 microversion: 2.1 time: 0.694590 Jul 14 14:39:18.015166 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 405/840] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:17 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1473 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:18.151033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:18.152303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:18.177789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.181775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.185190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.187158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.353762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.369496 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6bc57c5c-c5e3-45d4-81cd-fcad2372db02 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 0.755024 Jul 14 14:39:18.374721 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 436/841] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:17 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:18.380738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:18.385683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:18.403642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:18.410837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.411769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.412855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.418219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.754447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.771742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.776112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:18.777538 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-182698f0-903c-49d9-974e-b99199c225ef tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1604 microversion: 2.25 time: 0.639238 Jul 14 14:39:18.783770 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 406/842] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:18 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1604 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:39:18.802233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:18.803694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:18.814898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.816189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:18.821214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:18.844475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.010597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:19.016117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:19.044185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13f9fcbd-f4ab-453f-8164-af04e42c6046 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.667589 Jul 14 14:39:19.047315 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-818c3960-643e-4469-970d-7859eb202b98 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1937 microversion: 2.75 time: 0.261402 Jul 14 14:39:19.047884 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 437/843] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:18 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:19.069795 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 407/844] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:18 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1937 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:19.074937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:19.075522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-36276035-8133-4373-a55a-ce98e2d73ca1 req-773df7ba-7224-4c1b-a65f-289dcc413080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31672544-a4cf-4127-9f05-eaad6e51587f", "name": "network-vif-deleted", "tag": "2ccc4eaf-f66d-452b-b349-368ba4bc20ea"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:19.077760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:19.093806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.095499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.098206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.099363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.105101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-36276035-8133-4373-a55a-ce98e2d73ca1 req-773df7ba-7224-4c1b-a65f-289dcc413080 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.106201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-36276035-8133-4373-a55a-ce98e2d73ca1 req-773df7ba-7224-4c1b-a65f-289dcc413080 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.141839 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-36276035-8133-4373-a55a-ce98e2d73ca1 req-773df7ba-7224-4c1b-a65f-289dcc413080 service nova] Creating event network-vif-deleted:2ccc4eaf-f66d-452b-b349-368ba4bc20ea for instance 31672544-a4cf-4127-9f05-eaad6e51587f on n-h2-768852-23 Jul 14 14:39:19.153843 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-36276035-8133-4373-a55a-ce98e2d73ca1 req-773df7ba-7224-4c1b-a65f-289dcc413080 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103912 Jul 14 14:39:19.156125 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 438/845] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:19.181117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:19.182132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:19.197485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.198150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.199352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.199911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.376438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:19.391821 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c7fa8b3-6736-4700-8a35-2c4c4af34484 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1281 microversion: 2.1 time: 0.319958 Jul 14 14:39:19.401950 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 408/846] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:19 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1281 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:19.407859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:19.408491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:19.416342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.416797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.418442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.418959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.482881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0cdf8fd7-bf45-46cb-82bd-b8b580873c56 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.321464 Jul 14 14:39:19.484059 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 439/847] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 14:39:19 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-interface => generated 284 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:39:19.498224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:19.499323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:19.539809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.541160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.542239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lazy-loading 'fault' on Instance uuid 31672544-a4cf-4127-9f05-eaad6e51587f {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:19.542700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.543483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.544901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:19.545733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:19.632595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:19.646225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7be7968a-8f79-4755-bc70-93e9046e683a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 200 len: 1307 microversion: 2.1 time: 0.242917 Jul 14 14:39:19.647231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 409/848] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:19 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 1307 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:20.078698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.084444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:20.123605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.124356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.125675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.126381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.418629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:20.434716 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cebc819e-bee3-4132-85c6-ba7759d18c76 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1331 microversion: 2.1 time: 0.373869 Jul 14 14:39:20.436469 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 410/849] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:20 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1331 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:39:20.452975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.453909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:20.459261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:20.465482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.466254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.467248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.467813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.576151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] Lazy-loading 'services' on Instance uuid 582c9fa8-e90f-4ed0-8f2b-e7836044492b {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:20.615643 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3cb64221-f835-4813-a3d3-54b2f51f82b8 tempest-ServersAdmin275Test-1794597856 tempest-ServersAdmin275Test-1794597856-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1922 microversion: 2.75 time: 0.171367 Jul 14 14:39:20.631472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 411/850] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:20 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1922 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:20.650253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1884613928", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "ee03bffb-17d6-47bc-b312-096b88b6e925"}], "security_groups": [{"name": "tempest-securitygroup--901082170"}], "key_name": "tempest-keypair-1180841770", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:20.818532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] validate_networks() for [('ee03bffb-17d6-47bc-b312-096b88b6e925', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:39:20.904586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:20.921400 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-845a8af1-1ac3-48e4-ae86-ff6e0f610a49 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 1.430098 Jul 14 14:39:20.935067 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 440/851] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:19 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:20.945810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:20.946844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:20.953867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.955851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:20.957921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:20.958924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.402186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:21.478008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:21.683644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:39:21.684701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:39:21.685546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:39:21.686241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:39:21.686936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:39:21.703867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.704777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.706196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.707551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.742073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:39:21.749253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for user 038556a90129478eb04699f574ea7e1b and project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:39:21.768952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:21.771130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:39:21.775805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:39:21.786603 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed240e27-6478-4bb0-afe7-ac7bb69cf075 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 0.848042 Jul 14 14:39:21.787212 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 441/852] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:20 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:21.793060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.794009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 31672544-a4cf-4127-9f05-eaad6e51587f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:21.812923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.813824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.814924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.816274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.834026 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance 31672544-a4cf-4127-9f05-eaad6e51587f could not be found. Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f HTTP/1.1 Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:21.836279 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 31672544-a4cf-4127-9f05-eaad6e51587f could not be found. Jul 14 14:39:21.837724 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '31672544-a4cf-4127-9f05-eaad6e51587f'} Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31672544-a4cf-4127-9f05-eaad6e51587f could not be found. Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:21.838542 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31672544-a4cf-4127-9f05-eaad6e51587f could not be found. Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31672544-a4cf-4127-9f05-eaad6e51587f could not be found. Jul 14 14:39:21.839802 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:21.842869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance 31672544-a4cf-4127-9f05-eaad6e51587f could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:21.844218 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c183fc63-0a32-4ce2-938b-beddf964a74d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f" status: 404 len: 111 microversion: 2.1 time: 0.055613 Jul 14 14:39:21.845379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 442/853] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:21 2022] GET /compute/v2.1/servers/31672544-a4cf-4127-9f05-eaad6e51587f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:21.851040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.852013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:21.861196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.862100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.863212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.863977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.897681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:21.920833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ddc076b-5c9f-4a40-ae35-729d79f5f14e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.286896 Jul 14 14:39:21.922529 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 412/854] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:39:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:39:21.936974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:21.938617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:21.954933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.955832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:21.958552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:21.959669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.038328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8722ad2-aae4-4998-9cc5-374e6ef25a0e tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "DELETE /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 204 len: 0 microversion: 2.75 time: 0.191125 Jul 14 14:39:22.040607 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 443/855] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:39:21 2022] DELETE /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:39:22.051451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:22.052612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:22.060434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.061263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.062453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.063137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.167317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:22.248618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:22.487867 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-103b0c4d-a1ef-409f-a644-f0538978a499 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 204 len: 0 microversion: 2.1 time: 0.444520 Jul 14 14:39:22.489741 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 444/856] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:22 2022] DELETE /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:22.504066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4e21b75-4803-4231-af85-31f1225cf499 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:22.505788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4e21b75-4803-4231-af85-31f1225cf499 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:22.763327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:22.786456 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-192f329b-b6cd-4a29-8994-567412fc9dad tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1534 microversion: 2.1 time: 0.861846 Jul 14 14:39:22.787646 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 413/857] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:21 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1534 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:22.803154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:22.804281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:22.835333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.835333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:22.863862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:22.865067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.272077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.285436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10e0e0cc-240a-440e-a975-727fd29ed718 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 0.495000 Jul 14 14:39:23.287070 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 414/858] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:22 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:23.294012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:23.295094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:23.330314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4e21b75-4803-4231-af85-31f1225cf499 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.331045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:23.332399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.336326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:23.339730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.353059 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4e21b75-4803-4231-af85-31f1225cf499 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1235 microversion: 2.1 time: 0.860048 Jul 14 14:39:23.355330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:23.365534 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 445/859] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:22 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1235 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:23.381762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:23.383196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:23.447824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:23.453582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.456734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:23.459003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:23.578901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.593227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.609482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0fcd19b670624ba3afda2975aef28523', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1c0e8ba57d34db18ed461dc962a5e83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:23.636506 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b11485b-e26a-43cc-9e14-bdc9f35a52a6 tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 200 len: 1444 microversion: 2.75 time: 0.347494 Jul 14 14:39:23.661231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 415/860] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:23 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 1444 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:39:23.674772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cf695508-e558-4075-b0b2-04065470ca67 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'create', calling method: .version_select at 0x7fdbf3175ee0>, body: {"pool": "91cb616b-4d80-46c0-9cdc-6a18fbc05771"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:24.859588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:24.891141 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f7664f7-552e-4a73-97cc-b0912c27a7b0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1473 microversion: 2.1 time: 1.522998 Jul 14 14:39:24.897484 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 446/861] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:23 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1473 bytes in 1531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:24.916446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:24.918974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:24.935395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:24.937816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:24.940884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:24.942141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:25.910009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:25.948450 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-52e34bce-00ca-45ae-bcb1-2b01894d8c76 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 1.045471 Jul 14 14:39:25.951220 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 447/862] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:24 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:25.963658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-cffd8b16-c82a-49f5-8962-ce5fbc62dda6 req-28b7ed50-7fd3-42d9-b2c1-78536d3c6eb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3911a3e7-b736-4f7b-beac-e479f8461261", "name": "network-vif-plugged", "status": "completed", "tag": "e30d7cb5-3480-4ef2-94d6-1746f82d4903"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:25.980392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cffd8b16-c82a-49f5-8962-ce5fbc62dda6 req-28b7ed50-7fd3-42d9-b2c1-78536d3c6eb3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:25.981961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cffd8b16-c82a-49f5-8962-ce5fbc62dda6 req-28b7ed50-7fd3-42d9-b2c1-78536d3c6eb3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.011372 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-cffd8b16-c82a-49f5-8962-ce5fbc62dda6 req-28b7ed50-7fd3-42d9-b2c1-78536d3c6eb3 service nova] Creating event network-vif-plugged:e30d7cb5-3480-4ef2-94d6-1746f82d4903 for instance 3911a3e7-b736-4f7b-beac-e479f8461261 on n-h2-768852-23 Jul 14 14:39:26.021975 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-cffd8b16-c82a-49f5-8962-ce5fbc62dda6 req-28b7ed50-7fd3-42d9-b2c1-78536d3c6eb3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068190 Jul 14 14:39:26.023871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 448/863] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:26.046577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:26.048201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:26.082232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.088629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.093449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.094379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.842839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:26.854281 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79b556fa-1968-418c-b852-9fcb4e7df773 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1387 microversion: 2.1 time: 0.826442 Jul 14 14:39:26.854880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 449/864] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:26 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1387 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:26.868478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:26.869111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:26.888991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.889680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:26.890689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:26.891344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.027884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:27.041501 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5086ae9-f06c-4d8c-a48f-b0615801053c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1293 microversion: 2.1 time: 0.173846 Jul 14 14:39:27.044093 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 450/865] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:26 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1293 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:27.050190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:27.052329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] [instance: 582c9fa8-e90f-4ed0-8f2b-e7836044492b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:27.086352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.087094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.089484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.094227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.136317 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] HTTP exception thrown: Instance 582c9fa8-e90f-4ed0-8f2b-e7836044492b could not be found. Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Request method failure captured: Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b HTTP/1.1 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Co9T0OHO7TbSP9yTPJkcEJaOCFuss6Z6bL1SWc4Z8cBv5nRLI9XbxEaWVphJIh3suSQR_AW0MABWK1tlFuPKjyk1gQEJSY8UGFvRK4IJJVqfW_obeWas4MXoy_zwfih46_R83VgWuNKdVufOz9KzTWeNLz8JH2P6ES7JF2MaJ_xk3g Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.75 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b1c0e8ba57d34db18ed461dc962a5e83 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdmin275Test-791625746 Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:27.154416 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1c0e8ba57d34db18ed461dc962a5e83"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b1c0e8ba57d34db18ed461dc962a5e83"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b1c0e8ba57d34db18ed461dc962a5e83"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b1c0e8ba57d34db18ed461dc962a5e83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdmin275Test-791625746 Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b1c0e8ba57d34db18ed461dc962a5e83 Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdmin275Test-791625746 Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdmin275Test-791625746-project Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0fcd19b670624ba3afda2975aef28523 Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdmin275Test-791625746-project Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 582c9fa8-e90f-4ed0-8f2b-e7836044492b could not be found. Jul 14 14:39:27.156358 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '582c9fa8-e90f-4ed0-8f2b-e7836044492b'} Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 582c9fa8-e90f-4ed0-8f2b-e7836044492b could not be found. Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:27.157314 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 582c9fa8-e90f-4ed0-8f2b-e7836044492b could not be found. Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 582c9fa8-e90f-4ed0-8f2b-e7836044492b could not be found. Jul 14 14:39:27.158830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:27.168134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] Returning 404 to user: Instance 582c9fa8-e90f-4ed0-8f2b-e7836044492b could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:27.172059 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f969a445-ad61-4c78-af16-c2f17f2808bb tempest-ServersAdmin275Test-791625746 tempest-ServersAdmin275Test-791625746-project] 10.222.0.98 "GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b" status: 404 len: 111 microversion: 2.75 time: 0.126592 Jul 14 14:39:27.179229 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 451/866] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:39:27 2022] GET /compute/v2.1/servers/582c9fa8-e90f-4ed0-8f2b-e7836044492b => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:39:27.193933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:27.202094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:27.214245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.218594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.220606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.220606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.673557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:27.681874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c5277147-c54f-4b2b-9470-ba92c92746ed tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 200 len: 1473 microversion: 2.1 time: 0.502174 Jul 14 14:39:27.682892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 452/867] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:27 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 1473 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:27.687872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f1d295a9-f4e0-4393-a365-13df9d41baae req-ecd47007-9d7e-4907-ae7c-51d22d8b3434 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8909738-7b47-4e69-bbdd-e2eda2a35613", "tag": "dbe6d388-757a-486b-b2bf-76360da2d7f7"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:27.714660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f1d295a9-f4e0-4393-a365-13df9d41baae req-ecd47007-9d7e-4907-ae7c-51d22d8b3434 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.718873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f1d295a9-f4e0-4393-a365-13df9d41baae req-ecd47007-9d7e-4907-ae7c-51d22d8b3434 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.755367 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f1d295a9-f4e0-4393-a365-13df9d41baae req-ecd47007-9d7e-4907-ae7c-51d22d8b3434 service nova] Creating event network-changed:dbe6d388-757a-486b-b2bf-76360da2d7f7 for instance e8909738-7b47-4e69-bbdd-e2eda2a35613 on n-h2-768852-23 Jul 14 14:39:27.768145 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f1d295a9-f4e0-4393-a365-13df9d41baae req-ecd47007-9d7e-4907-ae7c-51d22d8b3434 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083681 Jul 14 14:39:27.769761 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 453/868] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:27.776233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:27.782123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:27.807498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.811814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:27.813084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:27.813879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:28.236315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:28.251292 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-290db2fe-0621-468c-9996-eb0f5f1660c5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 0.479968 Jul 14 14:39:28.263852 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 454/869] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:27 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:28.279441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:28.295850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:28.328581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:28.332715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:28.334087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:28.340563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.566496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:29.589936 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a245f082-c5ce-45ee-9527-4ab428be4a98 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1586 microversion: 2.1 time: 1.322098 Jul 14 14:39:29.591098 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 455/870] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:28 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1586 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:29.606176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:29.612010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:29.633517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.635426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:29.639250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:29.641389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.328129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:30.337647 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1268c27-f585-4c62-bc01-6a93a929928c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 0.739995 Jul 14 14:39:30.343162 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cf695508-e558-4075-b0b2-04065470ca67 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.678596 Jul 14 14:39:30.344481 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 416/871] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:39:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:30.350119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-718a38f2-e8ec-4e7f-95cb-5544d1d72882 req-ec043bc6-59a2-484b-b5af-a80dbd7d4ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8239eb66-b366-4119-b7d2-27f8faa6f57d", "name": "network-vif-deleted", "tag": "240e91e9-b919-4b5a-8483-848ef3c0a01f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:30.358826 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 456/872] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:29 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:30.373043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:30.373676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8239eb66-b366-4119-b7d2-27f8faa6f57d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:30.381008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-718a38f2-e8ec-4e7f-95cb-5544d1d72882 req-ec043bc6-59a2-484b-b5af-a80dbd7d4ce4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.382292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-718a38f2-e8ec-4e7f-95cb-5544d1d72882 req-ec043bc6-59a2-484b-b5af-a80dbd7d4ce4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.395485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.395946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.401031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.401724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.402581 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-718a38f2-e8ec-4e7f-95cb-5544d1d72882 req-ec043bc6-59a2-484b-b5af-a80dbd7d4ce4 service nova] Creating event network-vif-deleted:240e91e9-b919-4b5a-8483-848ef3c0a01f for instance 8239eb66-b366-4119-b7d2-27f8faa6f57d on n-h1-768852-23 Jul 14 14:39:30.418038 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-718a38f2-e8ec-4e7f-95cb-5544d1d72882 req-ec043bc6-59a2-484b-b5af-a80dbd7d4ce4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071533 Jul 14 14:39:30.419255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 417/873] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:30.430151 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance 8239eb66-b366-4119-b7d2-27f8faa6f57d could not be found. Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d HTTP/1.1 Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:30.431942 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 8239eb66-b366-4119-b7d2-27f8faa6f57d could not be found. Jul 14 14:39:30.433299 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '8239eb66-b366-4119-b7d2-27f8faa6f57d'} Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8239eb66-b366-4119-b7d2-27f8faa6f57d could not be found. Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:30.434247 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8239eb66-b366-4119-b7d2-27f8faa6f57d could not be found. Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8239eb66-b366-4119-b7d2-27f8faa6f57d could not be found. Jul 14 14:39:30.435538 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:30.440215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance 8239eb66-b366-4119-b7d2-27f8faa6f57d could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:30.440215 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-388a4d95-db37-4962-8b6f-ff6e3a8ed38c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d" status: 404 len: 111 microversion: 2.1 time: 0.073521 Jul 14 14:39:30.440215 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 457/874] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:30 2022] GET /compute/v2.1/servers/8239eb66-b366-4119-b7d2-27f8faa6f57d => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:30.443139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:30.444046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:30.444458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:30.444580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:30.454123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.458362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.459500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.460129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.480344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.481144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.482565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.494923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.801912 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9abfcc41-1df9-4532-8742-84214f7aff95 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.362665 Jul 14 14:39:30.811732 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 458/875] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:39:30 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261/os-interface => generated 284 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:30.819637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-dcfc2cd1-4e0a-4255-88b0-db332f9272d0 req-1ac8bad3-28ef-47c8-b1eb-586a3b0bdb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:30.839795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dcfc2cd1-4e0a-4255-88b0-db332f9272d0 req-1ac8bad3-28ef-47c8-b1eb-586a3b0bdb14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.840220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dcfc2cd1-4e0a-4255-88b0-db332f9272d0 req-1ac8bad3-28ef-47c8-b1eb-586a3b0bdb14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.857110 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-dcfc2cd1-4e0a-4255-88b0-db332f9272d0 req-1ac8bad3-28ef-47c8-b1eb-586a3b0bdb14 service nova] Creating event network-changed:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h1-768852-23 Jul 14 14:39:30.863575 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-dcfc2cd1-4e0a-4255-88b0-db332f9272d0 req-1ac8bad3-28ef-47c8-b1eb-586a3b0bdb14 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049795 Jul 14 14:39:30.864819 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 459/876] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:30.881484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'action', calling method: .version_select at 0x7fdc01d77040>, body: {"addFloatingIp": {"address": "172.25.1.130"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:30.883177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:30.890572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.891026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.891893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:30.892335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:30.986998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Acquired lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:39:31.696340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:31.725171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:31.766276 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c0bb3352-925e-4f86-8176-fc7b01b06d2c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 1.344104 Jul 14 14:39:31.768056 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 418/877] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:30 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:31.798110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:31.801166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:31.814882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:31.846485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:31.848485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:31.851488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:31.856268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:31.993056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:32.308183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-919c1aee-cd8d-4dd3-8337-6486ba540d66 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 204 len: 0 microversion: 2.1 time: 0.532232 Jul 14 14:39:32.319038 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 419/878] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:31 2022] DELETE /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:32.335367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:32.339634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:32.361449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.363250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.365010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.366145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.761316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:32.783745 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93650c2f-01ea-43e6-a0c1-0697446b06a8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 0.461605 Jul 14 14:39:32.785638 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 420/879] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:32 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:32.794705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:32.796051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:32.810495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.811410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:32.812847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:32.813623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.040317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:33.056748 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0cd420ad-dbb3-4969-a9c1-c252c1aa9ab1 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1471 microversion: 2.1 time: 0.269808 Jul 14 14:39:33.069967 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 421/880] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:32 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1471 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:33.081229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:33.083951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:33.094967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.095495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.096344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.097317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.341780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:33.382062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:33.471648 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eea8dd1e-6e22-41e3-b685-939fbcb4ce7c tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 0.395994 Jul 14 14:39:33.479372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 422/881] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:33 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:33.509853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cfcd859e-372b-4a40-8f72-553d7800b4ec req-f4426310-29a6-43e5-be8d-968cca3b0717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:33.549365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cfcd859e-372b-4a40-8f72-553d7800b4ec req-f4426310-29a6-43e5-be8d-968cca3b0717 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.550359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cfcd859e-372b-4a40-8f72-553d7800b4ec req-f4426310-29a6-43e5-be8d-968cca3b0717 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.572008 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cfcd859e-372b-4a40-8f72-553d7800b4ec req-f4426310-29a6-43e5-be8d-968cca3b0717 service nova] Creating event network-changed:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h2-768852-23 Jul 14 14:39:33.579105 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cfcd859e-372b-4a40-8f72-553d7800b4ec req-f4426310-29a6-43e5-be8d-968cca3b0717 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098113 Jul 14 14:39:33.580424 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 423/882] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:33.805551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:33.806656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:33.816962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.818651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:33.819631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:33.820185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.429158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:34.441143 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8711c1b0-6eba-43fa-9f69-e7420ffb3b30 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 0.638285 Jul 14 14:39:34.447645 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 424/883] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:33 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:34.463434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:34.468986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:34.491288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.492182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:34.495303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:34.498667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:35.281977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Building network info cache for instance {{(pid=125966) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:39:35.665656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:35.674557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e4e7546-dc6f-476c-82ec-a301249d5421 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 200 len: 1471 microversion: 2.1 time: 1.225530 Jul 14 14:39:35.683305 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 425/884] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:34 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 1471 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:35.702418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:35.707088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:35.738904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:35.739395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:35.740210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:35.740873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:36.497197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:36.548491 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cf638792-5640-4b72-bf40-2470a167420a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 0.855911 Jul 14 14:39:36.549295 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 426/885] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:35 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:36.575372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6ed583ab-2fb0-4777-8747-a45a435ac8d4 req-4b5e9b9a-445b-418d-9805-57860a4ba2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8909738-7b47-4e69-bbdd-e2eda2a35613", "name": "network-vif-plugged", "status": "completed", "tag": "dbe6d388-757a-486b-b2bf-76360da2d7f7"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:36.596113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6ed583ab-2fb0-4777-8747-a45a435ac8d4 req-4b5e9b9a-445b-418d-9805-57860a4ba2e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:36.596589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6ed583ab-2fb0-4777-8747-a45a435ac8d4 req-4b5e9b9a-445b-418d-9805-57860a4ba2e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:36.625386 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6ed583ab-2fb0-4777-8747-a45a435ac8d4 req-4b5e9b9a-445b-418d-9805-57860a4ba2e8 service nova] Creating event network-vif-plugged:dbe6d388-757a-486b-b2bf-76360da2d7f7 for instance e8909738-7b47-4e69-bbdd-e2eda2a35613 on n-h2-768852-23 Jul 14 14:39:36.637612 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6ed583ab-2fb0-4777-8747-a45a435ac8d4 req-4b5e9b9a-445b-418d-9805-57860a4ba2e8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081095 Jul 14 14:39:36.642105 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 427/886] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:36.654326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:36.665499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:36.693327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:36.694330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:36.694593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:36.695041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.313263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:37.328694 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6541875c-27da-4cdd-b92a-a14dd2a5016e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1586 microversion: 2.1 time: 0.684951 Jul 14 14:39:37.333259 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 428/887] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:36 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1586 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:37.355962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:37.357723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:37.386699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.391009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:37.393164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:37.398115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.090531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Updating instance_info_cache with network_info: [{"id": "5f8c4ef4-941b-455f-aa93-b927a9680207", "address": "fa:16:3e:33:1b:cd", "network": {"id": "849b71fc-e412-4904-8684-f09bf3d0d560", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-893385686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "597ba1a6e8624db1841a02a6f544039d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5f8c4ef4-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125966) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:39:38.155218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Releasing lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:39:38.158023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70a85936-9a62-430e-803c-65df9559deb7 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action" status: 202 len: 0 microversion: 2.1 time: 7.287235 Jul 14 14:39:38.164949 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 460/888] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:39:30 2022] POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action => generated 0 bytes in 7299 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:39:38.184237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d5694d5f-7f6d-49e9-bace-b834d8377b47 req-739bf5b4-6585-431e-8953-0a370be45e50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3911a3e7-b736-4f7b-beac-e479f8461261", "tag": "e30d7cb5-3480-4ef2-94d6-1746f82d4903"}, {"name": "network-changed", "server_uuid": "d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12", "tag": "5f8c4ef4-941b-455f-aa93-b927a9680207"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:38.224589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d5694d5f-7f6d-49e9-bace-b834d8377b47 req-739bf5b4-6585-431e-8953-0a370be45e50 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.231035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d5694d5f-7f6d-49e9-bace-b834d8377b47 req-739bf5b4-6585-431e-8953-0a370be45e50 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.274380 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d5694d5f-7f6d-49e9-bace-b834d8377b47 req-739bf5b4-6585-431e-8953-0a370be45e50 service nova] Creating event network-changed:e30d7cb5-3480-4ef2-94d6-1746f82d4903 for instance 3911a3e7-b736-4f7b-beac-e479f8461261 on n-h2-768852-23 Jul 14 14:39:38.280993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d5694d5f-7f6d-49e9-bace-b834d8377b47 req-739bf5b4-6585-431e-8953-0a370be45e50 service nova] Creating event network-changed:5f8c4ef4-941b-455f-aa93-b927a9680207 for instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 on n-h1-768852-23 Jul 14 14:39:38.302383 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d5694d5f-7f6d-49e9-bace-b834d8377b47 req-739bf5b4-6585-431e-8953-0a370be45e50 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.125457 Jul 14 14:39:38.303025 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 461/889] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:38.319578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:38.320469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: ece38b80-f3ff-4714-a1ca-8f4cb86f0f21] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:38.338609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.339069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.339930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.340372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.378818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 could not be found. Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 HTTP/1.1 Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:38.380693 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 could not be found. Jul 14 14:39:38.383305 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ece38b80-f3ff-4714-a1ca-8f4cb86f0f21'} Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 could not be found. Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:38.385345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 could not be found. Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 could not be found. Jul 14 14:39:38.390016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:38.395576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:38.395576 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa1c37e1-cf5c-44cf-82dc-9937d2996557 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21" status: 404 len: 111 microversion: 2.1 time: 0.077991 Jul 14 14:39:38.396148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:38.397105 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 462/890] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:38 2022] GET /compute/v2.1/servers/ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:38.397353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-43e7bb5d-421c-4722-80ba-005e0a427950 req-e336f149-3d86-45d2-84db-0a6ec8c4d9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ece38b80-f3ff-4714-a1ca-8f4cb86f0f21", "name": "network-vif-deleted", "tag": "aded7d27-3ced-4c1c-8e26-b68d8b0ba5bd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:38.426683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-43e7bb5d-421c-4722-80ba-005e0a427950 req-e336f149-3d86-45d2-84db-0a6ec8c4d9d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.427140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-43e7bb5d-421c-4722-80ba-005e0a427950 req-e336f149-3d86-45d2-84db-0a6ec8c4d9d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.441710 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ad041ea-d9af-4eb7-900e-84cc39180fbc tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 1.092594 Jul 14 14:39:38.448204 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 429/891] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:37 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:38.459140 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-43e7bb5d-421c-4722-80ba-005e0a427950 req-e336f149-3d86-45d2-84db-0a6ec8c4d9d8 service nova] Creating event network-vif-deleted:aded7d27-3ced-4c1c-8e26-b68d8b0ba5bd for instance ece38b80-f3ff-4714-a1ca-8f4cb86f0f21 on n-h1-768852-23 Jul 14 14:39:38.467690 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-43e7bb5d-421c-4722-80ba-005e0a427950 req-e336f149-3d86-45d2-84db-0a6ec8c4d9d8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074720 Jul 14 14:39:38.468316 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 463/892] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:38.472689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:38.478656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:38.493393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08c28d99-7b2c-433a-8ead-d3f86d6fe307 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'create', calling method: .version_select at 0x7fdbf319fc10>, body: {"pool": "91cb616b-4d80-46c0-9cdc-6a18fbc05771"} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:38.506223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.510003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:38.511262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:38.515620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.024565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:39.040741 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4f94b8a-1091-49ea-9df1-2ccaf737d0c1 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1323 microversion: 2.1 time: 0.590144 Jul 14 14:39:39.051446 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 430/893] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:38 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1323 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:39.056884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.070877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:39.078352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.079111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.080148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.082096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.140350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:39.295426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:39.407064 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-695169f7-38e9-4d5a-9fd2-0a716d3a2641 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 204 len: 0 microversion: 2.1 time: 0.353005 Jul 14 14:39:39.416421 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 431/894] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:39 2022] DELETE /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:39.434888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.436051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:39.481696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.483783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.490838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.497457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.572344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:39.856358 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c6bbfbe-76fd-41e4-bdf6-9d0aa141dbe2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 204 len: 0 microversion: 2.1 time: 0.434357 Jul 14 14:39:39.861120 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 432/895] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:39 2022] DELETE /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:39.872274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:39.873094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:39.889094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.891017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:39.895894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:39.897707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:40.290530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:40.299149 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-49857230-23be-4f9b-8d39-acdd784039fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 0.435095 Jul 14 14:39:40.301972 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 433/896] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:39 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:40.316259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:40.317399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:40.335847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:40.336300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:40.337395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:40.343377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:40.891778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:40.901451 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10345b32-1114-4792-8399-ec778df880a3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 200 len: 1475 microversion: 2.1 time: 0.597022 Jul 14 14:39:40.901451 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 434/897] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:40 2022] GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 1475 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:40.918104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:40.918104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:40.923220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:40.923714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:40.924515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:40.925500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:41.548431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:41.560314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d0134c3-c775-4cef-a41f-2cf03ae2e9cc tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1473 microversion: 2.1 time: 0.658143 Jul 14 14:39:41.560925 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 435/898] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:40 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1473 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:41.573741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:41.574700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:41.591845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:41.592719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:41.593726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:41.594334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.792730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:42.805889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1978fd3b-aa71-4745-b242-44be89cf769c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 1.242788 Jul 14 14:39:42.809858 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 436/899] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:41 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:42.829779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:42.830819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:42.838706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.839538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.840837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.841464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.897383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Request method failure captured: Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613/diagnostics HTTP/1.1 Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CqL0DdbOvqR7lq10WzdMg_eJvZ4qtIVWGfy8JvcVwQ4HU908tKX7cFgAnuZLhpRkgtRMpO-vow5-Rih4k36yDSsg7ACLtLIGF9AWwkZXCC78fFMr7psl_u0mZkQuJU9iED3Jzj0gDNfd9yXMcURSp65zkoahz2FzwNu3rPDabY5X7s Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f1dc5d177b084cfab1e0d4d9d1715fa3 Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1227968876 Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:39:42.899885 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1227968876 Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f1dc5d177b084cfab1e0d4d9d1715fa3 Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1227968876 Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerDiagnosticsNegativeTest-1227968876-project Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 679429de8da0408b93541374e89ce606 Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1227968876-project Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:39:42.901531 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': 'e8909738-7b47-4e69-bbdd-e2eda2a35613'} Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:39:42.902355 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Jul 14 14:39:42.903795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:42.905904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:42.907019 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-419223b7-3f19-4f2f-b45d-0e9e2eb2df12 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.095884 Jul 14 14:39:42.915976 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 437/900] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:39:42 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613/diagnostics => generated 117 bytes in 105 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:42.925987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:42.926931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:42.941403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.946435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:42.947594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:42.948331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.302665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:43.311903 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5fb57da-ff94-4d10-9b63-ec5e397d18d3 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 200 len: 1475 microversion: 2.1 time: 0.394512 Jul 14 14:39:43.320602 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 438/901] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:42 2022] GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 1475 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:43.325496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:43.326002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:43.348107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.348836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.349840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.350488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.400654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08c28d99-7b2c-433a-8ead-d3f86d6fe307 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.911433 Jul 14 14:39:43.408414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:43.416114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 464/902] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:39:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:43.449449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4c492c26-3531-445a-a046-0a746431f4a4 req-72fbd94f-a4dc-4513-a780-d4203b6f9544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "name": "network-vif-plugged", "status": "completed", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:43.531129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4c492c26-3531-445a-a046-0a746431f4a4 req-72fbd94f-a4dc-4513-a780-d4203b6f9544 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.533302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4c492c26-3531-445a-a046-0a746431f4a4 req-72fbd94f-a4dc-4513-a780-d4203b6f9544 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.574095 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4c492c26-3531-445a-a046-0a746431f4a4 req-72fbd94f-a4dc-4513-a780-d4203b6f9544 service nova] Creating event network-vif-plugged:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h2-768852-23 Jul 14 14:39:43.604496 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4c492c26-3531-445a-a046-0a746431f4a4 req-72fbd94f-a4dc-4513-a780-d4203b6f9544 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186438 Jul 14 14:39:43.607202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 465/903] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:43.619937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.44"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:43.628986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:43.646561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cb3cb2e1-c502-44f5-94a1-5ae3f20cf4a5 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 204 len: 0 microversion: 2.1 time: 0.324233 Jul 14 14:39:43.648905 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 439/904] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:43 2022] DELETE /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:43.653669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.654397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.655492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.656148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.669962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:43.670691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:43.681837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:43.693298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Acquired lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:39:43.710961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.711747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:43.713071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:43.713756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:44.682148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:44.710115 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88575cda-86ee-434a-a154-c1265fbd9038 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1479 microversion: 2.1 time: 1.055140 Jul 14 14:39:44.712387 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 440/905] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:43 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1479 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:44.723383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:44.726350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:44.759459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:44.772118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:44.775921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:44.781193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.278890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771.", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:39:45.282299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Releasing lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:39:45.284624 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] HTTP exception thrown: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.284624 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Request method failure captured: Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action HTTP/1.1 Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 45 Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cp5JrHLRQJB6WC8HqAN3qaFsWMS803-1qM2kZHNU-l_pQ7H5c6GbvfUHxaP-sbfi-XFImWv63Dkxv2bKHiXRdKf6kk1PF4Va6DaVaEtNleyqDq85PARMVWp6qigSxpCtKj69BTw7K0AHE9BWd5W61TDWy6iK17H4hxm48fZwSOC5PE Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:45.288617 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2cd356b55fa24209a77907ca05fc0315 Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: {"addFloatingIp": {"address": "172.25.1.44"}} Jul 14 14:39:45.290021 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12', 'body': {'addFloatingIp': {'address': '172.25.1.44'}}} Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:39:45.290779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:39:45.291845 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.292894 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.293895 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] Jul 14 14:39:45.295016 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.298344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Returning 400 to user: Cannot associate floating IP 172.25.1.44 (838d2977-2f87-478e-bcb1-182fd480d1e3) with port 5f8c4ef4-941b-455f-aa93-b927a9680207 using fixed IP 172.20.0.4, as that fixed IP already has a floating IP on external network 91cb616b-4d80-46c0-9cdc-6a18fbc05771. Jul 14 14:39:45.298344 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-6597b6c0-65ec-4adb-9605-2debc3009a71'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:45.300419 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-982bd632-db03-447c-ad5c-114d0ffd0271 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action" status: 400 len: 380 microversion: 2.1 time: 1.691178 Jul 14 14:39:45.306266 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 466/906] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:39:43 2022] POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action => generated 380 bytes in 1694 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:39:45.328285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-87de8058-0f42-4345-bafe-9dfdbc4a45fa req-afaec91d-12ac-4ef5-ae10-9dca9e14c8d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "405f671c-074b-4192-9e92-ff6c4c4103e2", "name": "network-vif-deleted", "tag": "ea893d0c-2968-4846-af6f-0af1e1bf79f5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:45.363444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-87de8058-0f42-4345-bafe-9dfdbc4a45fa req-afaec91d-12ac-4ef5-ae10-9dca9e14c8d0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.366225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-87de8058-0f42-4345-bafe-9dfdbc4a45fa req-afaec91d-12ac-4ef5-ae10-9dca9e14c8d0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.382190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-87de8058-0f42-4345-bafe-9dfdbc4a45fa req-afaec91d-12ac-4ef5-ae10-9dca9e14c8d0 service nova] Creating event network-vif-deleted:ea893d0c-2968-4846-af6f-0af1e1bf79f5 for instance 405f671c-074b-4192-9e92-ff6c4c4103e2 on n-h1-768852-23 Jul 14 14:39:45.390002 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-87de8058-0f42-4345-bafe-9dfdbc4a45fa req-afaec91d-12ac-4ef5-ae10-9dca9e14c8d0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080837 Jul 14 14:39:45.391071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 467/907] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:45.399632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:45.400626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 405f671c-074b-4192-9e92-ff6c4c4103e2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:45.415876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.416463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.417329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.417832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.458193 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance 405f671c-074b-4192-9e92-ff6c4c4103e2 could not be found. Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 HTTP/1.1 Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:45.461808 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 405f671c-074b-4192-9e92-ff6c4c4103e2 could not be found. Jul 14 14:39:45.463407 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '405f671c-074b-4192-9e92-ff6c4c4103e2'} Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 405f671c-074b-4192-9e92-ff6c4c4103e2 could not be found. Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:45.464312 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 405f671c-074b-4192-9e92-ff6c4c4103e2 could not be found. Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 405f671c-074b-4192-9e92-ff6c4c4103e2 could not be found. Jul 14 14:39:45.466056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:45.467383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance 405f671c-074b-4192-9e92-ff6c4c4103e2 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:45.467383 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9f15bf9-3534-436a-b0ae-2acc2b80b909 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2" status: 404 len: 111 microversion: 2.1 time: 0.071943 Jul 14 14:39:45.467383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 468/908] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:45 2022] GET /compute/v2.1/servers/405f671c-074b-4192-9e92-ff6c4c4103e2 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:45.475291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-09695e87-50ba-469f-8fbb-146b8dc27e74 req-9241eb42-4fca-4e09-b395-c1fc6a3d9b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81f0b0a2-c53c-4559-bb48-31b8a10d23a9", "name": "network-vif-deleted", "tag": "e787f9f6-4bc3-4b82-8c72-f2eaf8b43935"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:45.496443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09695e87-50ba-469f-8fbb-146b8dc27e74 req-9241eb42-4fca-4e09-b395-c1fc6a3d9b5e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.497260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09695e87-50ba-469f-8fbb-146b8dc27e74 req-9241eb42-4fca-4e09-b395-c1fc6a3d9b5e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.508680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:45.521630 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac33e487-848d-4bd8-801d-a2919d8da314 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 0.807247 Jul 14 14:39:45.522911 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 441/909] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:44 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:45.532715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3f097f0-848a-4e02-beb4-6efb347dcaea tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '.version_select at 0x7fdbf3161820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:45.537860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-09695e87-50ba-469f-8fbb-146b8dc27e74 req-9241eb42-4fca-4e09-b395-c1fc6a3d9b5e service nova] Creating event network-vif-deleted:e787f9f6-4bc3-4b82-8c72-f2eaf8b43935 for instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 on n-h2-768852-23 Jul 14 14:39:45.544171 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-09695e87-50ba-469f-8fbb-146b8dc27e74 req-9241eb42-4fca-4e09-b395-c1fc6a3d9b5e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077046 Jul 14 14:39:45.544792 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 469/910] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:45.551570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:45.552858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:45.561096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.561860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.562923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.563436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.583049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=95,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:45.614297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.615583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.616237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lazy-loading 'fault' on Instance uuid 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:45.708232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:45.725986 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95b727e8-41a1-41ca-aa1a-68ae8c8c644a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 200 len: 1309 microversion: 2.1 time: 0.179397 Jul 14 14:39:45.747839 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 470/911] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:45 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 1309 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:45.795836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:45.806523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:45.829812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.831110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:45.832712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:45.834167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:46.318693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:46.339569 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a13a3306-657d-4fb7-9dd5-5790bad64095 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1479 microversion: 2.1 time: 0.580513 Jul 14 14:39:46.355452 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 471/912] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:45 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1479 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:46.546064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:46.547924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:46.575916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:46.577785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:46.580925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:46.584896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.396884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:47.417241 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a3baf89-26b4-483d-943d-1fc3ba37b648 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1360 microversion: 2.1 time: 0.878280 Jul 14 14:39:47.426328 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 472/913] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:46 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1360 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:47.458025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:47.459978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 81f0b0a2-c53c-4559-bb48-31b8a10d23a9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:47.472085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.473434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.475429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.476553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.523873 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 could not be found. Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 HTTP/1.1 Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:39:47.533210 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 could not be found. Jul 14 14:39:47.535542 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '81f0b0a2-c53c-4559-bb48-31b8a10d23a9'} Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 could not be found. Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:47.536526 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 could not be found. Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 could not be found. Jul 14 14:39:47.538424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:39:47.560724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance 81f0b0a2-c53c-4559-bb48-31b8a10d23a9 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:47.564959 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ad665f1-83d2-4f7a-bfca-fa61265bdcff tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9" status: 404 len: 111 microversion: 2.1 time: 0.135310 Jul 14 14:39:47.567757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 473/914] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:47 2022] GET /compute/v2.1/servers/81f0b0a2-c53c-4559-bb48-31b8a10d23a9 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:47.587102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:47.589235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:47.616214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.619966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.622983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.623932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.719321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:47.722833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:47.723869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lazy-loading 'fault' on Instance uuid e8909738-7b47-4e69-bbdd-e2eda2a35613 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:39:47.906251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679429de8da0408b93541374e89ce606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1dc5d177b084cfab1e0d4d9d1715fa3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:47.923882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-69080659-5736-4e2b-b2cc-30ad83ebd6e0 tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 200 len: 1313 microversion: 2.1 time: 0.353067 Jul 14 14:39:47.953473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 474/915] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:47 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:47.963058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ca84e9ec-2d98-4dfb-90fb-0d5d2d7f1dcf req-d6bec48c-5701-430d-b905-e1a62c6af9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8909738-7b47-4e69-bbdd-e2eda2a35613", "name": "network-vif-deleted", "tag": "dbe6d388-757a-486b-b2bf-76360da2d7f7"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:47.998482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ca84e9ec-2d98-4dfb-90fb-0d5d2d7f1dcf req-d6bec48c-5701-430d-b905-e1a62c6af9d4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.000279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ca84e9ec-2d98-4dfb-90fb-0d5d2d7f1dcf req-d6bec48c-5701-430d-b905-e1a62c6af9d4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.034926 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ca84e9ec-2d98-4dfb-90fb-0d5d2d7f1dcf req-d6bec48c-5701-430d-b905-e1a62c6af9d4 service nova] Creating event network-vif-deleted:dbe6d388-757a-486b-b2bf-76360da2d7f7 for instance e8909738-7b47-4e69-bbdd-e2eda2a35613 on n-h2-768852-23 Jul 14 14:39:48.046452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ca84e9ec-2d98-4dfb-90fb-0d5d2d7f1dcf req-d6bec48c-5701-430d-b905-e1a62c6af9d4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091414 Jul 14 14:39:48.051192 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 475/916] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:48.059431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b35243c-f5c1-4d82-91fb-37079e7fd47d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:48.117880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:48.135536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b35243c-f5c1-4d82-91fb-37079e7fd47d tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/fe23445d-06fc-4f11-a147-7964616168d2" status: 204 len: 0 microversion: 2.1 time: 0.082343 Jul 14 14:39:48.137299 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 476/917] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:39:48 2022] DELETE /compute/v2.1/os-server-groups/fe23445d-06fc-4f11-a147-7964616168d2 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:48.167202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:48.169283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:48.216023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.216023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.218235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.223442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.421463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:48.679765 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4b47bc0-59cc-47ae-8df2-6cf5ec1a573a tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 204 len: 0 microversion: 2.1 time: 0.532476 Jul 14 14:39:48.687755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 477/918] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:48 2022] DELETE /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:48.697696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:48.698936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:48.712699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.714376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.717007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.717605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.855541 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3f097f0-848a-4e02-beb4-6efb347dcaea tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/838d2977-2f87-478e-bcb1-182fd480d1e3" status: 202 len: 0 microversion: 2.1 time: 3.329565 Jul 14 14:39:48.856487 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 442/919] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:39:45 2022] DELETE /compute/v2.1/os-floating-ips/838d2977-2f87-478e-bcb1-182fd480d1e3 => generated 0 bytes in 3331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:39:48.863025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:48.863606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:48.889014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.889720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:48.890814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:48.894436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.013402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:49.111689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:49.135111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80b44504-24f9-4bec-8538-f8e4a2c4d86b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1544 microversion: 2.1 time: 0.444398 Jul 14 14:39:49.147580 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 478/920] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:48 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1544 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:49.166146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'action', calling method: .version_select at 0x7fdc01ea8d30>, body: {"removeFloatingIp": {"address": "172.25.1.130"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:49.281364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fc17e924-10d4-4f04-aa5d-2a31171eb21e tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 204 len: 0 microversion: 2.1 time: 0.423554 Jul 14 14:39:49.286209 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 443/921] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:48 2022] DELETE /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:49.292948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:49.294058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] [instance: e8909738-7b47-4e69-bbdd-e2eda2a35613] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:49.302979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.303882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.305060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.305946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.325898 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] HTTP exception thrown: Instance e8909738-7b47-4e69-bbdd-e2eda2a35613 could not be found. Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Request method failure captured: Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 HTTP/1.1 Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CqL0DdbOvqR7lq10WzdMg_eJvZ4qtIVWGfy8JvcVwQ4HU908tKX7cFgAnuZLhpRkgtRMpO-vow5-Rih4k36yDSsg7ACLtLIGF9AWwkZXCC78fFMr7psl_u0mZkQuJU9iED3Jzj0gDNfd9yXMcURSp65zkoahz2FzwNu3rPDabY5X7s Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f1dc5d177b084cfab1e0d4d9d1715fa3 Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1227968876 Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:39:49.328339 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f1dc5d177b084cfab1e0d4d9d1715fa3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1227968876 Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f1dc5d177b084cfab1e0d4d9d1715fa3 Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1227968876 Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerDiagnosticsNegativeTest-1227968876-project Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 679429de8da0408b93541374e89ce606 Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1227968876-project Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance e8909738-7b47-4e69-bbdd-e2eda2a35613 could not be found. Jul 14 14:39:49.330141 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e8909738-7b47-4e69-bbdd-e2eda2a35613'} Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8909738-7b47-4e69-bbdd-e2eda2a35613 could not be found. Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:49.331089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8909738-7b47-4e69-bbdd-e2eda2a35613 could not be found. Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8909738-7b47-4e69-bbdd-e2eda2a35613 could not be found. Jul 14 14:39:49.332699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:49.335896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] Returning 404 to user: Instance e8909738-7b47-4e69-bbdd-e2eda2a35613 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:49.340194 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62ce20b7-3dae-452f-bbc0-676346ea7c6a tempest-ServerDiagnosticsNegativeTest-1227968876 tempest-ServerDiagnosticsNegativeTest-1227968876-project] 10.222.0.98 "GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613" status: 404 len: 111 microversion: 2.1 time: 0.049717 Jul 14 14:39:49.347708 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 444/922] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:49 2022] GET /compute/v2.1/servers/e8909738-7b47-4e69-bbdd-e2eda2a35613 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:49.353870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:49.354671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:49.364366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.365122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.366298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.366953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.372100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:39:49.491158 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-72c18b7b-decb-47ac-9581-f14cdc99a574 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.141782 Jul 14 14:39:49.492040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 445/923] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:39:49 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:49.498346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:49.499220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:49.517817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.521701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:49.522830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:49.527423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:50.197039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:50.218393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-793a4348-7787-4fc3-ac7f-feb3a8d28bbc tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1475 microversion: 2.1 time: 0.713946 Jul 14 14:39:50.231639 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 446/924] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:49 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1475 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:50.598975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:50.610238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:50.614920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:50.618394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:50.620763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:51.257438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:51.258616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:51.288837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:51.293242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:51.302547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:51.304123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:52.097657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Acquired lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:39:52.266208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:52.275043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e2566a5-7788-42a0-82ca-1cf9db39bd65 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1475 microversion: 2.1 time: 1.026196 Jul 14 14:39:52.275771 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 447/925] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:51 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1475 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:53.300088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:53.305623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:53.333381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.335888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:53.339013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:53.343382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.211486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:54.226939 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8130a7e8-5b48-43f6-87ce-93b408a87aa2 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1475 microversion: 2.1 time: 0.937791 Jul 14 14:39:54.231140 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 448/926] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:53 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1475 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:54.891398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Building network info cache for instance {{(pid=125966) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:39:54.904598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-420121e1-5ef9-4229-9ef7-ecab5d3679f0 req-e7907838-136c-44c0-a5db-a03847baee45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12", "tag": "5f8c4ef4-941b-455f-aa93-b927a9680207"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:54.938449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-420121e1-5ef9-4229-9ef7-ecab5d3679f0 req-e7907838-136c-44c0-a5db-a03847baee45 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:54.939826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-420121e1-5ef9-4229-9ef7-ecab5d3679f0 req-e7907838-136c-44c0-a5db-a03847baee45 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:54.970549 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-420121e1-5ef9-4229-9ef7-ecab5d3679f0 req-e7907838-136c-44c0-a5db-a03847baee45 service nova] Creating event network-changed:5f8c4ef4-941b-455f-aa93-b927a9680207 for instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 on n-h1-768852-23 Jul 14 14:39:54.978920 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-420121e1-5ef9-4229-9ef7-ecab5d3679f0 req-e7907838-136c-44c0-a5db-a03847baee45 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080305 Jul 14 14:39:54.979954 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 449/927] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:39:55.182961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-edba6967-9d52-41ee-8791-87c8e8f91d43 req-ad9db9f0-9829-443a-9230-0bc0318d385d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae7517a-302c-4bad-91ab-8df53f487e52", "name": "network-vif-deleted", "tag": "c3a6b3cb-10c0-45a3-8e64-3425433c81f6"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:55.267884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-edba6967-9d52-41ee-8791-87c8e8f91d43 req-ad9db9f0-9829-443a-9230-0bc0318d385d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:55.268681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-edba6967-9d52-41ee-8791-87c8e8f91d43 req-ad9db9f0-9829-443a-9230-0bc0318d385d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:55.340657 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-edba6967-9d52-41ee-8791-87c8e8f91d43 req-ad9db9f0-9829-443a-9230-0bc0318d385d service nova] Creating event network-vif-deleted:c3a6b3cb-10c0-45a3-8e64-3425433c81f6 for instance 8ae7517a-302c-4bad-91ab-8df53f487e52 on n-h1-768852-23 Jul 14 14:39:55.392802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-edba6967-9d52-41ee-8791-87c8e8f91d43 req-ad9db9f0-9829-443a-9230-0bc0318d385d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217965 Jul 14 14:39:55.395340 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 450/928] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:39:55.416350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:55.417086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:55.463916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:55.464382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:55.474376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:55.476862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:56.019737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:56.028061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-130b81d4-f71f-4b49-ad6f-ced4340dcb43 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 200 len: 1304 microversion: 2.1 time: 0.625640 Jul 14 14:39:56.052142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 451/929] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:55 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 1304 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:57.060381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.061102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 8ae7517a-302c-4bad-91ab-8df53f487e52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:57.088103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.091708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.093004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.097967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.167524 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance 8ae7517a-302c-4bad-91ab-8df53f487e52 could not be found. Jul 14 14:39:57.177775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Updating instance_info_cache with network_info: [{"id": "5f8c4ef4-941b-455f-aa93-b927a9680207", "address": "fa:16:3e:33:1b:cd", "network": {"id": "849b71fc-e412-4904-8684-f09bf3d0d560", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-893385686-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "597ba1a6e8624db1841a02a6f544039d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap5f8c4ef4-94", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125966) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 HTTP/1.1 Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:39:57.189628 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 8ae7517a-302c-4bad-91ab-8df53f487e52 could not be found. Jul 14 14:39:57.191914 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '8ae7517a-302c-4bad-91ab-8df53f487e52'} Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae7517a-302c-4bad-91ab-8df53f487e52 could not be found. Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:57.192840 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae7517a-302c-4bad-91ab-8df53f487e52 could not be found. Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae7517a-302c-4bad-91ab-8df53f487e52 could not be found. Jul 14 14:39:57.194168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.196822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance 8ae7517a-302c-4bad-91ab-8df53f487e52 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:57.201896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Releasing lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:39:57.204811 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5335f1be-fca8-4582-9b20-879db70d230c tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action" status: 202 len: 0 microversion: 2.1 time: 8.062216 Jul 14 14:39:57.205034 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-becb6d0f-33ce-414f-acc0-ac2a235bc3c8 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52" status: 404 len: 111 microversion: 2.1 time: 0.149465 Jul 14 14:39:57.210536 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 452/930] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:57 2022] GET /compute/v2.1/servers/8ae7517a-302c-4bad-91ab-8df53f487e52 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:39:57.219379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 479/931] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:39:49 2022] POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action => generated 0 bytes in 8077 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:39:57.223910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.226065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: c489130c-3390-441e-8a0c-9ccdc783c8be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:57.238991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4985b66d-45ca-4bc7-9407-7dd6fbba443b tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '.version_select at 0x7fdbf3883280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.243913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.249557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.250776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.251458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.296285 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance c489130c-3390-441e-8a0c-9ccdc783c8be could not be found. Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be HTTP/1.1 Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:39:57.298350 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance c489130c-3390-441e-8a0c-9ccdc783c8be could not be found. Jul 14 14:39:57.300387 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c489130c-3390-441e-8a0c-9ccdc783c8be'} Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c489130c-3390-441e-8a0c-9ccdc783c8be could not be found. Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:39:57.301135 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c489130c-3390-441e-8a0c-9ccdc783c8be could not be found. Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c489130c-3390-441e-8a0c-9ccdc783c8be could not be found. Jul 14 14:39:57.302317 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:39:57.307500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance c489130c-3390-441e-8a0c-9ccdc783c8be could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:39:57.308799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d40b21e2-9935-46e7-be46-d90000dbd121 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be" status: 404 len: 111 microversion: 2.1 time: 0.096645 Jul 14 14:39:57.309973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 453/932] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:57 2022] GET /compute/v2.1/servers/c489130c-3390-441e-8a0c-9ccdc783c8be => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:39:57.324591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f36b48b-f19a-486a-850b-40631cc67f9c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.396746 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f36b48b-f19a-486a-850b-40631cc67f9c tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/0937d67c-8842-4a46-9ce2-18fb43d96910" status: 204 len: 0 microversion: 2.1 time: 0.078705 Jul 14 14:39:57.398080 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 454/933] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:39:57 2022] DELETE /compute/v2.1/os-server-groups/0937d67c-8842-4a46-9ce2-18fb43d96910 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:57.406735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.409658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:57.422976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.427635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.431615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.432679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.510616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:39:57.764469 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-09c39d0d-98a4-4618-8227-34736977afb5 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "DELETE /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 204 len: 0 microversion: 2.1 time: 0.360518 Jul 14 14:39:57.769097 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 455/934] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:39:57 2022] DELETE /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:39:57.782242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-aa2ebc13-0ee2-441f-a866-0ba29beb9d67 req-0a162434-a6a5-4bec-a32f-525ddb1d9c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c489130c-3390-441e-8a0c-9ccdc783c8be", "name": "network-vif-deleted", "tag": "3df1e062-8916-4cfc-b355-1f1fdf623d4d"}, {"name": "network-changed", "server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:39:57.810394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aa2ebc13-0ee2-441f-a866-0ba29beb9d67 req-0a162434-a6a5-4bec-a32f-525ddb1d9c8a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.810846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aa2ebc13-0ee2-441f-a866-0ba29beb9d67 req-0a162434-a6a5-4bec-a32f-525ddb1d9c8a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.855857 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-aa2ebc13-0ee2-441f-a866-0ba29beb9d67 req-0a162434-a6a5-4bec-a32f-525ddb1d9c8a service nova] Creating event network-vif-deleted:3df1e062-8916-4cfc-b355-1f1fdf623d4d for instance c489130c-3390-441e-8a0c-9ccdc783c8be on n-h1-768852-23 Jul 14 14:39:57.856258 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-aa2ebc13-0ee2-441f-a866-0ba29beb9d67 req-0a162434-a6a5-4bec-a32f-525ddb1d9c8a service nova] Creating event network-changed:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h2-768852-23 Jul 14 14:39:57.867011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-aa2ebc13-0ee2-441f-a866-0ba29beb9d67 req-0a162434-a6a5-4bec-a32f-525ddb1d9c8a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.098090 Jul 14 14:39:57.867708 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 456/935] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:39:57.896582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:57.902751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:57.930143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.933064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:57.935421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:57.937146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:58.285033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:39:58.297746 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fbeb91a1-6373-4cdd-8d92-1fbcb95f86a0 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1472 microversion: 2.1 time: 0.422174 Jul 14 14:39:58.302340 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 457/936] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:57 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1472 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:39:59.333047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:39:59.337683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:39:59.385014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:59.388127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:39:59.395997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:39:59.397354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.225978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:00.252150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b4722ca0-0a52-4573-93fe-9bb101aa30ce tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1472 microversion: 2.1 time: 0.933993 Jul 14 14:40:00.272522 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 458/937] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:39:59 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1472 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:00.603062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:DELETE=1,nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:00.626238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:00.626983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:00.649914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:00.660124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.665845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:00.666666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:00.857724 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4985b66d-45ca-4bc7-9407-7dd6fbba443b tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/ed707974-30bd-4a5d-ac0c-d60addc291ae" status: 202 len: 0 microversion: 2.1 time: 3.633351 Jul 14 14:40:00.858596 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 480/938] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:39:57 2022] DELETE /compute/v2.1/os-floating-ips/ed707974-30bd-4a5d-ac0c-d60addc291ae => generated 0 bytes in 3636 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:01.260787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1364677896", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:01.309713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:01.346355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:01.349269 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e23e3b24-0300-42e2-a50d-11bb051f2002 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 2341 microversion: 2.25 time: 0.727008 Jul 14 14:40:01.351397 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 459/939] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:00 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 2341 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:40:01.365622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a98d404-7bac-4418-ae90-48585b010362 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'action', calling method: .version_select at 0x7fdc01d27c10>, body: {"addFloatingIp": {"address": ""}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a98d404-7bac-4418-ae90-48585b010362 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Request method failure captured: Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action HTTP/1.1 Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 34 Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cp5JrHLRQJB6WC8HqAN3qaFsWMS803-1qM2kZHNU-l_pQ7H5c6GbvfUHxaP-sbfi-XFImWv63Dkxv2bKHiXRdKf6kk1PF4Va6DaVaEtNleyqDq85PARMVWp6qigSxpCtKj69BTw7K0AHE9BWd5W61TDWy6iK17H4hxm48fZwSOC5PE Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:01.370648 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2cd356b55fa24209a77907ca05fc0315 Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: {"addFloatingIp": {"address": ""}} Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:01.372157 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'd1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12', 'body': {'addFloatingIp': {'address': ''}}} Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi '' Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:01.373120 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:40:01.374519 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:40:01.375832 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Jul 14 14:40:01.375832 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:01.386258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a98d404-7bac-4418-ae90-48585b010362 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:01.387771 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a98d404-7bac-4418-ae90-48585b010362 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action" status: 400 len: 142 microversion: 2.1 time: 0.034271 Jul 14 14:40:01.388544 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 460/940] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:40:01 2022] POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action => generated 142 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:40:01.400499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:01.401570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:01.409400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.410226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.411247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.412610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.529749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:01.540684 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cf24d7b9-bbd2-4da9-bef8-c0f2e7ef04e4 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1430 microversion: 2.1 time: 0.146166 Jul 14 14:40:01.542119 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 461/941] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:01 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1430 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:01.547368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f1113365-64e9-4d90-aa8a-33458b2446df tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:01.550459 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:01.550459 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:40:01.552343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1113365-64e9-4d90-aa8a-33458b2446df tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.553067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1113365-64e9-4d90-aa8a-33458b2446df tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.554166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1113365-64e9-4d90-aa8a-33458b2446df tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.555035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1113365-64e9-4d90-aa8a-33458b2446df tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.592233 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f1113365-64e9-4d90-aa8a-33458b2446df tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.048679 Jul 14 14:40:01.593678 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 462/942] 10.222.0.98 () {60 vars in 1216 bytes} [Thu Jul 14 14:40:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:40:01.599829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:01.601321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:01.613096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.613943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.615366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:01.616070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:01.838851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Acquired lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:40:02.016537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:02.018643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:02.019501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:02.020209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:02.021112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:02.071365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.075255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.077126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.084285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.141995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Getting quotas for project db181b6ddf3f42629734e66aeb2f0e3f. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:02.156379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Getting quotas for user 2643b694761c4380a7a37fe64add9423 and project db181b6ddf3f42629734e66aeb2f0e3f. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:02.194838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:02.198437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:02.335762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e81935fe-a593-4905-90ca-0f4f16cccf76 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.476226 Jul 14 14:40:02.336872 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 481/943] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:40:02.342787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3cf2fcbb-664e-4a6e-ac46-b7925622cd86 req-335d9b6c-1047-474e-b5e6-b4b6707c6331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "859ce988-fadf-44f6-b941-5639f6ccd35f", "name": "network-vif-deleted", "tag": "f5e94c64-02eb-45cc-b797-b9eae480e80a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:02.356454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3cf2fcbb-664e-4a6e-ac46-b7925622cd86 req-335d9b6c-1047-474e-b5e6-b4b6707c6331 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.357388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3cf2fcbb-664e-4a6e-ac46-b7925622cd86 req-335d9b6c-1047-474e-b5e6-b4b6707c6331 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.385034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3cf2fcbb-664e-4a6e-ac46-b7925622cd86 req-335d9b6c-1047-474e-b5e6-b4b6707c6331 service nova] Creating event network-vif-deleted:f5e94c64-02eb-45cc-b797-b9eae480e80a for instance 859ce988-fadf-44f6-b941-5639f6ccd35f on n-h2-768852-23 Jul 14 14:40:02.398778 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3cf2fcbb-664e-4a6e-ac46-b7925622cd86 req-335d9b6c-1047-474e-b5e6-b4b6707c6331 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060236 Jul 14 14:40:02.408561 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 482/944] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:02.448388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1913062066", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:02.590779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:02.722347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Releasing lock "refresh_cache-d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:40:02.723259 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] HTTP exception thrown: floating IP not found Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Request method failure captured: Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action HTTP/1.1 Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 41 Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cp5JrHLRQJB6WC8HqAN3qaFsWMS803-1qM2kZHNU-l_pQ7H5c6GbvfUHxaP-sbfi-XFImWv63Dkxv2bKHiXRdKf6kk1PF4Va6DaVaEtNleyqDq85PARMVWp6qigSxpCtKj69BTw7K0AHE9BWd5W61TDWy6iK17H4hxm48fZwSOC5PE Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:02.725781 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2cd356b55fa24209a77907ca05fc0315 Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: {"addFloatingIp": {"address": "0.0.0.0"}} Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: exception: floating IP not found Jul 14 14:40:02.727169 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'd1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:02.728079 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Jul 14 14:40:02.729220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:02.734639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Returning 404 to user: floating IP not found {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:02.736097 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80991060-4b9d-4f01-99bc-2db3891af5c0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action" status: 404 len: 67 microversion: 2.1 time: 1.140957 Jul 14 14:40:02.737749 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 463/945] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:40:01 2022] POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action => generated 67 bytes in 1143 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:02.760595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:02.767256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:02.796592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.797447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.798809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.800107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.888443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:02.889655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:02.889655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lazy-loading 'fault' on Instance uuid 859ce988-fadf-44f6-b941-5639f6ccd35f {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:02.977838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cdac1d4106674c7ab0cfe39939de9d7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f14b1548c547608944442a8a351e56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:02.992387 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b3184fa-7d91-4d8d-9fbf-ab3ef8f30066 tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 200 len: 1307 microversion: 2.1 time: 0.252893 Jul 14 14:40:02.993944 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 464/946] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:02 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:02.999330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d04c335b-9e2c-45b8-a3dc-8f2a7c30fd03 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Action: 'action', calling method: .version_select at 0x7fdc01ea9280>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:03.186267 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d04c335b-9e2c-45b8-a3dc-8f2a7c30fd03 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d04c335b-9e2c-45b8-a3dc-8f2a7c30fd03 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Request method failure captured: Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action HTTP/1.1 Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 44 Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cp5JrHLRQJB6WC8HqAN3qaFsWMS803-1qM2kZHNU-l_pQ7H5c6GbvfUHxaP-sbfi-XFImWv63Dkxv2bKHiXRdKf6kk1PF4Va6DaVaEtNleyqDq85PARMVWp6qigSxpCtKj69BTw7K0AHE9BWd5W61TDWy6iK17H4hxm48fZwSOC5PE Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:03.188547 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2cd356b55fa24209a77907ca05fc0315 Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: {"removeFloatingIp": {"address": "0.0.0.0"}} Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:03.189968 n-d-768852-23 devstack@n-api.service[125965]: exception: Floating IP not found for address 0.0.0.0. Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'd1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:03.190766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Jul 14 14:40:03.191947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:03.193254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d04c335b-9e2c-45b8-a3dc-8f2a7c30fd03 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:03.193254 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d04c335b-9e2c-45b8-a3dc-8f2a7c30fd03 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action" status: 404 len: 88 microversion: 2.1 time: 0.194866 Jul 14 14:40:03.193254 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 465/947] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:40:02 2022] POST /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12/action => generated 88 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:03.207725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:03.208237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:03.237276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.237657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.238387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.238844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.297216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:03.298474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:03.299953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:03.300727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:03.301374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:03.320018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.324974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.325845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:40:03.327077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.329660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.364253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:03.394208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Getting quotas for project db181b6ddf3f42629734e66aeb2f0e3f. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:03.415532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Getting quotas for user 2643b694761c4380a7a37fe64add9423 and project db181b6ddf3f42629734e66aeb2f0e3f. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:03.457483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:03.464770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:03.580969 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c1ef460-a76e-44d8-abbd-4f8f60441da1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138731 Jul 14 14:40:03.585870 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 483/948] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:40:03.599826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3fae8b72-c8b1-4a6e-a7d5-606ac1bf5be9 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 204 len: 0 microversion: 2.1 time: 0.396269 Jul 14 14:40:03.600421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e8bc6d5e-5d0c-4d5b-a8b6-24f3448a4c19 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:03.600795 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 466/949] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:03 2022] DELETE /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:40:03.604730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e8bc6d5e-5d0c-4d5b-a8b6-24f3448a4c19 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:03.620802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:03.621894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:03.636698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.644326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.645964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:03.646874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:03.782131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e8bc6d5e-5d0c-4d5b-a8b6-24f3448a4c19 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:03.789855 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e8bc6d5e-5d0c-4d5b-a8b6-24f3448a4c19 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1214 microversion: 2.1 time: 0.197914 Jul 14 14:40:03.807159 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 484/950] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:03 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1214 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:04.018819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:04.024959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] [instance: 859ce988-fadf-44f6-b941-5639f6ccd35f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:04.064816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:04.066667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:04.073042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:04.076729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:04.160751 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] HTTP exception thrown: Instance 859ce988-fadf-44f6-b941-5639f6ccd35f could not be found. Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Request method failure captured: Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f HTTP/1.1 Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CmpKHM9U9Zl1UvS3hppueNdT6kswvLcZVAejMWlIuHApHCPxBixiavd7CV4G6j3QWSdfAn3huof57qyTJIrm1num4tJSGu_BYgBFhBftrWrQWzWMsHuIUcmSeg77X5Fbas1TAfv5Pf37zbo7UHwLVFE4gN4tvflnyhNSO2uIL_KCPk Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:04.169889 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9f14b1548c547608944442a8a351e56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9f14b1548c547608944442a8a351e56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9f14b1548c547608944442a8a351e56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9f14b1548c547608944442a8a351e56 Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-279078030 Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cdac1d4106674c7ab0cfe39939de9d7b Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersOnMultiNodesTest-279078030-project Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 859ce988-fadf-44f6-b941-5639f6ccd35f could not be found. Jul 14 14:40:04.172775 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '859ce988-fadf-44f6-b941-5639f6ccd35f'} Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 859ce988-fadf-44f6-b941-5639f6ccd35f could not be found. Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:04.175029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 859ce988-fadf-44f6-b941-5639f6ccd35f could not be found. Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 859ce988-fadf-44f6-b941-5639f6ccd35f could not be found. Jul 14 14:40:04.178042 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:04.188958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] Returning 404 to user: Instance 859ce988-fadf-44f6-b941-5639f6ccd35f could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:04.192552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c24ea6f2-5307-4dbd-bfb9-d2c4db4a40ac tempest-ServersOnMultiNodesTest-279078030 tempest-ServersOnMultiNodesTest-279078030-project] 10.222.0.98 "GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f" status: 404 len: 111 microversion: 2.1 time: 0.185224 Jul 14 14:40:04.194291 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 485/951] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:04 2022] GET /compute/v2.1/servers/859ce988-fadf-44f6-b941-5639f6ccd35f => generated 111 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:40:04.493454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:04.515753 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b17b7a0c-8859-4983-a346-235c8b2cd8e0 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1540 microversion: 2.1 time: 0.909798 Jul 14 14:40:04.521063 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 467/952] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:03 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1540 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:04.811919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-223d2655-7d31-4209-aff1-b576bd2329f7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:04.813075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-223d2655-7d31-4209-aff1-b576bd2329f7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:05.022607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-223d2655-7d31-4209-aff1-b576bd2329f7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:05.044611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-223d2655-7d31-4209-aff1-b576bd2329f7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1214 microversion: 2.1 time: 0.239643 Jul 14 14:40:05.045964 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 486/953] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:04 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:05.538263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:05.542160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:05.584365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:05.585415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:05.591231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:05.592165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:06.084343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:06.085071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:06.113618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:06.114101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:06.121362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:06.125251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:06.461680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:06.495910 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9fc500b5-fc01-4c51-867b-bcd08fd28d60 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1266 microversion: 2.1 time: 0.436289 Jul 14 14:40:06.509726 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 487/954] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:06 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1266 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:06.762419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf7d00a6-7712-4cbe-93fe-bd2ed5cb5f8a", "device": "/dev/xvdb"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:06.765099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:06.774528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:06.775420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:06.777514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:06.778794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:07.201389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:07.252827 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56f42bb2-7007-4f8e-a5c6-6cd2629cb4a8 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1540 microversion: 2.1 time: 1.705567 Jul 14 14:40:07.259149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 468/955] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:05 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1540 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:07.523924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:07.526337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:07.592555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:07.594520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:07.603930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:07.605821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:07.970730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:07.994830 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b8eb2d7-f20a-4a24-b320-8c35a9d6bd6d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1272 microversion: 2.1 time: 0.482548 Jul 14 14:40:07.998123 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 469/956] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:07 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1272 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:08.014819 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec7f6635-8da0-405c-b8cd-3c94149fab19 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "POST /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.256281 Jul 14 14:40:08.016693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 488/957] 10.222.0.98 () {62 vars in 1363 bytes} [Thu Jul 14 14:40:06 2022] POST /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 194 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:40:08.278041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:08.279829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:08.301867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:08.310083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:08.312390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:08.318069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.024475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:09.025375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:09.040388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.055356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.056446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:09.057257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:09.878053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2cd356b55fa24209a77907ca05fc0315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597ba1a6e8624db1841a02a6f544039d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:09.891651 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16530dd5-23f3-4f15-8bc4-066d6575bb64 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 200 len: 1540 microversion: 2.1 time: 1.619799 Jul 14 14:40:09.893024 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 470/958] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:08 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 1540 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:09.922494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:09.948579 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-747fbc57-d716-46b5-8084-243dbd740575 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 0.928616 Jul 14 14:40:09.955503 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 489/959] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:09 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:10.015215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1dd23a8c-a116-482b-8a81-a9c620324e2e req-b8f7de4e-5af4-4826-9e92-939ac047e605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12", "name": "network-vif-deleted", "tag": "5f8c4ef4-941b-455f-aa93-b927a9680207"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:10.039802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1dd23a8c-a116-482b-8a81-a9c620324e2e req-b8f7de4e-5af4-4826-9e92-939ac047e605 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.052053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1dd23a8c-a116-482b-8a81-a9c620324e2e req-b8f7de4e-5af4-4826-9e92-939ac047e605 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.085088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1dd23a8c-a116-482b-8a81-a9c620324e2e req-b8f7de4e-5af4-4826-9e92-939ac047e605 service nova] Creating event network-vif-deleted:5f8c4ef4-941b-455f-aa93-b927a9680207 for instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 on n-h1-768852-23 Jul 14 14:40:10.102050 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1dd23a8c-a116-482b-8a81-a9c620324e2e req-b8f7de4e-5af4-4826-9e92-939ac047e605 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091067 Jul 14 14:40:10.103563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 471/960] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:10.277389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:10.277953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:10.298781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.300406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.303143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.304931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.377279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:10.389463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:40:10.616169 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec19f7be-d7ff-42c3-a0e1-18e2aefa5e0e tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 204 len: 0 microversion: 2.1 time: 0.342676 Jul 14 14:40:10.620674 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 490/961] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:10 2022] DELETE /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:10.632202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:10.633354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:10.648291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.653246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.654196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.654651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.916737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:10.917535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] [instance: d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:10.924269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.956600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:10.958600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:10.965402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:11.056837 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] HTTP exception thrown: Instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 could not be found. Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Request method failure captured: Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 HTTP/1.1 Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cp5JrHLRQJB6WC8HqAN3qaFsWMS803-1qM2kZHNU-l_pQ7H5c6GbvfUHxaP-sbfi-XFImWv63Dkxv2bKHiXRdKf6kk1PF4Va6DaVaEtNleyqDq85PARMVWp6qigSxpCtKj69BTw7K0AHE9BWd5W61TDWy6iK17H4hxm48fZwSOC5PE Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:11.061891 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/597ba1a6e8624db1841a02a6f544039d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 597ba1a6e8624db1841a02a6f544039d Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872 Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2cd356b55fa24209a77907ca05fc0315 Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 could not be found. Jul 14 14:40:11.063896 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12'} Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 could not be found. Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:11.064750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 could not be found. Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 could not be found. Jul 14 14:40:11.066672 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:11.073911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] Returning 404 to user: Instance d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:11.078654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3bbae1a0-d4d4-4d30-96b6-8c62e82f51f3 tempest-FloatingIPsAssociationNegativeTestJSON-501912872 tempest-FloatingIPsAssociationNegativeTestJSON-501912872-project] 10.222.0.98 "GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12" status: 404 len: 111 microversion: 2.1 time: 0.166294 Jul 14 14:40:11.082649 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 491/962] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:10 2022] GET /compute/v2.1/servers/d1eb11cd-1eb1-4a6d-943b-ab83f4a3ea12 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:40:11.096715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:11.097678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:11.105930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:11.107598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:11.108772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:11.109702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:11.573375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:12.010682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:12.032448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f46b3bd1-1a05-4572-927c-7fcbe85f1725 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 0.940218 Jul 14 14:40:12.046778 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 492/963] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:11 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:12.060271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:12.117497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb1593fd-6773-4486-a586-4559d7ff96ae tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1711 microversion: 2.1 time: 1.489654 Jul 14 14:40:12.140348 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 472/964] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:10 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1711 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:12.318928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-860a60e8-2ba7-40fe-8f8f-37a3f8c4b029 req-3dc44097-8966-409a-82f2-330e0b68b02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9532228c-4202-46fb-88f8-c732f76102b2", "tag": "7d2e6e6f-3de7-42cd-8f73-6f82ed24d4e9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:12.339876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-860a60e8-2ba7-40fe-8f8f-37a3f8c4b029 req-3dc44097-8966-409a-82f2-330e0b68b02d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:12.340317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-860a60e8-2ba7-40fe-8f8f-37a3f8c4b029 req-3dc44097-8966-409a-82f2-330e0b68b02d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:12.381448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-860a60e8-2ba7-40fe-8f8f-37a3f8c4b029 req-3dc44097-8966-409a-82f2-330e0b68b02d service nova] Creating event network-changed:7d2e6e6f-3de7-42cd-8f73-6f82ed24d4e9 for instance 9532228c-4202-46fb-88f8-c732f76102b2 on n-h1-768852-23 Jul 14 14:40:12.398959 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-860a60e8-2ba7-40fe-8f8f-37a3f8c4b029 req-3dc44097-8966-409a-82f2-330e0b68b02d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076177 Jul 14 14:40:12.403409 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 493/965] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:13.050777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:13.052252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:13.065905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.067582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:13.071874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.072793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:13.149840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:13.150660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:13.164491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.165221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:13.166907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:13.172002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:13.354012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:13.985169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:13.998344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b3fdc5ee-4ae6-4d6a-8247-01b8a1fc4f36 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1711 microversion: 2.1 time: 0.852724 Jul 14 14:40:13.999612 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 494/966] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:13 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1711 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:14.330717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c13e17c-ec97-4f03-ac29-042017ae35f5 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:14.332428 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:14.332428 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:40:14.335635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c13e17c-ec97-4f03-ac29-042017ae35f5 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.336193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c13e17c-ec97-4f03-ac29-042017ae35f5 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.337103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c13e17c-ec97-4f03-ac29-042017ae35f5 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.351079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c13e17c-ec97-4f03-ac29-042017ae35f5 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.494722 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c13e17c-ec97-4f03-ac29-042017ae35f5 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.465738 Jul 14 14:40:14.512863 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 495/967] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:40:14 2022] GET /compute/v2.1/os-services => generated 949 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:14.544327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-458adcdc-a1a4-4352-ac8c-c917c003980f tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:14.569317 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:14.569317 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:40:14.571123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458adcdc-a1a4-4352-ac8c-c917c003980f tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.571814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458adcdc-a1a4-4352-ac8c-c917c003980f tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.572831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458adcdc-a1a4-4352-ac8c-c917c003980f tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.574189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458adcdc-a1a4-4352-ac8c-c917c003980f tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.647336 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-458adcdc-a1a4-4352-ac8c-c917c003980f tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?host=n-d-768852-23" status: 200 len: 581 microversion: 2.1 time: 0.132743 Jul 14 14:40:14.648288 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 496/968] 10.222.0.98 () {58 vars in 1173 bytes} [Thu Jul 14 14:40:14 2022] GET /compute/v2.1/os-services?host=n-d-768852-23 => generated 581 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:14.672865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5421e0ef-7179-4af3-b31f-9515d70c23cb tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:14.674637 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:14.674637 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:40:14.676534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5421e0ef-7179-4af3-b31f-9515d70c23cb tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.677103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5421e0ef-7179-4af3-b31f-9515d70c23cb tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.678009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5421e0ef-7179-4af3-b31f-9515d70c23cb tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.678446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5421e0ef-7179-4af3-b31f-9515d70c23cb tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.767029 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5421e0ef-7179-4af3-b31f-9515d70c23cb tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.097788 Jul 14 14:40:14.768243 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 497/969] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:40:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:14.791319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e63b584b-cb31-4533-90b5-7d14efa6dda7 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:14.793185 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:14.793185 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:40:14.795037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e63b584b-cb31-4533-90b5-7d14efa6dda7 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.795521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e63b584b-cb31-4533-90b5-7d14efa6dda7 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.796620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e63b584b-cb31-4533-90b5-7d14efa6dda7 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:14.800101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e63b584b-cb31-4533-90b5-7d14efa6dda7 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:14.870493 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e63b584b-cb31-4533-90b5-7d14efa6dda7 tempest-ServicesAdminTestJSON-938327170 tempest-ServicesAdminTestJSON-938327170-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.083209 Jul 14 14:40:14.879724 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 498/970] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:40:14 2022] GET /compute/v2.1/os-services => generated 949 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:15.031611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:15.032749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:15.040985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=16 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:15.045559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:15.048072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:15.049262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:15.053540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:15.131493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:15.188149 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d591800a-a4f8-4d98-ae44-322a5773194e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 2.131071 Jul 14 14:40:15.206312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 473/971] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:13 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:16.221542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:16.225008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:16.237411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=3,nova_api:DELETE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:16.269255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.271615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.274262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:16.280342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:16.293461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:16.317432 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5bb82182-a506-4027-a670-76c28fd047cb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1711 microversion: 2.1 time: 1.289387 Jul 14 14:40:16.334967 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 499/972] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:15 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1711 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:17.169487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:17.179754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b05e2ea-07f5-41f2-92d0-3565a515a036 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 0.966246 Jul 14 14:40:17.192617 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 474/973] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:16 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:17.364427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:17.365258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:17.378964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.379605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.380598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.383526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.639411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cdf18754-f4f8-416a-9878-605150212c6f req-601c2eb8-2099-4078-b43b-449db7235749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3911a3e7-b736-4f7b-beac-e479f8461261", "name": "network-vif-deleted", "tag": "e30d7cb5-3480-4ef2-94d6-1746f82d4903"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:17.669140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cdf18754-f4f8-416a-9878-605150212c6f req-601c2eb8-2099-4078-b43b-449db7235749 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:17.669677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cdf18754-f4f8-416a-9878-605150212c6f req-601c2eb8-2099-4078-b43b-449db7235749 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:17.712105 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cdf18754-f4f8-416a-9878-605150212c6f req-601c2eb8-2099-4078-b43b-449db7235749 service nova] Creating event network-vif-deleted:e30d7cb5-3480-4ef2-94d6-1746f82d4903 for instance 3911a3e7-b736-4f7b-beac-e479f8461261 on n-h2-768852-23 Jul 14 14:40:17.729161 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cdf18754-f4f8-416a-9878-605150212c6f req-601c2eb8-2099-4078-b43b-449db7235749 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095886 Jul 14 14:40:17.729808 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 475/974] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:18.024405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160fe1ec6b2d45e48990558af381a0ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab3c7bb172ef49c6a5154aee18c8a1bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:18.070130 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a955c65-8ba7-4ede-8ccd-0814cc0560b6 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 200 len: 1643 microversion: 2.1 time: 0.700192 Jul 14 14:40:18.071058 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 500/975] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:17 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 1643 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:18.201638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:18.202889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:18.213631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:18.218130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:18.219198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:18.228124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.088680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.089308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:19.101108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.101559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.102391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.114973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.185239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 HTTP/1.1 Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:19.197985 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:19.201341 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '3911a3e7-b736-4f7b-beac-e479f8461261'} Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:19.203094 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:19.206515 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.209242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:19.209242 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-46ef3a57-5879-4bf2-bb7d-7580eeeee4fb tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 404 len: 111 microversion: 2.1 time: 0.115005 Jul 14 14:40:19.215368 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 501/976] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:19 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:40:19.224546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.225762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:19.270981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.272650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.275765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.276587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.333226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 HTTP/1.1 Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:19.336820 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.338292 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '721a7dad-ae26-4f27-91f7-e71bd1adfad3'} Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:19.339036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.340306 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.341528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:19.353140 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bec28ff7-1ef0-4d67-8f50-ac259f3e2582 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 404 len: 111 microversion: 2.1 time: 0.135750 Jul 14 14:40:19.353830 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 502/977] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:19 2022] DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:19.396111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.397457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:19.453834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.461439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.464205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:19.465049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:19.508860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 HTTP/1.1 Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:19.518747 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.521411 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '721a7dad-ae26-4f27-91f7-e71bd1adfad3'} Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:19.523625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:19.525994 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:19.532564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:19.535055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bfa1096d-94c9-41b2-ade0-7b4018c6d602 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 404 len: 111 microversion: 2.1 time: 0.162394 Jul 14 14:40:19.537276 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 503/978] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:19 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:19.565800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ff7e670-acd2-40e3-895d-e074041249e4 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '.version_select at 0x7fdbf306e670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:19.590489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:19.606451 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e5ffe9c-3af2-4a8a-96eb-bbf0e8ad9bf7 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 1.409007 Jul 14 14:40:19.609887 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 476/979] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:18 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:19.632129 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ff7e670-acd2-40e3-895d-e074041249e4 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-135405226" status: 202 len: 0 microversion: 2.1 time: 0.089393 Jul 14 14:40:19.634397 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 504/980] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-135405226 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:20.627170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:20.628860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:20.651207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:20.652556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:20.659788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:20.660915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.007011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0ca81718-e8c8-4ef7-9595-8bf7ed1218d3 req-d9ec526e-326a-40e0-bc08-e339dacd8d03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28c69871-43bd-4251-ae79-02953e468fc7", "tag": "fb021a48-5a36-4cbf-8c24-ec016855b2a2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:22.080794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0ca81718-e8c8-4ef7-9595-8bf7ed1218d3 req-d9ec526e-326a-40e0-bc08-e339dacd8d03 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.081499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0ca81718-e8c8-4ef7-9595-8bf7ed1218d3 req-d9ec526e-326a-40e0-bc08-e339dacd8d03 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.123246 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0ca81718-e8c8-4ef7-9595-8bf7ed1218d3 req-d9ec526e-326a-40e0-bc08-e339dacd8d03 service nova] Creating event network-changed:fb021a48-5a36-4cbf-8c24-ec016855b2a2 for instance 28c69871-43bd-4251-ae79-02953e468fc7 on n-h1-768852-23 Jul 14 14:40:22.150555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0ca81718-e8c8-4ef7-9595-8bf7ed1218d3 req-d9ec526e-326a-40e0-bc08-e339dacd8d03 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149817 Jul 14 14:40:22.152002 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 505/981] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:22.395321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b550c072-9701-4c51-a8c1-2e044d8f62d2 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.396378 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:22.396378 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:40:22.401867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:22.442449 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b550c072-9701-4c51-a8c1-2e044d8f62d2 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1978985474" status: 202 len: 0 microversion: 2.1 time: 0.058783 Jul 14 14:40:22.447348 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 506/982] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:40:22 2022] DELETE /compute/v2.1/flavors/1978985474 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:40:22.457557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7675157a-87d6-45aa-a8ae-eb3e4a6a3905 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.500793 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7675157a-87d6-45aa-a8ae-eb3e4a6a3905 tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 5402 microversion: 2.1 time: 0.051589 Jul 14 14:40:22.502336 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 507/983] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:40:22 2022] GET /compute/v2.1/flavors/detail => generated 5402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:22.524909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54025d45-a735-4b82-96a8-6ee0a9fd413c tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.570941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54025d45-a735-4b82-96a8-6ee0a9fd413c tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/737895153" status: 202 len: 0 microversion: 2.1 time: 0.054885 Jul 14 14:40:22.575313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 508/984] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:40:22 2022] DELETE /compute/v2.1/flavors/737895153 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:40:22.591907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0b187e4-0efb-49bd-a51e-53f64dd9b29c tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.660146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0b187e4-0efb-49bd-a51e-53f64dd9b29c tempest-ServersWithSpecificFlavorTestJSON-81744704 tempest-ServersWithSpecificFlavorTestJSON-81744704-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.082004 Jul 14 14:40:22.670626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 509/985] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:40:22 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:22.716763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.718162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:22.732347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.745155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.746898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.753716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.786708 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 HTTP/1.1 Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:22.789312 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.790876 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '3911a3e7-b736-4f7b-beac-e479f8461261'} Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:22.791727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.793472 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.796526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:22.798382 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-329bf074-bf2f-42af-9e0d-f46b81537d74 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 404 len: 111 microversion: 2.1 time: 0.089851 Jul 14 14:40:22.802680 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 510/986] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:22 2022] DELETE /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:22.812035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.812676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 3911a3e7-b736-4f7b-beac-e479f8461261] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:22.820800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.821265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.822321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.823026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.844004 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 HTTP/1.1 Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:22.847068 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.848768 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '3911a3e7-b736-4f7b-beac-e479f8461261'} Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:22.849719 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. Jul 14 14:40:22.851210 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.853906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 3911a3e7-b736-4f7b-beac-e479f8461261 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:22.855224 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ebf2255-e762-48cd-b9dd-908e7dda30e0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261" status: 404 len: 111 microversion: 2.1 time: 0.048307 Jul 14 14:40:22.856809 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 511/987] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:22 2022] GET /compute/v2.1/servers/3911a3e7-b736-4f7b-beac-e479f8461261 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:40:22.875018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.877597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:22.910618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.911646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.913394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:22.914489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:22.959735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 HTTP/1.1 Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:22.963862 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:22.966934 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '721a7dad-ae26-4f27-91f7-e71bd1adfad3'} Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:22.970328 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:22.972448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:22.975061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:22.983633 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3bccf0fb-9c8f-40e1-a02e-33673e504ecc tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 404 len: 111 microversion: 2.1 time: 0.110878 Jul 14 14:40:22.983633 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 512/988] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:40:22 2022] DELETE /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:22.995464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:22.996526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] [instance: 721a7dad-ae26-4f27-91f7-e71bd1adfad3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:23.005184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:23.011074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:23.012911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:23.016499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:23.018342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:23.029422 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-34ade708-8de7-4483-9397-759cab59065d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 2.401031 Jul 14 14:40:23.044215 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 477/989] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:20 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 2421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:23.062679 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] HTTP exception thrown: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Request method failure captured: Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 HTTP/1.1 Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoYCR4UIzknej_J5tw4FhuwnQPSjpQx7p6IbcXaz6yjoVO02lIu0z9vpCJbks_fTk4Co9URenGfJDG6bCKaJrXK0zwnwX9PedeaLbMmROhZNxLJn7jKOXcapoIek9W-VnAsuvOw8Cv9QXdscE2Z9OduRlZ0S84aHWX_4TwyZBRtSUA Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:23.073473 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ab3c7bb172ef49c6a5154aee18c8a1bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ab3c7bb172ef49c6a5154aee18c8a1bd Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032 Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 160fe1ec6b2d45e48990558af381a0ef Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1604520032-project Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:23.075916 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '721a7dad-ae26-4f27-91f7-e71bd1adfad3'} Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:23.076900 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. Jul 14 14:40:23.078425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:23.079889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] Returning 404 to user: Instance 721a7dad-ae26-4f27-91f7-e71bd1adfad3 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:23.082322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a94f2328-4650-4453-ae71-dc1c0459b2b0 tempest-ServersWithSpecificFlavorTestJSON-1604520032 tempest-ServersWithSpecificFlavorTestJSON-1604520032-project] 10.222.0.98 "GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3" status: 404 len: 111 microversion: 2.1 time: 0.096460 Jul 14 14:40:23.090594 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 513/990] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:22 2022] GET /compute/v2.1/servers/721a7dad-ae26-4f27-91f7-e71bd1adfad3 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:40:24.033964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-da5d59d7-e1bc-4365-95e8-fb76dd19adca req-57896480-569b-4bb6-bced-6ab1ff8256a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9532228c-4202-46fb-88f8-c732f76102b2", "name": "network-vif-plugged", "status": "completed", "tag": "7d2e6e6f-3de7-42cd-8f73-6f82ed24d4e9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:24.062933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:24.065286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:24.066167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-da5d59d7-e1bc-4365-95e8-fb76dd19adca req-57896480-569b-4bb6-bced-6ab1ff8256a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.069286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-da5d59d7-e1bc-4365-95e8-fb76dd19adca req-57896480-569b-4bb6-bced-6ab1ff8256a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:24.097398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.101310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:24.102845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:24.103696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:24.142729 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-da5d59d7-e1bc-4365-95e8-fb76dd19adca req-57896480-569b-4bb6-bced-6ab1ff8256a8 service nova] Creating event network-vif-plugged:7d2e6e6f-3de7-42cd-8f73-6f82ed24d4e9 for instance 9532228c-4202-46fb-88f8-c732f76102b2 on n-h1-768852-23 Jul 14 14:40:24.165470 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-da5d59d7-e1bc-4365-95e8-fb76dd19adca req-57896480-569b-4bb6-bced-6ab1ff8256a8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143322 Jul 14 14:40:24.171077 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 478/991] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:24.830905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:24.899015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:24.922059 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c7661e5e-fefc-4114-9455-87e96620f96c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 0.865954 Jul 14 14:40:24.955229 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 514/992] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:24 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:25.239877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d29a8657-ac7b-47b2-852f-2162979ba38e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Action: 'create', calling method: .version_select at 0x7fdbf30d0310>, body: {"keypair": {"name": "tempest-keypair-860994581", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpYrL8E9hB0oVC8AuTFV9Nk65PDXg8iNAVEk3EaM9CUWmHvvVRH0oBlX80A6+lYk8CSX9g9BF5NUT1MiFQc7UK8lhg9TL81qaxODMs9DYi4imnGdKU2/Htc+XMZrUGg0w=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:25.288075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-d29a8657-ac7b-47b2-852f-2162979ba38e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Getting quotas for project 2a999d9d8991476983a97cb975c6302a. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:25.300008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-d29a8657-ac7b-47b2-852f-2162979ba38e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Getting quotas for user 2deda01949ad4a5eb16842b00afe7567 and project 2a999d9d8991476983a97cb975c6302a. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:25.357217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d29a8657-ac7b-47b2-852f-2162979ba38e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.561029 Jul 14 14:40:25.372114 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 479/993] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:40:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:25.971171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:25.976043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:26.007709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:26.011699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:26.016859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:26.018338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:27.775242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:27.808124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-840b13de-c5e2-4675-9a88-782689398121 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1314 microversion: 2.1 time: 1.840973 Jul 14 14:40:27.809540 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 515/994] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:25 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1314 bytes in 1847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:28.282740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:28.298762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:28.354328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.357327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.361879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.362779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.842502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:28.855891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:28.885629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.897291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:28.898857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:28.899690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.296319 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e01c9ce-fc92-4033-970f-a6922b78b05f tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1816 microversion: 2.1 time: 1.023107 Jul 14 14:40:29.299668 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 480/995] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:28 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1816 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:29.326099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00ed6217-e569-4fe7-a173-a99334de2f06 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:29.327637 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:40:29.327637 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:40:29.329157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00ed6217-e569-4fe7-a173-a99334de2f06 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:29.329638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00ed6217-e569-4fe7-a173-a99334de2f06 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.330494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00ed6217-e569-4fe7-a173-a99334de2f06 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:29.330925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00ed6217-e569-4fe7-a173-a99334de2f06 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:29.461499 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00ed6217-e569-4fe7-a173-a99334de2f06 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.139090 Jul 14 14:40:29.466867 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 481/996] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:40:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:30.072462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:30.074113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:30.117599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.118602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.122121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.122667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.745912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:30.761551 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0552f897-a3ba-4c05-8022-60d26231ad18 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1463 microversion: 2.1 time: 1.926656 Jul 14 14:40:30.762569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 516/997] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:28 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1463 bytes in 1929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:30.790165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:30.791191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:30.799928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.800937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:30.802024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:30.803492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.280345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:31.321038 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cb7478c3-82c0-4e65-a2a2-28d3f844854e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 2419 microversion: 2.25 time: 1.264379 Jul 14 14:40:31.323530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 482/998] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:30 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 2419 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:31.384571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": "auto"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:31.393547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:31.431608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.432381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.433774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:31.435413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:31.535093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'flavor' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:31.638759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Going to try to live migrate instance to n-h2-768852-23 {{(pid=125965) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:40:31.926275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:32.441423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:32.454130 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-91abca11-c92d-4cf5-a4a6-469a3bc9b054 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1314 microversion: 2.1 time: 1.668922 Jul 14 14:40:32.457042 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 517/999] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:30 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1314 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:32.687511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e29ec51-cab4-45fe-87be-e466fb058920", "device": "/dev/xvdb"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:32.688872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:32.698297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:32.698796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:32.699807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:32.711958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:33.336808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:33.386635 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ef8574d9-6158-45ae-a9c0-f59670d0ac9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "POST /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.704168 Jul 14 14:40:33.397075 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 518/1000] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:40:32 2022] POST /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 194 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:40:33.487548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:33.488651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:33.516032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:33.518171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:33.541154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:33.541902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.305576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:35.322541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:35.324595 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8032599e-12fe-423b-b61c-dce29465f41d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1314 microversion: 2.1 time: 1.842887 Jul 14 14:40:35.341168 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 519/1001] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:33 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1314 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:35.354860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e894b5b4-e2e1-4191-bca6-c9f28e853257 req-4bf1c90a-4c5d-4cae-b941-bc0197f2b3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c69871-43bd-4251-ae79-02953e468fc7", "name": "network-vif-plugged", "status": "completed", "tag": "fb021a48-5a36-4cbf-8c24-ec016855b2a2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:35.376123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e894b5b4-e2e1-4191-bca6-c9f28e853257 req-4bf1c90a-4c5d-4cae-b941-bc0197f2b3a0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:35.377562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e894b5b4-e2e1-4191-bca6-c9f28e853257 req-4bf1c90a-4c5d-4cae-b941-bc0197f2b3a0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:35.410019 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e894b5b4-e2e1-4191-bca6-c9f28e853257 req-4bf1c90a-4c5d-4cae-b941-bc0197f2b3a0 service nova] Creating event network-vif-plugged:fb021a48-5a36-4cbf-8c24-ec016855b2a2 for instance 28c69871-43bd-4251-ae79-02953e468fc7 on n-h1-768852-23 Jul 14 14:40:35.435432 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e894b5b4-e2e1-4191-bca6-c9f28e853257 req-4bf1c90a-4c5d-4cae-b941-bc0197f2b3a0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091899 Jul 14 14:40:35.439602 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 520/1002] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:35.928811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-822ef29b-4003-4775-90b9-5995f9ffe4f6 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Calling method '.version_select at 0x7fdbf3243e50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:36.014230 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-822ef29b-4003-4775-90b9-5995f9ffe4f6 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] HTTP exception thrown: Image not found. Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-822ef29b-4003-4775-90b9-5995f9ffe4f6 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Request method failure captured: Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/3c890950-f3c8-40eb-b75c-35158967d735/metadata/os_distro HTTP/1.1 Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CriK3DJWBmzrVW_WRtborOes93C57COaCuu9LGaJQHgJRAmDuAQs-rWiKiUaPwMWiyrwwgcKLloeeiRiamPRuvs30WEPclPp41AetF9qlkWR3zyzDV-BO4thVqM8D5dbGw9SwARZQH0iJW7Yxf_hcpx3tKXyTGFdeH3WBCb7-c71zg Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:36.035035 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 6661091c8dd84d48b029940abd8b76c3 Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'image_id': '3c890950-f3c8-40eb-b75c-35158967d735', 'id': 'os_distro'} Jul 14 14:40:36.036648 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:36.037531 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 3c890950-f3c8-40eb-b75c-35158967d735 Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:36.038856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 3c890950-f3c8-40eb-b75c-35158967d735 could not be found. Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:36.040501 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:36.041896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-822ef29b-4003-4775-90b9-5995f9ffe4f6 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:36.043225 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-822ef29b-4003-4775-90b9-5995f9ffe4f6 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] 10.222.0.98 "DELETE /compute/v2.1/images/3c890950-f3c8-40eb-b75c-35158967d735/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.591845 Jul 14 14:40:36.048478 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 521/1003] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 14:40:35 2022] DELETE /compute/v2.1/images/3c890950-f3c8-40eb-b75c-35158967d735/metadata/os_distro => generated 62 bytes in 598 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:36.072258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1738377614", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "9ace3d13-e3c2-4c42-82fb-f9f624fdc4bd"}], "security_groups": [{"name": "tempest-securitygroup--1098937592"}], "key_name": "tempest-keypair-860994581", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:36.851044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] validate_networks() for [('9ace3d13-e3c2-4c42-82fb-f9f624fdc4bd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:37.101142 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b8e7adc-a99e-44f6-b379-510d60a05235 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/action" status: 202 len: 0 microversion: 2.25 time: 5.747417 Jul 14 14:40:37.104700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 483/1004] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:40:31 2022] POST /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/action => generated 0 bytes in 5753 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:40:37.141204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e250bfb2-93a0-4f1f-bf2f-e87333087cd3 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Calling method '.version_select at 0x7fdbf30263a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:37.263861 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e250bfb2-93a0-4f1f-bf2f-e87333087cd3 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] HTTP exception thrown: Image not found. Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e250bfb2-93a0-4f1f-bf2f-e87333087cd3 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Request method failure captured: Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/images/33c35551-2453-484b-84c1-7d552ffa2d39/metadata/os_version HTTP/1.1 Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CriK3DJWBmzrVW_WRtborOes93C57COaCuu9LGaJQHgJRAmDuAQs-rWiKiUaPwMWiyrwwgcKLloeeiRiamPRuvs30WEPclPp41AetF9qlkWR3zyzDV-BO4thVqM8D5dbGw9SwARZQH0iJW7Yxf_hcpx3tKXyTGFdeH3WBCb7-c71zg Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:37.285979 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6661091c8dd84d48b029940abd8b76c3 Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'image_id': '33c35551-2453-484b-84c1-7d552ffa2d39', 'id': 'os_version'} Jul 14 14:40:37.288536 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:37.290732 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 33c35551-2453-484b-84c1-7d552ffa2d39 Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:37.294553 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 33c35551-2453-484b-84c1-7d552ffa2d39 could not be found. Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:37.299484 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:40:37.302788 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:37.305576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e250bfb2-93a0-4f1f-bf2f-e87333087cd3 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:37.306638 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e250bfb2-93a0-4f1f-bf2f-e87333087cd3 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] 10.222.0.98 "GET /compute/v2.1/images/33c35551-2453-484b-84c1-7d552ffa2d39/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.199924 Jul 14 14:40:37.307661 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 484/1005] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 14:40:37 2022] GET /compute/v2.1/images/33c35551-2453-484b-84c1-7d552ffa2d39/metadata/os_version => generated 62 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:37.333419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:37.334865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:37.372263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.376118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.382560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.387853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.830792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:37.847889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c9e76061-33e2-4606-b291-834f6f5b691f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1314 microversion: 2.1 time: 0.528901 Jul 14 14:40:37.850656 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 485/1006] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:37 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:37.862460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:37.865964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:37.885312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.886434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:37.888838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:37.890832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.852979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.867916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.875476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:38.879881 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f1c2fc2-1ce1-47af-8235-5c9e4701fd73 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.027945 Jul 14 14:40:38.880977 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 486/1007] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:37 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:38.893213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b4ef956-08bf-48b8-b395-cf8560f11501 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Calling method '.version_select at 0x7fdbf2f803a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:38.937505 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0b4ef956-08bf-48b8-b395-cf8560f11501 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] HTTP exception thrown: Image not found. Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b4ef956-08bf-48b8-b395-cf8560f11501 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Request method failure captured: Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/images/ebdbbe67-8fc9-47c7-9eda-d7aa158df1c6/metadata HTTP/1.1 Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CriK3DJWBmzrVW_WRtborOes93C57COaCuu9LGaJQHgJRAmDuAQs-rWiKiUaPwMWiyrwwgcKLloeeiRiamPRuvs30WEPclPp41AetF9qlkWR3zyzDV-BO4thVqM8D5dbGw9SwARZQH0iJW7Yxf_hcpx3tKXyTGFdeH3WBCb7-c71zg Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:38.940650 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6661091c8dd84d48b029940abd8b76c3 Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'image_id': 'ebdbbe67-8fc9-47c7-9eda-d7aa158df1c6'} Jul 14 14:40:38.942358 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:38.943754 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ebdbbe67-8fc9-47c7-9eda-d7aa158df1c6 Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:38.948714 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ebdbbe67-8fc9-47c7-9eda-d7aa158df1c6 could not be found. Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:38.950102 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:38.951560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b4ef956-08bf-48b8-b395-cf8560f11501 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:38.958736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b4ef956-08bf-48b8-b395-cf8560f11501 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] 10.222.0.98 "GET /compute/v2.1/images/ebdbbe67-8fc9-47c7-9eda-d7aa158df1c6/metadata" status: 404 len: 62 microversion: 2.1 time: 0.060822 Jul 14 14:40:38.958736 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 487/1008] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:40:38 2022] GET /compute/v2.1/images/ebdbbe67-8fc9-47c7-9eda-d7aa158df1c6/metadata => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:38.959086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:38.963413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:38.977308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.978331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:38.979446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:38.979446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.090204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:39.090731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:39.091203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:39.091665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:39.092114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:39.118754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.119203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.120045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:39.120704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:39.179069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Getting quotas for project 2a999d9d8991476983a97cb975c6302a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:39.185066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Getting quotas for user 2deda01949ad4a5eb16842b00afe7567 and project 2a999d9d8991476983a97cb975c6302a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:39.212598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:39.216698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:39.336492 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dda57e8a-3810-4766-8627-d59ac982d9a5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.290846 Jul 14 14:40:39.339111 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 522/1009] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 3294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:40:39.347459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:39.350280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c07a3a8a-a7b3-45c8-a72c-83ec0aac3a93 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Action: 'update_all', calling method: .version_select at 0x7fdbf30338b0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:39.420049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c07a3a8a-a7b3-45c8-a72c-83ec0aac3a93 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] HTTP exception thrown: Image not found. Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c07a3a8a-a7b3-45c8-a72c-83ec0aac3a93 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Request method failure captured: Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/images/48e50277-88ee-4280-aa6f-18dd63d70e5a/metadata HTTP/1.1 Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 57 Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CriK3DJWBmzrVW_WRtborOes93C57COaCuu9LGaJQHgJRAmDuAQs-rWiKiUaPwMWiyrwwgcKLloeeiRiamPRuvs30WEPclPp41AetF9qlkWR3zyzDV-BO4thVqM8D5dbGw9SwARZQH0iJW7Yxf_hcpx3tKXyTGFdeH3WBCb7-c71zg Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:40:39.422208 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 6661091c8dd84d48b029940abd8b76c3 Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:40:39.423809 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'image_id': '48e50277-88ee-4280-aa6f-18dd63d70e5a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:39.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 48e50277-88ee-4280-aa6f-18dd63d70e5a Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:39.425971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 48e50277-88ee-4280-aa6f-18dd63d70e5a could not be found. Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:39.427336 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:40:39.428516 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.429837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c07a3a8a-a7b3-45c8-a72c-83ec0aac3a93 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:39.429837 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c07a3a8a-a7b3-45c8-a72c-83ec0aac3a93 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] 10.222.0.98 "PUT /compute/v2.1/images/48e50277-88ee-4280-aa6f-18dd63d70e5a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.082891 Jul 14 14:40:39.429837 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 523/1010] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:40:39 2022] PUT /compute/v2.1/images/48e50277-88ee-4280-aa6f-18dd63d70e5a/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:39.438522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50572922-052b-4c0a-8f3d-a339d5ffed37 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:39.439195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50572922-052b-4c0a-8f3d-a339d5ffed37 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:39.497054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:39.519027 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a8b24037-9867-4ca0-9593-531cfa53f1bb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1463 microversion: 2.1 time: 0.567571 Jul 14 14:40:39.520815 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 488/1011] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:38 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1463 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:39.531656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-284c5636-236a-49d3-a087-976b5c6e7581 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Action: 'update', calling method: .version_select at 0x7fdbf2f9d1f0>, body: {"meta": {"os_distro": "alt"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:39.570091 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-284c5636-236a-49d3-a087-976b5c6e7581 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] HTTP exception thrown: Image not found. Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-284c5636-236a-49d3-a087-976b5c6e7581 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Request method failure captured: Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/images/b27146c5-1a42-4cbd-abfd-d7bce4811553/metadata/os_distro HTTP/1.1 Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 30 Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CriK3DJWBmzrVW_WRtborOes93C57COaCuu9LGaJQHgJRAmDuAQs-rWiKiUaPwMWiyrwwgcKLloeeiRiamPRuvs30WEPclPp41AetF9qlkWR3zyzDV-BO4thVqM8D5dbGw9SwARZQH0iJW7Yxf_hcpx3tKXyTGFdeH3WBCb7-c71zg Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:39.572420 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6661091c8dd84d48b029940abd8b76c3 Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: {"meta": {"os_distro": "alt"}} Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:40:39.573873 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'image_id': 'b27146c5-1a42-4cbd-abfd-d7bce4811553', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:39.574739 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b27146c5-1a42-4cbd-abfd-d7bce4811553 Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:39.575870 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b27146c5-1a42-4cbd-abfd-d7bce4811553 could not be found. Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:39.577039 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:40:39.578252 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.581672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-284c5636-236a-49d3-a087-976b5c6e7581 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:39.581672 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-284c5636-236a-49d3-a087-976b5c6e7581 tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] 10.222.0.98 "PUT /compute/v2.1/images/b27146c5-1a42-4cbd-abfd-d7bce4811553/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.051565 Jul 14 14:40:39.581672 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 489/1012] 10.222.0.98 () {60 vars in 1309 bytes} [Thu Jul 14 14:40:39 2022] PUT /compute/v2.1/images/b27146c5-1a42-4cbd-abfd-d7bce4811553/metadata/os_distro => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:40:39.588827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4471370-ee43-4fed-9ed7-fe1cc036e5de tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Action: 'create', calling method: .version_select at 0x7fdbf30a7430>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:39.650571 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e4471370-ee43-4fed-9ed7-fe1cc036e5de tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] HTTP exception thrown: Image not found. Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4471370-ee43-4fed-9ed7-fe1cc036e5de tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Request method failure captured: Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/images/9ceef224-8b73-4246-99c9-2afbc8a3a06f/metadata HTTP/1.1 Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 57 Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CriK3DJWBmzrVW_WRtborOes93C57COaCuu9LGaJQHgJRAmDuAQs-rWiKiUaPwMWiyrwwgcKLloeeiRiamPRuvs30WEPclPp41AetF9qlkWR3zyzDV-BO4thVqM8D5dbGw9SwARZQH0iJW7Yxf_hcpx3tKXyTGFdeH3WBCb7-c71zg Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:40:39.652907 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/570505c27a6f4e83a9cdfe10a497a1ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 570505c27a6f4e83a9cdfe10a497a1ae Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548 Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6661091c8dd84d48b029940abd8b76c3 Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1520273548-project Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:40:39.654261 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'image_id': '9ceef224-8b73-4246-99c9-2afbc8a3a06f', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:39.655110 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9ceef224-8b73-4246-99c9-2afbc8a3a06f Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:40:39.656220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ceef224-8b73-4246-99c9-2afbc8a3a06f could not be found. Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:40:39.657719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:40:39.659621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:40:39.664598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4471370-ee43-4fed-9ed7-fe1cc036e5de tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:40:39.665636 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4471370-ee43-4fed-9ed7-fe1cc036e5de tempest-ImagesMetadataNegativeTestJSON-1520273548 tempest-ImagesMetadataNegativeTestJSON-1520273548-project] 10.222.0.98 "POST /compute/v2.1/images/9ceef224-8b73-4246-99c9-2afbc8a3a06f/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081212 Jul 14 14:40:39.666698 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 490/1013] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Jul 14 14:40:39 2022] POST /compute/v2.1/images/9ceef224-8b73-4246-99c9-2afbc8a3a06f/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:40:39.890041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1339777748", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "28c69871-43bd-4251-ae79-02953e468fc7"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:39.963994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:40.008362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50572922-052b-4c0a-8f3d-a339d5ffed37 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:40.027577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50572922-052b-4c0a-8f3d-a339d5ffed37 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1241 microversion: 2.1 time: 0.599405 Jul 14 14:40:40.044385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 524/1014] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:39 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1241 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:40.060513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:40.066426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:40.105657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.107572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.122599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.123769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.808055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:40.809141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:40.810016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:40.811036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:40.811849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:40.838675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.841341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.843083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:40.845165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:40.904771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Getting quotas for project db181b6ddf3f42629734e66aeb2f0e3f. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:40.920137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Getting quotas for user 2643b694761c4380a7a37fe64add9423 and project db181b6ddf3f42629734e66aeb2f0e3f. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:40.956595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:40.962698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:41.137841 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46b1c38b-9b1b-46d9-8b99-281992870da3 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250352 Jul 14 14:40:41.145472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 491/1015] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:40:41.171842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:41.174816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:41.195194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:41.199899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:41.202552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:41.203743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:41.566865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.587694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.592410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.594146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa1b91ea-f413-43b9-bf61-9b77365a70e3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.548637 Jul 14 14:40:41.597939 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 525/1016] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:40 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:41.616213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8729e499-f1a3-43c8-821e-d97eef48e01a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:41.617291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8729e499-f1a3-43c8-821e-d97eef48e01a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:41.647164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.661180 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-818be330-3e73-4ad2-9611-be10ecb1c517 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1237 microversion: 2.1 time: 0.507506 Jul 14 14:40:41.672472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 492/1017] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:41 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1237 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:41.713450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8729e499-f1a3-43c8-821e-d97eef48e01a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:41.727686 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8729e499-f1a3-43c8-821e-d97eef48e01a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1214 microversion: 2.1 time: 0.125176 Jul 14 14:40:41.739933 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 526/1018] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:41 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1214 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:42.632027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:42.633770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:42.652580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.653478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.654748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.655600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.692966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:42.693952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:42.746847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.747702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:42.749709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:42.750782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:43.150509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.182322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c4d13dd-5077-4208-91b3-204bddaaa862 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1299 microversion: 2.1 time: 0.495058 Jul 14 14:40:43.185938 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 527/1019] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:42 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1299 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:43.214256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:43.215230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:43.255208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:43.257521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:43.261110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:43.269831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:43.813806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.868104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.881285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:43.885899 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b19d680a-eec6-4d3a-b602-597eb05980d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.257919 Jul 14 14:40:43.888247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 493/1020] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:42 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:44.024677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:44.055528 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c4eaf53-aff6-41a1-af83-5b7b809fdf31 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1266 microversion: 2.1 time: 0.867007 Jul 14 14:40:44.057255 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 528/1021] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:43 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1266 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:44.213368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:44.219937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:44.273435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.273882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.277237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.278458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.929292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:44.932958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:44.934150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:44.946856 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c654fa4d-6a52-45b1-9811-b82e04d5acdd tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1299 microversion: 2.1 time: 0.744766 Jul 14 14:40:44.948162 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 494/1022] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:44 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1299 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:44.981835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.989394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:44.990979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:44.991871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:45.086664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:45.088596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:45.100860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:45.101311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:45.102147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:45.107926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:45.609032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.655666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c339260e-8bf3-46a9-9bfd-cdad72e0c9e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1272 microversion: 2.1 time: 0.575592 Jul 14 14:40:45.666728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 495/1023] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:45 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1272 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:45.933636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.947922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.961029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:45.962759 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1468ad6-a025-4322-b4ba-2ba58622d1d2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.047529 Jul 14 14:40:45.963388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 529/1024] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:44 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:45.965755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:45.966512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:45.996093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:45.999493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.004009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:46.006513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:46.756738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-829490055", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:46.918338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:40:47.454345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.469591 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cc37f3c0-5d8b-4754-a450-db74784a1683 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 1.508772 Jul 14 14:40:47.472647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 496/1025] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:45 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:47.496177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:47.498003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:47.514918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:47.531107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.531577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.549269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.550732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.865001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:47.895937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57d245e5-3252-4436-9c63-3c8516a43a37 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1272 microversion: 2.1 time: 0.418190 Jul 14 14:40:47.897190 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 497/1026] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:47 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1272 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:47.917737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:47.921962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:47.942729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.955513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:47.958006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:47.959512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:48.947183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:40:48.948006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:40:48.948902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:40:48.949650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:40:48.950403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:40:48.962789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.013093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.016487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.018918 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68634e66-b98b-4823-bd60-5c76c69854c4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.119773 Jul 14 14:40:49.022281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.023070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.024726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.025505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.033693 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 498/1027] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:47 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:49.060709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:49.061764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:49.139610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.140429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.142042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.142845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.161049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Getting quotas for project 75041b3d85ea40d4a5525c6c62f91ec2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:49.185735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Getting quotas for user 9802f1cfe8d54628a7ccf4aa0d3cc19e and project 75041b3d85ea40d4a5525c6c62f91ec2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:49.229105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:40:49.238739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:40:49.344255 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64a6088c-1da0-413d-a6e1-8e4a16050747 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.994679 Jul 14 14:40:49.355758 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 530/1028] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:40:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 3007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:40:49.369972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:49.370884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:49.380592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.381300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.383001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:49.383695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:49.867484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:49.893373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1972fa82-b151-4643-9939-bce81aa8ac2f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.857760 Jul 14 14:40:49.899242 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 499/1029] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:49 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:49.917707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7cad0b8-7fd4-40b7-9e6d-eaa5127397bb tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:49.918809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7cad0b8-7fd4-40b7-9e6d-eaa5127397bb tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:50.104288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d7cad0b8-7fd4-40b7-9e6d-eaa5127397bb tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:50.130072 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7cad0b8-7fd4-40b7-9e6d-eaa5127397bb tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1216 microversion: 2.1 time: 0.228564 Jul 14 14:40:50.151589 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 500/1030] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:49 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1216 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:50.162174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:50.175742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:50.206166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.219372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.221397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:50.222568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:50.876189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:51.039178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.073366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.079039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.082289 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57438586-0a34-43bb-8c07-98d68f23d835 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.927749 Jul 14 14:40:51.084566 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 501/1031] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:50 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:51.106040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:51.108154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.119419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.120351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.122329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.123670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.749898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:51.782337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb8f8494-ea51-413b-aca4-30710f6bfaa3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.695546 Jul 14 14:40:51.783323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 502/1032] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:51 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:51.788307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:51.788940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:51.821279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.821738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:51.822557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:51.823017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.002296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:52.022088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:52.023789 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d7ccb61-0252-4ca4-9bfd-85a9f0cbb505 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 2.666037 Jul 14 14:40:52.036505 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d4d06a9-075d-4240-b0d8-4aeafebad225 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1286 microversion: 2.1 time: 0.251932 Jul 14 14:40:52.047149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 503/1033] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:51 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1286 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:52.066327 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 531/1034] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:49 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 2709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:52.147315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:52.149372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:52.175322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.175960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.177138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.178993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.800084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:52.800753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:52.804084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:52.827139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.827661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:52.828493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:52.828924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.586119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.588491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.597480 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94b5857f-173c-4552-b386-0fb16971b062 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.801988 Jul 14 14:40:53.606673 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 532/1035] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:52 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:40:53.613475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.615361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:53.619982 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a339cbdf-7911-451a-ad44-de72a91253e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.508081 Jul 14 14:40:53.630040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 504/1036] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:52 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:53.652025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:53.654638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:53.693065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.693632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:53.694583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:53.695155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.039655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e30bfeb3-c064-49d7-99b4-b953559e08fa req-e8b0323a-209e-4b37-a957-e35bfc4a063c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1", "tag": "aa1b56f3-5a23-4109-a088-bc3e84fe5bf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:54.065311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e30bfeb3-c064-49d7-99b4-b953559e08fa req-e8b0323a-209e-4b37-a957-e35bfc4a063c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.065782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e30bfeb3-c064-49d7-99b4-b953559e08fa req-e8b0323a-209e-4b37-a957-e35bfc4a063c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.114517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e30bfeb3-c064-49d7-99b4-b953559e08fa req-e8b0323a-209e-4b37-a957-e35bfc4a063c service nova] Creating event network-changed:aa1b56f3-5a23-4109-a088-bc3e84fe5bf2 for instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 on n-h2-768852-23 Jul 14 14:40:54.140863 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e30bfeb3-c064-49d7-99b4-b953559e08fa req-e8b0323a-209e-4b37-a957-e35bfc4a063c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.524720 Jul 14 14:40:54.145813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 533/1037] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:54.168249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.177775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.212842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.213337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.214192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.214640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.636712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:54.647679 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f57c4fe8-3770-41d8-bf4b-280e1574cda7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1274 microversion: 2.1 time: 0.497406 Jul 14 14:40:54.653940 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 534/1038] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1274 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:54.694837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:54.696791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:54.749678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.750909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:54.754568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:54.757862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:55.154692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:55.162266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:55.168692 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7dd14576-f533-4cee-999f-1596e8d3f12a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 1.534574 Jul 14 14:40:55.171463 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 505/1039] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:53 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:55.192335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:55.194530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:55.239650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:55.242154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:55.248708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:55.249687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.353631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.368245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.370978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:57.372544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87f3f605-2d97-4999-8e1d-9537bc647704 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 2.199744 Jul 14 14:40:57.373472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 506/1040] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:55 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 2201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:57.391427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:57.393069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:57.401107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.401983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:57.403120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:57.403889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.055862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.077301 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3716e509-bd77-48b6-bee9-61a45d61967d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 3.418517 Jul 14 14:40:58.078252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 535/1041] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:54 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 3424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:58.091184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.091858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.103009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.107613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.108815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.109482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.248297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f0d1d71-340d-4420-8eed-85a675a760d0 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1862 microversion: 2.1 time: 0.873058 Jul 14 14:40:58.251524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 507/1042] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:57 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1862 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:58.276060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:58.277270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:58.301976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.304280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.306653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.310302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:58.624795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:58.643740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-883a1bdd-e33e-4ed3-b6cc-4fa81c567ef6 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1274 microversion: 2.1 time: 0.564211 Jul 14 14:40:58.644724 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 536/1043] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1274 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:58.953333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-20b71299-7c67-4849-86c7-bd2477044cc4 req-92205ae8-7e4b-4912-b10b-7d03224ade81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2277c627-ff22-472a-ac2e-a5226ae6db10", "tag": "62ff24b4-f81b-413d-b083-007ea279a865"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:58.969876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-20b71299-7c67-4849-86c7-bd2477044cc4 req-92205ae8-7e4b-4912-b10b-7d03224ade81 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:58.978356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-20b71299-7c67-4849-86c7-bd2477044cc4 req-92205ae8-7e4b-4912-b10b-7d03224ade81 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.006703 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-20b71299-7c67-4849-86c7-bd2477044cc4 req-92205ae8-7e4b-4912-b10b-7d03224ade81 service nova] Creating event network-changed:62ff24b4-f81b-413d-b083-007ea279a865 for instance 2277c627-ff22-472a-ac2e-a5226ae6db10 on n-h1-768852-23 Jul 14 14:40:59.018956 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-20b71299-7c67-4849-86c7-bd2477044cc4 req-92205ae8-7e4b-4912-b10b-7d03224ade81 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.372933 Jul 14 14:40:59.020690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 537/1044] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:40:59.026215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-768852-23", "block_migration": true, "disk_over_commit": false}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:59.028288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.041792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.042154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.049458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.050265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.111484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.123253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-83a630bd-4fd4-4511-bf42-c7b570bb2873 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 0.869251 Jul 14 14:40:59.125005 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 508/1045] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:58 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:40:59.131896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.132755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.138051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:59.139597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.140314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.141648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.142194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.199402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lazy-loading 'flavor' on Instance uuid d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:40:59.230328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=16 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:40:59.244404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Going to try to live migrate instance to n-h1-768852-23 {{(pid=125966) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:40:59.461008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.487819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.489452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:40:59.494005 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dbcfb5e3-a7ea-423d-9901-e32d8be3ecb3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.367433 Jul 14 14:40:59.500039 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 509/1046] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:40:59 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:40:59.506501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86ea192e-5ac2-40c5-8703-3b17f319f477 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Action: 'create', calling method: .version_select at 0x7fdbf3010ca0>, body: {"keypair": {"name": "tempest-keypair-545208601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEIoqviObOrWhqmIR837tBL07YrcM+YuFEbYD/kC6pR8/XUM1/nTimtWR8GnObbf1O+0cbA/IjCbibV1wbtIK/Zx2IRfzhuAutKL0zb6XZAhsFCXEvoTOSV/A+BufT7abw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:40:59.545014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-86ea192e-5ac2-40c5-8703-3b17f319f477 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Getting quotas for project 93c4325b23c544eab268df27d8f485af. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:40:59.555171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-86ea192e-5ac2-40c5-8703-3b17f319f477 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Getting quotas for user 2020ca323f8947adb35690d56979724d and project 93c4325b23c544eab268df27d8f485af. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:40:59.619874 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86ea192e-5ac2-40c5-8703-3b17f319f477 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.118191 Jul 14 14:40:59.620505 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 510/1047] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:40:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:40:59.635692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:40:59.636338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:40:59.651216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.651733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:40:59.652654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:40:59.661243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.107564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:00.125035 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4e65971a-238d-4d47-acf2-907f21a13d6b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.503093 Jul 14 14:41:00.126639 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 511/1048] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:40:59 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:00.146533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:00.148062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:00.173630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.174995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.176867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.180154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.711874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:00.732915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26df9ed3-1ee4-429e-ba4e-9517983b38e7 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 0.599542 Jul 14 14:41:00.736141 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 512/1049] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:00 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:00.746941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:00.748632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:00.764326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.765150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:00.767123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:00.767953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:01.166830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:01.210013 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0042a13d-5c50-47bc-9b1a-aac30ec61c0d tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 0.467324 Jul 14 14:41:01.214361 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 513/1050] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:00 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:01.229740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:01.230790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:01.272140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:01.276739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:01.285181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:01.285831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:01.631921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:01.648947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:01.651700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:01.656212 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07f2ecb9-53d4-4505-ab08-d024120417dc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.439392 Jul 14 14:41:01.671765 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 514/1051] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:01 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:01.681465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:01.692384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:01.718104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:01.719370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:01.721252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:01.721739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.181930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:02.198037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22598a7f-938b-40b1-b2d8-265ba009848f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.524246 Jul 14 14:41:02.200527 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 515/1052] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:01 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:02.206716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:02.207915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:02.215033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.216034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.217020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.217815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.898483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:02.960713 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37baa8b2-54b7-40e0-838d-23c63b6df580 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 0.758228 Jul 14 14:41:02.974125 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 516/1053] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:02 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:02.981780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:02.982837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:02.996627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:02.997481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:02.999406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.001240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.619902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:03.630972 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68e40fd6-d24f-42c7-a560-017da2e4d821 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 0.655190 Jul 14 14:41:03.639175 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 517/1054] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:02 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:03.645293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:03.647946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:03.664209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.669900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:03.671109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:03.671589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.304962 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a95613e-fb4c-4a1c-a9c6-6dd27f6d89e5 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/action" status: 202 len: 0 microversion: 2.1 time: 5.282653 Jul 14 14:41:04.305655 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 538/1055] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:40:59 2022] POST /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/action => generated 0 bytes in 5284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:41:04.312748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:04.313045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:04.331202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.340902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.342685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.351796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.358860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:04.610215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:04.629036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:04.639956 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d2c89c28-88d6-4d39-bcbf-a30f3b321eb7 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.333019 Jul 14 14:41:04.647108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:04.649313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 539/1056] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:04 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:04.655067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:04.658663 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5160f823-a75a-412c-b926-2c14ab57534a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 1.017989 Jul 14 14:41:04.661098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-14c6a5ff-ec49-46cb-8060-78cd7c6b769b req-0f466cb8-67b5-4928-9a99-0cdbdf2285ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:04.675069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-14c6a5ff-ec49-46cb-8060-78cd7c6b769b req-0f466cb8-67b5-4928-9a99-0cdbdf2285ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.675954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-14c6a5ff-ec49-46cb-8060-78cd7c6b769b req-0f466cb8-67b5-4928-9a99-0cdbdf2285ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.677780 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 518/1057] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:03 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:04.709021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:04.713561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:04.729354 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-14c6a5ff-ec49-46cb-8060-78cd7c6b769b req-0f466cb8-67b5-4928-9a99-0cdbdf2285ea service nova] Creating event network-changed:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:41:04.730193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.734515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.737139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.738916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.748298 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-14c6a5ff-ec49-46cb-8060-78cd7c6b769b req-0f466cb8-67b5-4928-9a99-0cdbdf2285ea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096558 Jul 14 14:41:04.751146 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 540/1058] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:04.770699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:04.775338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:04.801622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.802734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:04.805221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:04.806682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:05.160152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:05.169842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e3f3f73-c069-4cff-a659-585f095074d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 0.490188 Jul 14 14:41:05.172364 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 519/1059] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:04 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:05.206692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:05.209672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:05.226440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:05.227438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:05.228949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:05.230219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:05.567675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:05.585312 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4cccca92-33b4-4f2a-a1d9-7b9250ce50f7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.828467 Jul 14 14:41:05.587058 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 541/1060] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:04 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:05.601977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-587460762", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "030db24e-d30c-4e2f-bc57-65d911497b44"}, {"port": "a88643fc-2419-43ac-8f5a-9547d68bbab8", "tag": "port-1"}, {"port": "aad3ef53-ce16-4b02-a1b5-5f7e52a7985d", "tag": "port-2"}, {"uuid": "8f258608-2b8e-41ec-9ee9-a6eaf0d69b52", "tag": "net-1"}, {"uuid": "8f258608-2b8e-41ec-9ee9-a6eaf0d69b52"}, {"uuid": "98bf4bde-ffaa-4f07-9bb7-997f9badac88", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "98bf4bde-ffaa-4f07-9bb7-997f9badac88", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "03cbda62-891f-4f79-8ee3-ad96dfbc91b9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "e03b2307-b609-4bf6-aab4-acd40a3d9528", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "9145f8a7-329c-4609-8b11-a49148572d4e", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1206970027"}], "key_name": "tempest-keypair-545208601", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:05.628094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:05.650432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-97e7bb5c-b06d-48d4-9140-1ae60b7be769 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 0.460451 Jul 14 14:41:05.654759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 520/1061] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:05 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:05.662937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:05.675926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:05.685260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:05.687017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:05.688234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:05.692773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.111809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:06.148692 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fca45994-21ba-4f41-8612-2793f84b874a tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.490944 Jul 14 14:41:06.151255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 521/1062] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:05 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:06.163723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] validate_networks() for [('030db24e-d30c-4e2f-bc57-65d911497b44', None, None, None, None, None), (None, None, 'a88643fc-2419-43ac-8f5a-9547d68bbab8', None, None, None), (None, None, 'aad3ef53-ce16-4b02-a1b5-5f7e52a7985d', None, None, None), ('8f258608-2b8e-41ec-9ee9-a6eaf0d69b52', None, None, None, None, None), ('8f258608-2b8e-41ec-9ee9-a6eaf0d69b52', None, None, None, None, None), ('98bf4bde-ffaa-4f07-9bb7-997f9badac88', '10.2.2.100', None, None, None, None), ('98bf4bde-ffaa-4f07-9bb7-997f9badac88', '10.2.2.200', None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:41:06.187731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:06.192244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:06.206526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.207567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.212922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.213504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.443775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:06.455142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:06.456789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:06.459189 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-766656ad-a493-47ab-bc76-f6877bb6dd41 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.288164 Jul 14 14:41:06.460300 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 522/1063] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:06 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:06.783118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ca0b4c46-9abe-476c-a94a-fcf011854f74 req-bba259e9-ae37-4ff2-a3da-72e4ff71bda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1", "name": "network-vif-plugged", "status": "completed", "tag": "aa1b56f3-5a23-4109-a088-bc3e84fe5bf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:06.794962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ca0b4c46-9abe-476c-a94a-fcf011854f74 req-bba259e9-ae37-4ff2-a3da-72e4ff71bda5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.795697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ca0b4c46-9abe-476c-a94a-fcf011854f74 req-bba259e9-ae37-4ff2-a3da-72e4ff71bda5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.813145 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ca0b4c46-9abe-476c-a94a-fcf011854f74 req-bba259e9-ae37-4ff2-a3da-72e4ff71bda5 service nova] Creating event network-vif-plugged:aa1b56f3-5a23-4109-a088-bc3e84fe5bf2 for instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 on n-h2-768852-23 Jul 14 14:41:06.821017 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ca0b4c46-9abe-476c-a94a-fcf011854f74 req-bba259e9-ae37-4ff2-a3da-72e4ff71bda5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.358110 Jul 14 14:41:06.822170 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 523/1064] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:06.830574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:06.831971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:06.842012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.842615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.843973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:06.844748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:06.880233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:07.162358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:07.176986 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac7d8359-a422-4e45-a568-469632fcd75f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 0.352007 Jul 14 14:41:07.184557 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 524/1065] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:06 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:07.316408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Calling method '.version_select at 0x7fdbf2f80dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:07.318824 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:07.318824 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:07.322922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.323536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.341117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.341673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.356555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.357162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.367556 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b818a3d8-985d-4a8c-9d25-227dee55c2b1 tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.180182 Jul 14 14:41:07.369119 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 525/1066] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:41:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:07.375169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:07.376140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:07.382975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.384161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.384546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.384976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.658187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:07.678995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-425a2c9e-cd39-49cb-b40d-7b8178f1ef5e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.308221 Jul 14 14:41:07.696828 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 526/1067] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:07 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:07.714044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:07.716970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:07.728736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.729458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:07.733237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:07.734048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:08.392530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:08.410983 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94b81679-b4a1-42ba-a4e3-5f8cb31e38e8 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 0.712804 Jul 14 14:41:08.412276 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 527/1068] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:07 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:08.427995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:08.430189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:08.447526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:08.448339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:08.449412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:08.450063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.142468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:09.152303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94660271-799b-461d-9ce2-8ef6d6482210 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1367 microversion: 2.1 time: 0.738580 Jul 14 14:41:09.152937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 528/1069] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:08 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1367 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:09.167520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f83bfb7-7309-47fa-aa3a-94341afb4bca tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Calling method '.version_select at 0x7fdbf3001160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:09.168423 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:09.168423 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:09.169734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f83bfb7-7309-47fa-aa3a-94341afb4bca tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.170181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f83bfb7-7309-47fa-aa3a-94341afb4bca tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.209253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f83bfb7-7309-47fa-aa3a-94341afb4bca tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.228899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f83bfb7-7309-47fa-aa3a-94341afb4bca tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.245726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f83bfb7-7309-47fa-aa3a-94341afb4bca tempest-HypervisorAdminV228Test-632774135 tempest-HypervisorAdminV228Test-632774135-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 721 microversion: 2.28 time: 0.084885 Jul 14 14:41:09.251901 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 529/1070] 10.222.0.98 () {60 vars in 1192 bytes} [Thu Jul 14 14:41:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 721 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:09.264598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:09.264999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:09.306196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.306533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.310895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:09.311382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:09.578148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=12 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:10.130406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:10.170025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:10.173957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:10.176736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-24fff5dd-45eb-4b99-8d49-93927fe74d39 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.923217 Jul 14 14:41:10.178965 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 530/1071] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:09 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:10.208660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0c0a26dc-a4b7-4741-aad2-115a6568cdc1 req-d39b4b50-d507-4733-8504-a6fcd26a72f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "name": "network-vif-unplugged", "status": "completed", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:10.221877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0c0a26dc-a4b7-4741-aad2-115a6568cdc1 req-d39b4b50-d507-4733-8504-a6fcd26a72f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.222677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0c0a26dc-a4b7-4741-aad2-115a6568cdc1 req-d39b4b50-d507-4733-8504-a6fcd26a72f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.244327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0c0a26dc-a4b7-4741-aad2-115a6568cdc1 req-d39b4b50-d507-4733-8504-a6fcd26a72f4 service nova] Creating event network-vif-unplugged:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h1-768852-23 Jul 14 14:41:10.255007 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0c0a26dc-a4b7-4741-aad2-115a6568cdc1 req-d39b4b50-d507-4733-8504-a6fcd26a72f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054307 Jul 14 14:41:10.256935 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 531/1072] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:10.277361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:10.279191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:10.296953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.298539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.302252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.303714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.951536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:10.968014 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c7c949a-9703-4cfc-824b-e1236ba842fd tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 0.706909 Jul 14 14:41:10.971680 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 532/1073] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:10 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:10.986611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:10.987568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:10.997115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.997873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:10.998839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:10.999493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:11.288640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:11.304649 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c669dbc7-0462-4b4b-84d7-a6a1a6c9db57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.321975 Jul 14 14:41:11.305602 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 533/1074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:10 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:11.316875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4ed43eb1-f0d6-4665-ae05-c433369dbdf8 req-354d64f4-2684-4548-8d9d-48aabe81fc4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2277c627-ff22-472a-ac2e-a5226ae6db10", "name": "network-vif-plugged", "status": "completed", "tag": "62ff24b4-f81b-413d-b083-007ea279a865"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:11.335184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4ed43eb1-f0d6-4665-ae05-c433369dbdf8 req-354d64f4-2684-4548-8d9d-48aabe81fc4a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:11.335668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4ed43eb1-f0d6-4665-ae05-c433369dbdf8 req-354d64f4-2684-4548-8d9d-48aabe81fc4a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:11.373098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4ed43eb1-f0d6-4665-ae05-c433369dbdf8 req-354d64f4-2684-4548-8d9d-48aabe81fc4a service nova] Creating event network-vif-plugged:62ff24b4-f81b-413d-b083-007ea279a865 for instance 2277c627-ff22-472a-ac2e-a5226ae6db10 on n-h1-768852-23 Jul 14 14:41:11.420575 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4ed43eb1-f0d6-4665-ae05-c433369dbdf8 req-354d64f4-2684-4548-8d9d-48aabe81fc4a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112981 Jul 14 14:41:11.424544 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 534/1075] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:11.467783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:11.472077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:11.497572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:11.498880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:11.500921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:11.502138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.040652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:12.074135 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-760b698c-9255-404e-a338-2cdfd3a93ac4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1314 microversion: 2.1 time: 0.643554 Jul 14 14:41:12.075871 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 535/1076] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:11 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:12.108105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:12.110319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:12.123580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.124367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.127057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.127889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.580700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:12.596989 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d22f5ce-d59f-4056-ab14-5bad7890ef81 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1556 microversion: 2.1 time: 0.505043 Jul 14 14:41:12.603343 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 536/1077] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:12 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1556 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:12.608277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:12.609566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:12.626746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.627629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.629177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.630097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.891628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:12.910855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:12.912960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:12.927564 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9becc54e-e16f-4d5d-b00c-a65b5f41cb2c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.314557 Jul 14 14:41:12.946829 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 537/1078] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:12 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:12.951956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:12.952581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:12.963851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.964722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:12.965780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:12.966836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.504275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:13.533373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20119b5c-6e8a-46a6-bf7a-5fd048d1bbf8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 0.584741 Jul 14 14:41:13.535581 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 538/1079] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:12 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:13.566945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d21ee7c9-dfbb-4e57-94ae-8af9ffa3e5a8 req-b2a85013-06d3-42f0-a07a-cb7d24bdf69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:13.653500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d21ee7c9-dfbb-4e57-94ae-8af9ffa3e5a8 req-b2a85013-06d3-42f0-a07a-cb7d24bdf69c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.653947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d21ee7c9-dfbb-4e57-94ae-8af9ffa3e5a8 req-b2a85013-06d3-42f0-a07a-cb7d24bdf69c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.688431 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d21ee7c9-dfbb-4e57-94ae-8af9ffa3e5a8 req-b2a85013-06d3-42f0-a07a-cb7d24bdf69c service nova] Creating event network-changed:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h1-768852-23 Jul 14 14:41:13.700788 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d21ee7c9-dfbb-4e57-94ae-8af9ffa3e5a8 req-b2a85013-06d3-42f0-a07a-cb7d24bdf69c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163417 Jul 14 14:41:13.708767 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 539/1080] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:13.723174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:13.724136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:13.745782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:13.750890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.754786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:13.755722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:13.756235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:14.501796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:14.557942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e20b62a9-49ee-4033-a569-b7a6139b3235 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.846390 Jul 14 14:41:14.560442 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 540/1081] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:13 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:14.604224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:14.613396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:14.656251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:14.662941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:14.664601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:14.670370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:14.967432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e30f28b1-833f-4c55-a573-2bcd9f34e46d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.404532 Jul 14 14:41:14.968760 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 541/1082] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:41:14 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-interface => generated 284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:14.974501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:14.976428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:14.997209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:14.998776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.003160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.003960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.580072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=13 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:15.801613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:15.815901 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d044e353-2d57-4696-8367-97c6b2482334 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1463 microversion: 2.1 time: 0.845214 Jul 14 14:41:15.822448 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 542/1083] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:14 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1463 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:15.850089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:15.876194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:15.900732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.901118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:15.903344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:15.921121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.030510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:16.820394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:41:16.822612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:41:16.824749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:41:16.826267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:41:16.827455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:41:16.885114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.894297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:16.896790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:16.898348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:17.030678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Getting quotas for project 93c4325b23c544eab268df27d8f485af. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:41:17.053573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Getting quotas for user 2020ca323f8947adb35690d56979724d and project 93c4325b23c544eab268df27d8f485af. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:41:17.844704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:17.897238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:17.897669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:17.903615 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75fdba22-8f5f-4159-ba51-56cfbd70af7f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 2.071211 Jul 14 14:41:17.920508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 543/1084] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:15 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 2091 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:17.938813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:17.941988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:17.971347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:17.975575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:17.976914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:17.979716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.194836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:19.214239 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ff7b8467-1ea5-40f6-828f-932833e75fd5 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1316 microversion: 2.1 time: 1.292007 Jul 14 14:41:19.215057 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 544/1085] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:17 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1316 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:19.226939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4a57be32-e399-408b-a463-9a0c17738789 req-fb5e730d-2ed4-4e4e-855f-1009a630409f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "name": "network-vif-plugged", "status": "completed", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:19.241696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4a57be32-e399-408b-a463-9a0c17738789 req-fb5e730d-2ed4-4e4e-855f-1009a630409f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.244422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4a57be32-e399-408b-a463-9a0c17738789 req-fb5e730d-2ed4-4e4e-855f-1009a630409f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.262630 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4a57be32-e399-408b-a463-9a0c17738789 req-fb5e730d-2ed4-4e4e-855f-1009a630409f service nova] Creating event network-vif-plugged:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:41:19.271395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4a57be32-e399-408b-a463-9a0c17738789 req-fb5e730d-2ed4-4e4e-855f-1009a630409f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054631 Jul 14 14:41:19.276500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 545/1086] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:19.294897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:19.296858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:19.306302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.307055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.308439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:19.309202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:19.834648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:19.863889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a549bf1a-9632-41ec-badb-7ac70aefaf5f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.562643 Jul 14 14:41:19.874932 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 546/1087] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:19 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:20.341486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:20.347501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'deleted': False, 'project_id': 'bbed583bb3d44926bfffd1be76ef5b3c'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:20.354445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.355204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.356084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.356531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.507791 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86ee0a57-068f-4da2-8ce5-865d9dcdd0d9 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.630738 Jul 14 14:41:20.508673 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 547/1088] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:41:19 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:41:20.690284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Calling method '.version_select at 0x7fdbf3026ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:20.691638 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:20.691638 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:20.693812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.694755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.715085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.716606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.741072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.741807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.752270 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3dc07b9-2b24-4caa-bd75-04487e27e711 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.241922 Jul 14 14:41:20.753708 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 548/1089] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:41:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:20.761755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:20.762689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:20.773475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.774831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:20.776262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:20.784900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.040274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:21.070426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:21.077240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:21.080527 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61c5d780-df06-4255-b1ff-492fdab34831 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.325378 Jul 14 14:41:21.091618 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 549/1090] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:20 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:21.098662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-333f6821-713f-4b7b-ad19-bb4842b14b16 req-b86f450b-8e0c-4481-aa4c-56a5a9b74b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1", "tag": "aa1b56f3-5a23-4109-a088-bc3e84fe5bf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:21.138871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-333f6821-713f-4b7b-ad19-bb4842b14b16 req-b86f450b-8e0c-4481-aa4c-56a5a9b74b0c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.142297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-333f6821-713f-4b7b-ad19-bb4842b14b16 req-b86f450b-8e0c-4481-aa4c-56a5a9b74b0c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.182515 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-333f6821-713f-4b7b-ad19-bb4842b14b16 req-b86f450b-8e0c-4481-aa4c-56a5a9b74b0c service nova] Creating event network-changed:aa1b56f3-5a23-4109-a088-bc3e84fe5bf2 for instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 on n-h2-768852-23 Jul 14 14:41:21.198260 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-333f6821-713f-4b7b-ad19-bb4842b14b16 req-b86f450b-8e0c-4481-aa4c-56a5a9b74b0c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101894 Jul 14 14:41:21.201199 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 550/1091] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:21.230515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:21.240011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:21.275959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.277500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.283613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.285259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.683302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:21.700434 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21469e9d-6092-4a3b-a626-f6c010b59c00 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1465 microversion: 2.1 time: 0.496782 Jul 14 14:41:21.701755 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 551/1092] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:21 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1465 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:21.713597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:21.720958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'deleted': False} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:21.727322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.728087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:21.729132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:21.729745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.013090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Listed batch of 11 results from cell out of 1000 limit. Returned 11 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:41:22.131170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:22.131666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:22.913815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:41:22.918666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='03cbda62-891f-4f79-8ee3-ad96dfbc91b9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='e03b2307-b609-4bf6-aab4-acd40a3d9528',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9145f8a7-329c-4609-8b11-a49148572d4e',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:41:23.027785 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3e280fb0-69e9-4afe-9041-41ed4e97aeb3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 18455 microversion: 2.1 time: 1.324219 Jul 14 14:41:23.029429 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 552/1093] 10.222.0.98 () {58 vars in 1170 bytes} [Thu Jul 14 14:41:21 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 18455 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:23.338788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5aa53888-f587-4c24-a70b-aef64dde43c9 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Calling method '.version_select at 0x7fdbf2fb3550>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:23.339749 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:23.339749 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:23.340902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5aa53888-f587-4c24-a70b-aef64dde43c9 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'eff77aea2c8f4c2cac7726b7e142a4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b10d5c92e084da0b25f64a061521a4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5aa53888-f587-4c24-a70b-aef64dde43c9 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Request method failure captured: Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hypervisors/n-h1-768852-23/search HTTP/1.1 Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CsMfcLxdh5ScbPfglyH88m1R4fp3r-ysQKulDJcop4ray6t5lOf0918Lnb-73gOPbyeXOS7ImxikruXXSIBp5inRfZxvqSL05hSLCwh7qohzww-8NnZixobnjGfCMIuI00fKG29Iw5z4zh3pr5k1Q0R5BnZzQrUQasqhn3vv5EZPXE Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 3b10d5c92e084da0b25f64a061521a4a Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1760264600 Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:41:23.342618 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1760264600 Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 3b10d5c92e084da0b25f64a061521a4a Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1760264600 Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: eff77aea2c8f4c2cac7726b7e142a4df Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 14 14:41:23.345068 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'n-h1-768852-23'} Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:41:23.346621 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Jul 14 14:41:23.349162 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:23.351108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5aa53888-f587-4c24-a70b-aef64dde43c9 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:23.360984 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5aa53888-f587-4c24-a70b-aef64dde43c9 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/n-h1-768852-23/search" status: 403 len: 117 microversion: 2.1 time: 0.329351 Jul 14 14:41:23.361561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 553/1094] 10.222.0.98 () {58 vars in 1211 bytes} [Thu Jul 14 14:41:23 2022] GET /compute/v2.1/os-hypervisors/n-h1-768852-23/search => generated 117 bytes in 332 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:23.380744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:23.381382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:23.396701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.397163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.397986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.398434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.636561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=36 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:23.783669 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a7ec82e-a813-4cbd-9125-f0415114d19f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 18.192678 Jul 14 14:41:23.795940 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 542/1095] 10.222.0.98 () {62 vars in 1188 bytes} [Thu Jul 14 14:41:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 18208 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:41:23.818679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e793cecb-13d1-4e8a-9cca-5ff6c4690c7c req-9949a127-0dc1-4fc5-963b-5b5ace3dae58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "name": "network-vif-unplugged", "status": "completed", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:23.841504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e793cecb-13d1-4e8a-9cca-5ff6c4690c7c req-9949a127-0dc1-4fc5-963b-5b5ace3dae58 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.842667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e793cecb-13d1-4e8a-9cca-5ff6c4690c7c req-9949a127-0dc1-4fc5-963b-5b5ace3dae58 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.860396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:23.882803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e793cecb-13d1-4e8a-9cca-5ff6c4690c7c req-9949a127-0dc1-4fc5-963b-5b5ace3dae58 service nova] Creating event network-vif-unplugged:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h1-768852-23 Jul 14 14:41:23.892956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77c75d42-a528-4dd1-8a87-63e25b85c08a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.522836 Jul 14 14:41:23.895370 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e793cecb-13d1-4e8a-9cca-5ff6c4690c7c req-9949a127-0dc1-4fc5-963b-5b5ace3dae58 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095638 Jul 14 14:41:23.901438 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 543/1096] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:23.917837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1238782991", "metadata": {"image_type": "test"}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:23.920258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:23.934394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.935181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.936747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.937580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.940266 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 554/1097] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:23 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:23.966241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:23.967251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:23.990442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.990913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:23.991777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:23.992235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:24.077650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Getting quotas for project 75041b3d85ea40d4a5525c6c62f91ec2. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:41:24.113752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Getting quotas for user 9802f1cfe8d54628a7ccf4aa0d3cc19e and project 75041b3d85ea40d4a5525c6c62f91ec2. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:41:24.448135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:24.465269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:24.466870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:24.500691 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a210be3-3aea-42cc-a620-100ad9dd7071 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.526809 Jul 14 14:41:24.510404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 555/1098] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:23 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:24.533732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:24.563130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'deleted': False, 'project_id': 'bbed583bb3d44926bfffd1be76ef5b3c'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:24.613395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:24.614195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:24.615304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:24.615946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:24.719858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb30b19a-1acd-4f84-94cd-885efa4f2cc8 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/detail?tenant_id=db181b6ddf3f42629734e66aeb2f0e3f" status: 200 len: 15 microversion: 2.1 time: 0.199736 Jul 14 14:41:24.723336 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 556/1099] 10.222.0.98 () {58 vars in 1230 bytes} [Thu Jul 14 14:41:24 2022] GET /compute/v2.1/servers/detail?tenant_id=db181b6ddf3f42629734e66aeb2f0e3f => generated 15 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:41:24.738068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Calling method '.version_select at 0x7fdbf3001c10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:24.739350 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:24.739350 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:24.744737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:24.745471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:24.789730 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Request method failure captured: Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CsOURJD5NFAvZLE613D-GROd-_40SC9G4gwiDVuuTL63QQ43qZPoI1SVAs-c3hYT4U9soiGBFKzfRpuuqWkTMQjzQxOVnSGxmC82AGvIEUHFMbRpvwpAACqU-SAUkDVd5fnwCN6tngagApS84D-Yzh3eLObAg0UcWo-NdIPF-ZhRQw Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 381949dbe47d4cb3bcb31a94f7afe74b Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-420552611 Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:41:24.794616 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-420552611 Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 381949dbe47d4cb3bcb31a94f7afe74b Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-420552611 Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ae1c7d97bb1e49cbb24aaa62cbfdb78e Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:41:24.796593 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'nonexistent_hypervisor_name'} Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:24.807622 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:24.809417 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:24.809417 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:24.809417 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:24.809417 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Jul 14 14:41:24.809417 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:24.815526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:24.816701 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50e4eb01-7f70-4735-b177-19552f94a7f5 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.091089 Jul 14 14:41:24.818805 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 557/1100] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:41:24 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:24.836997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d68f04f-d8c0-424a-9e2f-b8ce930719bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:24.839637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d68f04f-d8c0-424a-9e2f-b8ce930719bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:24.903642 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ead8a601-ca23-4afc-bf71-94e3b464903d tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "POST /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43/action" status: 202 len: 0 microversion: 2.1 time: 0.996126 Jul 14 14:41:24.916102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 544/1101] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:41:23 2022] POST /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:41:24.948577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:24.981237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'tenant_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'deleted': False} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:25.026084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.026950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.032275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.033069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.120585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d68f04f-d8c0-424a-9e2f-b8ce930719bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.147256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d68f04f-d8c0-424a-9e2f-b8ce930719bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.158631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d68f04f-d8c0-424a-9e2f-b8ce930719bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.160929 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d68f04f-d8c0-424a-9e2f-b8ce930719bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1284 microversion: 2.42 time: 0.340130 Jul 14 14:41:25.170485 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 558/1102] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:24 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1284 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:25.179719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Calling method '.version_select at 0x7fdbf2e58b80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:25.196224 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:25.196224 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:25.202818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.204239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.263063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.265063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.287685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:41:25.295102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.296672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.329731 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5c44715-02e2-4229-8794-914b9af86091 tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.157575 Jul 14 14:41:25.343755 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 559/1103] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:41:25 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:25.365808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:25.370329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:25.419741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.421955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.424866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.425891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:25.426323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.426529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:25.927110 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed8c3670-0f7d-4b90-89e1-3d266d3db67f tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=db181b6ddf3f42629734e66aeb2f0e3f" status: 200 len: 4831 microversion: 2.1 time: 1.003165 Jul 14 14:41:25.928673 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 545/1104] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 14:41:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=db181b6ddf3f42629734e66aeb2f0e3f => generated 4831 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:25.932857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:25.935489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-28590cc3-3693-4891-a06d-2bcc96e76915 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf314baf0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:25.965966 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4d347e12-8b5b-4fca-a0a4-b840d660d46f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.619000 Jul 14 14:41:25.967083 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 560/1105] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:25 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:25.992401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba9e5e15-3a8b-47a6-bfa7-9a32ff8899f7 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Calling method '.version_select at 0x7fdbf2f3cee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:25.992401 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:25.992401 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:41:25.998619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba9e5e15-3a8b-47a6-bfa7-9a32ff8899f7 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'eff77aea2c8f4c2cac7726b7e142a4df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b10d5c92e084da0b25f64a061521a4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba9e5e15-3a8b-47a6-bfa7-9a32ff8899f7 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Request method failure captured: Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CsMfcLxdh5ScbPfglyH88m1R4fp3r-ysQKulDJcop4ray6t5lOf0918Lnb-73gOPbyeXOS7ImxikruXXSIBp5inRfZxvqSL05hSLCwh7qohzww-8NnZixobnjGfCMIuI00fKG29Iw5z4zh3pr5k1Q0R5BnZzQrUQasqhn3vv5EZPXE Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 3b10d5c92e084da0b25f64a061521a4a Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1760264600 Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:41:26.011165 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/3b10d5c92e084da0b25f64a061521a4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1760264600 Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 3b10d5c92e084da0b25f64a061521a4a Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1760264600 Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: eff77aea2c8f4c2cac7726b7e142a4df Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 14 14:41:26.014387 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '1'} Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:41:26.016633 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Jul 14 14:41:26.019244 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:41:26.022621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba9e5e15-3a8b-47a6-bfa7-9a32ff8899f7 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:26.022621 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba9e5e15-3a8b-47a6-bfa7-9a32ff8899f7 tempest-HypervisorAdminNegativeUnderV252Test-1760264600 tempest-HypervisorAdminNegativeUnderV252Test-1760264600-project] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.048429 Jul 14 14:41:26.024011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 561/1106] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:41:25 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:26.058935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.062401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:26.128329 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-28590cc3-3693-4891-a06d-2bcc96e76915 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 200 len: 1422 microversion: 2.1 time: 0.197582 Jul 14 14:41:26.130459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 546/1107] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:25 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 1422 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:26.137227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.138380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.140843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.141980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.144963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.160940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'tenant_id': 'bbed583bb3d44926bfffd1be76ef5b3c', 'deleted': False} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:26.173622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.174826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.176719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.177864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.279394 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d4bcf233-c347-4932-ba64-a9ed5e250bc3 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=bbed583bb3d44926bfffd1be76ef5b3c" status: 200 len: 15 microversion: 2.1 time: 0.146299 Jul 14 14:41:26.305676 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 547/1108] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=bbed583bb3d44926bfffd1be76ef5b3c => generated 15 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:41:26.333609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Calling method '.version_select at 0x7fdbf30d7790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.337382 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:41:26.337382 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:41:26.341486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.345283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.370858 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] HTTP exception thrown: No hypervisor matching '07dfccd7-ef37-440b-9caf-e032ab936e40' could be found. Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Request method failure captured: Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-hypervisors/07dfccd7-ef37-440b-9caf-e032ab936e40/servers HTTP/1.1 Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CsOURJD5NFAvZLE613D-GROd-_40SC9G4gwiDVuuTL63QQ43qZPoI1SVAs-c3hYT4U9soiGBFKzfRpuuqWkTMQjzQxOVnSGxmC82AGvIEUHFMbRpvwpAACqU-SAUkDVd5fnwCN6tngagApS84D-Yzh3eLObAg0UcWo-NdIPF-ZhRQw Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 381949dbe47d4cb3bcb31a94f7afe74b Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-420552611 Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:41:26.373665 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/381949dbe47d4cb3bcb31a94f7afe74b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-420552611 Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 381949dbe47d4cb3bcb31a94f7afe74b Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-420552611 Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ae1c7d97bb1e49cbb24aaa62cbfdb78e Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: exception: No hypervisor matching '07dfccd7-ef37-440b-9caf-e032ab936e40' could be found. Jul 14 14:41:26.389081 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '07dfccd7-ef37-440b-9caf-e032ab936e40'} Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '07dfccd7-ef37-440b-9caf-e032ab936e40' could be found. Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:41:26.399047 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '07dfccd7-ef37-440b-9caf-e032ab936e40' could be found. Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] Returning 404 to user: No hypervisor matching '07dfccd7-ef37-440b-9caf-e032ab936e40' could be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63dc7856-9b1f-4604-9e2a-f4c2cb7549ba tempest-HypervisorAdminNegativeUnderV252Test-420552611 tempest-HypervisorAdminNegativeUnderV252Test-420552611-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors/07dfccd7-ef37-440b-9caf-e032ab936e40/servers" status: 404 len: 123 microversion: 2.1 time: 0.068899 Jul 14 14:41:26.404497 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 548/1109] 10.222.0.98 () {58 vars in 1280 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/os-hypervisors/07dfccd7-ef37-440b-9caf-e032ab936e40/servers => generated 123 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:41:26.406275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.408230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:26.418733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.419553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.420283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.420781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.636780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.647124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.676341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.680513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.686000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-abb02ac5-0561-4168-96a2-02e9dc1d454a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.654133 Jul 14 14:41:26.686298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.695564 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 562/1110] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:26.701340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:26.707396 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e98a39c-c70f-4e83-a30a-9dfc03a7d599 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1574 microversion: 2.42 time: 0.319552 Jul 14 14:41:26.719341 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 549/1111] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1574 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:26.720022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c571b000-d704-4d88-b0d3-0a9cfb23233a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:26.736752 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c571b000-d704-4d88-b0d3-0a9cfb23233a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.041394 Jul 14 14:41:26.747643 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 563/1112] 10.222.0.98 () {58 vars in 1188 bytes} [Thu Jul 14 14:41:26 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:41:26.782987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:26.786351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:26.820769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.821558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:26.822987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:26.823828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.015659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:27.017828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:27.065480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.069772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.079574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.091773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.127948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4359290-67da-48c2-951c-83fd68e6a4bd tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.354612 Jul 14 14:41:27.128961 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 550/1113] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:41:26 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:41:27.143332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:27.149340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:27.150305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:27.195587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.196210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.197141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.197701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.580785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:41:27.748152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:27.785082 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a27c4ff2-4f66-4513-bdf8-bdc38d75f393 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.646777 Jul 14 14:41:27.792330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 551/1114] 10.222.0.98 () {58 vars in 1149 bytes} [Thu Jul 14 14:41:27 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:27.797324 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a699da0-ac6e-4f3d-85dc-18df3fff6ed7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.789797 Jul 14 14:41:27.801147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af05b916-322f-40b4-9beb-bf5a5f3ab250 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2fb41f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:27.804367 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 564/1115] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:27 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:27.831031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:27.838992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:27.878378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.883179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.884774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.885531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.891006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af05b916-322f-40b4-9beb-bf5a5f3ab250 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 200 len: 1422 microversion: 2.1 time: 0.096992 Jul 14 14:41:27.894016 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 552/1116] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:27 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:27.900281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:27.916814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:27.939410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.939410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:27.939410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:27.942951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.128503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.146681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.153416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.157606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-079ea78e-33fb-4034-a974-ced26ca94346 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1592 microversion: 2.42 time: 0.261952 Jul 14 14:41:28.171350 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 553/1117] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:27 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1592 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:28.189201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:28.190458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:28.206321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.208498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.210577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.211021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.392193 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-762899dc-9ff3-4589-9057-0c5ac723f7e6 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.221697 Jul 14 14:41:28.395143 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 554/1118] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:41:28 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:41:28.408729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:28.409535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:28.425490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.425942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.426746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.427182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.480903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.499758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.508664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:28.510086 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-862ac713-aa9c-41a4-84c2-b010ec10f4c8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1811 microversion: 2.25 time: 0.704072 Jul 14 14:41:28.518051 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 565/1119] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:27 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1811 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:28.829703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:28.830832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:28.896657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.900536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:28.904579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:28.905457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:29.381453 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-831f9c3a-349c-4b4e-8292-95971d6cbe1a tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1616 microversion: 2.1 time: 0.982015 Jul 14 14:41:29.382529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 555/1120] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:28 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1616 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:29.420904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00e81b61-c9d2-44d0-9ccf-2b138c031861 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2d00790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:29.593119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00e81b61-c9d2-44d0-9ccf-2b138c031861 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 200 len: 1422 microversion: 2.1 time: 0.186014 Jul 14 14:41:29.601102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 556/1121] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:29 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 1422 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:29.662277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:29.669954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:29.705093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:29.706761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:29.727432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df136d9b-8bcd-446c-ba8f-0ff8307b5fc8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.907064 Jul 14 14:41:29.736604 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 566/1122] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:28 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:29.743131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:29.752870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:29.754442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:29.758375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:29.759077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:29.759743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:29.791878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:29.807820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:29.809682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:29.812314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.047123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.101428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.111975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.123398 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1be7a228-afec-46bc-917c-2d4c850d2be0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1592 microversion: 2.42 time: 0.511363 Jul 14 14:41:30.124056 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 557/1123] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:29 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1592 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:30.133203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.134574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:30.148398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.149068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.157072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.157540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.167416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:30.331522 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2646e3a4-ec29-4b1a-959b-5a33559ac4ad tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1616 microversion: 2.1 time: 0.592408 Jul 14 14:41:30.332513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 567/1124] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:29 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1616 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:30.356163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d256daf8-5ab7-4a31-aef7-423a81e831ac req-b5a406b0-0867-4f7f-aebb-89783d98f17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "name": "network-vif-plugged", "status": "completed", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:30.382122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d256daf8-5ab7-4a31-aef7-423a81e831ac req-b5a406b0-0867-4f7f-aebb-89783d98f17f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.383381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d256daf8-5ab7-4a31-aef7-423a81e831ac req-b5a406b0-0867-4f7f-aebb-89783d98f17f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.421203 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d256daf8-5ab7-4a31-aef7-423a81e831ac req-b5a406b0-0867-4f7f-aebb-89783d98f17f service nova] Creating event network-vif-plugged:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:41:30.436444 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d256daf8-5ab7-4a31-aef7-423a81e831ac req-b5a406b0-0867-4f7f-aebb-89783d98f17f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102070 Jul 14 14:41:30.440582 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 568/1125] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:30.454789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.461979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'host': 'n-h1-768852-23', 'deleted': False} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:30.470422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.471175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.472736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.473504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.590841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.615067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:41:30.628073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.631661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:30.639934 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a06433d-fc69-40f3-a220-0ccc4b595e57 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1801 microversion: 2.25 time: 0.508150 Jul 14 14:41:30.641200 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 558/1126] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1801 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:30.673094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d010d16c-b6cd-45ee-af13-ecab6cfe4ca2 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2f2ec10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.703412 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85c16c1d-95a5-49ae-87c8-b8e57a76a27d tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers?host=n-h1-768852-23&all_tenants=1" status: 200 len: 1633 microversion: 2.1 time: 0.259912 Jul 14 14:41:30.704847 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 569/1127] 10.222.0.98 () {58 vars in 1191 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/servers?host=n-h1-768852-23&all_tenants=1 => generated 1633 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:30.719771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c293d379-bdaa-4472-a053-4a35ec4b3e26 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '.version_select at 0x7fdbf312ad30>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.722974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c293d379-bdaa-4472-a053-4a35ec4b3e26 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.723894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c293d379-bdaa-4472-a053-4a35ec4b3e26 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.758498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c293d379-bdaa-4472-a053-4a35ec4b3e26 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 3050 microversion: 2.25 time: 0.052087 Jul 14 14:41:30.765906 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 570/1128] 10.222.0.98 () {60 vars in 1183 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/os-migrations => generated 3050 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:30.778685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.820044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:41:30.837211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.838004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.839504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.840246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.894123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcd4db6e-a0b4-4711-9be6-4d4fc5be1443 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.132633 Jul 14 14:41:30.896247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 571/1129] 10.222.0.98 () {58 vars in 1195 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:41:30.911421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:30.913240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:30.933596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.935025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:30.938594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:30.940359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:31.412819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:31.446066 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aafcd589-eb34-4e9e-a626-f5bf1dfeabe5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.546865 Jul 14 14:41:31.449784 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 572/1130] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:31.484212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:31.491179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:31.506716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:31.507562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:31.509129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:31.512642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.190202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:41:32.266834 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b66b0f0a-2ade-44c0-9888-f05c6a6881b9 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 2419 microversion: 2.25 time: 0.813391 Jul 14 14:41:32.275247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 573/1131] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:31 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 2419 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:32.287812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:32.316387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:32.334675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.335507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.336952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.337730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.701774 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-016fb813-7c51-4029-9d7f-6636b936897e tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.424086 Jul 14 14:41:32.708160 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 574/1132] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:41:32 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:41:32.710485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:32.717145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:32.743859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.744486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:32.745402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:32.745919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.148306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.162673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.169260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:33.173230 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c5bddc3-9061-4521-b399-9fba46b59b4a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1660 microversion: 2.42 time: 0.466593 Jul 14 14:41:33.176663 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 575/1133] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:32 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1660 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:33.191391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:33.192903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:33.207482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.208764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:33.209901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:33.210628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.383667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:41:34.481525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f94a5752-682e-488e-84d2-84975e2ccd6e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 2419 microversion: 2.25 time: 1.303047 Jul 14 14:41:34.490182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 576/1134] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:33 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 2419 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:34.548462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:34.549897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:34.572354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.573543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:34.578290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:34.580413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:35.143663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:35.351243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:35.368357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74c9e05d-406a-4066-8689-bc901c6343fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.861678 Jul 14 14:41:35.380979 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 577/1135] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:34 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:35.402588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:35.415421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:35.416495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:35.443020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:35.443510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:35.444321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:35.444765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:37.337477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:40.148088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=36 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:40.600192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:40.851625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:45.442867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=79 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:45.557433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:41:52.686827 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d010d16c-b6cd-45ee-af13-ecab6cfe4ca2 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 200 len: 1422 microversion: 2.1 time: 22.022641 Jul 14 14:41:52.701581 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 559/1136] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:30 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 1422 bytes in 22060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:52.723893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:52.725487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:52.739475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.741542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.743808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.744881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.748427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:41:52.749296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:41:52.749536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:41:52.750567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:41:52.750990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:41:52.976485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:52.991079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:52.993643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:52.999572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.001784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.154248 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-540fcc9d-5d79-43b2-976d-8159a6f07aa4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 1067 microversion: 2.1 time: 17.771663 Jul 14 14:41:53.162583 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 578/1137] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:41:35 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 1067 bytes in 17781 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:41:53.394768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.405531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.408697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:53.410935 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6f73a4d4-b48f-47dd-a461-9099f0e692bd tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 0.707469 Jul 14 14:41:53.427877 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 560/1138] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:52 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:53.439121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-15775804-0c1a-4e20-836e-87ec8d0d069c req-3e3530c4-1c2a-432d-8d38-b966ddb5b75a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:53.463054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-15775804-0c1a-4e20-836e-87ec8d0d069c req-3e3530c4-1c2a-432d-8d38-b966ddb5b75a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.465044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-15775804-0c1a-4e20-836e-87ec8d0d069c req-3e3530c4-1c2a-432d-8d38-b966ddb5b75a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.502247 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-15775804-0c1a-4e20-836e-87ec8d0d069c req-3e3530c4-1c2a-432d-8d38-b966ddb5b75a service nova] Creating event network-vif-unplugged:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h2-768852-23 Jul 14 14:41:53.516561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-15775804-0c1a-4e20-836e-87ec8d0d069c req-3e3530c4-1c2a-432d-8d38-b966ddb5b75a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084228 Jul 14 14:41:53.520934 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 561/1139] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:53.527867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:53.534067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:53.555020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.557396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.559193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.561568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.730133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:53.731161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:53.746367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.747590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:53.748795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:53.749491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.401499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lazy-loading 'services' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:41:54.591161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:54.630314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-822a0447-ec48-4bbe-9f1d-9551879d5550 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments/cf7d00a6-7712-4cbe-93fe-bd2ed5cb5f8a" status: 202 len: 0 microversion: 2.25 time: 1.464589 Jul 14 14:41:54.637228 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 579/1140] 10.222.0.98 () {60 vars in 1456 bytes} [Thu Jul 14 14:41:53 2022] DELETE /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments/cf7d00a6-7712-4cbe-93fe-bd2ed5cb5f8a => generated 0 bytes in 1474 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:41:54.646414 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77550f49-5a24-4488-9b80-539cae171327 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 1.123382 Jul 14 14:41:54.667894 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 562/1141] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:53 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:54.733694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3686d3b3-1824-4084-bf72-93bb924ecc54 req-514a0ae2-b952-4904-973e-59d41893d118 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "0760b55f-c71b-47a8-9fc4-8e71037f0156"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:54.784744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3686d3b3-1824-4084-bf72-93bb924ecc54 req-514a0ae2-b952-4904-973e-59d41893d118 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.785900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3686d3b3-1824-4084-bf72-93bb924ecc54 req-514a0ae2-b952-4904-973e-59d41893d118 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.807669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8756f192-9382-4254-90de-c94963d9e0e3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf3175820>, body: {"quota_set": {"ram": "5120"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:54.827569 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3686d3b3-1824-4084-bf72-93bb924ecc54 req-514a0ae2-b952-4904-973e-59d41893d118 service nova] Creating event network-changed:0760b55f-c71b-47a8-9fc4-8e71037f0156 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:41:54.846336 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3686d3b3-1824-4084-bf72-93bb924ecc54 req-514a0ae2-b952-4904-973e-59d41893d118 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.175554 Jul 14 14:41:54.848513 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 563/1142] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:54.867884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-73755ad2-0898-4fd2-a901-bec1462920ea req-48f7088c-d1b0-49c5-8e50-d34acd48f72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "name": "network-vif-unplugged", "status": "completed", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:54.906830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-73755ad2-0898-4fd2-a901-bec1462920ea req-48f7088c-d1b0-49c5-8e50-d34acd48f72f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.908875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-73755ad2-0898-4fd2-a901-bec1462920ea req-48f7088c-d1b0-49c5-8e50-d34acd48f72f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.948897 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-73755ad2-0898-4fd2-a901-bec1462920ea req-48f7088c-d1b0-49c5-8e50-d34acd48f72f service nova] Creating event network-vif-unplugged:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h2-768852-23 Jul 14 14:41:54.970823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-73755ad2-0898-4fd2-a901-bec1462920ea req-48f7088c-d1b0-49c5-8e50-d34acd48f72f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117528 Jul 14 14:41:54.972561 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 564/1143] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:54.988868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8756f192-9382-4254-90de-c94963d9e0e3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.989694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8756f192-9382-4254-90de-c94963d9e0e3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:54.991202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8756f192-9382-4254-90de-c94963d9e0e3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:54.992011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8756f192-9382-4254-90de-c94963d9e0e3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:55.160467 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8756f192-9382-4254-90de-c94963d9e0e3 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572" status: 200 len: 148 microversion: 2.57 time: 0.520933 Jul 14 14:41:55.171136 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 580/1144] 10.222.0.98 () {62 vars in 1302 bytes} [Thu Jul 14 14:41:54 2022] PUT /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572 => generated 148 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:55.181217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:55.182929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:55.197131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:55.198588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:55.200612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:55.201796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:55.335176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c53cabbe-f49f-415c-97f7-bab95127c5c2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Action: 'create', calling method: .version_select at 0x7fdbf2cc93a0>, body: {"keypair": {"name": "tempest-keypair-588415069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG6tEKzjiFg7kD03wys9CN1sa/YKNOXCqpdSbLZivEupKbNRo5D8ZszSh2aZDg7vDX3Ar1NP/d965cbKRc6E0b3dxRY9EY9A4jWYhm5fEUJMH03CeofJFae/xa/uXO88oQ=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:55.393986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c53cabbe-f49f-415c-97f7-bab95127c5c2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Getting quotas for project d42c6a91fbc440a6a4e4f9a4cf6caaf7. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:41:55.403190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c53cabbe-f49f-415c-97f7-bab95127c5c2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Getting quotas for user a900db43445e48a5a09451a909a074d1 and project d42c6a91fbc440a6a4e4f9a4cf6caaf7. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:41:55.479196 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c53cabbe-f49f-415c-97f7-bab95127c5c2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.498717 Jul 14 14:41:55.481038 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 565/1145] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:41:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:55.503958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8861996-b8d0-44f5-94d3-76006db03b52 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2d3aa60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:55.641635 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8861996-b8d0-44f5-94d3-76006db03b52 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 200 len: 1431 microversion: 2.1 time: 0.157146 Jul 14 14:41:55.647989 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 566/1146] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:55 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 1431 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:55.663787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:55.666404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:55.722961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:55.724374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:55.731150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:55.732911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.009369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:56.030578 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c216f3ec-15cc-4523-a4c1-358cf4326dff tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1471 microversion: 2.1 time: 0.856400 Jul 14 14:41:56.040511 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 581/1147] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:55 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1471 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:56.071557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:56.074516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:56.097945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.098997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.103964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.107362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.195598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e0d659f-4977-4e1b-833d-55e0163a5453 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.150315 Jul 14 14:41:56.197588 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 582/1148] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:41:56 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:56.203848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0056a2e4-c42d-4639-8102-accc955e5ff2 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Calling method '.version_select at 0x7fdbf3161160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:56.325411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0056a2e4-c42d-4639-8102-accc955e5ff2 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.325955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0056a2e4-c42d-4639-8102-accc955e5ff2 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.335176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0056a2e4-c42d-4639-8102-accc955e5ff2 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.341095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0056a2e4-c42d-4639-8102-accc955e5ff2 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.402824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0056a2e4-c42d-4639-8102-accc955e5ff2 tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572/detail" status: 200 len: 463 microversion: 2.57 time: 0.203688 Jul 14 14:41:56.404189 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 583/1149] 10.222.0.98 () {60 vars in 1303 bytes} [Thu Jul 14 14:41:56 2022] GET /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572/detail => generated 463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:56.411765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99f60981-1374-4c56-9484-691377c19b90 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf3161b80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:56.496332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99f60981-1374-4c56-9484-691377c19b90 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 200 len: 1431 microversion: 2.1 time: 0.090468 Jul 14 14:41:56.497074 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 584/1150] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:56 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 1431 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:56.510318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:56.511112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:56.529142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.529643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:56.530482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:56.531230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.037169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.060337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.069364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.075425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a86ac988-f255-43a0-851a-d8fea7c8661c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 1.424486 Jul 14 14:41:57.082318 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 567/1151] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:55 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:41:57.102472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-77a5d767-5a2c-4363-98be-0971391ced2f req-60ff7a3e-fbb1-414d-822f-e7af9b5b7986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:57.131231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-77a5d767-5a2c-4363-98be-0971391ced2f req-60ff7a3e-fbb1-414d-822f-e7af9b5b7986 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.132123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-77a5d767-5a2c-4363-98be-0971391ced2f req-60ff7a3e-fbb1-414d-822f-e7af9b5b7986 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.154524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-77a5d767-5a2c-4363-98be-0971391ced2f req-60ff7a3e-fbb1-414d-822f-e7af9b5b7986 service nova] Creating event network-changed:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h2-768852-23 Jul 14 14:41:57.165186 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-77a5d767-5a2c-4363-98be-0971391ced2f req-60ff7a3e-fbb1-414d-822f-e7af9b5b7986 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076189 Jul 14 14:41:57.167911 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 568/1152] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:57.182223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:57.187677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:57.213949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.213949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.213949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.219257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.344227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:57.354610 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4f44d5a-f0bf-4b63-a4fa-dae689f48212 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.856590 Jul 14 14:41:57.360667 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 585/1153] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:56 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:57.373060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31613a0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:57.490716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.492142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.494800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.496235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.565934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.566794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.567866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.568477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.674090 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-652eb0b5-8e49-4a78-b493-e795f70e5aec tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572?user_id=eb31060e50db4c3b860671f89bea3b13" status: 200 len: 148 microversion: 2.57 time: 0.308967 Jul 14 14:41:57.675651 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 586/1154] 10.222.0.98 () {62 vars in 1383 bytes} [Thu Jul 14 14:41:57 2022] PUT /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572?user_id=eb31060e50db4c3b860671f89bea3b13 => generated 148 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:57.681778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "a88643fc-2419-43ac-8f5a-9547d68bbab8"}, {"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "aad3ef53-ce16-4b02-a1b5-5f7e52a7985d"}, {"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "f26436fc-3fd6-47ef-906d-83794b61754d"}, {"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "ad8cd311-4741-44e0-8060-a4915242cfdd"}, {"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "c3c6e28a-5abb-499b-9d2c-08703e602c92"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:57.700136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.702448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.732598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Creating event network-changed:a88643fc-2419-43ac-8f5a-9547d68bbab8 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:41:57.733114 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Creating event network-changed:aad3ef53-ce16-4b02-a1b5-5f7e52a7985d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:41:57.736514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Creating event network-changed:f26436fc-3fd6-47ef-906d-83794b61754d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:41:57.737040 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Creating event network-changed:ad8cd311-4741-44e0-8060-a4915242cfdd for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:41:57.737551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] Creating event network-changed:c3c6e28a-5abb-499b-9d2c-08703e602c92 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:41:57.758809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7a259f7a-5ec3-4d94-a365-7918246a553f req-ff630d92-b62b-464d-b604-9cfc8ae7b941 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 847 microversion: 2.1 time: 0.081343 Jul 14 14:41:57.760533 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 587/1155] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 847 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:57.777954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:57.780806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:57.818691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.821069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:57.822406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:57.826087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.049714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:58.061604 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db473ea8-ec52-43ad-b8e4-5e9509b18351 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1465 microversion: 2.1 time: 0.892295 Jul 14 14:41:58.068199 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 569/1156] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:57 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1465 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:58.075708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:58.080645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:58.095754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.098194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.102024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.103117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.149401 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bd73bc1-2f37-46f9-9ec0-6260cb9273b1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.079476 Jul 14 14:41:58.150750 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 570/1157] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:41:58 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:58.156166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8a016212-79ff-446d-828d-e77f013b6ed6 req-4624c62b-e9c4-4331-ae55-bd6ecdc26846 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "name": "network-vif-unplugged", "status": "completed", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:58.166318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8a016212-79ff-446d-828d-e77f013b6ed6 req-4624c62b-e9c4-4331-ae55-bd6ecdc26846 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.169042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8a016212-79ff-446d-828d-e77f013b6ed6 req-4624c62b-e9c4-4331-ae55-bd6ecdc26846 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.196860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8a016212-79ff-446d-828d-e77f013b6ed6 req-4624c62b-e9c4-4331-ae55-bd6ecdc26846 service nova] Creating event network-vif-unplugged:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:41:58.209056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8a016212-79ff-446d-828d-e77f013b6ed6 req-4624c62b-e9c4-4331-ae55-bd6ecdc26846 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055978 Jul 14 14:41:58.211164 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 571/1158] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:58.219725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b017aea-dc5c-4341-82e6-8d3c9e89d2af tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] Calling method '.version_select at 0x7fdbf2d0ad30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:58.340467 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b017aea-dc5c-4341-82e6-8d3c9e89d2af tempest-QuotasAdminTestV257-1616938196 tempest-QuotasAdminTestV257-1616938196-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572?user_id=eb31060e50db4c3b860671f89bea3b13" status: 200 len: 190 microversion: 2.57 time: 0.127562 Jul 14 14:41:58.341412 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 572/1159] 10.222.0.98 () {60 vars in 1363 bytes} [Thu Jul 14 14:41:58 2022] GET /compute/v2.1/os-quota-sets/53c8758d63b748a69cf16ae629597572?user_id=eb31060e50db4c3b860671f89bea3b13 => generated 190 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:58.349173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c7815d5-05fe-465b-938c-78a21bb6055d"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:41:58.360942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:58.382549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.383844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.387776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.389133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.449593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:58.469326 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0cdd6fa4-c6b3-4bba-b894-0faf12af7539 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1471 microversion: 2.1 time: 0.702312 Jul 14 14:41:58.471153 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 588/1160] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:57 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:58.482913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1e42772-25e2-4f37-a354-8fe527d8d618 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf31af3a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:58.580076 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1e42772-25e2-4f37-a354-8fe527d8d618 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/882b5d60-a014-41cb-b7f7-f80f1fdee9e4" status: 200 len: 784 microversion: 2.1 time: 0.107406 Jul 14 14:41:58.604260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 589/1161] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:41:58 2022] GET /compute/v2.1/images/882b5d60-a014-41cb-b7f7-f80f1fdee9e4 => generated 784 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:58.624666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:58.630105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:58.645561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.646059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:58.646891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:58.650980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.014911 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f3a807b0-e4e1-42e8-962d-d05df8931085 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "POST /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.671931 Jul 14 14:41:59.016122 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 573/1162] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:41:58 2022] POST /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 194 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:59.029705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:59.030559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:59.057316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.064109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.065256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.066397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.730990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:41:59.745075 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-85ece418-f8d9-4448-8a5f-0a61f3e27a58 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.727641 Jul 14 14:41:59.745729 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 574/1163] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:59 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:41:59.758257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3225a925-2bfe-40b5-b2ec-76911833d8a8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:59.779627 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3225a925-2bfe-40b5-b2ec-76911833d8a8 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030973 Jul 14 14:41:59.782717 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 575/1164] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:41:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:41:59.794976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:59.799922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:59.815161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.818311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.819480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.819947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.925803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc34c139-8776-473f-832b-31bdccd97e5c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.141788 Jul 14 14:41:59.928011 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 576/1165] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:41:59 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:41:59.938608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:41:59.940495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:41:59.949124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.949845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:41:59.950916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:41:59.951761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.184617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:00.208970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:00.212300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:00.213419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-59909845-8c60-4c49-b800-9fc7fe4ad2d8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 1.607252 Jul 14 14:42:00.218806 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 590/1166] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:41:58 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 1613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:00.226343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dc02394-3cfe-4685-b3c9-e74802c3b2d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf3627700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:00.416916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:00.435666 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-babdd0bf-2002-4a02-a30a-184b73f0827e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1471 microversion: 2.1 time: 0.505629 Jul 14 14:42:00.440410 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 577/1167] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:41:59 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1471 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:00.453872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-89415be3-afa9-4c07-9a4a-c003a8595682 req-7a25f52f-7bf3-4b60-b93a-9ffc4898517b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "ac4d4f21-84d8-472e-a32d-f8dbffcec22f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:00.470340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-89415be3-afa9-4c07-9a4a-c003a8595682 req-7a25f52f-7bf3-4b60-b93a-9ffc4898517b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.472483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-89415be3-afa9-4c07-9a4a-c003a8595682 req-7a25f52f-7bf3-4b60-b93a-9ffc4898517b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.513573 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-89415be3-afa9-4c07-9a4a-c003a8595682 req-7a25f52f-7bf3-4b60-b93a-9ffc4898517b service nova] Creating event network-changed:ac4d4f21-84d8-472e-a32d-f8dbffcec22f for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:00.535948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-89415be3-afa9-4c07-9a4a-c003a8595682 req-7a25f52f-7bf3-4b60-b93a-9ffc4898517b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091163 Jul 14 14:42:00.536920 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 578/1168] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:00.762777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:00.763824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:00.777651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.778146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:00.779028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:00.779583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.133622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:01.145440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f199eb82-dc0a-4a66-8967-1f89c61fec09 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.387023 Jul 14 14:42:01.159172 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 579/1169] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:00 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:01.166712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:01.169396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:01.180072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.181771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.183414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.184076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.239902 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04b8c0d4-070c-410e-8be1-0bca6ad3dd40 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.078291 Jul 14 14:42:01.241383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 580/1170] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:42:01 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:42:01.251551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:01.252697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:01.268217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.270032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.272114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.272767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.306712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3dc02394-3cfe-4685-b3c9-e74802c3b2d3 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "DELETE /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 204 len: 0 microversion: 2.1 time: 1.086438 Jul 14 14:42:01.307554 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 591/1171] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:00 2022] DELETE /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 0 bytes in 1088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:42:01.319770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3b549f6-559f-4ef6-bf76-cf9d6614a873 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf31438b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:01.349239 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d3b549f6-559f-4ef6-bf76-cf9d6614a873 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] HTTP exception thrown: Image not found. Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3b549f6-559f-4ef6-bf76-cf9d6614a873 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Request method failure captured: Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 HTTP/1.1 Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Crt8LDTad1YCvyymPKaWf-8IsgiIaQJaPV--eq854dwsD2Cuntl_VtGDJM4T27CDSL97A8gsS3w_J3woILk5r8k4GFayGIALEjGtaFu7B89hf81eOgsPunUtKuwcXTz-ceM6jqCtk2ZU0nngGPoSCWKwCZeOFRndPe5oncsCpkBNGk Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 75041b3d85ea40d4a5525c6c62f91ec2 Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:42:01.356281 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 75041b3d85ea40d4a5525c6c62f91ec2 Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerTestJSON-208828394-project Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 9802f1cfe8d54628a7ccf4aa0d3cc19e Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerTestJSON-208828394-project Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'da984628-5ed9-4323-8122-cd4e7680ed75'} Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:01.359866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID da984628-5ed9-4323-8122-cd4e7680ed75 Jul 14 14:42:01.364549 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:42:01.368875 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da984628-5ed9-4323-8122-cd4e7680ed75 could not be found. Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:42:01.378970 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3b549f6-559f-4ef6-bf76-cf9d6614a873 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:01.384849 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3b549f6-559f-4ef6-bf76-cf9d6614a873 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 404 len: 62 microversion: 2.1 time: 0.059570 Jul 14 14:42:01.388938 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 592/1172] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:01 2022] GET /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:42:01.400931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-314303168"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:01.402576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:01.410157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.411000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.412184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.412895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.771677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:01.799963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:01.803083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:01.817348 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02e4b8fa-719c-4539-a745-7c11dfb031ca tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 0.574376 Jul 14 14:42:01.839476 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 581/1173] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:01 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:01.850141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:01.851227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:01.865049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.866163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:01.868037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:01.870004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.165084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:02.200227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f9bf24d-bb43-43cc-bd6a-6aa52b65ecfa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1471 microversion: 2.1 time: 0.349014 Jul 14 14:42:02.215306 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 582/1174] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:01 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1471 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:02.221680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1317047461", "imageRef": "1c05c2c0-af4c-467a-b126-324191b2fc9a", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "161c0ead-f4fd-4ba2-9a75-b4f13757f2cc"}], "security_groups": [{"name": "tempest-securitygroup--247704877"}], "key_name": "tempest-keypair-588415069", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:02.233579 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e865052-e514-4fb6-bc06-21f5821b4638 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "POST /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43/action" status: 202 len: 0 microversion: 2.1 time: 0.842358 Jul 14 14:42:02.248832 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 593/1175] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:42:01 2022] POST /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43/action => generated 0 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:42:02.259981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.267874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.297026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.297499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.298309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.298751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.519981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] validate_networks() for [('161c0ead-f4fd-4ba2-9a75-b4f13757f2cc', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:42:02.653746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:02.674784 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1757b054-d533-4a68-b1e3-db43fa5305f8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1719 microversion: 2.1 time: 0.423374 Jul 14 14:42:02.675511 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 594/1176] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:02 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1719 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:02.690075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.692120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.702345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.703139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.704219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.704990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.752215 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-941d5401-bfe5-4b85-9601-72902303c84d tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.075185 Jul 14 14:42:02.757394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 595/1177] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:42:02 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:42:02.765008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-58abfb07-9509-4093-b4b1-5cca8d77a599 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf3143dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.872344 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-58abfb07-9509-4093-b4b1-5cca8d77a599 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c" status: 200 len: 1426 microversion: 2.1 time: 0.113141 Jul 14 14:42:02.873063 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 596/1178] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:02 2022] GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c => generated 1426 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:02.884275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:02.896316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:02.903783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.904241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:02.905255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:02.905907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.419963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:42:03.422235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:42:03.423586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:42:03.424718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:42:03.425819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:42:03.443394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.444754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.447303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.448247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.468052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:03.493398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Getting quotas for project d42c6a91fbc440a6a4e4f9a4cf6caaf7. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:42:03.505161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Getting quotas for user a900db43445e48a5a09451a909a074d1 and project d42c6a91fbc440a6a4e4f9a4cf6caaf7. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:42:03.510823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:03.533991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:42:03.539119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:03.539760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1c05c2c0-af4c-467a-b126-324191b2fc9a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:42:03.542866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:03.544048 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac1937db-c5aa-4933-986f-ceaeb8e7be0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 0.669801 Jul 14 14:42:03.544979 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 597/1179] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:02 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:03.550209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:03.551236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:03.558573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.559458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.560573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.561188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.586495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:03.653892 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38b33ffe-8d8c-4670-9365-6401ded2fcc9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.450034 Jul 14 14:42:03.660391 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 583/1180] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:42:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:42:03.666483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1a42a8c-62d0-4053-8357-92e3536d2d43 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:03.667152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f1a42a8c-62d0-4053-8357-92e3536d2d43 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:03.754130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f1a42a8c-62d0-4053-8357-92e3536d2d43 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:03.763059 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1a42a8c-62d0-4053-8357-92e3536d2d43 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1245 microversion: 2.1 time: 0.100976 Jul 14 14:42:03.763688 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 584/1181] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:03 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1245 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:03.780038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:03.782272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:03.795427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.797485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:03.799330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:03.800707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.037913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:04.053745 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-365a5ecf-2b59-45d1-974a-66b65cefc083 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1471 microversion: 2.1 time: 0.507187 Jul 14 14:42:04.055431 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 598/1182] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:03 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1471 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:04.082575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:04.085358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:04.101099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.102397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.103598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.104257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.180273 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e25cccd2-95e1-496c-bad0-452d0068d988 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.114503 Jul 14 14:42:04.187904 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 599/1183] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:42:04 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:42:04.196505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b3f9ea3-5173-4953-8daf-0628c01a9851 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf31a9e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:04.276766 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b3f9ea3-5173-4953-8daf-0628c01a9851 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c" status: 200 len: 1426 microversion: 2.1 time: 0.085447 Jul 14 14:42:04.277294 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 600/1184] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:04 2022] GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c => generated 1426 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:04.282301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:04.300382 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d632e3b9-5a28-4554-80db-756e4bb7e06a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1709 microversion: 2.1 time: 0.529909 Jul 14 14:42:04.301249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 585/1185] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:03 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1709 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:04.332496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63703b52-6c5a-4116-b918-62c30157f239 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '.version_select at 0x7fdbf31430d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:04.336492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63703b52-6c5a-4116-b918-62c30157f239 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.336944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63703b52-6c5a-4116-b918-62c30157f239 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.361373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63703b52-6c5a-4116-b918-62c30157f239 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 2342 microversion: 2.1 time: 0.037548 Jul 14 14:42:04.367247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 601/1186] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:42:04 2022] GET /compute/v2.1/os-migrations => generated 2342 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:04.385766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:04.386707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:04.416908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.417635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.418986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.422963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.564550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:04.565341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:04.579678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.582509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.585782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.586545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.684990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c89b392-fea4-4da4-b409-2a46b886d6f8 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1862 microversion: 2.1 time: 0.303247 Jul 14 14:42:04.686313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 586/1187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:04 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1862 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:04.719144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:04.719734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:04.740139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.741794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:04.744110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:04.745686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.094845 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74816c16-5906-4099-b510-0c918d837384 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1862 microversion: 2.1 time: 0.382734 Jul 14 14:42:05.096841 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 587/1188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:04 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1862 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:05.111364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.114903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:05.132109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.133025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.136154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.137237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.304189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.319948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d6368e1-b0ba-41bd-946d-e447b75ab301 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1241 microversion: 2.1 time: 0.221225 Jul 14 14:42:05.320757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 588/1189] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1241 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:05.330482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.333949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:05.345623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.346821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.348563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.349654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.379897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.396139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.398108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.399374 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92f0b601-92c6-4bc0-9f3c-104123c63639 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 0.840109 Jul 14 14:42:05.414036 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 602/1190] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:04 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:05.421435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.426510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:05.433670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.434172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.435002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:05.435541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:05.491370 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4b0a260-6299-4255-91aa-7336fb1eda99 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.077661 Jul 14 14:42:05.496407 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 603/1191] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:42:05.502898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6663b4bd-d46c-46b2-8c1d-bb5e4daa6d32 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf349bf70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:05.596914 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6663b4bd-d46c-46b2-8c1d-bb5e4daa6d32 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c" status: 200 len: 1426 microversion: 2.1 time: 0.098774 Jul 14 14:42:05.598002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 604/1192] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c => generated 1426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:05.665620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:05.675303 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4cec8a44-5281-4d82-8a00-498dc4e9ddd6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1471 microversion: 2.1 time: 0.352705 Jul 14 14:42:05.688091 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 589/1193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:05 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:06.147186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:06.150570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:06.177012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.180407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.186907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.188545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.340445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:06.341295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:06.362089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.362801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.364038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.364679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.476208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:06.485739 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d4525ca-2ca0-4496-8acb-a9c14d642551 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1303 microversion: 2.1 time: 0.150886 Jul 14 14:42:06.486342 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 590/1194] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:06 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1303 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:06.493043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:06.493672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:06.530391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.556181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:06.556181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:06.556181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.489261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:07.509653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:07.516959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:07.518340 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3630fb86-1fff-443a-8f89-23e36c7dca93 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1890 microversion: 2.42 time: 1.030965 Jul 14 14:42:07.519090 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 591/1195] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:06 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1890 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:07.551624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:07.552756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:07.573793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.574433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.581872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:07.582869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:07.594591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=9 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:07.666835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=22 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:07.731587 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b06adfef-d39b-4f00-b46c-aef366100fc0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.207636 Jul 14 14:42:07.735770 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 592/1196] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:42:07 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c/os-volume_attachments => generated 25 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:07.755765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7910cd28-0cee-4af2-8c2d-821803466b96 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2f2eee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:13.467360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:13.761503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=16 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:16.162874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:16.276610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=27 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:17.563354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:17.709480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=48 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:20.002669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lazy-loading 'services' on Instance uuid d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:42:20.779962 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-791ba675-39f5-45c5-bfec-6781709ae6fd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments/2e29ec51-cab4-45fe-87be-e466fb058920" status: 202 len: 0 microversion: 2.1 time: 14.639258 Jul 14 14:42:20.788533 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 605/1197] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 14:42:06 2022] DELETE /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments/2e29ec51-cab4-45fe-87be-e466fb058920 => generated 0 bytes in 14647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:42:20.805067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:20.806793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:20.819682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.820875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:20.826638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:20.827904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.060560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:21.076439 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1845c979-b984-42ef-a04e-7df7c83b70bc tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1477 microversion: 2.1 time: 0.284645 Jul 14 14:42:21.079508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 606/1198] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:20 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1477 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:21.408002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bec85172-f41d-45e6-8dbe-0f7f3b3b1a0f tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:21.409672 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:21.409672 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:42:21.411098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bec85172-f41d-45e6-8dbe-0f7f3b3b1a0f tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.411669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bec85172-f41d-45e6-8dbe-0f7f3b3b1a0f tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.414971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bec85172-f41d-45e6-8dbe-0f7f3b3b1a0f tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.416687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bec85172-f41d-45e6-8dbe-0f7f3b3b1a0f tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.481667 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bec85172-f41d-45e6-8dbe-0f7f3b3b1a0f tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.400448 Jul 14 14:42:21.482286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 607/1199] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:42:21 2022] GET /compute/v2.1/os-services => generated 949 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:21.497918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:21.507364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:21.535712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.538532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.540231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.543320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:21.927250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:21.956413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4595efe-3bb3-4e1f-9e5f-f1c775c1f587 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.462680 Jul 14 14:42:21.964985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 608/1200] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:21 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:21.977388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:21.978676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:21.997265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:21.998142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.000051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.001054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.458044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:22.494559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:22.497547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:22.511016 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7bee15bb-70d4-407c-8f7d-201524d25f95 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.532192 Jul 14 14:42:22.515688 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 609/1201] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:21 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:22.543460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e7be7895-ed1a-45fe-95d9-dcb040e06edc req-f69066bb-c2eb-4412-802b-38cf879cc949 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "name": "network-vif-plugged", "status": "completed", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:22.574627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e7be7895-ed1a-45fe-95d9-dcb040e06edc req-f69066bb-c2eb-4412-802b-38cf879cc949 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.575914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e7be7895-ed1a-45fe-95d9-dcb040e06edc req-f69066bb-c2eb-4412-802b-38cf879cc949 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.607425 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e7be7895-ed1a-45fe-95d9-dcb040e06edc req-f69066bb-c2eb-4412-802b-38cf879cc949 service nova] Creating event network-vif-plugged:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:42:22.621493 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e7be7895-ed1a-45fe-95d9-dcb040e06edc req-f69066bb-c2eb-4412-802b-38cf879cc949 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101753 Jul 14 14:42:22.623621 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 610/1202] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:22.640348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1cd3ff2c-d5d2-4cec-96bd-9e03f906d4e8 req-74f99c93-1228-45e7-96e3-ea178d715e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ab0475-3f12-4654-90aa-a9836585f0e9", "tag": "98ccc6ee-23a2-4598-b98e-18e84f0552f5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:22.662865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1cd3ff2c-d5d2-4cec-96bd-9e03f906d4e8 req-74f99c93-1228-45e7-96e3-ea178d715e39 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.663999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1cd3ff2c-d5d2-4cec-96bd-9e03f906d4e8 req-74f99c93-1228-45e7-96e3-ea178d715e39 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.690525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1cd3ff2c-d5d2-4cec-96bd-9e03f906d4e8 req-74f99c93-1228-45e7-96e3-ea178d715e39 service nova] Creating event network-changed:98ccc6ee-23a2-4598-b98e-18e84f0552f5 for instance a8ab0475-3f12-4654-90aa-a9836585f0e9 on n-h2-768852-23 Jul 14 14:42:22.701041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1cd3ff2c-d5d2-4cec-96bd-9e03f906d4e8 req-74f99c93-1228-45e7-96e3-ea178d715e39 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068674 Jul 14 14:42:22.702096 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 611/1203] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:22.709109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:22.710380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:22.717689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.718922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.720076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.720944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.790362 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-525d73ef-5922-4607-8bb3-188650949e24 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086504 Jul 14 14:42:22.791909 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 612/1204] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:22 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:22.807768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a3398a5-f4d6-4aa5-97ea-49c98f84557e tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:22.809692 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:22.809692 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:42:22.811124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3398a5-f4d6-4aa5-97ea-49c98f84557e tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.811668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3398a5-f4d6-4aa5-97ea-49c98f84557e tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.812518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3398a5-f4d6-4aa5-97ea-49c98f84557e tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.812961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3398a5-f4d6-4aa5-97ea-49c98f84557e tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.849948 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a3398a5-f4d6-4aa5-97ea-49c98f84557e tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.054645 Jul 14 14:42:22.850929 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 613/1205] 10.222.0.98 () {58 vars in 1169 bytes} [Thu Jul 14 14:42:22 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:22.855790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:22.856414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:22.863357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.863813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:22.864631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:22.865068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.286041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:23.302516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-524054f4-cfe6-4e31-89fc-fcc180124205 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1477 microversion: 2.1 time: 0.450116 Jul 14 14:42:23.304237 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 614/1206] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:22 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1477 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:23.314358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e323709f-2fb3-43ac-a734-3c7a3f8b1ac1 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.317370 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:23.317370 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:42:23.321140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e323709f-2fb3-43ac-a734-3c7a3f8b1ac1 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.322448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e323709f-2fb3-43ac-a734-3c7a3f8b1ac1 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.324299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e323709f-2fb3-43ac-a734-3c7a3f8b1ac1 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.325423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e323709f-2fb3-43ac-a734-3c7a3f8b1ac1 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.379116 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e323709f-2fb3-43ac-a734-3c7a3f8b1ac1 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.072586 Jul 14 14:42:23.381852 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 615/1207] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/os-services => generated 949 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:23.391986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.393666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:23.406855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.408208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.410060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.411944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.584257 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7910cd28-0cee-4af2-8c2d-821803466b96 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c" status: 200 len: 1435 microversion: 2.1 time: 15.843794 Jul 14 14:42:23.585096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 593/1208] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:07 2022] GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c => generated 1435 bytes in 15848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:23.598651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f50bf84-82cb-4ee7-ad99-82a04f224e89 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.600178 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:23.600178 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:42:23.601675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f50bf84-82cb-4ee7-ad99-82a04f224e89 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.608997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f50bf84-82cb-4ee7-ad99-82a04f224e89 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.610058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f50bf84-82cb-4ee7-ad99-82a04f224e89 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.610512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f50bf84-82cb-4ee7-ad99-82a04f224e89 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.680023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f50bf84-82cb-4ee7-ad99-82a04f224e89 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?host=n-d-768852-23&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.081402 Jul 14 14:42:23.680272 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 594/1209] 10.222.0.98 () {58 vars in 1195 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/os-services?host=n-d-768852-23&binary=xxx => generated 16 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:42:23.695672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.696310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:23.705001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.706661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.708378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.709601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.783091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:23.793191 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fb9ac1f-f5b7-4c8e-a353-dbc5fb0f14c6 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.409302 Jul 14 14:42:23.794763 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 616/1210] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:23.801471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c17b508-a366-44f6-b892-085e4e397911 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf36354c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.870472 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c17b508-a366-44f6-b892-085e4e397911 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c" status: 200 len: 1435 microversion: 2.1 time: 0.073921 Jul 14 14:42:23.871198 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 617/1211] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c => generated 1435 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:23.881019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c05a595-ce8d-4b39-9523-3be9dbffacb3 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.885620 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:23.885620 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:42:23.888767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c05a595-ce8d-4b39-9523-3be9dbffacb3 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.889331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c05a595-ce8d-4b39-9523-3be9dbffacb3 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.890829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c05a595-ce8d-4b39-9523-3be9dbffacb3 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.891384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c05a595-ce8d-4b39-9523-3be9dbffacb3 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.927977 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c05a595-ce8d-4b39-9523-3be9dbffacb3 tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.055300 Jul 14 14:42:23.928994 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 618/1212] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/os-services => generated 949 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:23.958019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:23.961106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:23.978606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.983748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:23.985040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:23.985884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.029317 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cca22169-a37d-438f-8cb3-a01039ca210b tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091358 Jul 14 14:42:24.031294 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 619/1213] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:24.037166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:24.038094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:24.047160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:24.048478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.048873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:24.049597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.329840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:24.353609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:24.364692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:24.370639 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bad614eb-4258-4dad-ad0f-efcc97e0b887 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.681810 Jul 14 14:42:24.372336 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 595/1214] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:23 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:24.390304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:24.403235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65e0deac-b511-4dd8-bf2a-c151a555c76d tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:24.406973 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bad1e226-624d-444f-9810-4d430317f169 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1465 microversion: 2.1 time: 0.372836 Jul 14 14:42:24.407188 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:24.407188 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:42:24.410132 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 620/1215] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:24 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1465 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:24.413752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65e0deac-b511-4dd8-bf2a-c151a555c76d tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:24.419437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65e0deac-b511-4dd8-bf2a-c151a555c76d tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.422835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65e0deac-b511-4dd8-bf2a-c151a555c76d tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:24.422835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65e0deac-b511-4dd8-bf2a-c151a555c76d tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.428568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:24.431359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:24.441063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:24.441932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.443161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:24.443964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:24.568088 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65e0deac-b511-4dd8-bf2a-c151a555c76d tempest-ServicesAdminNegativeTestJSON-1323760892 tempest-ServicesAdminNegativeTestJSON-1323760892-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.179347 Jul 14 14:42:24.575563 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 596/1216] 10.222.0.98 () {58 vars in 1197 bytes} [Thu Jul 14 14:42:24 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:42:24.594443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e51f9121-172d-4afe-957a-084da15ba06c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2c8d3a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:24.856709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:24.866536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9da8676-8bb0-4878-9cdc-a5851adaee46 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1477 microversion: 2.1 time: 0.454763 Jul 14 14:42:24.867059 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 621/1217] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:24 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1477 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:25.040311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd541559-c94f-41e2-8983-52cdbd0d24ff tempest-ServicesAdminNegativeTestJSON-475102731 tempest-ServicesAdminNegativeTestJSON-475102731-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:25.041779 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:42:25.041779 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:42:25.043320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bd541559-c94f-41e2-8983-52cdbd0d24ff tempest-ServicesAdminNegativeTestJSON-475102731 tempest-ServicesAdminNegativeTestJSON-475102731-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '4455db034a8c44dc84452b1ece326f09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df3bf8e3cc1f4ead9fd86cee504d9b7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd541559-c94f-41e2-8983-52cdbd0d24ff tempest-ServicesAdminNegativeTestJSON-475102731 tempest-ServicesAdminNegativeTestJSON-475102731-project] Request method failure captured: Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cs9A5Adp4cJPEl9IvAIYVFPoJI7QnKbF6J47D6VcdrouhdPdikrvaz6wIWbCXY98XeT9Mcne07pxs8AeXSxhyhrESbbdHOxiunWdkK5s8RGLmiaZ-JNWifZXzf55q1VWsljSbZ2VKxinHYKwkaImNhm4HNhDv8lCq6U4j_10RHpDKE Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: df3bf8e3cc1f4ead9fd86cee504d9b7e Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-475102731 Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:42:25.051244 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/df3bf8e3cc1f4ead9fd86cee504d9b7e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_df3bf8e3cc1f4ead9fd86cee504d9b7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/df3bf8e3cc1f4ead9fd86cee504d9b7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/df3bf8e3cc1f4ead9fd86cee504d9b7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-475102731 Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: df3bf8e3cc1f4ead9fd86cee504d9b7e Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-475102731 Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServicesAdminNegativeTestJSON-475102731-project Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4455db034a8c44dc84452b1ece326f09 Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-475102731-project Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:42:25.052893 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:42:25.053894 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:42:25.055670 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:25.057246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd541559-c94f-41e2-8983-52cdbd0d24ff tempest-ServicesAdminNegativeTestJSON-475102731 tempest-ServicesAdminNegativeTestJSON-475102731-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:25.057246 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd541559-c94f-41e2-8983-52cdbd0d24ff tempest-ServicesAdminNegativeTestJSON-475102731 tempest-ServicesAdminNegativeTestJSON-475102731-project] 10.222.0.98 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.184163 Jul 14 14:42:25.057246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 622/1218] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:42:24 2022] GET /compute/v2.1/os-services => generated 112 bytes in 186 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:25.067895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-41cfc379-f48c-4bd9-9278-7cfea411ff6b req-9b1be6dd-2a7f-45ca-98da-5d04f825d0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c69871-43bd-4251-ae79-02953e468fc7", "name": "network-vif-plugged", "status": "completed", "tag": "fb021a48-5a36-4cbf-8c24-ec016855b2a2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:25.086911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-41cfc379-f48c-4bd9-9278-7cfea411ff6b req-9b1be6dd-2a7f-45ca-98da-5d04f825d0fa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.087636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-41cfc379-f48c-4bd9-9278-7cfea411ff6b req-9b1be6dd-2a7f-45ca-98da-5d04f825d0fa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.117663 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-41cfc379-f48c-4bd9-9278-7cfea411ff6b req-9b1be6dd-2a7f-45ca-98da-5d04f825d0fa service nova] Creating event network-vif-plugged:fb021a48-5a36-4cbf-8c24-ec016855b2a2 for instance 28c69871-43bd-4251-ae79-02953e468fc7 on n-h1-768852-23 Jul 14 14:42:25.130345 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-41cfc379-f48c-4bd9-9278-7cfea411ff6b req-9b1be6dd-2a7f-45ca-98da-5d04f825d0fa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075124 Jul 14 14:42:25.131378 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 623/1219] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:25.146737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:25.147528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:25.175420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.180494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.181371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.181821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.547967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:25.580854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-97cab9d9-e128-4ecd-9727-8e3db2aacc41 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.446009 Jul 14 14:42:25.581736 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 624/1220] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:25 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:25.592506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:25.597930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:25.617030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.620369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.621630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.623360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.699346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44260cce-cbdf-4c14-826a-76e1bb28cc57 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114997 Jul 14 14:42:25.701126 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 625/1221] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:25 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:25.713246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:25.715554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:25.727006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.728207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.729789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:25.731414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:25.740067 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e51f9121-172d-4afe-957a-084da15ba06c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "DELETE /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c" status: 204 len: 0 microversion: 2.1 time: 1.163221 Jul 14 14:42:25.741639 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 597/1222] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:24 2022] DELETE /compute/v2.1/images/a1c03c8b-f70c-43e7-8d14-59603645a54c => generated 0 bytes in 1165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:42:25.753028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16727576-9f6f-4aa7-9543-66b68263826c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '.version_select at 0x7fdbf2cfdee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.065542 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-16727576-9f6f-4aa7-9543-66b68263826c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] HTTP exception thrown: Image not found. Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16727576-9f6f-4aa7-9543-66b68263826c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Request method failure captured: Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 HTTP/1.1 Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Crt8LDTad1YCvyymPKaWf-8IsgiIaQJaPV--eq854dwsD2Cuntl_VtGDJM4T27CDSL97A8gsS3w_J3woILk5r8k4GFayGIALEjGtaFu7B89hf81eOgsPunUtKuwcXTz-ceM6jqCtk2ZU0nngGPoSCWKwCZeOFRndPe5oncsCpkBNGk Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 75041b3d85ea40d4a5525c6c62f91ec2 Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:42:26.067141 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 75041b3d85ea40d4a5525c6c62f91ec2 Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesOneServerTestJSON-208828394-project Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 9802f1cfe8d54628a7ccf4aa0d3cc19e Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesOneServerTestJSON-208828394-project Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'da984628-5ed9-4323-8122-cd4e7680ed75'} Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:26.068892 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image da984628-5ed9-4323-8122-cd4e7680ed75 to delete Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.069821 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image da984628-5ed9-4323-8122-cd4e7680ed75 could not be found. Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:26.071697 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16727576-9f6f-4aa7-9543-66b68263826c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16727576-9f6f-4aa7-9543-66b68263826c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "DELETE /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75" status: 404 len: 62 microversion: 2.1 time: 0.323105 Jul 14 14:42:26.074798 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 598/1223] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:25 2022] DELETE /compute/v2.1/images/da984628-5ed9-4323-8122-cd4e7680ed75 => generated 62 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:42:26.078626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.078990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:26.099694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.100072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.100888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.101331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.121085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:26.138003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:26.140610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:26.141881 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30770faa-e12e-4dc5-bf45-63dc8ffa383a tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.437509 Jul 14 14:42:26.154485 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 626/1224] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:25 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:26.161207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.162013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:26.170673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.171994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.173531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.174176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.219683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:42:26.254157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:26.375492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:26.387538 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5baafa6f-daae-4906-aa21-0aac801d1e27 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1477 microversion: 2.1 time: 0.317257 Jul 14 14:42:26.398445 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 599/1225] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:26 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1477 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:26.431603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-013b9d3a-2ff1-4075-bee5-8d55d066770f tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 204 len: 0 microversion: 2.1 time: 0.274421 Jul 14 14:42:26.433017 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 627/1226] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:42:26 2022] DELETE /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:42:26.447070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.448293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:26.457882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.459008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.460708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.462377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.602261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.603612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:26.611469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.612229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.613714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.614340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.722109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:26.733132 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38e473ce-d8b1-4469-a6da-7c6c99b69db9 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1471 microversion: 2.1 time: 0.294822 Jul 14 14:42:26.743782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 600/1227] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:26 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1471 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:26.749817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:26.751238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:26.759415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.760479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.762247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:26.763023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:26.807439 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0bb89a9-0690-4d06-a52a-5f8e26032eb9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061599 Jul 14 14:42:26.811723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 601/1228] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:26 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:26.862886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:26.873834 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ee4a0d4-54a2-4ea2-9465-067d237a6999 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.276195 Jul 14 14:42:26.883635 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 628/1229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:26 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:27.170285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:27.170973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:27.185209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.187974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.189107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.194603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.409639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:27.410442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:27.423357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.425146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.427824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.428489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.656148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:27.703928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:27.714911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:27.718387 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e04c48a3-51fc-4c02-8663-42405835a31c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.558354 Jul 14 14:42:27.720113 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 602/1230] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:27 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:27.722548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:27.728655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e27c47c8-6729-4ed2-bad9-ec6dc1ed20d2 req-e62c8243-0002-41f7-b461-939c12f8b305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "name": "network-vif-unplugged", "status": "completed", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:27.731793 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46317e0d-1fcd-45a5-9805-f67d87e054ce tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1463 microversion: 2.1 time: 0.328694 Jul 14 14:42:27.732515 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 629/1231] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:27 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1463 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:27.750037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e27c47c8-6729-4ed2-bad9-ec6dc1ed20d2 req-e62c8243-0002-41f7-b461-939c12f8b305 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.752059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e27c47c8-6729-4ed2-bad9-ec6dc1ed20d2 req-e62c8243-0002-41f7-b461-939c12f8b305 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.760444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:27.761884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:27.779214 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e27c47c8-6729-4ed2-bad9-ec6dc1ed20d2 req-e62c8243-0002-41f7-b461-939c12f8b305 service nova] Creating event network-vif-unplugged:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:42:27.781778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.782255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.783160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.783559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.791833 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e27c47c8-6729-4ed2-bad9-ec6dc1ed20d2 req-e62c8243-0002-41f7-b461-939c12f8b305 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069146 Jul 14 14:42:27.799752 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 603/1232] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:27.814933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:27.817198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:27.832067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.833453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:27.836333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:27.837436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.059160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:28.078589 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54c14db3-781f-486b-bc99-bda3dc37a27c tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1471 microversion: 2.1 time: 0.329479 Jul 14 14:42:28.092783 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 630/1233] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:27 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:28.110850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:28.125999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:28.160304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.162195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.164882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.165750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.223210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66ea4491-c0e8-4a64-bde1-2c0bf2654c39 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122438 Jul 14 14:42:28.229225 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 631/1234] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:28 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:28.230145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:28.230782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:28.239124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.239615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.240652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.241102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.318543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:28.338350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d54a656-e827-434b-8fe2-f4473c87d8a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1463 microversion: 2.1 time: 0.534836 Jul 14 14:42:28.352666 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 604/1235] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:27 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1463 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:28.379230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:28.386664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:28.414932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.415231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.416303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.418962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.530328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:28.558172 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3b539fa-5947-432b-963d-206658c58b34 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.332208 Jul 14 14:42:28.576856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 632/1236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:28 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:28.667398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:42:28.668503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:42:28.669384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:42:28.670136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:42:28.671454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:42:28.767479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:28.769733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:28.793817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.794611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.797913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.798588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.942918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:28.983215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.988303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:28.989824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:28.990646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.090797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:29.102990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:29.105038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:29.106824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2011074b-4686-466a-83ec-d280a13ffca8 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.357706 Jul 14 14:42:29.108943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 633/1237] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:28 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:29.114525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:29.115638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:29.124763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.125526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.126518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.127116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.188096 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfa5bba6-de87-4ec0-9e45-e06ed618721c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 1067 microversion: 2.1 time: 0.821877 Jul 14 14:42:29.190639 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 605/1238] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:42:28 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 1067 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Jul 14 14:42:29.215568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:29.217287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:29.232655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.234316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.236752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.237901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.530838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:29.542890 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d85968e6-fcf4-473e-a812-5fb9cf40ca79 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1471 microversion: 2.1 time: 0.432534 Jul 14 14:42:29.546710 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 634/1239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:29 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1471 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:29.572908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:29.586970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:29.620687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.647974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.649144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.652591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.749398 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e6076fd-ce0b-4076-8a32-840fc3e6c9ee tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193638 Jul 14 14:42:29.758596 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 635/1240] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:29 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:29.773692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:29.778809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:29.798372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.801479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:29.804496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:29.805078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.074865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.084664 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2924991a-780d-4309-9718-4f2c500807b9 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.882343 Jul 14 14:42:30.090188 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 606/1241] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:29 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:30.147060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:30.147683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:30.165186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.167361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.168402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.168855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.183479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.193902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4b8f1465-da27-446e-ba4b-308d8d12313f tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.433912 Jul 14 14:42:30.199755 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 636/1242] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:29 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:30.565179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:30.566868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:30.580087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.583412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.588589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.589321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.795001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9802f1cfe8d54628a7ccf4aa0d3cc19e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75041b3d85ea40d4a5525c6c62f91ec2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.813630 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3df9ecd2-d3e0-4676-8396-59f370a2a49a tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 200 len: 1429 microversion: 2.1 time: 0.248677 Jul 14 14:42:30.823799 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 637/1243] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:30 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 1429 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:42:30.939219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.959801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.966604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:30.969769 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64f4967f-e820-45d5-9d57-99bc608fdd8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.826723 Jul 14 14:42:30.974164 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 607/1244] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:30 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:30.980418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:30.981942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:30.990175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.990846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:30.992072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:30.992696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.066260 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51d49cd5-4719-4feb-b47e-0a2b2ece2846 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089538 Jul 14 14:42:31.067930 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 608/1245] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:30 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:31.093560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a79676e5-fff9-4954-ba4c-e52eb48a81c2 req-fcf85511-ff83-4a12-94be-b4de90bbcce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffeadfcc-2f9b-4563-8e7c-bfe400f77e43", "name": "network-vif-deleted", "tag": "0015c323-e4f8-43d6-b57e-60ea851bd4d2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:31.117494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a79676e5-fff9-4954-ba4c-e52eb48a81c2 req-fcf85511-ff83-4a12-94be-b4de90bbcce9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.117949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a79676e5-fff9-4954-ba4c-e52eb48a81c2 req-fcf85511-ff83-4a12-94be-b4de90bbcce9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.140175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a79676e5-fff9-4954-ba4c-e52eb48a81c2 req-fcf85511-ff83-4a12-94be-b4de90bbcce9 service nova] Creating event network-vif-deleted:0015c323-e4f8-43d6-b57e-60ea851bd4d2 for instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 on n-h2-768852-23 Jul 14 14:42:31.147848 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a79676e5-fff9-4954-ba4c-e52eb48a81c2 req-fcf85511-ff83-4a12-94be-b4de90bbcce9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077824 Jul 14 14:42:31.150390 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 609/1246] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:31.157762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:31.159438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:31.168466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.169345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.171351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.172124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.513474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4447df41-23cf-4f33-8330-66ed3aba846e"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:31.526546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:31.567700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.579117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.582416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.588534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.868690 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] HTTP exception thrown: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Request method failure captured: Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments/6c7815d5-05fe-465b-938c-78a21bb6055d HTTP/1.1 Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 74 Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CrYPbMOhqiqh70OiqzNk9U-pQOgAsEO_Igxum-zmY6Oh5ACZErrVOkQ7059nb6mKGu2qUP_TQ1ptJXaEomxjxVnoo77-O4SWDZu-DdmBunwUfcbtka-7lO8j8-_x4M2HCpB8XYJf7-mgBPuJotnpDqGm4gDXSfT0x94WkUIpvP9jPw Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: fce063950ebc4d3ab9e0fc06579144b8 Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesAdminNegativeTest-664428940 Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:42:31.910942 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesAdminNegativeTest-664428940 Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: fce063950ebc4d3ab9e0fc06579144b8 Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-664428940 Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesAdminNegativeTest-664428940-project-admin Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c31177f742594d958cceefddea7bc399 Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesAdminNegativeTest-664428940-project-admin Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: {"volumeAttachment": {"volumeId": "4447df41-23cf-4f33-8330-66ed3aba846e"}} Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:42:31.913580 n-d-768852-23 devstack@n-api.service[125965]: exception: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': '2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1', 'id': '6c7815d5-05fe-465b-938c-78a21bb6055d', 'body': {'volumeAttachment': {'volumeId': '4447df41-23cf-4f33-8330-66ed3aba846e'}}} Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:42:31.915216 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. (HTTP 404) (Request-ID: req-1a37185f-c65c-4b9f-a149-af224f453339) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:42:31.917485 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:31.922905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. Jul 14 14:42:31.927702 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:31.932728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Returning 400 to user: Volume 4447df41-23cf-4f33-8330-66ed3aba846e could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:31.932728 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4ba3316-8019-4785-8509-b5c0d51e3dd9 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] 10.222.0.98 "PUT /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments/6c7815d5-05fe-465b-938c-78a21bb6055d" status: 400 len: 107 microversion: 2.1 time: 1.087668 Jul 14 14:42:31.932728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 638/1247] 10.222.0.98 () {60 vars in 1432 bytes} [Thu Jul 14 14:42:30 2022] PUT /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments/6c7815d5-05fe-465b-938c-78a21bb6055d => generated 107 bytes in 1089 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:42:31.932728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:31.932728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:31.945954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.948128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:31.949174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:31.949700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.331756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:32.345223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e9fc9fac-ed5f-492c-b8b1-23e6925de610 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.430547 Jul 14 14:42:32.346211 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 639/1248] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:31 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:32.352813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-92878ad1-3ada-49e6-b89b-fc4582549b77 req-2ab94fb6-fda6-46cf-9ac2-215ab69b41d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ab0475-3f12-4654-90aa-a9836585f0e9", "name": "network-vif-plugged", "status": "completed", "tag": "98ccc6ee-23a2-4598-b98e-18e84f0552f5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:32.362881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-92878ad1-3ada-49e6-b89b-fc4582549b77 req-2ab94fb6-fda6-46cf-9ac2-215ab69b41d1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.363891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-92878ad1-3ada-49e6-b89b-fc4582549b77 req-2ab94fb6-fda6-46cf-9ac2-215ab69b41d1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.379135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:32.390346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-92878ad1-3ada-49e6-b89b-fc4582549b77 req-2ab94fb6-fda6-46cf-9ac2-215ab69b41d1 service nova] Creating event network-vif-plugged:98ccc6ee-23a2-4598-b98e-18e84f0552f5 for instance a8ab0475-3f12-4654-90aa-a9836585f0e9 on n-h2-768852-23 Jul 14 14:42:32.392124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66353af9-3502-46fc-a8df-4734f046ab10 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 1.239872 Jul 14 14:42:32.392971 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 610/1249] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:31 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:32.401042 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-92878ad1-3ada-49e6-b89b-fc4582549b77 req-2ab94fb6-fda6-46cf-9ac2-215ab69b41d1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053177 Jul 14 14:42:32.402144 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 640/1250] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:32.409680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:32.410609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:32.419676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.420498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.422054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.423636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.436074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:32.441597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] [instance: ffeadfcc-2f9b-4563-8e7c-bfe400f77e43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:32.464257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.468404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.478893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.491349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.552737 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] HTTP exception thrown: Instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 could not be found. Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Request method failure captured: Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 HTTP/1.1 Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Crt8LDTad1YCvyymPKaWf-8IsgiIaQJaPV--eq854dwsD2Cuntl_VtGDJM4T27CDSL97A8gsS3w_J3woILk5r8k4GFayGIALEjGtaFu7B89hf81eOgsPunUtKuwcXTz-ceM6jqCtk2ZU0nngGPoSCWKwCZeOFRndPe5oncsCpkBNGk Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 75041b3d85ea40d4a5525c6c62f91ec2 Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:42:32.562620 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/75041b3d85ea40d4a5525c6c62f91ec2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 75041b3d85ea40d4a5525c6c62f91ec2 Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-208828394 Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesOneServerTestJSON-208828394-project Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 9802f1cfe8d54628a7ccf4aa0d3cc19e Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesOneServerTestJSON-208828394-project Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 could not be found. Jul 14 14:42:32.564477 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ffeadfcc-2f9b-4563-8e7c-bfe400f77e43'} Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 could not be found. Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:32.565447 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 could not be found. Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 could not be found. Jul 14 14:42:32.567056 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:42:32.569532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] Returning 404 to user: Instance ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:32.572843 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3ef4e54-fa8c-4c09-b083-aebb67266277 tempest-ImagesOneServerTestJSON-208828394 tempest-ImagesOneServerTestJSON-208828394-project] 10.222.0.98 "GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43" status: 404 len: 111 microversion: 2.1 time: 0.177939 Jul 14 14:42:32.591621 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 611/1251] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:32 2022] GET /compute/v2.1/servers/ffeadfcc-2f9b-4563-8e7c-bfe400f77e43 => generated 111 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:42:32.606843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:32.608815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:32.617832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.618530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.619653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.620321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.672896 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54c386d2-675a-45ac-aa54-f707ff4275cd tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079621 Jul 14 14:42:32.674432 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 612/1252] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:32 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:32.697849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:32.698711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:32.715973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.717115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:32.720023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:32.721249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.011996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:33.038156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:33.042865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:33.045789 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-afa7563f-7518-4218-8bfb-1865e29cc109 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.641759 Jul 14 14:42:33.048604 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 641/1253] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:32 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:33.122195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:33.132571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lazy-loading 'services' on Instance uuid 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:42:33.378697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:33.388657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:33.410091 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-96d67a87-358e-4988-b48c-737000b3bb01 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments/6c7815d5-05fe-465b-938c-78a21bb6055d" status: 202 len: 0 microversion: 2.1 time: 0.731594 Jul 14 14:42:33.413507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:33.414899 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 613/1254] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 14:42:32 2022] DELETE /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments/6c7815d5-05fe-465b-938c-78a21bb6055d => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:42:33.444377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.446279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:33.447696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.459577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:33.463487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:33.483349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:33.486129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.489155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:33.490031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:33.908129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:34.003498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:34.031119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aec007f2-0bbc-4376-b0ef-3025b3df8288 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.595299 Jul 14 14:42:34.034479 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 614/1255] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:33 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:34.044059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:34.069955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:34.080491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:34.088164 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f8c9350-a59a-436b-b159-1104ce287088 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1370 microversion: 2.1 time: 0.716553 Jul 14 14:42:34.103894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.103894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.105114 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 642/1256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:33 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1370 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:34.106760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.110880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.122040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:34.125792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:34.138392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.139798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.141558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.142632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.218415 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c2920c2-f4a8-465b-9c35-b389d58072a3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109082 Jul 14 14:42:34.229149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 643/1257] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:34 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:42:34.235714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4654a9b1-95c8-4bee-90a5-f5cdb59690ce tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.199053 Jul 14 14:42:34.236963 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 615/1258] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:34 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:34.237168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:34.249454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:34.277675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.283167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.284222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:34.284686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:34.291006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:35.062264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:35.063214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.067989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:35.096483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.097517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.099439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.104201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.130527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:35.176909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:35.184210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:35.194287 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ef7e758-af32-4a61-954e-45dd6c7d59f7 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.968603 Jul 14 14:42:35.200695 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 644/1259] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:34 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:35.215797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:35.227733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.261421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.262619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.270358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.273758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.692242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:35.713442 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1bfc94c3-0abf-42da-80dc-b703b1f4e8da tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1555 microversion: 2.1 time: 0.511014 Jul 14 14:42:35.714658 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 645/1260] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:35 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1555 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:35.720130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:35.721544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.748042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.749841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.754297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.756010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.868802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb1458db-44b6-4d91-bdde-cedeccd51d60 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152359 Jul 14 14:42:35.875402 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 646/1261] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:35 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:35.886787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:35.890174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:35.915627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:35.926940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7553e32d-0adc-49dd-a09f-60e5e7591cfb tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.867133 Jul 14 14:42:35.941934 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 616/1262] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:35 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:35.947006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.948973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:35.951442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:35.953339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:36.233949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:36.234511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:36.245663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:36.246123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:36.246926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:36.247395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:36.361647 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b5c16ec3-a092-4e73-b2e9-08598d4d31d5 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.483382 Jul 14 14:42:36.364490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 647/1263] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:42:35 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-interface => generated 284 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:37.146661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fa29953-0d62-4920-b0c6-b3b1a87fd5c1 tempest-ListImageFiltersNegativeTestJSON-1791636986 tempest-ListImageFiltersNegativeTestJSON-1791636986-project] Calling method '.version_select at 0x7fdbf2c0e5e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:37.449613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:37.473004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:37.480847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:37.489684 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d27e5089-e708-446e-a9e7-354e77b660f5 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 1.259120 Jul 14 14:42:37.490479 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 617/1264] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:36 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:37.505482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:37.506529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:37.537676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:37.538136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:37.544913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:37.546471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:37.724762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16d7be69-e9f6-48ac-9c4e-6543fdd65966 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231509 Jul 14 14:42:37.727976 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 618/1265] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:37 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:37.765266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:37.767015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:37.798432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:37.799308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:37.802351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:37.805761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:38.496594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:38.522668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e69c8777-ee5e-4797-a97d-508f2b77f470 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.784052 Jul 14 14:42:38.533368 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 619/1266] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:37 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:38.549833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:38.574424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:38.636525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:38.637089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:38.644242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:38.645818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:39.629781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:39.662065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:39.664796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:39.673582 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d085635-a613-441c-83d6-e2d3cc314b1c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 1.146697 Jul 14 14:42:39.685465 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 620/1267] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:38 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:39.697525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:39.700651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:39.715151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:39.715973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:39.721236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:39.722412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:39.883261 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b33dbbb-2ad0-44d5-952e-c6ba02cba63b tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195699 Jul 14 14:42:39.909852 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 621/1268] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:39 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 197 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:39.955702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-78bf42cd-f0b9-4ea8-9dd8-2f8bef565f4e req-87eb4eb4-06c7-432f-9112-abf0264eff3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ab0475-3f12-4654-90aa-a9836585f0e9", "tag": "98ccc6ee-23a2-4598-b98e-18e84f0552f5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:40.003423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-78bf42cd-f0b9-4ea8-9dd8-2f8bef565f4e req-87eb4eb4-06c7-432f-9112-abf0264eff3c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:40.004610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-78bf42cd-f0b9-4ea8-9dd8-2f8bef565f4e req-87eb4eb4-06c7-432f-9112-abf0264eff3c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:40.051642 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-78bf42cd-f0b9-4ea8-9dd8-2f8bef565f4e req-87eb4eb4-06c7-432f-9112-abf0264eff3c service nova] Creating event network-changed:98ccc6ee-23a2-4598-b98e-18e84f0552f5 for instance a8ab0475-3f12-4654-90aa-a9836585f0e9 on n-h2-768852-23 Jul 14 14:42:40.074279 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-78bf42cd-f0b9-4ea8-9dd8-2f8bef565f4e req-87eb4eb4-06c7-432f-9112-abf0264eff3c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161786 Jul 14 14:42:40.075881 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 622/1269] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:40.094438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:40.101177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:40.131089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:40.132488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:40.134408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:40.135685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:40.810004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:40.846053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a25a8c7-6200-4338-9a71-8be0f040a960 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.759938 Jul 14 14:42:40.870554 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 623/1270] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:40 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:40.878516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:40.881656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:40.898759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:40.902206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:40.907189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:40.909080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.022284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:42.044429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:42.052883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:42.058902 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56783ca0-3ad8-4530-b810-88c4f6f6126b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 1.183345 Jul 14 14:42:42.064617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 624/1271] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:40 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:42.073920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:42.080522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:42.096802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:42.099634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.101143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:42.103401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.181445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8605ec2a-b475-45fd-a315-3bde1e3897ed tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115211 Jul 14 14:42:42.182103 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 625/1272] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:42 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:42.191623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:42.196180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:42.220450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:42.221273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.222292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:42.222909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:42.791696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:42.834584 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f317422-31b4-4a52-88b3-1ecddd8fac08 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.647061 Jul 14 14:42:42.836140 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 626/1273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:42 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:43.083664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:43.087378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:43.110656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:43.112001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:43.113670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:43.115390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:43.922435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:43.955189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:43.963820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:43.968515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4043ef66-b180-4959-8ca3-215b6fe19c8d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.893369 Jul 14 14:42:43.973118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 627/1274] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:43 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:44.022356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:44.024199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:44.034703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:44.036140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:44.037198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:44.038119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:44.099592 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15ee9b9f-4736-4d73-9806-4abdff38ee1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.124257 Jul 14 14:42:44.101905 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 628/1275] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:43 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:44.119636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:44.120915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:44.131652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:44.132453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:44.134931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:44.135657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:44.537207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:44.553693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6295e3e9-d5e9-4b6d-a71c-d414ba82c240 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.450039 Jul 14 14:42:44.554932 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 629/1276] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:44 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:45.006497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:45.010151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:45.058761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.060011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.062247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.063839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.142301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:45.372048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:45.383053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:45.385005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:45.386286 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18478978-f77b-4563-bbdb-e8f52b5b4ce0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.398748 Jul 14 14:42:45.387171 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 630/1277] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:44 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:42:45.392757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:45.393627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:45.400527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.401272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.402119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:45.402571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:45.446754 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ce732c5-f152-4f6d-ab2f-ba29bb918bdc tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058243 Jul 14 14:42:45.454257 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 631/1278] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:42:45 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1/os-volume_attachments => generated 25 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:42:45.588931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-88ee8b53-fd0c-4187-b9ce-0844a87bbfc4 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Action: 'create', calling method: .version_select at 0x7fdbf2f2e5e0>, body: {"pool": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:45.942251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:46.078864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=20 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:47.628105 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-88ee8b53-fd0c-4187-b9ce-0844a87bbfc4 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.171952 Jul 14 14:42:47.630459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 632/1279] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:42:45 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:47.636789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:47.637695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:47.650482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=81 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:42:47.658073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:47.659677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:47.661347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:47.662014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:47.952407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:47.994782 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c15a13a-1cb8-4ad3-bdf1-0206a1a826bf tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.362915 Jul 14 14:42:48.005015 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 633/1280] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:47 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:48.015380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-492070392", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "9ace3d13-e3c2-4c42-82fb-f9f624fdc4bd"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:52.280419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6fa29953-0d62-4920-b0c6-b3b1a87fd5c1 tempest-ListImageFiltersNegativeTestJSON-1791636986 tempest-ListImageFiltersNegativeTestJSON-1791636986-project] HTTP exception thrown: Image not found. Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fa29953-0d62-4920-b0c6-b3b1a87fd5c1 tempest-ListImageFiltersNegativeTestJSON-1791636986 tempest-ListImageFiltersNegativeTestJSON-1791636986-project] Request method failure captured: Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/images/fabd906c-e19b-4480-935b-56ca234c03e5 HTTP/1.1 Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CtcHTeErqA6n1kWoLhh4DndsEAW0Sg4OVp1-MnNgep08UrDEigkI8TJJso_-oqP_HAAXgFu3zhkPdufwc-EOGlsCE6bs3OOq3srV4bKKxfze_H-fFTUT8Qe9Scazg6NkgQgT0iMDiPitLr4XO3dizIOV2OxdKdsFHW9TcefvmSx3tI Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 064698e5699446feb41a72106863062b Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1791636986 Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:42:52.284775 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/064698e5699446feb41a72106863062b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_064698e5699446feb41a72106863062b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/064698e5699446feb41a72106863062b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/064698e5699446feb41a72106863062b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1791636986 Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 064698e5699446feb41a72106863062b Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1791636986 Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListImageFiltersNegativeTestJSON-1791636986-project Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: f6d13082d682457baea50ada61fc0f9d Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1791636986-project Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fabd906c-e19b-4480-935b-56ca234c03e5'} Jul 14 14:42:52.286617 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:42:52.288178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fabd906c-e19b-4480-935b-56ca234c03e5 Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:42:52.291974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fabd906c-e19b-4480-935b-56ca234c03e5 could not be found. Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:42:52.293408 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:52.294645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fa29953-0d62-4920-b0c6-b3b1a87fd5c1 tempest-ListImageFiltersNegativeTestJSON-1791636986 tempest-ListImageFiltersNegativeTestJSON-1791636986-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:52.296392 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6fa29953-0d62-4920-b0c6-b3b1a87fd5c1 tempest-ListImageFiltersNegativeTestJSON-1791636986 tempest-ListImageFiltersNegativeTestJSON-1791636986-project] 10.222.0.98 "GET /compute/v2.1/images/fabd906c-e19b-4480-935b-56ca234c03e5" status: 404 len: 62 microversion: 2.1 time: 15.414251 Jul 14 14:42:52.296392 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 648/1281] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:42:36 2022] GET /compute/v2.1/images/fabd906c-e19b-4480-935b-56ca234c03e5 => generated 62 bytes in 15417 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:42:52.307311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:52.307311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:52.316678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:52.318138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:52.320307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:52.321693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:52.356824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] validate_networks() for [('9ace3d13-e3c2-4c42-82fb-f9f624fdc4bd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:42:52.745721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:52.762924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:52.768481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:52.769990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd9458ec-2763-4ae1-a17d-321b9de4486f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.476209 Jul 14 14:42:52.772551 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 649/1282] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:52 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:52.777530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c9125b1c-a016-430c-abaf-df977ceb8286 req-8a0806b2-9c68-4841-9dee-1e35bce037a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "c3c6e28a-5abb-499b-9d2c-08703e602c92"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:52.796225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c9125b1c-a016-430c-abaf-df977ceb8286 req-8a0806b2-9c68-4841-9dee-1e35bce037a1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:52.797173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c9125b1c-a016-430c-abaf-df977ceb8286 req-8a0806b2-9c68-4841-9dee-1e35bce037a1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:52.814563 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c9125b1c-a016-430c-abaf-df977ceb8286 req-8a0806b2-9c68-4841-9dee-1e35bce037a1 service nova] Creating event network-vif-plugged:c3c6e28a-5abb-499b-9d2c-08703e602c92 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:52.822540 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c9125b1c-a016-430c-abaf-df977ceb8286 req-8a0806b2-9c68-4841-9dee-1e35bce037a1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048470 Jul 14 14:42:52.823218 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 650/1283] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:52.833977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaaa9939-fc60-46d0-a679-db79d1e48f9c tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Action: 'create', calling method: .version_select at 0x7fdbf33e1040>, body: {"pool": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:53.620446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:42:53.621395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:42:53.622030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:42:53.622962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:42:53.624114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:42:53.639600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:53.641287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:53.642827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:53.643627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:53.682341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Getting quotas for project 2a999d9d8991476983a97cb975c6302a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:42:53.690861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Getting quotas for user 2deda01949ad4a5eb16842b00afe7567 and project 2a999d9d8991476983a97cb975c6302a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:42:53.711010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:42:53.716643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:42:53.919335 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d7fced8-ac9c-4557-b9f6-5dddf64cf702 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.910741 Jul 14 14:42:53.928462 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 634/1284] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:42:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 5923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:42:53.961849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:53.964946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:54.016935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.017401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.018399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.018856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.258331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:54.273430 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-235c0f1f-969c-4aa1-9f74-7323bd07de1e tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.342713 Jul 14 14:42:54.279152 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 635/1285] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:53 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:54.285501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:54.286138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:54.295415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.295928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.296889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.297455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.772663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:54.812830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:54.818294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:54.820371 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bcbb494b-13af-4922-9ad3-6c0d3cd83ed0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.539145 Jul 14 14:42:54.826267 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 636/1286] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:54 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:54.835775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:54.840496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:54.860159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.863040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:54.870332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:54.870891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.036589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:55.045953 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-819b77e4-26aa-4ab8-9997-b973d45ccb25 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1221 microversion: 2.1 time: 0.217572 Jul 14 14:42:55.048290 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 637/1287] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:54 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1221 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:55.062974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "f26436fc-3fd6-47ef-906d-83794b61754d"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "ad8cd311-4741-44e0-8060-a4915242cfdd"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "0760b55f-c71b-47a8-9fc4-8e71037f0156"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "ac4d4f21-84d8-472e-a32d-f8dbffcec22f"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "aad3ef53-ce16-4b02-a1b5-5f7e52a7985d"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-plugged", "status": "completed", "tag": "a88643fc-2419-43ac-8f5a-9547d68bbab8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:55.083766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.084508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.102040 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Creating event network-vif-plugged:f26436fc-3fd6-47ef-906d-83794b61754d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:55.103935 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Creating event network-vif-plugged:ad8cd311-4741-44e0-8060-a4915242cfdd for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:55.105069 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Creating event network-vif-plugged:0760b55f-c71b-47a8-9fc4-8e71037f0156 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:55.105923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Creating event network-vif-plugged:ac4d4f21-84d8-472e-a32d-f8dbffcec22f for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:55.106735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Creating event network-vif-plugged:aad3ef53-ce16-4b02-a1b5-5f7e52a7985d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:55.107993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] Creating event network-vif-plugged:a88643fc-2419-43ac-8f5a-9547d68bbab8 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:42:55.117363 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a7f3cd5b-4baa-4441-b48a-d44eb357f0ed req-fb5285a2-2755-4a47-9cc8-fc569c1fde83 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.067343 Jul 14 14:42:55.118645 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 638/1288] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:55.298728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:55.302161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:55.320736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.322291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.323401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:55.324434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:55.715720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:55.735969 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e15d61a-b75d-44d4-b4d5-4168c26d2d8c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.442487 Jul 14 14:42:55.738631 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 639/1289] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:55 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:56.129820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-33f557d2-35de-4503-a6c5-ef853393df90 tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Calling method '.version_select at 0x7fdbf2d31ee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.150672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33f557d2-35de-4503-a6c5-ef853393df90 tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.151132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33f557d2-35de-4503-a6c5-ef853393df90 tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.152012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33f557d2-35de-4503-a6c5-ef853393df90 tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.152461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33f557d2-35de-4503-a6c5-ef853393df90 tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.198811 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-33f557d2-35de-4503-a6c5-ef853393df90 tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] 10.222.0.98 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.407121 Jul 14 14:42:56.215447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 640/1290] 10.222.0.98 () {58 vars in 1121 bytes} [Thu Jul 14 14:42:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:42:56.222060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.223116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.230954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.232295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.233656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.234355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.408113 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aaaa9939-fc60-46d0-a679-db79d1e48f9c tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.580458 Jul 14 14:42:56.418979 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 651/1291] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:42:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3584 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:42:56.430273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:56.431650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:56.447493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.448635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.450540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:56.451316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:56.585368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:56.604822 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e88c15c8-f822-4cdb-87bd-a92bce181321 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1275 microversion: 2.1 time: 0.180717 Jul 14 14:42:56.611189 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 652/1292] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:56 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1275 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:56.618529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-275840135", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:56.677744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:56.687537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:56.693213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:56.702398 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-126fa82d-1805-4d12-bcb6-031cd5397607 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1878 microversion: 2.42 time: 0.484934 Jul 14 14:42:56.703640 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 641/1293] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:56 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1878 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:56.709752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e57b536-dbc4-4d4c-a8ba-38e48910343e tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Action: 'create', calling method: .version_select at 0x7fdbf2d3a0d0>, body: {"pool": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:42:56.734585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:42:57.211662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Getting quotas for project 7c0704801516448cb0a2d64dabf184cf. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:42:57.233163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Getting quotas for user e1ea594c233d409dba82caa49b62f7b8 and project 7c0704801516448cb0a2d64dabf184cf. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:42:57.272000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Request method failure captured: Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 1751 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CtvzZXjY95JUepTpKToNDLf4a1QV2pnnc4k4Ggmqzxhu6QD8J3ee5sgTfpkQMX2TMVGbLZ4A0Glwgqo1_Dbeexlobbk3NZvHiABfj-2QFa4SnWbsvX4ho8lw-JMRcYz647xQK8zg2RNwapcDQZzJstc5_AfEMwExV1R3jbavBOvNgg Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 7c0704801516448cb0a2d64dabf184cf Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1152442357 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7c0704801516448cb0a2d64dabf184cf"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7c0704801516448cb0a2d64dabf184cf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7c0704801516448cb0a2d64dabf184cf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7c0704801516448cb0a2d64dabf184cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1152442357 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 7c0704801516448cb0a2d64dabf184cf Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1152442357 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: e1ea594c233d409dba82caa49b62f7b8 Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-275840135", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:42:57.274415 n-d-768852-23 devstack@n-api.service[125965]: exception: Maximum number of metadata items exceeds 128 Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-275840135', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 462, in _check_metadata_properties_quota Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1002, in _checks_for_create_and_rebuild Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 469, in _check_metadata_properties_quota Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:57.284725 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 802, in create Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ad00890-0be6-4971-ae70-6e1d9b6b296c tempest-AbsoluteLimitsNegativeTestJSON-1152442357 tempest-AbsoluteLimitsNegativeTestJSON-1152442357-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.663189 Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 653/1294] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Jul 14 14:42:56 2022] POST /compute/v2.1/servers => generated 87 bytes in 669 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.298524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.304246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.801343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:57.870643 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3768a80c-b5bf-4372-9633-6d02682160c1 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.585127 Jul 14 14:42:57.874799 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 654/1295] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:57 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:57.895416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:57.899032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:57.921958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.925780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:57.943608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:57.944562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:58.310691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:58.331950 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ac19fae-dab4-4353-aef2-a76963ab882e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.451782 Jul 14 14:42:58.338231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 655/1296] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:57 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:58.378128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:58.383116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:58.414420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:58.419516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:58.424754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:58.430258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:58.890901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:58.906091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:58.908240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:58.915372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f9c9e18-29ee-4533-972c-5638756d52cc tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2839 microversion: 2.42 time: 0.574021 Jul 14 14:42:58.916207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 656/1297] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:42:58 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2839 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:58.944629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:58.945456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:58.961491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:58.961962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:58.962784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:58.965057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:59.330692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:42:59.349844 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cde702bd-d0cf-49ff-8ca9-a95bfe21b30c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.420704 Jul 14 14:42:59.355831 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 657/1298] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:58 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:42:59.369062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:59.370535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:59.397669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:59.402874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:59.406084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:59.408684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:59.663150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-736078bf-9798-43a0-b6d5-b46c433fc543 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.303737 Jul 14 14:42:59.664106 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 658/1299] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 14:42:59 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0/os-interface => generated 1833 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:42:59.677508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:42:59.680906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:42:59.696778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:59.700204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:42:59.703714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:42:59.708265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:00.726569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:00.738798 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9ad401da-40af-40ff-b6d5-034d0d3f2c03 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 1.073499 Jul 14 14:43:00.741648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 659/1300] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:42:59 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:00.761743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:00.765594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:00.794238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:00.794704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:00.802945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:00.803966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:01.275863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:01.288058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9906dc1e-c4ba-4578-862d-19f69fa1f4a6 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1472 microversion: 2.1 time: 0.544884 Jul 14 14:43:01.293513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 660/1301] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:00 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1472 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:01.677173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-18352589-49ac-431d-abcc-193db2e6a61d req-35d8cdb9-69ed-49ee-8fe9-f6ec8ab00630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "492e8309-1aff-4d9b-99d8-403072c94185", "tag": "2cc87f89-2c15-41ca-9d01-62f4b9f60530"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:01.690005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-18352589-49ac-431d-abcc-193db2e6a61d req-35d8cdb9-69ed-49ee-8fe9-f6ec8ab00630 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.696909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-18352589-49ac-431d-abcc-193db2e6a61d req-35d8cdb9-69ed-49ee-8fe9-f6ec8ab00630 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:01.729010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-18352589-49ac-431d-abcc-193db2e6a61d req-35d8cdb9-69ed-49ee-8fe9-f6ec8ab00630 service nova] Creating event network-changed:2cc87f89-2c15-41ca-9d01-62f4b9f60530 for instance 492e8309-1aff-4d9b-99d8-403072c94185 on n-h2-768852-23 Jul 14 14:43:01.752819 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-18352589-49ac-431d-abcc-193db2e6a61d req-35d8cdb9-69ed-49ee-8fe9-f6ec8ab00630 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082505 Jul 14 14:43:01.759709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 661/1302] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:01.778828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:01.779677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:01.801854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.802955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:01.804135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:01.806145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:02.205207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:02.217189 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3043fa49-8455-402a-9f41-7de447246b20 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.451204 Jul 14 14:43:02.228232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 662/1303] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:01 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:02.322586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:02.323985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:02.336089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:02.341761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:02.343844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:02.344658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:02.603932 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e57b536-dbc4-4d4c-a8ba-38e48910343e tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.898966 Jul 14 14:43:02.606526 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 642/1304] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:42:56 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5902 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:02.626977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ebf1258-7659-4fb3-b3bd-172832c66630 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Action: 'create', calling method: .version_select at 0x7fdbf2cca790>, body: {"pool": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:02.992164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:03.017816 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0901c31e-2047-46c5-b7ad-544fd902c44a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1478 microversion: 2.1 time: 0.698868 Jul 14 14:43:03.021351 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 663/1305] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:02 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1478 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:03.265975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:03.268874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:03.313945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:03.314404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:03.322623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:03.323088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:03.666706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:03.679704 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32b2fb5c-0a39-468d-990a-8398ffcd7276 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.425616 Jul 14 14:43:03.680501 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 664/1306] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:03 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:03.696991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-29a7eec8-b25a-41e6-a697-0d02f114cd99 req-44a85c11-e19b-49bc-993a-b1892acd12aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "tag": "0760b55f-c71b-47a8-9fc4-8e71037f0156"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:03.710847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-29a7eec8-b25a-41e6-a697-0d02f114cd99 req-44a85c11-e19b-49bc-993a-b1892acd12aa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:03.711702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-29a7eec8-b25a-41e6-a697-0d02f114cd99 req-44a85c11-e19b-49bc-993a-b1892acd12aa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:03.728166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-29a7eec8-b25a-41e6-a697-0d02f114cd99 req-44a85c11-e19b-49bc-993a-b1892acd12aa service nova] Creating event network-changed:0760b55f-c71b-47a8-9fc4-8e71037f0156 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:43:03.737865 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-29a7eec8-b25a-41e6-a697-0d02f114cd99 req-44a85c11-e19b-49bc-993a-b1892acd12aa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045300 Jul 14 14:43:03.738882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 665/1307] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:04.074043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:04.088604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:04.178182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.180239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.184151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.186063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.682361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:04.728758 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-079e4837-2866-4438-8ceb-188ea936609b tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1478 microversion: 2.1 time: 0.690477 Jul 14 14:43:04.736198 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 666/1308] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:04 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1478 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:04.760118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:04.766491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:04.787653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.788408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:04.789788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:04.790515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:05.126650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:05.141516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99a82ddc-9b0d-41c3-b852-4e607ea49fd3 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.403296 Jul 14 14:43:05.148899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 667/1309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:04 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:05.769102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:05.775022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:05.803556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:05.804772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:05.807049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:05.818095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:06.147620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:06.183883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:06.230586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:06.295395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:06.304840 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c235754b-0d05-4b7f-98e6-0e4fdb8deced tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1478 microversion: 2.1 time: 0.547673 Jul 14 14:43:06.305459 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 668/1310] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:05 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1478 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:06.317395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:06.321449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:06.345792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:06.351677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:06.353332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:06.359897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:06.686644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=50 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:06.721893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:06.731168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:06.743211 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f047e867-fd13-4818-a678-df201988ded9 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.430045 Jul 14 14:43:06.763251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 669/1311] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:06 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:06.934312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2e273b84-e35a-4b77-b360-d881da4ca905 req-e7ea1c63-c2f0-4dba-8d1a-f5b2ed0b5701 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c69871-43bd-4251-ae79-02953e468fc7", "name": "network-vif-unplugged", "status": "completed", "tag": "fb021a48-5a36-4cbf-8c24-ec016855b2a2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:06.958093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2e273b84-e35a-4b77-b360-d881da4ca905 req-e7ea1c63-c2f0-4dba-8d1a-f5b2ed0b5701 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:06.959636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2e273b84-e35a-4b77-b360-d881da4ca905 req-e7ea1c63-c2f0-4dba-8d1a-f5b2ed0b5701 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:07.000970 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2e273b84-e35a-4b77-b360-d881da4ca905 req-e7ea1c63-c2f0-4dba-8d1a-f5b2ed0b5701 service nova] Creating event network-vif-unplugged:fb021a48-5a36-4cbf-8c24-ec016855b2a2 for instance 28c69871-43bd-4251-ae79-02953e468fc7 on n-h1-768852-23 Jul 14 14:43:07.017761 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2e273b84-e35a-4b77-b360-d881da4ca905 req-e7ea1c63-c2f0-4dba-8d1a-f5b2ed0b5701 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098071 Jul 14 14:43:07.021239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 670/1312] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:07.054102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-899475498", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "7c3118c3-58de-439c-bb53-8c4407b089fe"}], "block_device_mapping_v2": [{"uuid": "1e95d77f-0002-48af-ae6b-c0627bf37465", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:07.232699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] validate_networks() for [('7c3118c3-58de-439c-bb53-8c4407b089fe', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:07.267996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:08.135862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:08.137807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:08.139157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:08.140392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:08.141486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:08.179161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.180737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.184525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.185899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.260966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:08.267811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Getting quotas for user aeb3928894284b77b4aea925a38470ba and project 6e033f599b294c1f9a66eb4703aba0e6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:08.411245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:08.413559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e95d77f-0002-48af-ae6b-c0627bf37465',volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:08.651387 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be3d6cdd-10bf-4b79-9da6-d753ae6d812b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.608856 Jul 14 14:43:08.653633 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 671/1313] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:43:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:43:08.665747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:08.667670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:08.682908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.686657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.689560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.691239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.862460 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ebf1258-7659-4fb3-b3bd-172832c66630 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.241104 Jul 14 14:43:08.873548 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 643/1314] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:43:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:08.884632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:08.885727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:08.924751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.925970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.928912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:08.930115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:08.974425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:08.995428 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6892c130-2c28-4877-8f70-f97126f7abaa tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1463 microversion: 2.1 time: 0.338744 Jul 14 14:43:09.009705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 672/1315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:08 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1463 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:09.036307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6bb1072c-b32e-48c1-9ea1-6e675c46a989 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:09.037996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6bb1072c-b32e-48c1-9ea1-6e675c46a989 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:09.133476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6bb1072c-b32e-48c1-9ea1-6e675c46a989 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:09.147162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6bb1072c-b32e-48c1-9ea1-6e675c46a989 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:09.149901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6bb1072c-b32e-48c1-9ea1-6e675c46a989 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:09.151831 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6bb1072c-b32e-48c1-9ea1-6e675c46a989 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1103 microversion: 2.25 time: 0.130954 Jul 14 14:43:09.152772 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 673/1316] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:09 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1103 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:09.159446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad6c12d3-fc4a-493b-8599-52fe147dd1f0 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf2c0ea60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:09.471547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:09.515775 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-23ee316a-9a8a-49aa-9064-914371eee9ab tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.638632 Jul 14 14:43:09.517902 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 644/1317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:08 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:09.540587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:09.542193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:09.551307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.552086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.553268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.553981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.804832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad6c12d3-fc4a-493b-8599-52fe147dd1f0 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips/84d48b21-2f9f-4305-a2a2-4b637c971e4d" status: 200 len: 142 microversion: 2.1 time: 0.650119 Jul 14 14:43:09.806431 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 674/1318] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:43:09 2022] GET /compute/v2.1/os-floating-ips/84d48b21-2f9f-4305-a2a2-4b637c971e4d => generated 142 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:09.825753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f9abb4a-c9f0-4f0f-be00-eeb8386a249d tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf2cffaf0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:09.844612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3fd18f8d-a9b8-4343-9bee-79e94e812271 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.312675 Jul 14 14:43:09.847762 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 645/1319] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:09 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:09.860512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:09.861450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:09.871363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.872704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.873761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.874970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.965204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:09.965688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:09.966228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lazy-loading 'fault' on Instance uuid 28c69871-43bd-4251-ae79-02953e468fc7 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:10.384421 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-113189c7-8a46-4261-811c-b21faffaa322 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1599 microversion: 2.1 time: 0.529499 Jul 14 14:43:10.389296 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 646/1320] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:09 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1599 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:10.407122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:10.417457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.441356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.442191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.444392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.456877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.754837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:10.771793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:10.773987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:10.780202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0935ddde-3a7e-48e1-8fd1-37eef4504655 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1176 microversion: 2.25 time: 0.384875 Jul 14 14:43:10.781542 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 647/1321] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:10 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1176 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:10.794176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:10.803451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:10.811167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.817669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.819708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:10.820443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:10.988033 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44b18f10-1ecb-4a76-9856-b82c71e9ca35 tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action" status: 202 len: 0 microversion: 2.1 time: 0.202801 Jul 14 14:43:10.993832 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 648/1322] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:10 2022] POST /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:11.000995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:11.002581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:11.011501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.012305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.014482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.015462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.902299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:11.924823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ade75576-f3f3-48ad-8b41-2de125fb4170 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.929353 Jul 14 14:43:11.925459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 649/1323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:10 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:11.950500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:11.955036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:11.985704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.986172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:11.986991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:11.993360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.395013 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-35088d61-43f7-4438-b210-46222342d3ec tempest-ServersAdminTestJSON-659494771 tempest-ServersAdminTestJSON-659494771-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1616 microversion: 2.1 time: 0.462191 Jul 14 14:43:12.408314 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 650/1324] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:11 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1616 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:12.413645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-aaadaefa-0934-45ea-b10f-6056d9580471 req-5d997cdd-7d3a-4d6e-a586-c9744ba11927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c69871-43bd-4251-ae79-02953e468fc7", "name": "network-vif-plugged", "status": "completed", "tag": "fb021a48-5a36-4cbf-8c24-ec016855b2a2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:12.434192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-aaadaefa-0934-45ea-b10f-6056d9580471 req-5d997cdd-7d3a-4d6e-a586-c9744ba11927 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.434970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-aaadaefa-0934-45ea-b10f-6056d9580471 req-5d997cdd-7d3a-4d6e-a586-c9744ba11927 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.453954 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-aaadaefa-0934-45ea-b10f-6056d9580471 req-5d997cdd-7d3a-4d6e-a586-c9744ba11927 service nova] Creating event network-vif-plugged:fb021a48-5a36-4cbf-8c24-ec016855b2a2 for instance 28c69871-43bd-4251-ae79-02953e468fc7 on n-h1-768852-23 Jul 14 14:43:12.470210 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-aaadaefa-0934-45ea-b10f-6056d9580471 req-5d997cdd-7d3a-4d6e-a586-c9744ba11927 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060166 Jul 14 14:43:12.474584 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 651/1325] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:12.484407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:12.494109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:12.509835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.510750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.515861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.516625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.632979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.649259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.655736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:12.657043 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-900645eb-6057-44f5-ab5c-de563c5fb6f5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1250 microversion: 2.25 time: 0.180861 Jul 14 14:43:12.657663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 652/1326] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:12 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1250 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:12.667080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:12.667958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:12.683359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.687203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.690696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:12.691321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:12.765010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:12.986363 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-31b4fbbf-3a34-4e36-8f12-8d59cfdf1f28 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 204 len: 0 microversion: 2.1 time: 0.326858 Jul 14 14:43:12.987416 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 653/1327] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:12 2022] DELETE /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:43:12.995301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:12.997055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:13.006593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.007691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.008669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.009237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.572434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:13.601336 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3bfbd390-2f2f-4bc5-97f8-ef0ba3422601 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.611860 Jul 14 14:43:13.608752 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 654/1328] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:12 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:13.629387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:13.630984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:13.670144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.673128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.676122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.679870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.819930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f9abb4a-c9f0-4f0f-be00-eeb8386a249d tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/84d48b21-2f9f-4305-a2a2-4b637c971e4d" status: 202 len: 0 microversion: 2.1 time: 4.001973 Jul 14 14:43:13.820953 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 675/1329] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:43:09 2022] DELETE /compute/v2.1/os-floating-ips/84d48b21-2f9f-4305-a2a2-4b637c971e4d => generated 0 bytes in 4005 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:43:13.836377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:13.837482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:13.882625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.883421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:13.884863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:13.885652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:14.552324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:14.586294 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-625be0d1-2202-41d4-99a7-ae2f45f53376 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1469 microversion: 2.1 time: 0.974958 Jul 14 14:43:14.587695 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 655/1330] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:13 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1469 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:14.611964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b505c78-bcd9-4c00-971f-13b06186b8cb tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf2d31790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.328248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:15.379343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:15.392324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:15.394495 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69769a5e-93b1-469d-9f6d-590f23826ba2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 1.565479 Jul 14 14:43:15.396996 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 676/1331] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:13 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:15.417937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.419784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.437461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.444579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.451571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.453038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.899710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:15.914537 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f1e5a3a2-ad04-45af-800f-f188dfd2ce98 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.515700 Jul 14 14:43:15.926738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 677/1332] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:15 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:15.933234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:15.934313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:15.956150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.957516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:15.959187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:15.960117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.320824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:16.329820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fc58cdfb-1a07-4b1b-83a9-9919d0e37b7c tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 200 len: 1427 microversion: 2.1 time: 0.401363 Jul 14 14:43:16.343574 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 678/1333] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:15 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 1427 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:16.349113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cb3cc2f-77d5-4104-bab4-09eefdc354b3"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:16.350314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:16.366592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:16.374982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.375504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.376356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.376811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.500609 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b505c78-bcd9-4c00-971f-13b06186b8cb tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.907339 Jul 14 14:43:16.503948 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 656/1334] 10.222.0.98 () {58 vars in 1163 bytes} [Thu Jul 14 14:43:14 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1916 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:43:16.516062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ecda92fd-5acd-48a5-bd71-af73c7262dfc req-090ef092-502e-4f37-bb4a-a9adb409f114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492e8309-1aff-4d9b-99d8-403072c94185", "name": "network-vif-plugged", "status": "completed", "tag": "2cc87f89-2c15-41ca-9d01-62f4b9f60530"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:16.561692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ecda92fd-5acd-48a5-bd71-af73c7262dfc req-090ef092-502e-4f37-bb4a-a9adb409f114 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.565900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ecda92fd-5acd-48a5-bd71-af73c7262dfc req-090ef092-502e-4f37-bb4a-a9adb409f114 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.605391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:16.609359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ecda92fd-5acd-48a5-bd71-af73c7262dfc req-090ef092-502e-4f37-bb4a-a9adb409f114 service nova] Creating event network-vif-plugged:2cc87f89-2c15-41ca-9d01-62f4b9f60530 for instance 492e8309-1aff-4d9b-99d8-403072c94185 on n-h2-768852-23 Jul 14 14:43:16.620023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ecda92fd-5acd-48a5-bd71-af73c7262dfc req-090ef092-502e-4f37-bb4a-a9adb409f114 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111949 Jul 14 14:43:16.621285 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 657/1335] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:16.640930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:16.647583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:16.705086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.706491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:16.711771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:16.712789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:17.227016 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ab96a91-1eb5-4683-9f39-b5941ae2f9b9 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "POST /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.881814 Jul 14 14:43:17.236516 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 679/1336] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:43:16 2022] POST /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments => generated 194 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:17.273448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88953f57-ac2e-4583-b5ce-ec0b5690ad09 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf3142af0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:18.072368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:18.104704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:18.121586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:18.133272 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c2498ed-f8b7-4265-9391-7cf0db06654a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 1.499426 Jul 14 14:43:18.138458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 658/1337] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:16 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:18.184516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2915433b-a5f0-4321-b90f-6c01ff39cfbb req-a84ef8c1-fbd0-4eb9-a8bb-29f391ace443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2277c627-ff22-472a-ac2e-a5226ae6db10", "name": "network-vif-deleted", "tag": "62ff24b4-f81b-413d-b083-007ea279a865"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:18.222310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:18.248630 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88953f57-ac2e-4583-b5ce-ec0b5690ad09 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 1.010372 Jul 14 14:43:18.257089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2915433b-a5f0-4321-b90f-6c01ff39cfbb req-a84ef8c1-fbd0-4eb9-a8bb-29f391ace443 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.257089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2915433b-a5f0-4321-b90f-6c01ff39cfbb req-a84ef8c1-fbd0-4eb9-a8bb-29f391ace443 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.257654 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 680/1338] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:43:17 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:18.263529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:18.270278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:18.300277 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2915433b-a5f0-4321-b90f-6c01ff39cfbb req-a84ef8c1-fbd0-4eb9-a8bb-29f391ace443 service nova] Creating event network-vif-deleted:62ff24b4-f81b-413d-b083-007ea279a865 for instance 2277c627-ff22-472a-ac2e-a5226ae6db10 on n-h1-768852-23 Jul 14 14:43:18.302085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.305270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.306566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.310624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.314227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2915433b-a5f0-4321-b90f-6c01ff39cfbb req-a84ef8c1-fbd0-4eb9-a8bb-29f391ace443 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168790 Jul 14 14:43:18.316457 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 659/1339] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:18.331609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:18.333878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 2277c627-ff22-472a-ac2e-a5226ae6db10] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:18.349403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.350974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.355029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:18.356787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:18.393771 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] HTTP exception thrown: Instance 2277c627-ff22-472a-ac2e-a5226ae6db10 could not be found. Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Request method failure captured: Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 HTTP/1.1 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cq-wVMloiLsyQ2lGECzzdOT84cDUIXIIAr0yroRPnB8AmWV0e4QJrQZQTDtAekfaiEIQzNUIHyDkXIcu55bNLsPy4Vz643qq7aHyIiKwWlL5OG5uOctTFv9pvumRYR5wiSzvjOo72pLhTk6mwdk7Ulzr_eW0frpgaBE_HXafj5_yB8 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: db181b6ddf3f42629734e66aeb2f0e3f Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: db181b6ddf3f42629734e66aeb2f0e3f Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminTestJSON-1674981205-project Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2643b694761c4380a7a37fe64add9423 Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminTestJSON-1674981205-project Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2277c627-ff22-472a-ac2e-a5226ae6db10 could not be found. Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2277c627-ff22-472a-ac2e-a5226ae6db10'} Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2277c627-ff22-472a-ac2e-a5226ae6db10 could not be found. Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2277c627-ff22-472a-ac2e-a5226ae6db10 could not be found. Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:18.398308 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2277c627-ff22-472a-ac2e-a5226ae6db10 could not be found. Jul 14 14:43:18.415478 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:18.424393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Returning 404 to user: Instance 2277c627-ff22-472a-ac2e-a5226ae6db10 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:18.426650 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a7018e2d-5544-4443-ab39-be02714fd621 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10" status: 404 len: 111 microversion: 2.1 time: 0.106626 Jul 14 14:43:18.429090 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 660/1340] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:18 2022] GET /compute/v2.1/servers/2277c627-ff22-472a-ac2e-a5226ae6db10 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:18.452672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0253850b-3e5f-443b-b694-ad35a7be6daf tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf2ccadc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:19.145120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:19.206592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:19.222843 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac9d0210-5fa4-46ad-92e5-e176f0a9a4de tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1317 microversion: 2.1 time: 0.963746 Jul 14 14:43:19.238741 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 681/1341] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:18 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1317 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:19.255572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:19.256575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:19.273973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:19.279252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:19.280529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:19.281338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:19.344081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:19.503575 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-053afa28-6710-4289-808c-4057f924c518 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 204 len: 0 microversion: 2.1 time: 0.262066 Jul 14 14:43:19.504698 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 682/1342] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:19 2022] DELETE /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:43:19.520006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:19.521342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:19.539757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:19.540666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:19.541762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:19.542470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.330578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.355563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.359142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.369305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3747139-85b5-4738-8139-8e2c2b0a2af7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 0.854971 Jul 14 14:43:20.388656 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 683/1343] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:19 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:20.397951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:20.399460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:20.416040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.419682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.423778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.428186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.881595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:20.897241 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1b02e14-9eb6-4b7c-907b-21bd02f60934 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1469 microversion: 2.1 time: 0.506524 Jul 14 14:43:20.898845 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 684/1344] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:20 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1469 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:20.916515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0253850b-3e5f-443b-b694-ad35a7be6daf tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/57e4fb0c-af93-402f-abae-efc978260bd0" status: 202 len: 0 microversion: 2.1 time: 2.485102 Jul 14 14:43:20.917839 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 661/1345] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:43:18 2022] DELETE /compute/v2.1/os-floating-ips/57e4fb0c-af93-402f-abae-efc978260bd0 => generated 0 bytes in 2488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:20.934979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:20.939725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:20.940262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8c001c82-2158-4747-994a-1c9f60b67d4f req-c4f947fa-eb2f-47d3-8231-40ae159a8113 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde86f6d-6561-44c7-b3c0-46cb586ab9ca", "tag": "2660e2f0-d5e5-47e4-805e-17cfccb97fbf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:20.949392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.950179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.952111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.955773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.958557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8c001c82-2158-4747-994a-1c9f60b67d4f req-c4f947fa-eb2f-47d3-8231-40ae159a8113 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:20.959147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8c001c82-2158-4747-994a-1c9f60b67d4f req-c4f947fa-eb2f-47d3-8231-40ae159a8113 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:20.974626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8c001c82-2158-4747-994a-1c9f60b67d4f req-c4f947fa-eb2f-47d3-8231-40ae159a8113 service nova] Creating event network-changed:2660e2f0-d5e5-47e4-805e-17cfccb97fbf for instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca on n-h1-768852-23 Jul 14 14:43:20.982426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8c001c82-2158-4747-994a-1c9f60b67d4f req-c4f947fa-eb2f-47d3-8231-40ae159a8113 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080743 Jul 14 14:43:20.984161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 685/1346] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:20.993811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2607088-9a10-4275-b394-608f36e16358 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf2bc3f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:21.408977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:21.421449 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a23ee96a-0276-4da2-a845-23aa640422b0 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1506 microversion: 2.1 time: 0.501806 Jul 14 14:43:21.422066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 662/1347] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:20 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1506 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:21.825231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1791030268", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "d6657581-5d58-47ce-b6fb-21e494ac1d86"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:21.922915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] validate_networks() for [('d6657581-5d58-47ce-b6fb-21e494ac1d86', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:23.195410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2607088-9a10-4275-b394-608f36e16358 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/0440c6a8-215d-4839-b0e4-8cbcd2535984" status: 202 len: 0 microversion: 2.1 time: 2.205675 Jul 14 14:43:23.204372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 686/1348] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:43:20 2022] DELETE /compute/v2.1/os-floating-ips/0440c6a8-215d-4839-b0e4-8cbcd2535984 => generated 0 bytes in 2214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:23.232456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:23.260486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:23.336134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.337340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.339353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.340594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.495139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:23.498182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:23.498749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:23.499171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:23.499763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:23.533679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.534049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.534907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.535501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.612467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Getting quotas for project a21758c8c2ee4fd3bc58344c4948f503. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:23.622181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Getting quotas for user b04aa0fbcacd45bdadeb9bde761d4def and project a21758c8c2ee4fd3bc58344c4948f503. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:23.660667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:23.664794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:23.734018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:23.787638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.348691 Jul 14 14:43:23.790730 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 663/1349] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 2368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:23.807637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:23.824024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:23.828271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:23.838303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-142ac721-9693-41c2-9749-c7169cbf5d03 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 0.630994 Jul 14 14:43:23.842918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:23.853404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 687/1350] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:23 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:23.893432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.901031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.902118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8382382a-951c-4c46-9538-903140ca7bc4 req-e1d83392-fc10-40cf-b4ae-4c9142070c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9532228c-4202-46fb-88f8-c732f76102b2", "name": "network-vif-deleted", "tag": "7d2e6e6f-3de7-42cd-8f73-6f82ed24d4e9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:23.906907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.912514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:23.960334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8382382a-951c-4c46-9538-903140ca7bc4 req-e1d83392-fc10-40cf-b4ae-4c9142070c9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:23.969528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8382382a-951c-4c46-9538-903140ca7bc4 req-e1d83392-fc10-40cf-b4ae-4c9142070c9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.030158 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8382382a-951c-4c46-9538-903140ca7bc4 req-e1d83392-fc10-40cf-b4ae-4c9142070c9c service nova] Creating event network-vif-deleted:7d2e6e6f-3de7-42cd-8f73-6f82ed24d4e9 for instance 9532228c-4202-46fb-88f8-c732f76102b2 on n-h1-768852-23 Jul 14 14:43:24.038262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.038971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.039658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lazy-loading 'fault' on Instance uuid 9532228c-4202-46fb-88f8-c732f76102b2 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:24.059421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8382382a-951c-4c46-9538-903140ca7bc4 req-e1d83392-fc10-40cf-b4ae-4c9142070c9c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.192831 Jul 14 14:43:24.063827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 688/1351] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:24.102189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e710d99-872e-4de0-b9dd-61a3f6f28225 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] Calling method '.version_select at 0x7fdbf31ac0d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:24.229015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:24.244328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d1be7ed-f5ab-4539-8734-877cc51aba3a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 200 len: 1304 microversion: 2.1 time: 0.451292 Jul 14 14:43:24.247847 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 664/1352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:23 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 1304 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:24.262401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ef71132-3417-4ccb-bc33-5199bbbb572d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:24.263122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ef71132-3417-4ccb-bc33-5199bbbb572d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:24.470155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ef71132-3417-4ccb-bc33-5199bbbb572d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:24.480325 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ef71132-3417-4ccb-bc33-5199bbbb572d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1217 microversion: 2.1 time: 0.230765 Jul 14 14:43:24.497247 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 665/1353] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:24 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:24.885570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:24.886404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:24.909147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.909736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:24.916628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:24.918573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.237758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.255680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.260342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.263502 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05c21e8f-0c2d-433a-9bcd-a030f2d17dae tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 0.383657 Jul 14 14:43:25.275682 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 666/1354] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:24 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:43:25.284766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:25.285888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 9532228c-4202-46fb-88f8-c732f76102b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:25.293650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.294156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.295071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.295751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.315343 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] HTTP exception thrown: Instance 9532228c-4202-46fb-88f8-c732f76102b2 could not be found. Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Request method failure captured: Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 HTTP/1.1 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cq-wVMloiLsyQ2lGECzzdOT84cDUIXIIAr0yroRPnB8AmWV0e4QJrQZQTDtAekfaiEIQzNUIHyDkXIcu55bNLsPy4Vz643qq7aHyIiKwWlL5OG5uOctTFv9pvumRYR5wiSzvjOo72pLhTk6mwdk7Ulzr_eW0frpgaBE_HXafj5_yB8 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: db181b6ddf3f42629734e66aeb2f0e3f Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: db181b6ddf3f42629734e66aeb2f0e3f Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminTestJSON-1674981205-project Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2643b694761c4380a7a37fe64add9423 Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminTestJSON-1674981205-project Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 9532228c-4202-46fb-88f8-c732f76102b2 could not be found. Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9532228c-4202-46fb-88f8-c732f76102b2'} Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9532228c-4202-46fb-88f8-c732f76102b2 could not be found. Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9532228c-4202-46fb-88f8-c732f76102b2 could not be found. Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:25.317207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9532228c-4202-46fb-88f8-c732f76102b2 could not be found. Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Returning 404 to user: Instance 9532228c-4202-46fb-88f8-c732f76102b2 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b696e8d1-05da-4865-aaba-5b411b8649bd tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2" status: 404 len: 111 microversion: 2.1 time: 0.038162 Jul 14 14:43:25.330693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 667/1355] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:25 2022] GET /compute/v2.1/servers/9532228c-4202-46fb-88f8-c732f76102b2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:25.334681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:25.334997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:25.345101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.345424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.346580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.347457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.385190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:25.509421 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3196af82-0bde-4145-a668-0c0997020b1a tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "DELETE /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 204 len: 0 microversion: 2.1 time: 0.183336 Jul 14 14:43:25.514742 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 668/1356] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:25 2022] DELETE /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:43:25.521171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:25.522181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:25.531109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.531891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.532897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.533513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.669931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.685406 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2c032a0-a9e7-45b6-b88a-b83972dbae47 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1213 microversion: 2.1 time: 0.168312 Jul 14 14:43:25.686017 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 669/1357] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:25 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1213 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:25.700985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:25.701927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:25.722780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.724702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.725733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:25.726209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:25.941427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:25.952641 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-409a6a1e-27c3-4bf6-a32c-32b4461f0ba4 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1469 microversion: 2.1 time: 0.258039 Jul 14 14:43:25.964379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 670/1358] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:25 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1469 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:26.283966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:26.285325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:26.296319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.297524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.298240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.298679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.492104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4e710d99-872e-4de0-b9dd-61a3f6f28225 tempest-FloatingIPDetailsTestJSON-265937937 tempest-FloatingIPDetailsTestJSON-265937937-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/a4de995b-6c1d-4119-bc11-6db555bb31de" status: 202 len: 0 microversion: 2.1 time: 2.422344 Jul 14 14:43:26.494394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 689/1359] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:43:24 2022] DELETE /compute/v2.1/os-floating-ips/a4de995b-6c1d-4119-bc11-6db555bb31de => generated 0 bytes in 2429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:26.553155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:26.564299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:26.567406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:26.568928 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6f6aafe-0b1f-4c47-9538-1f4972f083e6 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 0.289989 Jul 14 14:43:26.569601 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 671/1360] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:26 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:43:26.708365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:26.709928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:26.723843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.724762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.726287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.727466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.862320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:26.870873 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9ecc39f-3d89-42f7-892e-5c693602dd37 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1269 microversion: 2.1 time: 0.171246 Jul 14 14:43:26.871958 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 690/1361] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:26 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1269 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:26.970924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:26.971989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:26.979905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.980758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:26.981862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:26.982782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.254359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:27.284137 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ce2d292-6cb1-4a7d-ab94-c6141646b896 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1469 microversion: 2.1 time: 0.317509 Jul 14 14:43:27.288874 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 672/1362] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:26 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1469 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:27.593754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:27.601803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:27.634886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.636045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.637960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.639080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.891543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:27.892580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:27.904590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.905698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:27.906963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:27.907848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:28.051761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:28.068899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:28.070703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:28.072316 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8dd6e9e8-7ce2-4b3f-97be-905f835dc9e7 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 0.486822 Jul 14 14:43:28.073142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 691/1363] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:27 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:28.304639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:28.306229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:28.316403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:28.317556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:28.318640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:28.319592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:28.328977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:28.337739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:28.380743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71dbaa4a-b744-4a48-951c-6f71770c291d tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1275 microversion: 2.1 time: 0.494799 Jul 14 14:43:28.392948 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 673/1364] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:27 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1275 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:28.456241 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 14:43:28.456984 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 14:43:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 (ip 10.222.0.98) !!! Jul 14 14:43:28.937651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-09a4c628-17c4-4f75-9631-a637e5a957c8 req-f051c375-e3bd-496d-82d2-7270b04fbebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28c69871-43bd-4251-ae79-02953e468fc7", "name": "network-vif-deleted", "tag": "fb021a48-5a36-4cbf-8c24-ec016855b2a2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:28.980561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09a4c628-17c4-4f75-9631-a637e5a957c8 req-f051c375-e3bd-496d-82d2-7270b04fbebb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:28.985278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09a4c628-17c4-4f75-9631-a637e5a957c8 req-f051c375-e3bd-496d-82d2-7270b04fbebb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.026480 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-09a4c628-17c4-4f75-9631-a637e5a957c8 req-f051c375-e3bd-496d-82d2-7270b04fbebb service nova] Creating event network-vif-deleted:fb021a48-5a36-4cbf-8c24-ec016855b2a2 for instance 28c69871-43bd-4251-ae79-02953e468fc7 on n-h1-768852-23 Jul 14 14:43:29.041380 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-09a4c628-17c4-4f75-9631-a637e5a957c8 req-f051c375-e3bd-496d-82d2-7270b04fbebb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115195 Jul 14 14:43:29.043388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 674/1365] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:29.108462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:29.109613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:29.119071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.120004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.123378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.125418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.303811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2643b694761c4380a7a37fe64add9423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db181b6ddf3f42629734e66aeb2f0e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:29.332113 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb1d9c82-5583-4e29-9ba0-782fb47c3482 tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 200 len: 1469 microversion: 2.1 time: 1.032549 Jul 14 14:43:29.343843 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 692/1366] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:28 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 1469 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:29.404053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:29.404780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:29.425169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.425741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.426643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:29.427096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:29.470587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:29.518350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:29.532732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:29.534610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18ce5f7b-1561-44a0-84ec-c9fe395b178e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1292 microversion: 2.25 time: 0.433449 Jul 14 14:43:29.554715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:29.559383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 675/1367] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:29 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1292 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:29.573293 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77dd931d-7240-4191-8cfc-b8e1c8521651 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1275 microversion: 2.1 time: 0.173709 Jul 14 14:43:29.602767 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 693/1368] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:29 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1275 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:29.890355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-143543674", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "ee03bffb-17d6-47bc-b312-096b88b6e925"}], "block_device_mapping_v2": [{"uuid": "b7fc7167-bf46-46e1-9de1-80e17d44fe3d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:30.373448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:30.377114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] [instance: 28c69871-43bd-4251-ae79-02953e468fc7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:30.413911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.416985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.439704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.442941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.502271 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] HTTP exception thrown: Instance 28c69871-43bd-4251-ae79-02953e468fc7 could not be found. Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Request method failure captured: Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 HTTP/1.1 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cq-wVMloiLsyQ2lGECzzdOT84cDUIXIIAr0yroRPnB8AmWV0e4QJrQZQTDtAekfaiEIQzNUIHyDkXIcu55bNLsPy4Vz643qq7aHyIiKwWlL5OG5uOctTFv9pvumRYR5wiSzvjOo72pLhTk6mwdk7Ulzr_eW0frpgaBE_HXafj5_yB8 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: db181b6ddf3f42629734e66aeb2f0e3f Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/db181b6ddf3f42629734e66aeb2f0e3f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: db181b6ddf3f42629734e66aeb2f0e3f Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersAdminTestJSON-1674981205 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersAdminTestJSON-1674981205-project Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2643b694761c4380a7a37fe64add9423 Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersAdminTestJSON-1674981205-project Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 28c69871-43bd-4251-ae79-02953e468fc7 could not be found. Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '28c69871-43bd-4251-ae79-02953e468fc7'} Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28c69871-43bd-4251-ae79-02953e468fc7 could not be found. Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28c69871-43bd-4251-ae79-02953e468fc7 could not be found. Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:30.509157 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28c69871-43bd-4251-ae79-02953e468fc7 could not be found. Jul 14 14:43:30.518743 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:30.524046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] Returning 404 to user: Instance 28c69871-43bd-4251-ae79-02953e468fc7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:30.526111 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6818ea83-5e8f-4cb9-aa29-47d9ecb33e4f tempest-ServersAdminTestJSON-1674981205 tempest-ServersAdminTestJSON-1674981205-project] 10.222.0.98 "GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7" status: 404 len: 111 microversion: 2.1 time: 0.166203 Jul 14 14:43:30.535816 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 694/1369] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:30 2022] GET /compute/v2.1/servers/28c69871-43bd-4251-ae79-02953e468fc7 => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:30.627774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] validate_networks() for [('ee03bffb-17d6-47bc-b312-096b88b6e925', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:43:30.644902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:30.650872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:30.669371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.671217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:30.673417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:30.674555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:31.375975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:31.409301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:31.412754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:31.415104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9799d130-0b46-48be-b849-eeb551c4b099 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.831549 Jul 14 14:43:31.416245 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 695/1370] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:30 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:31.449611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:31.456303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:31.473201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:31.480530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:31.484734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:31.486201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:31.984297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:32.014045 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f64386c7-f087-4451-a06b-9b3e5d2e9612 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.581559 Jul 14 14:43:32.033149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 696/1371] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:31 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:32.454043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:32.457070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:32.473532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.474344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.476130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.479934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.924865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:43:32.925635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:43:32.926586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:43:32.927651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:43:32.928394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:43:32.947111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.948132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.949217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:32.949876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:32.996552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:33.003570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:33.010302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Getting quotas for user 038556a90129478eb04699f574ea7e1b and project c46a694ba42e4d1ba55d161224195378. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:33.037109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:33.059336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:33.059336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:33.065157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-155f9b45-d844-484c-935b-14f56de3137b tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.618797 Jul 14 14:43:33.070750 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 697/1372] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:32 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:33.117199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "4d29ee92-1770-483a-b4c1-5a600aa113a1"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:33.123540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:33.145286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:33.146156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:33.158218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:33.159418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:33.229875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:43:33.233560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7fc7167-bf46-46e1-9de1-80e17d44fe3d',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:43:33.313136 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] HTTP exception thrown: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Request method failure captured: Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185/os-volume_attachments/5c40841e-83e7-4b64-8da8-e18d95a7859a HTTP/1.1 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 74 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CrYPbMOhqiqh70OiqzNk9U-pQOgAsEO_Igxum-zmY6Oh5ACZErrVOkQ7059nb6mKGu2qUP_TQ1ptJXaEomxjxVnoo77-O4SWDZu-DdmBunwUfcbtka-7lO8j8-_x4M2HCpB8XYJf7-mgBPuJotnpDqGm4gDXSfT0x94WkUIpvP9jPw Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: fce063950ebc4d3ab9e0fc06579144b8 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesAdminNegativeTest-664428940 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/fce063950ebc4d3ab9e0fc06579144b8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesAdminNegativeTest-664428940 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: fce063950ebc4d3ab9e0fc06579144b8 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-664428940 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesAdminNegativeTest-664428940-project-admin Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c31177f742594d958cceefddea7bc399 Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesAdminNegativeTest-664428940-project-admin Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: {"volumeAttachment": {"volumeId": "4d29ee92-1770-483a-b4c1-5a600aa113a1"}} Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: exception: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': '492e8309-1aff-4d9b-99d8-403072c94185', 'id': '5c40841e-83e7-4b64-8da8-e18d95a7859a', 'body': {'volumeAttachment': {'volumeId': '4d29ee92-1770-483a-b4c1-5a600aa113a1'}}} Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. (HTTP 404) (Request-ID: req-898ccf12-bea9-4d51-b8a7-1e9ad60917f5) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:43:33.315695 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] Returning 404 to user: Volume 5c40841e-83e7-4b64-8da8-e18d95a7859a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66a1644b-0955-44a9-88cf-10b002d1c402 tempest-VolumesAdminNegativeTest-664428940 tempest-VolumesAdminNegativeTest-664428940-project-admin] 10.222.0.98 "PUT /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185/os-volume_attachments/5c40841e-83e7-4b64-8da8-e18d95a7859a" status: 404 len: 109 microversion: 2.1 time: 0.244013 Jul 14 14:43:33.327842 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 698/1373] 10.222.0.98 () {60 vars in 1432 bytes} [Thu Jul 14 14:43:33 2022] PUT /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185/os-volume_attachments/5c40841e-83e7-4b64-8da8-e18d95a7859a => generated 109 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:33.348895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:33.352008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:33.399370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:33.399855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:33.412800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:33.423653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:33.822694 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-710c8220-34cb-4c5d-82c4-5ac2a5c8c970 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.936869 Jul 14 14:43:33.824525 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 676/1374] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:43:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3941 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:43:33.846265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-75d56a8c-cc30-465d-bf1b-9552c7bc32ec req-f49e7a91-b0c6-40ac-8dc0-a9d39c4e23b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2409443c-e899-4bc5-a5c4-594d184005f3", "tag": "48906d69-6ef1-47c3-a041-d23a274d3012"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:33.866599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-75d56a8c-cc30-465d-bf1b-9552c7bc32ec req-f49e7a91-b0c6-40ac-8dc0-a9d39c4e23b2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:33.867768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-75d56a8c-cc30-465d-bf1b-9552c7bc32ec req-f49e7a91-b0c6-40ac-8dc0-a9d39c4e23b2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:33.893789 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-75d56a8c-cc30-465d-bf1b-9552c7bc32ec req-f49e7a91-b0c6-40ac-8dc0-a9d39c4e23b2 service nova] Creating event network-changed:48906d69-6ef1-47c3-a041-d23a274d3012 for instance 2409443c-e899-4bc5-a5c4-594d184005f3 on n-h1-768852-23 Jul 14 14:43:33.912648 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-75d56a8c-cc30-465d-bf1b-9552c7bc32ec req-f49e7a91-b0c6-40ac-8dc0-a9d39c4e23b2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074998 Jul 14 14:43:33.915002 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 677/1375] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:33.930575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2fb08db-b6cb-4eea-902c-c133b1a213e4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:33.933769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2fb08db-b6cb-4eea-902c-c133b1a213e4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:34.168591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:34.179666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9caef1e4-8854-4865-b7ed-e2cef7c2cae6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.850735 Jul 14 14:43:34.182343 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 699/1376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:33 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:34.214505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:34.220474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:34.220809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2fb08db-b6cb-4eea-902c-c133b1a213e4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:34.249824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:34.250654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:34.253832 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2fb08db-b6cb-4eea-902c-c133b1a213e4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1052 microversion: 2.1 time: 0.336199 Jul 14 14:43:34.254341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:34.255255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:34.256423 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 678/1377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:33 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1052 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:35.231014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:35.235362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:35.298946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.300326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.313129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.315774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.316082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.318158 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f84ac5d4-5316-464c-8964-7b66e3b05b0e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 1.134021 Jul 14 14:43:35.318637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.319653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.330460 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 700/1378] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:34 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:35.338191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:35.339474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:35.348218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.349010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.350378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:35.351226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:35.451081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.464045 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a772a925-58c7-4688-9727-557112951054 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1094 microversion: 2.1 time: 0.130891 Jul 14 14:43:35.465845 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 701/1379] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:35 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1094 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:35.940267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:35.976097 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b14a6d76-be90-465c-937a-14bfa91ae724 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.764276 Jul 14 14:43:36.000151 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 679/1380] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:35 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:36.352420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:36.353275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:36.372909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:36.374074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.375486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:36.376148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.500946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:36.503482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:36.543177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:36.546106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.550811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:36.557559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:36.623511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:36.797970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:36.857828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5026f7e1-b922-4995-a8aa-7f1e7db027b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1158 microversion: 2.1 time: 0.368459 Jul 14 14:43:36.870134 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 680/1381] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:36 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1158 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:37.013293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:37.014719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:37.046325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:37.054825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.062163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.064383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.066760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.073012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:37.091321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:37.097842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32348476-0cab-402e-bf86-e1943892e14c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.755836 Jul 14 14:43:37.115922 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 702/1382] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:36 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:37.889406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:37.890451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:37.911445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.912218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:37.913236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:37.913868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:38.078008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:38.095071 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e05fbb7-8c6c-42c1-a079-d35e40f11228 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1168 microversion: 2.1 time: 0.205603 Jul 14 14:43:38.109084 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 703/1383] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:37 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:38.134816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:38.136854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:38.150059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:38.151155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:38.153573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:38.155017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:38.155780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:38.248079 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7f826bf-941b-4283-a631-60d3ff893e9a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 1.232706 Jul 14 14:43:38.263048 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 681/1384] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:37 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:38.545809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:38.555923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:38.558821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:38.560498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bce9898a-9987-40f5-84ec-c6403d85aa17 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.430216 Jul 14 14:43:38.561724 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 704/1385] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:38 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:43:39.122546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:39.139884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:39.186514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.209487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:39.211360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.223987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:39.272261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:39.273257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:39.297806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.298304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:39.310555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.318739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:39.750086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:39.770426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0bd12b4d-15a5-4720-b555-7c496606056f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.494196 Jul 14 14:43:39.770426 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 705/1386] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:39 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:39.770426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:39.770426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:39.777989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.779242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:39.780003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:39.780493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.326549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:40.369590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:40.370458 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-53b809e1-abe7-4fbb-b200-cc661682d33d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 1.255593 Jul 14 14:43:40.372874 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 682/1387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:39 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:40.401543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:40.403389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:40.405295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:40.406585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:40.414318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7becae7a-b271-4f2a-837d-69c840397bf4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.649693 Jul 14 14:43:40.418427 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 706/1388] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:39 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:40.447764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:40.452580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:40.454019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.454727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:40.461803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:40.463136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.477109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:40.477584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.482149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:40.485708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.540298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:40.583913 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-813feda3-b81e-4670-a0ee-16a89e139611 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.207652 Jul 14 14:43:40.612875 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 683/1389] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:43:40 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:40.831836 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1901fc4-3d92-4103-8342-2b1677854440 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 204 len: 0 microversion: 2.1 time: 0.411414 Jul 14 14:43:40.833039 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 707/1390] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:40 2022] DELETE /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:43:40.841373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:40.844609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:40.859493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:40.860175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.861554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:40.862571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:40.872764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:41.117533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lazy-loading 'services' on Instance uuid a8ab0475-3f12-4654-90aa-a9836585f0e9 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:41.276975 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7fd0b920-f7bf-452b-a3f9-7967e7976c9d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments/0cb3cc2f-77d5-4104-bab4-09eefdc354b3" status: 202 len: 0 microversion: 2.1 time: 0.442027 Jul 14 14:43:41.282486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 708/1391] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 14:43:40 2022] DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments/0cb3cc2f-77d5-4104-bab4-09eefdc354b3 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:41.304706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:41.312559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:41.327544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.332565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.333928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.334731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.556179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf2f2edc0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:41.558020 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:41.558020 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:43:41.559383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.559982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.578608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.579892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.601608 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] HTTP exception thrown: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Request method failure captured: Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5 HTTP/1.1 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 56 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CubI58PMCaqfSlilmb4L9PSxYrh6AbqPEOmO_kWW8hPtjFR6imKPpQ51gBIRzjbZbHcwhBUFl218tNGW86nqO5hbVLLARptKyPG9JbR7eIFDFpJ_DOyAnLR_9STn3dSgQLBZUSG8-k-51A6CmsqRcnrddjw6M2lmGLyInt169sk1fI Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8b775d65376f417cb942bb2d65d5f3f3 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8b775d65376f417cb942bb2d65d5f3f3 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a5fadff37edb42daa7257f7a47f814f6 Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: {"status": "disabled", "disabled_reason": "maintenance"} Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: exception: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'fffc3d72-d201-446f-9f00-a7a9778ba7d5', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:41.604294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:41.610406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:41.617092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Returning 404 to user: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:41.618641 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9af58f6f-1e0d-4f69-a3e9-3166392e0c8f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5" status: 404 len: 110 microversion: 2.53 time: 1.002474 Jul 14 14:43:41.624931 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 684/1392] 10.222.0.98 () {62 vars in 1308 bytes} [Thu Jul 14 14:43:40 2022] PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5 => generated 110 bytes in 1011 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:41.638145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:41.644204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:41.658712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.664015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.673533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:41.674954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:41.791732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:41.809860 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-119079a6-a499-4ab0-b1ea-25febabdac6f tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.519232 Jul 14 14:43:41.811943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 709/1393] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:41 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:42.001039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18589d06-be93-41d7-9ee2-91e2e1be4263 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2c20700>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWChI8lR7N/2vT0w3G+G+g9LhFaKBihG1ZLHRtTn9RfRh0gks7ZGGsg6l3U4u2fuFSCHW7gtPtkGjNy4BqfxmrQMHqWRgO669TL21B2QUqG8A/wExRPdGY8IQQ2uqM7tQ=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.020940 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-18589d06-be93-41d7-9ee2-91e2e1be4263 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18589d06-be93-41d7-9ee2-91e2e1be4263 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 257 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWChI8lR7N/2vT0w3G+G+g9LhFaKBihG1ZLHRtTn9RfRh0gks7ZGGsg6l3U4u2fuFSCHW7gtPtkGjNy4BqfxmrQMHqWRgO669TL21B2QUqG8A/wExRPdGY8IQQ2uqM7tQ=="}} Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: exception: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWChI8lR7N/2vT0w3G+G+g9LhFaKBihG1ZLHRtTn9RfRh0gks7ZGGsg6l3U4u2fuFSCHW7gtPtkGjNy4BqfxmrQMHqWRgO669TL21B2QUqG8A/wExRPdGY8IQQ2uqM7tQ=='}}} Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in import_key_pair Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._validate_new_key_pair(context, user_id, key_name, key_type) Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6619, in _validate_new_key_pair Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:42.033235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: Keypair name contains unsafe characters Jul 14 14:43:42.041463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.046619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18589d06-be93-41d7-9ee2-91e2e1be4263 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:42.048307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-18589d06-be93-41d7-9ee2-91e2e1be4263 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.234756 Jul 14 14:43:42.049999 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 710/1394] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:43:41 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:42.065275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:42.067891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:42.104054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.104545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.105905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.106419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.239113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:42.256591 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-422db733-c150-4346-91aa-9bc0a8a65bff tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1512 microversion: 2.1 time: 0.627871 Jul 14 14:43:42.258304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 685/1395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:41 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1512 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:42.284852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:42.288393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:42.326191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.327385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.333117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.338065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.415129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:42.435043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-855911b6-8fe0-4d9b-a8c5-1f9748eaa64d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.382679 Jul 14 14:43:42.438909 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 711/1396] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:42 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:42.444373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf36200d0>, body: {"status": "disabled"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.446502 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:42.446502 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:43:42.448710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.452029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.462987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.464557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.475585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] HTTP exception thrown: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Request method failure captured: Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5 HTTP/1.1 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 22 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CubI58PMCaqfSlilmb4L9PSxYrh6AbqPEOmO_kWW8hPtjFR6imKPpQ51gBIRzjbZbHcwhBUFl218tNGW86nqO5hbVLLARptKyPG9JbR7eIFDFpJ_DOyAnLR_9STn3dSgQLBZUSG8-k-51A6CmsqRcnrddjw6M2lmGLyInt169sk1fI Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8b775d65376f417cb942bb2d65d5f3f3 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8b775d65376f417cb942bb2d65d5f3f3 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a5fadff37edb42daa7257f7a47f814f6 Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: {"status": "disabled"} Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: exception: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fffc3d72-d201-446f-9f00-a7a9778ba7d5', 'body': {'status': 'disabled'}} Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.478146 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.482860 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.484560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Returning 404 to user: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:42.485135 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad64e02e-5af7-4b2b-849a-4fc8de73f592 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5" status: 404 len: 110 microversion: 2.53 time: 0.044789 Jul 14 14:43:42.490362 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 712/1397] 10.222.0.98 () {62 vars in 1308 bytes} [Thu Jul 14 14:43:42 2022] PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5 => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:42.500902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2cffdc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1550932708", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.520236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:42.525050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for user 5ffc53165a0b4a6992fea0dd8325c343 and project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:42.548791 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 2167 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1550932708", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:42.565389 n-d-768852-23 devstack@n-api.service[125965]: exception: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1550932708', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:42.568295 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:42.571543 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.579364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:42.582115 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-684d94b4-e9f3-4e98-823e-a223f6161832 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.090079 Jul 14 14:43:42.583859 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 713/1398] 10.222.0.98 () {60 vars in 1159 bytes} [Thu Jul 14 14:43:42 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:42.595821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f84781c2-e874-4acc-a116-ddd75204713e req-dbf66d4e-33c4-481d-a610-1b63362935c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409443c-e899-4bc5-a5c4-594d184005f3", "name": "network-vif-plugged", "status": "completed", "tag": "48906d69-6ef1-47c3-a041-d23a274d3012"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.612446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f84781c2-e874-4acc-a116-ddd75204713e req-dbf66d4e-33c4-481d-a610-1b63362935c6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.612974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f84781c2-e874-4acc-a116-ddd75204713e req-dbf66d4e-33c4-481d-a610-1b63362935c6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.628536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f84781c2-e874-4acc-a116-ddd75204713e req-dbf66d4e-33c4-481d-a610-1b63362935c6 service nova] Creating event network-vif-plugged:48906d69-6ef1-47c3-a041-d23a274d3012 for instance 2409443c-e899-4bc5-a5c4-594d184005f3 on n-h1-768852-23 Jul 14 14:43:42.637098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f84781c2-e874-4acc-a116-ddd75204713e req-dbf66d4e-33c4-481d-a610-1b63362935c6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051411 Jul 14 14:43:42.639158 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 714/1399] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:42.646896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf39291f0>, body: {"status": "enabled"} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.648768 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:42.648768 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:43:42.651348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.652131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.661141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.661921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.668909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] HTTP exception thrown: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Request method failure captured: Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5 HTTP/1.1 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 21 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CubI58PMCaqfSlilmb4L9PSxYrh6AbqPEOmO_kWW8hPtjFR6imKPpQ51gBIRzjbZbHcwhBUFl218tNGW86nqO5hbVLLARptKyPG9JbR7eIFDFpJ_DOyAnLR_9STn3dSgQLBZUSG8-k-51A6CmsqRcnrddjw6M2lmGLyInt169sk1fI Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8b775d65376f417cb942bb2d65d5f3f3 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8b775d65376f417cb942bb2d65d5f3f3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8b775d65376f417cb942bb2d65d5f3f3 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a5fadff37edb42daa7257f7a47f814f6 Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: {"status": "enabled"} Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: exception: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fffc3d72-d201-446f-9f00-a7a9778ba7d5', 'body': {'status': 'enabled'}} Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6076, in service_get_by_id Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5936, in _find_service_in_cell Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6078, in service_get_by_id Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.671657 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. Jul 14 14:43:42.676998 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.688823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Returning 404 to user: Service fffc3d72-d201-446f-9f00-a7a9778ba7d5 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:42.692858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-90449f25-0581-46f9-a385-56d1c6b16d33 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5" status: 404 len: 110 microversion: 2.53 time: 0.051799 Jul 14 14:43:42.694285 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 715/1400] 10.222.0.98 () {62 vars in 1308 bytes} [Thu Jul 14 14:43:42 2022] PUT /compute/v2.1/os-services/fffc3d72-d201-446f-9f00-a7a9778ba7d5 => generated 110 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:42.705787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-623ddac7-8b86-49a5-bdca-6780f3ac1195 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2bc69d0>, body: {"keypair": {"name": "tempest-keypair-822534559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBC3zsMRPyZ8wpJ8KIs9iGfdPcdCgEmlxCvSg0gx8OOZufsQ0CltNBN6D6LV51LNC1rF35aZH6YrRCnk6LGbaJXzegKcx8hKwcnV9JW6LbWVylmWL3HBp5D3aLou0hmySg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.728756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-623ddac7-8b86-49a5-bdca-6780f3ac1195 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:42.735130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-623ddac7-8b86-49a5-bdca-6780f3ac1195 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for user 5ffc53165a0b4a6992fea0dd8325c343 and project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:42.785170 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-623ddac7-8b86-49a5-bdca-6780f3ac1195 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.089508 Jul 14 14:43:42.795360 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 716/1401] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:43:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:42.802433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-103534aa-8ebd-4e26-806e-3e8a2ca43913 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:42.805302 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:42.805302 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:43:42.806977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-103534aa-8ebd-4e26-806e-3e8a2ca43913 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.807592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-103534aa-8ebd-4e26-806e-3e8a2ca43913 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.809619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-103534aa-8ebd-4e26-806e-3e8a2ca43913 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.810309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-103534aa-8ebd-4e26-806e-3e8a2ca43913 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.847698 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-103534aa-8ebd-4e26-806e-3e8a2ca43913 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.049941 Jul 14 14:43:42.853958 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 717/1402] 10.222.0.98 () {60 vars in 1177 bytes} [Thu Jul 14 14:43:42 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:42.862741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2bd53a0>, body: {"keypair": {"name": "tempest-keypair-822534559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ecgPw0Re4Mnop4Hongjv1p439nwS2qB8IkOP9mikl4ndrD7kDRuZRB8VRt//HNXt3HcuKUm7mrGC4qxbvwH0rNbmu8RCgslvRa+22iHJ8lBXKyq92yweHT+hmXcwxGg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:42.878571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:42.890321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:42.897668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for user 5ffc53165a0b4a6992fea0dd8325c343 and project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:42.931871 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] HTTP exception thrown: Key pair 'tempest-keypair-822534559' already exists. Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 272 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: {"keypair": {"name": "tempest-keypair-822534559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ecgPw0Re4Mnop4Hongjv1p439nwS2qB8IkOP9mikl4ndrD7kDRuZRB8VRt//HNXt3HcuKUm7mrGC4qxbvwH0rNbmu8RCgslvRa+22iHJ8lBXKyq92yweHT+hmXcwxGg=="}} Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: exception: Key pair 'tempest-keypair-822534559' already exists. Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-822534559', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ecgPw0Re4Mnop4Hongjv1p439nwS2qB8IkOP9mikl4ndrD7kDRuZRB8VRt//HNXt3HcuKUm7mrGC4qxbvwH0rNbmu8RCgslvRa+22iHJ8lBXKyq92yweHT+hmXcwxGg=='}}} Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '5ffc53165a0b4a6992fea0dd8325c343-tempest-keypair-822534559' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 14 14:43:42.939334 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi kp.save(context.session) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi session.flush() Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._flush(objects) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi compat.raise_( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi flush_context.execute() Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi rec.execute(self) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = self._query(query) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi conn.query(q) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result.read() Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Jul 14 14:43:42.943722 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '5ffc53165a0b4a6992fea0dd8325c343-tempest-keypair-822534559' for key 'key_pairs.uniq_key_pairs0user_id0name'") Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 7, 14, 14, 43, 42, 924343), 'updated_at': None, 'name': 'tempest-keypair-822534559', 'user_id': '5ffc53165a0b4a6992fea0dd8325c343', 'fingerprint': 'cd:90:6c:15:9f:fd:53:8b:8c:0b:49:16:d7:5f:9b:cc', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO+ecgPw0Re4Mnop4Hongjv1p439nwS2qB8IkOP9mikl4ndrD7kDRuZRB8VRt//HNXt3HcuKUm7mrGC4qxbvwH0rNbmu8RCgslvRa+22iHJ8lBXKyq92yweHT+hmXcwxGg==', 'type': 'ssh'}] Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6661, in import_key_pair Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi keypair.create() Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._create() Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-822534559' already exists. Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 126, in _create Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Jul 14 14:43:42.951947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-822534559' already exists. Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-822534559' already exists. Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 409 to user: Key pair 'tempest-keypair-822534559' already exists. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3b29dda-96ac-4873-9321-120006f5d43f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.084548 Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 718/1403] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:43:42 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:42.959985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:42.963562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.964172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.965541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:42.967240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:42.994594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:43.005967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:43.008938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:43.011111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5911c900-3370-4748-8a65-1db48b73ad09 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.749363 Jul 14 14:43:43.013265 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 686/1404] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:42 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:43.019929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e349be0-a120-4107-bfce-52d0e7325a6b tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.024099 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:43.024099 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:43:43.032703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e349be0-a120-4107-bfce-52d0e7325a6b tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.033258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e349be0-a120-4107-bfce-52d0e7325a6b tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.034186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e349be0-a120-4107-bfce-52d0e7325a6b tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.035554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e349be0-a120-4107-bfce-52d0e7325a6b tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.072511 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e349be0-a120-4107-bfce-52d0e7325a6b tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.057776 Jul 14 14:43:43.073806 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 687/1405] 10.222.0.98 () {60 vars in 1210 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:43.101306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2e31a008-abb4-41e9-a23c-263628b6c103 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Calling method '.version_select at 0x7fdbf2cfd160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.139349 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2e31a008-abb4-41e9-a23c-263628b6c103 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-822534559" status: 202 len: 0 microversion: 2.1 time: 0.060035 Jul 14 14:43:43.140084 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 688/1406] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-822534559 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:43.158045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-39cf5d87-e81a-43b4-ba69-a3d10f694411 req-0604330e-858a-416a-9cb8-b3156d8a5f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b060b5-502d-43ad-b5d9-487f0a89e438", "tag": "d7920837-2445-4490-b644-0e5e66a09961"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:43.171084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-39cf5d87-e81a-43b4-ba69-a3d10f694411 req-0604330e-858a-416a-9cb8-b3156d8a5f76 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.171888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-39cf5d87-e81a-43b4-ba69-a3d10f694411 req-0604330e-858a-416a-9cb8-b3156d8a5f76 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.185417 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-39cf5d87-e81a-43b4-ba69-a3d10f694411 req-0604330e-858a-416a-9cb8-b3156d8a5f76 service nova] Creating event network-changed:d7920837-2445-4490-b644-0e5e66a09961 for instance e7b060b5-502d-43ad-b5d9-487f0a89e438 on n-h2-768852-23 Jul 14 14:43:43.191757 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-39cf5d87-e81a-43b4-ba69-a3d10f694411 req-0604330e-858a-416a-9cb8-b3156d8a5f76 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050219 Jul 14 14:43:43.192996 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 689/1407] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:43.199540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c8efba2f-06b4-45e9-98ae-7fc9b0b5ed3f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.201564 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:43.201564 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:43:43.203426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8efba2f-06b4-45e9-98ae-7fc9b0b5ed3f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.204151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8efba2f-06b4-45e9-98ae-7fc9b0b5ed3f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.210470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8efba2f-06b4-45e9-98ae-7fc9b0b5ed3f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.212088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8efba2f-06b4-45e9-98ae-7fc9b0b5ed3f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.230319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:43.254123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe844a2a-7bb5-4175-ae39-537934ec167e tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.305404 Jul 14 14:43:43.267502 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 719/1408] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:42 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:43.284711 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c8efba2f-06b4-45e9-98ae-7fc9b0b5ed3f tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.090249 Jul 14 14:43:43.287729 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 690/1409] 10.222.0.98 () {60 vars in 1177 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:43.300447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1f82bce-066a-43b3-ae8d-dfc9ddb9d9df tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2bd5280>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEafrQmei2QTWjZ4dTq5AdpIyYeAH8TmkOV+LR0WAb85gncYyXYQM1u6XKl35mG+7PEBOJESK3WxtEIFoE479TwqY87v5AZB3p1tuCSqmUs+rOhGUmnrrzioy89OhoUa3w=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1f82bce-066a-43b3-ae8d-dfc9ddb9d9df tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 247 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEafrQmei2QTWjZ4dTq5AdpIyYeAH8TmkOV+LR0WAb85gncYyXYQM1u6XKl35mG+7PEBOJESK3WxtEIFoE479TwqY87v5AZB3p1tuCSqmUs+rOhGUmnrrzioy89OhoUa3w=="}} Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEafrQmei2QTWjZ4dTq5AdpIyYeAH8TmkOV+LR0WAb85gncYyXYQM1u6XKl35mG+7PEBOJESK3WxtEIFoE479TwqY87v5AZB3p1tuCSqmUs+rOhGUmnrrzioy89OhoUa3w=='}}} Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']: Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi '' Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:43:43.303329 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 14:43:43.311083 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.317886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.317886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:43.319021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1f82bce-066a-43b3-ae8d-dfc9ddb9d9df tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:43.319021 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1f82bce-066a-43b3-ae8d-dfc9ddb9d9df tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.042187 Jul 14 14:43:43.319021 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 720/1410] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:43:43 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:43.324494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f072a37a-8ced-48b3-a767-eb3a5ef55ed1 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.326145 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:43.326145 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:43:43.328198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.328767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.329753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.330145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.338941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f072a37a-8ced-48b3-a767-eb3a5ef55ed1 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.339793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f072a37a-8ced-48b3-a767-eb3a5ef55ed1 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.345126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f072a37a-8ced-48b3-a767-eb3a5ef55ed1 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.348167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f072a37a-8ced-48b3-a767-eb3a5ef55ed1 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.407557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f072a37a-8ced-48b3-a767-eb3a5ef55ed1 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?host=n-d-768852-23&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.090865 Jul 14 14:43:43.413948 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 721/1411] 10.222.0.98 () {60 vars in 1236 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/os-services?host=n-d-768852-23&binary=xxx => generated 16 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:43.421193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf31a9ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1654013721", "public_key": " "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:43.451890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:43.457902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for user 5ffc53165a0b4a6992fea0dd8325c343 and project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:43.479618 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 95 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1654013721", "public_key": " "}} Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: exception: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1654013721', 'public_key': ' '}}} Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.481574 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65393a86-457c-43b0-a081-03d0c9617a9f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.073603 Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 722/1412] 10.222.0.98 () {60 vars in 1157 bytes} [Thu Jul 14 14:43:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 75 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:43.490275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c835fa70-c6f3-460d-91f2-dc932aab0379 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.498075 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:43.498075 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:43:43.498075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c835fa70-c6f3-460d-91f2-dc932aab0379 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.498075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c835fa70-c6f3-460d-91f2-dc932aab0379 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.498075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c835fa70-c6f3-460d-91f2-dc932aab0379 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.498075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c835fa70-c6f3-460d-91f2-dc932aab0379 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.534273 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c835fa70-c6f3-460d-91f2-dc932aab0379 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.048549 Jul 14 14:43:43.535030 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 723/1413] 10.222.0.98 () {60 vars in 1177 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:43.541296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.541842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:43.550355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.550806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.551706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.552147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.706100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:43.715363 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68d595df-b9c8-47fe-b2e2-d745462249b5 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.178927 Jul 14 14:43:43.716119 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 724/1414] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:43.724058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dbf1d15-23f2-46cb-8adc-97512644f54f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2b87ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZOxPfLOFa7i5dDW4rpf+6Ht/2uG6D/yLxEj3IGjQgpeXyvFBWqMnmAvlGrC3Wcy6yBggFQUtCqfFxrehOCDgTYoRQYFtp4OB8IKIdxn6r5fUzcbm6l6mfkH0f5vc96dA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dbf1d15-23f2-46cb-8adc-97512644f54f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 507 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZOxPfLOFa7i5dDW4rpf+6Ht/2uG6D/yLxEj3IGjQgpeXyvFBWqMnmAvlGrC3Wcy6yBggFQUtCqfFxrehOCDgTYoRQYFtp4OB8IKIdxn6r5fUzcbm6l6mfkH0f5vc96dA=="}} Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNZOxPfLOFa7i5dDW4rpf+6Ht/2uG6D/yLxEj3IGjQgpeXyvFBWqMnmAvlGrC3Wcy6yBggFQUtCqfFxrehOCDgTYoRQYFtp4OB8IKIdxn6r5fUzcbm6l6mfkH0f5vc96dA=='}}} Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']: Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['keypair']: Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Jul 14 14:43:43.728560 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Jul 14 14:43:43.733220 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.736125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dbf1d15-23f2-46cb-8adc-97512644f54f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:43.737644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3dbf1d15-23f2-46cb-8adc-97512644f54f tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.020087 Jul 14 14:43:43.742420 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 725/1415] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:43:43 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:43.743790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:43.743947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69cdde96-e701-403b-9be3-e1d243633827 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.745525 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:43.745525 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:43:43.747838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69cdde96-e701-403b-9be3-e1d243633827 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.748404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69cdde96-e701-403b-9be3-e1d243633827 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.749350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69cdde96-e701-403b-9be3-e1d243633827 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:43.750063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69cdde96-e701-403b-9be3-e1d243633827 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:43.753258 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7c3208a-2d8a-43f9-9be6-eb538df824ea tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1512 microversion: 2.1 time: 0.463117 Jul 14 14:43:43.755449 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 691/1416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1512 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:43.761794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Action: 'create', calling method: .version_select at 0x7fdbf2d31ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1718477253", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:43.778139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:43:43.783827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Getting quotas for user 5ffc53165a0b4a6992fea0dd8325c343 and project cdff374d01764239b8f35f469216115c. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:43:43.804139 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 118 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1718477253", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: exception: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1718477253', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 113, in _create Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6658, in import_key_pair Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6731, in _generate_fingerprint Jul 14 14:43:43.808271 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 99, in create Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._create(req, body) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 124, in _create Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Jul 14 14:43:43.815873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.822645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:43.823634 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a0ff0e6-6ba8-40f6-9ef9-8dc73e100f67 tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.061592 Jul 14 14:43:43.824997 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 692/1417] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:43:43 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:43:43.825998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69cdde96-e701-403b-9be3-e1d243633827 tempest-ServicesAdminNegativeV253TestJSON-236151189 tempest-ServicesAdminNegativeV253TestJSON-236151189-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.086776 Jul 14 14:43:43.826832 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 726/1418] 10.222.0.98 () {60 vars in 1238 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:43.863706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af1b0782-d00a-4aca-bf10-61ec99b26edd tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Calling method '.version_select at 0x7fdbf31a9ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:43.878082 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-af1b0782-d00a-4aca-bf10-61ec99b26edd tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1583560672 not found for user 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af1b0782-d00a-4aca-bf10-61ec99b26edd tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Request method failure captured: Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1583560672 HTTP/1.1 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CucKYPzgh3e3QrQAj8uBxktEmXefWKHzueds_p5d0_l4OfT2CTrzOQBCJWkmBS5WW7VtczFI2v1f6-7A20rpIYinTNH4ONxl85xv_eeaZrqEh-mmlFginhEEtzO1kjDG3dqJoMIGdCqge9Bt1ceZgs1bJ2JoLraW6pKCuFLTy00lu0 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cdff374d01764239b8f35f469216115c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cdff374d01764239b8f35f469216115c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cdff374d01764239b8f35f469216115c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cdff374d01764239b8f35f469216115c Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-594301281 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-KeyPairsNegativeTestJSON-594301281-project Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: exception: Keypair tempest-keypair-non-existent-1583560672 not found for user 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'tempest-keypair-non-existent-1583560672'} Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 164, in _delete Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6745, in delete_key_pair Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6766, in get_key_pair Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1583560672 not found for user 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.880588 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 137, in delete Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req, id) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 166, in _delete Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1583560672 not found for user 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1583560672 not found for user 5ffc53165a0b4a6992fea0dd8325c343 Jul 14 14:43:43.885598 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:43.889746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af1b0782-d00a-4aca-bf10-61ec99b26edd tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1583560672 not found for user 5ffc53165a0b4a6992fea0dd8325c343 {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:43.891113 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af1b0782-d00a-4aca-bf10-61ec99b26edd tempest-KeyPairsNegativeTestJSON-594301281 tempest-KeyPairsNegativeTestJSON-594301281-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1583560672" status: 404 len: 145 microversion: 2.1 time: 0.050488 Jul 14 14:43:43.901500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 727/1419] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:43:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1583560672 => generated 145 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:44.034174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:44.035248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:44.055137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.059935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.061347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.064691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.105086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efd93459-cff9-42cb-979f-d8da0178381d tempest-ServicesAdminNegativeV253TestJSON-163849520 tempest-ServicesAdminNegativeV253TestJSON-163849520-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:44.107968 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:44.107968 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:43:44.109235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-efd93459-cff9-42cb-979f-d8da0178381d tempest-ServicesAdminNegativeV253TestJSON-163849520 tempest-ServicesAdminNegativeV253TestJSON-163849520-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '8ed3d7a4c74f4be789ded3830c8e988f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01a0e85ed66f4cc38e7fb3ce7d76cc96', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efd93459-cff9-42cb-979f-d8da0178381d tempest-ServicesAdminNegativeV253TestJSON-163849520 tempest-ServicesAdminNegativeV253TestJSON-163849520-project] Request method failure captured: Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-services HTTP/1.1 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CuZFCWbV8rEBGnyCrcDHo5NiLAWDq5Kd2HdbvUkEpT9jcf95ZlNkLMJokMpxySchlNcVAAJ-QoA-78GXYzJj95Vp1oKTqYHx_uYMDOtxBvZjnD-AbN22L1OLZX-cXpdP_ch7smYYnLWGGK5_eFBc9xKJ8iY6MIslZX1MVwPk7qssIk Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.53 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 01a0e85ed66f4cc38e7fb3ce7d76cc96 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-163849520 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/01a0e85ed66f4cc38e7fb3ce7d76cc96"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_01a0e85ed66f4cc38e7fb3ce7d76cc96"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/01a0e85ed66f4cc38e7fb3ce7d76cc96"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/01a0e85ed66f4cc38e7fb3ce7d76cc96"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-163849520 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 01a0e85ed66f4cc38e7fb3ce7d76cc96 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-163849520 Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServicesAdminNegativeV253TestJSON-163849520-project Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8ed3d7a4c74f4be789ded3830c8e988f Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-163849520-project Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: action_args: {} Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.force_reraise() Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise self.value Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.enforce( Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:43:44.114244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efd93459-cff9-42cb-979f-d8da0178381d tempest-ServicesAdminNegativeV253TestJSON-163849520 tempest-ServicesAdminNegativeV253TestJSON-163849520-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-efd93459-cff9-42cb-979f-d8da0178381d tempest-ServicesAdminNegativeV253TestJSON-163849520 tempest-ServicesAdminNegativeV253TestJSON-163849520-project] 10.222.0.98 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.284114 Jul 14 14:43:44.131437 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 693/1420] 10.222.0.98 () {60 vars in 1177 bytes} [Thu Jul 14 14:43:43 2022] GET /compute/v2.1/os-services => generated 112 bytes in 296 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:43:44.274655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:44.277678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:44.307650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.308316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.309653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.317767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.480110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.519345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.523644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.540743 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-808f3d30-e981-43e5-b23e-f0438536e919 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.502292 Jul 14 14:43:44.543528 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 728/1421] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:44 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:44.739916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-eddfc8d6-4051-470f-b54a-9bbe99e69b77 req-5456f978-be38-490e-9674-e54808abb5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde86f6d-6561-44c7-b3c0-46cb586ab9ca", "name": "network-vif-plugged", "status": "completed", "tag": "2660e2f0-d5e5-47e4-805e-17cfccb97fbf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:44.797770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-eddfc8d6-4051-470f-b54a-9bbe99e69b77 req-5456f978-be38-490e-9674-e54808abb5d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.797983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-eddfc8d6-4051-470f-b54a-9bbe99e69b77 req-5456f978-be38-490e-9674-e54808abb5d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.818573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:44.836304 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d5aed4a9-515f-4119-ab41-a51d313a1151 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1317 microversion: 2.1 time: 0.567691 Jul 14 14:43:44.848535 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-eddfc8d6-4051-470f-b54a-9bbe99e69b77 req-5456f978-be38-490e-9674-e54808abb5d5 service nova] Creating event network-vif-plugged:2660e2f0-d5e5-47e4-805e-17cfccb97fbf for instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca on n-h1-768852-23 Jul 14 14:43:44.855369 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 694/1422] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:44 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1317 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:44.866690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:44.867441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:44.870114 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-eddfc8d6-4051-470f-b54a-9bbe99e69b77 req-5456f978-be38-490e-9674-e54808abb5d5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148957 Jul 14 14:43:44.872151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 729/1423] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:44.880585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.881439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.886625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.888791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.891413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:44.894486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:44.936790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.938716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:44.941412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:44.941871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.038826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:45.039323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.040022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lazy-loading 'fault' on Instance uuid 492e8309-1aff-4d9b-99d8-403072c94185 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:45.155754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:45.178737 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba66d2a9-4bb2-41d7-9cf6-ef312e5044c8 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 200 len: 1307 microversion: 2.1 time: 0.303211 Jul 14 14:43:45.181405 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 730/1424] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:44 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 1307 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:45.237427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-88c74eec-a416-4368-87ce-d89cabcb0b68 req-dc27ae8b-6642-4ba4-9e4a-8d7f00f4206d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "492e8309-1aff-4d9b-99d8-403072c94185", "name": "network-vif-deleted", "tag": "2cc87f89-2c15-41ca-9d01-62f4b9f60530"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:45.259305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-88c74eec-a416-4368-87ce-d89cabcb0b68 req-dc27ae8b-6642-4ba4-9e4a-8d7f00f4206d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:45.261275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-88c74eec-a416-4368-87ce-d89cabcb0b68 req-dc27ae8b-6642-4ba4-9e4a-8d7f00f4206d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.301249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-88c74eec-a416-4368-87ce-d89cabcb0b68 req-dc27ae8b-6642-4ba4-9e4a-8d7f00f4206d service nova] Creating event network-vif-deleted:2cc87f89-2c15-41ca-9d01-62f4b9f60530 for instance 492e8309-1aff-4d9b-99d8-403072c94185 on n-h2-768852-23 Jul 14 14:43:45.316651 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-88c74eec-a416-4368-87ce-d89cabcb0b68 req-dc27ae8b-6642-4ba4-9e4a-8d7f00f4206d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080510 Jul 14 14:43:45.322004 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 731/1425] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:45.388036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:45.410284 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9674646-3d3b-4326-97c5-5ec182bdc301 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.553217 Jul 14 14:43:45.425458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 695/1426] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:44 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:45.596902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:45.599516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:45.619369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:45.620412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.622201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:45.622970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.861124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:45.864932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:45.882054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:45.885683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.889167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:45.891196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:45.925858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:45.992513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:45.995748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:45.997136 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f661eaec-d994-4080-b2d9-faf29953b99f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.435006 Jul 14 14:43:46.008903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 732/1427] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:45 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:46.209034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:46.209784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 492e8309-1aff-4d9b-99d8-403072c94185] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:46.221076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.222456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.224065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.224827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.251905 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] HTTP exception thrown: Instance 492e8309-1aff-4d9b-99d8-403072c94185 could not be found. Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Request method failure captured: Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 HTTP/1.1 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cq8t3oVU8etBlOnAuJ3KgUh2rptjfyQrdJNnTbW56RwnE-GWj9EAiynsHoZ4IEitCTthvrzDUQ2kjQxIbFRJBG1EAasQ0JE-fDhtHJmThuG4AFaTwzZI9LJ1CjvkSRdeOZn6OGmF9ZXEheZS8CZAeCYqbEtnOSE9qJrqp6o0JU3sg0 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2a999d9d8991476983a97cb975c6302a Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesAdminNegativeTest-1395457122 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2a999d9d8991476983a97cb975c6302a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2a999d9d8991476983a97cb975c6302a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2a999d9d8991476983a97cb975c6302a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2a999d9d8991476983a97cb975c6302a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesAdminNegativeTest-1395457122 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2a999d9d8991476983a97cb975c6302a Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1395457122 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesAdminNegativeTest-1395457122-project Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2deda01949ad4a5eb16842b00afe7567 Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesAdminNegativeTest-1395457122-project Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 492e8309-1aff-4d9b-99d8-403072c94185 could not be found. Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '492e8309-1aff-4d9b-99d8-403072c94185'} Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 492e8309-1aff-4d9b-99d8-403072c94185 could not be found. Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 492e8309-1aff-4d9b-99d8-403072c94185 could not be found. Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:46.254330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 492e8309-1aff-4d9b-99d8-403072c94185 could not be found. Jul 14 14:43:46.258977 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:46.264855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Returning 404 to user: Instance 492e8309-1aff-4d9b-99d8-403072c94185 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:46.266702 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4e756816-041d-406f-8394-1e402a87a15e tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185" status: 404 len: 111 microversion: 2.1 time: 0.062527 Jul 14 14:43:46.271546 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 733/1428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:46 2022] GET /compute/v2.1/servers/492e8309-1aff-4d9b-99d8-403072c94185 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:46.333239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:46.345909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2cccb02-4751-4fee-8f01-2c9e8e02c1da tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1506 microversion: 2.1 time: 0.492831 Jul 14 14:43:46.346582 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 696/1429] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:45 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1506 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:46.364449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:46.365624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:46.374918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.375448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.375917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.376361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.419603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:46.419603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d78d5d9-5f9d-4e40-be2b-aee18fc4470a tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3/os-instance-actions/req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208" status: 200 len: 313 microversion: 2.1 time: 0.057359 Jul 14 14:43:46.431558 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 734/1430] 10.222.0.98 () {58 vars in 1418 bytes} [Thu Jul 14 14:43:46 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3/os-instance-actions/req-f8a8ee62-0d72-4e3f-b09a-7f8e64e29208 => generated 313 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:46.443468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:46.444764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:46.464581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:46.467246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.467736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.473147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.473746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:46.479246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.511386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.511949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.514739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.516623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.662480 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e747245-7c54-4c70-b5f4-d7fdec158a29 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "POST /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3/action" status: 202 len: 0 microversion: 2.1 time: 0.233639 Jul 14 14:43:46.668194 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 697/1431] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:43:46 2022] POST /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:43:46.677337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:46.678413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:46.724295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.729988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.736810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:46.739064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:46.822956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:46.839662 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cbc2a93b-25e3-425d-b65d-75f798b2ff87 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.384244 Jul 14 14:43:46.841119 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 735/1432] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:46 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:47.018470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:47.019562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:47.031678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.038144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.041646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.042456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.047151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:47.062902 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2ad3fc4f-3ffe-40e5-b9cf-3759441c43f6 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1508 microversion: 2.1 time: 0.390117 Jul 14 14:43:47.074917 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 698/1433] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:46 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:47.427072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:47.436257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:47.438076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:47.439254 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dd13b113-2152-480f-a18f-f9a735edb298 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1280 microversion: 2.25 time: 0.426531 Jul 14 14:43:47.439959 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 736/1434] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:47 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1280 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:43:47.859297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:47.860100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:47.876561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.880471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:47.882015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:47.882968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.070546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a083a46-a8c3-46ac-a1c1-1d349b1509ba tempest-AZV2TestJSON-973089427 tempest-AZV2TestJSON-973089427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:48.072777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a083a46-a8c3-46ac-a1c1-1d349b1509ba tempest-AZV2TestJSON-973089427 tempest-AZV2TestJSON-973089427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.073241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a083a46-a8c3-46ac-a1c1-1d349b1509ba tempest-AZV2TestJSON-973089427 tempest-AZV2TestJSON-973089427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.077562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a083a46-a8c3-46ac-a1c1-1d349b1509ba tempest-AZV2TestJSON-973089427 tempest-AZV2TestJSON-973089427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.078028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a083a46-a8c3-46ac-a1c1-1d349b1509ba tempest-AZV2TestJSON-973089427 tempest-AZV2TestJSON-973089427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.092637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=11 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:48.124175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a083a46-a8c3-46ac-a1c1-1d349b1509ba tempest-AZV2TestJSON-973089427 tempest-AZV2TestJSON-973089427-project] 10.222.0.98 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.513600 Jul 14 14:43:48.125950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 699/1435] 10.222.0.98 () {58 vars in 1163 bytes} [Thu Jul 14 14:43:47 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:43:48.131952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:48.134375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:48.172451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.177535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.181203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.186147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.362558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:48.388080 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16bd325e-7160-4cac-87ce-525ef50f8375 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.533259 Jul 14 14:43:48.389145 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 737/1436] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:47 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:48.466097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:48.469196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:48.487136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.488633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.491810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:48.493063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:48.545865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:48.550882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:48.557842 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-382bcfe1-1b10-4b79-b356-fa9952a862e0 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1508 microversion: 2.1 time: 0.430353 Jul 14 14:43:48.559781 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 700/1437] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:48 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1508 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:48.821262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:48.840085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:48.844097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:48.846694 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4bd48b20-bc33-49ab-828d-0f3d56bfe6da tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1476 microversion: 2.25 time: 0.391678 Jul 14 14:43:48.848174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 738/1438] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:48 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1476 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:49.431114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:49.432194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:49.454105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.454706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.462533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.463081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.518982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:49.519917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:49.532402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.532865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.540778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.541140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.845879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:49.891726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a66757a7-0c06-434e-95fe-ab2f7a70b021 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.477675 Jul 14 14:43:49.893805 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 739/1439] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:49 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:49.900843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:49.917061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:49.944333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.947735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:49.954159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:49.954856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.230182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:50.238373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid cde86f6d-6561-44c7-b3c0-46cb586ab9ca {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:50.251606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:50.279488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21e38b11-4395-4393-917b-175b0f9db6a1 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1970 microversion: 2.25 time: 1.405940 Jul 14 14:43:50.280995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33620cb9-797f-416b-80cc-6aedca781b73 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1506 microversion: 2.1 time: 0.384039 Jul 14 14:43:50.292307 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 701/1440] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:48 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1970 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:50.303943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 740/1441] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:49 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1506 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:50.316211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.317378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.326620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '.version_select at 0x7fdbf2b4c4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.327217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.338026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.338811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.339999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.340734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.341058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.341912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.343100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.344016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.393283 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7edc074b-1a1e-49b5-82c2-94c70a2ef6eb tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.072526 Jul 14 14:43:50.394669 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 741/1442] 10.222.0.98 () {58 vars in 1295 bytes} [Thu Jul 14 14:43:50 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3/os-instance-actions => generated 611 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:43:50.406925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.410380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.427605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.428199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.429495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.430044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.466231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:50.657178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid cde86f6d-6561-44c7-b3c0-46cb586ab9ca {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:50.678194 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b27773ad-ae64-4ad4-bc8c-31bf69dcff1b tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1970 microversion: 2.25 time: 0.369840 Jul 14 14:43:50.679520 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 702/1443] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:50 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1970 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:50.698083 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4f5a3f4-597e-4e07-8240-b0a67ebeeb69 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 204 len: 0 microversion: 2.1 time: 0.294759 Jul 14 14:43:50.699839 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 742/1444] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:50 2022] DELETE /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:43:50.710536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bb60112d-d692-46d2-8697-2f8c42004ac8 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.712620 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:43:50.712620 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:43:50.716222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb60112d-d692-46d2-8697-2f8c42004ac8 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.717089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb60112d-d692-46d2-8697-2f8c42004ac8 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.717871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:50.718374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb60112d-d692-46d2-8697-2f8c42004ac8 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.719039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb60112d-d692-46d2-8697-2f8c42004ac8 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.722522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.734024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.734466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.735495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.736079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.793998 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bb60112d-d692-46d2-8697-2f8c42004ac8 tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.081921 Jul 14 14:43:50.795600 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 703/1445] 10.222.0.98 () {60 vars in 1216 bytes} [Thu Jul 14 14:43:50 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:43:50.813538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": "auto"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:50.816886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:50.834601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.835738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.837226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:50.838058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:50.880134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'flavor' on Instance uuid cde86f6d-6561-44c7-b3c0-46cb586ab9ca {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:43:50.898221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Going to try to live migrate instance to n-h2-768852-23 {{(pid=125966) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:43:51.011818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:51.022300 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07586279-745c-4f20-b0af-fb412d3b7a64 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1512 microversion: 2.1 time: 0.315510 Jul 14 14:43:51.034394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 743/1446] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:50 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:51.039132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:51.039820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:51.054649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:51.055105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:51.055922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:51.056355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:51.319581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:51.331246 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38a819ba-440b-48d1-8ce4-70427c3d6430 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.302818 Jul 14 14:43:51.332876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 744/1447] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:51 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:52.044882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:52.046245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:52.058368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:52.059354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:52.060937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:52.062425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.050283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:53.078151 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d545bd2-c8c5-486a-b441-9b2bf5d966d8 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1512 microversion: 2.1 time: 1.038104 Jul 14 14:43:53.079477 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 745/1448] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:52 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1512 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:43:53.093647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:53.096387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:53.114977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:53.120216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.123698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:53.124357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.466715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=16 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:53.782008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=12 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:53.795033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=20 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:53.828343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:53.838568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a0073516-8f44-4f11-9419-5165bc803e62 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.757427 Jul 14 14:43:53.839348 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 746/1449] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:53 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:53.858572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:53.859982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:53.875565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:53.879315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.880422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:53.881450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:53.930547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9fb1c00c-9816-492e-a188-6e8c8c3c879b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090017 Jul 14 14:43:53.931768 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 747/1450] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:43:53 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:43:54.084602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:54.085895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:54.103515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.103967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.104804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.110551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.181620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bf22bd6d-ec3e-4ec2-9cd0-b2546b4655e7 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.109043 Jul 14 14:43:54.182649 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 748/1451] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:43:54 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:43:54.188901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:54.189882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:54.229343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.229709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.230626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.231103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.588754 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b43645b-4cb3-4993-8d2a-b847aa70bb0c tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca/action" status: 202 len: 0 microversion: 2.25 time: 3.781477 Jul 14 14:43:54.601426 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 704/1452] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:43:50 2022] POST /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca/action => generated 0 bytes in 3795 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:43:54.613881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:54.615756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:54.675208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.680328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.687818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:54.691661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:54.791254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:43:54.989294 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca50b06c-b106-4a3e-858f-641e034d650d tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 204 len: 0 microversion: 2.1 time: 0.385333 Jul 14 14:43:54.990972 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 705/1453] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:43:54 2022] DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:43:54.999189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:55.000329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:55.020235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.021545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.026544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.026817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b04aa0fbcacd45bdadeb9bde761d4def', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a21758c8c2ee4fd3bc58344c4948f503', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:55.028639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.035341 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4d8ab7a-5e28-4112-80d7-304f824db5ba tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 200 len: 1512 microversion: 2.1 time: 0.850998 Jul 14 14:43:55.035962 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 749/1454] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:54 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:55.075188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:55.081616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:55.118460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.123457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.124612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.127257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.637349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:55.647826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e450f5e8-143c-467e-98ac-789ac0e8d09d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.600296 Jul 14 14:43:55.654597 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 750/1455] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:55 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:55.662383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-efdcf4c5-9672-4056-904a-a19fed61852c req-1459161e-3372-460c-b950-3f45660ef81d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2409443c-e899-4bc5-a5c4-594d184005f3", "name": "network-vif-deleted", "tag": "48906d69-6ef1-47c3-a041-d23a274d3012"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:43:55.685995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-efdcf4c5-9672-4056-904a-a19fed61852c req-1459161e-3372-460c-b950-3f45660ef81d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.691545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-efdcf4c5-9672-4056-904a-a19fed61852c req-1459161e-3372-460c-b950-3f45660ef81d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.725190 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-efdcf4c5-9672-4056-904a-a19fed61852c req-1459161e-3372-460c-b950-3f45660ef81d service nova] Creating event network-vif-deleted:48906d69-6ef1-47c3-a041-d23a274d3012 for instance 2409443c-e899-4bc5-a5c4-594d184005f3 on n-h1-768852-23 Jul 14 14:43:55.736009 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-efdcf4c5-9672-4056-904a-a19fed61852c req-1459161e-3372-460c-b950-3f45660ef81d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079618 Jul 14 14:43:55.737023 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 751/1456] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:43:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:43:55.746209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:55.753374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:55.754193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:55.769308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:55.771166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.771758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.772827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:55.773326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:55.778796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:55.782072 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-339f8552-13ef-4bcc-a5e4-43a82e10f76c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.789508 Jul 14 14:43:55.785304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 706/1457] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:54 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:56.052270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:56.057905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:56.071986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.078312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.079448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.082485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.174762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:56.197790 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c3859a3-9c53-40a0-b5cf-2545785c9a28 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1680 microversion: 2.1 time: 0.456712 Jul 14 14:43:56.201356 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 752/1458] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:55 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1680 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:56.222242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:56.223178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] [instance: 2409443c-e899-4bc5-a5c4-594d184005f3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:56.249739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.250199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.251000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.251466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.305686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] HTTP exception thrown: Instance 2409443c-e899-4bc5-a5c4-594d184005f3 could not be found. Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Request method failure captured: Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 HTTP/1.1 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CuJRY57nIO6VsRH2MTle0ve-225Im_t6c4r-WEepbKC2Ti_0HrCQhkfM89AWT1gNgG69AKEc-BpXfHeloWyu-_wgAJcoK8RIVOKXqmx9FWiPodA-UDLD7jMAJQeTfW1E3m1z_5dM022FHE2zIlDpkhemGSuFan26ry13cl02eCKpT4 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a21758c8c2ee4fd3bc58344c4948f503 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-InstanceActionsTestJSON-56660722 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a21758c8c2ee4fd3bc58344c4948f503"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a21758c8c2ee4fd3bc58344c4948f503"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a21758c8c2ee4fd3bc58344c4948f503"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a21758c8c2ee4fd3bc58344c4948f503"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-InstanceActionsTestJSON-56660722 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a21758c8c2ee4fd3bc58344c4948f503 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-InstanceActionsTestJSON-56660722 Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-InstanceActionsTestJSON-56660722-project Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b04aa0fbcacd45bdadeb9bde761d4def Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-InstanceActionsTestJSON-56660722-project Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2409443c-e899-4bc5-a5c4-594d184005f3 could not be found. Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2409443c-e899-4bc5-a5c4-594d184005f3'} Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2409443c-e899-4bc5-a5c4-594d184005f3 could not be found. Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2409443c-e899-4bc5-a5c4-594d184005f3 could not be found. Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:43:56.311144 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2409443c-e899-4bc5-a5c4-594d184005f3 could not be found. Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] Returning 404 to user: Instance 2409443c-e899-4bc5-a5c4-594d184005f3 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:43:56.318224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43d07c18-2530-413a-8815-6e49015ab593 tempest-InstanceActionsTestJSON-56660722 tempest-InstanceActionsTestJSON-56660722-project] 10.222.0.98 "GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3" status: 404 len: 111 microversion: 2.1 time: 0.104959 Jul 14 14:43:56.321747 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 753/1459] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:56 2022] GET /compute/v2.1/servers/2409443c-e899-4bc5-a5c4-594d184005f3 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:43:56.674886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:56.675942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:56.693039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.694821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:56.698316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:56.700250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.622813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.627608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:57.642035 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8aebe859-cf4f-4356-8071-b42b407ac359 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1210 microversion: 2.1 time: 0.973419 Jul 14 14:43:57.658880 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 754/1460] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:56 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1210 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:57.682837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:57.684399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:57.691598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:43:57.693737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.694474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.695548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.696622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.795803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.826922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.832835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:57.837781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-848509cb-007a-419f-a1d5-4c4ee5f1e729 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2958 microversion: 2.42 time: 1.797112 Jul 14 14:43:57.843971 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 707/1461] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:56 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2958 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:43:57.851184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:57.852043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:57.881278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.883216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:57.885809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:57.886907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.150280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:58.160645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:58.165127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:58.177947 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2cad568e-8338-4880-bd86-c965f0e29749 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.508686 Jul 14 14:43:58.179668 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 755/1462] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:57 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:58.200469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:58.204248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:58.229691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.231849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.234712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.237979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.601520 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1594c7b3-cee3-47d7-bf9b-ba9018cc6735 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0/os-interface" status: 200 len: 1833 microversion: 2.42 time: 0.420181 Jul 14 14:43:58.602378 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 756/1463] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 14:43:58 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0/os-interface => generated 1833 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:43:58.661529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:58.662576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:58.673881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.686521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:58.691555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:58.692718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.088908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.104779 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-447eb2c8-d0de-47f1-af42-1c293cf2d715 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1198 microversion: 2.1 time: 0.447089 Jul 14 14:43:59.106851 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 757/1464] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:58 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1198 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:43:59.201636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:43:59.205904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:43:59.225424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:59.227907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.231874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:43:59.232544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:43:59.462633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:43:59.493241 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5a0392f-5c40-4000-99f3-48883bbff890 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1680 microversion: 2.1 time: 1.638301 Jul 14 14:43:59.494358 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 708/1465] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:43:57 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1680 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:00.028146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:00.060243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:00.069823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:00.082226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-11a25d3c-5199-44ff-9243-73e5d1df15b0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.887242 Jul 14 14:44:00.084596 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 758/1466] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:43:59 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:00.134865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:00.135578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:00.157520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.158011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.158826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.159295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.521123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:00.525220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:00.583092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.585275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.600068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:00.601972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:00.732513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:01.158105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:01.184966 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a378c737-861d-44af-85a4-ac635c7840c4 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1680 microversion: 2.1 time: 0.675623 Jul 14 14:44:01.191632 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 759/1467] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:00 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1680 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:01.202359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:01.215362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:01.235181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:01.257012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:01.259048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:01.261619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:01.755536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:01.784004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:01.785785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:01.792948 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b16fbe52-bd0b-420c-a049-af4f3c0dc6e0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.597619 Jul 14 14:44:01.798881 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 760/1468] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:01 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:01.825558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dada0f6d-2225-4a50-8e50-83062ae492a2 req-ea0a90cb-c781-487d-9b92-4882e52a89b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ab0475-3f12-4654-90aa-a9836585f0e9", "name": "network-vif-unplugged", "status": "completed", "tag": "98ccc6ee-23a2-4598-b98e-18e84f0552f5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:01.857124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dada0f6d-2225-4a50-8e50-83062ae492a2 req-ea0a90cb-c781-487d-9b92-4882e52a89b0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:01.865012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dada0f6d-2225-4a50-8e50-83062ae492a2 req-ea0a90cb-c781-487d-9b92-4882e52a89b0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:01.887393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dada0f6d-2225-4a50-8e50-83062ae492a2 req-ea0a90cb-c781-487d-9b92-4882e52a89b0 service nova] Creating event network-vif-unplugged:98ccc6ee-23a2-4598-b98e-18e84f0552f5 for instance a8ab0475-3f12-4654-90aa-a9836585f0e9 on n-h2-768852-23 Jul 14 14:44:01.918305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dada0f6d-2225-4a50-8e50-83062ae492a2 req-ea0a90cb-c781-487d-9b92-4882e52a89b0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114638 Jul 14 14:44:01.924497 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 761/1469] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:02.221697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:02.227469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:02.245582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:02.248221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:02.251538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:02.252371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:02.435767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:02.458142 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2adcbb86-5ac1-43d3-816d-aa8db0820cc4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1198 microversion: 2.1 time: 2.328251 Jul 14 14:44:02.463405 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 709/1470] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:00 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1198 bytes in 2334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:02.832176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:02.832976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:02.849860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:02.853838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:02.855031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:02.856731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:02.857437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:02.980253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:03.020401 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd91574b-0c37-48cc-82e7-a4b8f0113ddc tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1680 microversion: 2.1 time: 0.812166 Jul 14 14:44:03.024937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 762/1471] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:02 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1680 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:03.502660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:03.509417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:03.566996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.569403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:03.577803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:03.578969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.434566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:04.469373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e934ea77-2b0d-4297-bb36-f016ee38109a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1198 microversion: 2.1 time: 0.991624 Jul 14 14:44:04.472768 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 763/1472] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:03 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1198 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:04.521988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:04.524986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:04.539428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.540652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.544480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.545815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.630344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:44:04.931699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d7e8b08-7928-4196-8d82-e22f5b137df5 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 204 len: 0 microversion: 2.1 time: 0.422458 Jul 14 14:44:04.940065 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 764/1473] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:44:04 2022] DELETE /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:44:04.954051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:04.956179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:04.972600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.974326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:04.976606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:04.977749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.276616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.303083 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26067ca4-f3bc-45bc-b61c-9412677251c0 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1613 microversion: 2.1 time: 0.359097 Jul 14 14:44:05.303732 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 765/1474] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:04 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1613 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:05.322317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:05.324951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:05.348786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.352467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.353230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.354700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.357564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.367880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.369687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.370982 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aac439cd-e7a1-4df0-90da-3f5280f5c25e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 2.547989 Jul 14 14:44:05.385639 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 710/1475] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:02 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 2556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:05.504134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:05.504949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:05.522502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.525365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.526739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:05.529354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:05.689220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:05.701414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5151d551-e982-45ba-8c26-641064c3c171 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1681 microversion: 2.1 time: 0.394614 Jul 14 14:44:05.706925 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 766/1476] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:05 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1681 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:05.838929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1528954466", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e576d3b6-a989-4f8c-ac73-d2914dd9164a"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:05.950820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] validate_networks() for [('e576d3b6-a989-4f8c-ac73-d2914dd9164a', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:44:06.689370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:44:06.690168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:44:06.690658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:44:06.691210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:44:06.691789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:44:06.713488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.715405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.716789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:06.718559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:06.758702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Getting quotas for project 33d5773713f8495c9018a5aaed6fd744. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:06.784822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Getting quotas for user c2e85acbfcdc4b3a813830d6723b006f and project 33d5773713f8495c9018a5aaed6fd744. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:06.819552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:44:06.826381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:44:06.997599 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eca7c31e-bf49-4394-9d7b-ca329d6dd000 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232926 Jul 14 14:44:07.008200 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 767/1477] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:44:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:44:07.020613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.022060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:07.034786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.035903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.037417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.038759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.195644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.211049 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-023b1cf6-50fb-4c90-86e2-a512cb42a6d2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1613 microversion: 2.1 time: 0.198187 Jul 14 14:44:07.217392 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 768/1478] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1613 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:07.227557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.228590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:07.248815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.251566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.253882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.255422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.697061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.719166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.720807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.722126 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-097f6d73-380d-49db-a83f-48fd890fc020 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.503497 Jul 14 14:44:07.722792 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 769/1479] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:07.728099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.736432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:07.749956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.764860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.766805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:07.769471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:07.797740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:07.809321 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1774f201-4070-4398-b6ca-fcaa8c59ce1f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1198 microversion: 2.1 time: 2.311542 Jul 14 14:44:07.813559 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 711/1480] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:05 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1198 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:07.846391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b292aa66-d230-4eda-b189-35141cf7b243 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:07.851585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b292aa66-d230-4eda-b189-35141cf7b243 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.413113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:08.431701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b292aa66-d230-4eda-b189-35141cf7b243 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:08.453199 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3eff49a8-2c08-45ee-9c5b-d3d7a7114cc1 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1681 microversion: 2.1 time: 0.728444 Jul 14 14:44:08.454229 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 770/1481] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1681 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:08.471370 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b292aa66-d230-4eda-b189-35141cf7b243 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1218 microversion: 2.1 time: 0.621359 Jul 14 14:44:08.473890 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 712/1482] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:07 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1218 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:08.479086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:08.484115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.497033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.504275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.505680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.514077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.518370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6d6e2b63-9f89-457e-8c0e-db4c9b22451c req-3f313a9c-4429-41e8-b938-9df684de1d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ab0475-3f12-4654-90aa-a9836585f0e9", "name": "network-vif-deleted", "tag": "98ccc6ee-23a2-4598-b98e-18e84f0552f5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:08.560780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6d6e2b63-9f89-457e-8c0e-db4c9b22451c req-3f313a9c-4429-41e8-b938-9df684de1d1e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.565934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6d6e2b63-9f89-457e-8c0e-db4c9b22451c req-3f313a9c-4429-41e8-b938-9df684de1d1e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.609075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.610096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.612174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lazy-loading 'fault' on Instance uuid a8ab0475-3f12-4654-90aa-a9836585f0e9 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:08.613458 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6d6e2b63-9f89-457e-8c0e-db4c9b22451c req-3f313a9c-4429-41e8-b938-9df684de1d1e service nova] Creating event network-vif-deleted:98ccc6ee-23a2-4598-b98e-18e84f0552f5 for instance a8ab0475-3f12-4654-90aa-a9836585f0e9 on n-h2-768852-23 Jul 14 14:44:08.642942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6d6e2b63-9f89-457e-8c0e-db4c9b22451c req-3f313a9c-4429-41e8-b938-9df684de1d1e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162333 Jul 14 14:44:08.644047 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 771/1483] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:08.658964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-803c34c8-a26d-4ffd-afb7-ff244aeece23 req-53a5bc4d-5156-4d72-8977-e2511b4f102c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b060b5-502d-43ad-b5d9-487f0a89e438", "name": "network-vif-plugged", "status": "completed", "tag": "d7920837-2445-4490-b644-0e5e66a09961"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:08.675910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-803c34c8-a26d-4ffd-afb7-ff244aeece23 req-53a5bc4d-5156-4d72-8977-e2511b4f102c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.676596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-803c34c8-a26d-4ffd-afb7-ff244aeece23 req-53a5bc4d-5156-4d72-8977-e2511b4f102c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.682868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:08.716675 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-803c34c8-a26d-4ffd-afb7-ff244aeece23 req-53a5bc4d-5156-4d72-8977-e2511b4f102c service nova] Creating event network-vif-plugged:d7920837-2445-4490-b644-0e5e66a09961 for instance e7b060b5-502d-43ad-b5d9-487f0a89e438 on n-h2-768852-23 Jul 14 14:44:08.732727 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-803c34c8-a26d-4ffd-afb7-ff244aeece23 req-53a5bc4d-5156-4d72-8977-e2511b4f102c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085265 Jul 14 14:44:08.736168 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 772/1484] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:08.750937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:08.753720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.772475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.776093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.781061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.782718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.795800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a900db43445e48a5a09451a909a074d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42c6a91fbc440a6a4e4f9a4cf6caaf7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:08.804755 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-187344bc-b2df-4add-96a3-c3d6d63f4702 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 200 len: 1331 microversion: 2.1 time: 0.329391 Jul 14 14:44:08.824101 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 713/1485] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:08 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 1331 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:08.845497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:08.849711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:08.875039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.895963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:08.904664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:08.909751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.213781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.231995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.234336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.253077 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30925fea-d7df-4195-aa52-6edba85fd3cc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.498075 Jul 14 14:44:09.257894 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 773/1486] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:08 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:09.476230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:09.477977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:09.507169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.508307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.510280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.512668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.855755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.869858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d41b2a67-43a4-4c8a-b792-fbeec9dc7f1d tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1681 microversion: 2.1 time: 0.402498 Jul 14 14:44:09.870582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:09.872367 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 774/1487] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:09 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1681 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:09.878090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:09.883557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:09.905559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.907368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.909060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.909242 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8fc9795-b3b8-4e3d-9401-79fff291357d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1198 microversion: 2.1 time: 1.068591 Jul 14 14:44:09.910387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.911973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 714/1488] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:08 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1198 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:09.954589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:09.956967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:09.994990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:09.995790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:09.997575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.001653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.044359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] HTTP exception thrown: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:10.049923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Request method failure captured: Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 HTTP/1.1 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cr1BKHiZkBDJF25GFcsCMNqD6XT1nE3GirML-FKB3-w_8208YE-xkm_vsdGGZCkRk8J5Nn-8PzM46nQ642-hH8lvqWnPfpnECfIpj6UoifyHcTJG36yE0xcZXmYMA5Jb5SHpOqvb4xT7j4dXSJMUmGXKXnO_ss68l27SJKTZoGFBgM Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: d42c6a91fbc440a6a4e4f9a4cf6caaf7 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: d42c6a91fbc440a6a4e4f9a4cf6caaf7 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachSCSIVolumeTestJSON-1787154509-project Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a900db43445e48a5a09451a909a074d1 Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1787154509-project Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a8ab0475-3f12-4654-90aa-a9836585f0e9'} Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:10.060594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:10.066993 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:10.067557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fa1366e9-e0fa-43fd-98c5-50301b60f930 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1278 microversion: 2.1 time: 0.188907 Jul 14 14:44:10.067557 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 775/1489] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:09 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:10.077948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Returning 404 to user: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:10.079190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da0df813-04ba-42de-b3bf-b9fedcec23e8 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 404 len: 111 microversion: 2.1 time: 0.157750 Jul 14 14:44:10.080031 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 715/1490] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:09 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:10.092461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce4fd2cc-b202-4745-9860-2a858a5f1f5b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '.version_select at 0x7fdbf2acaca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:10.140252 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce4fd2cc-b202-4745-9860-2a858a5f1f5b tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-588415069" status: 202 len: 0 microversion: 2.1 time: 0.054698 Jul 14 14:44:10.145814 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 776/1491] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:44:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-588415069 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:44:10.289125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:10.289818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:10.317772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.318226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.325122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.328762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.383479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:10.897628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:10.900591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:10.926940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.927814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:10.928884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:10.929595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.263654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.313874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.323158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.325837 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a16aadee-46c6-4275-acab-e51878ae52dd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.040944 Jul 14 14:44:11.336579 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 716/1492] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:10 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:11.346838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:11.355990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:11.382261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.391337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.393373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.398936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.847031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:11.866855 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21d899cf-86da-4b5f-a69f-139ff629a8f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1613 microversion: 2.1 time: 0.980026 Jul 14 14:44:11.869740 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 777/1493] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:10 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1613 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:11.891615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:11.895944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:11.918947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.920205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:11.920406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:11.920822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.014291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:12.037300 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-756405d2-e52d-423a-ae89-f84ce2f955e2 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1382 microversion: 2.1 time: 0.696875 Jul 14 14:44:12.039884 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 717/1494] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:11 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1382 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:12.255838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3bb99dd-49bf-4d40-ac78-d1a41657506a tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Calling method '.version_select at 0x7fdbf314b4c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:12.419696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:12.434462 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-319fd939-c233-491f-bb75-17cf122837a4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1276 microversion: 2.1 time: 0.550901 Jul 14 14:44:12.435820 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 778/1495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:11 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1276 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:12.436230 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d3bb99dd-49bf-4d40-ac78-d1a41657506a tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.393094 Jul 14 14:44:12.444185 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 718/1496] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:44:12 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:44:12.449423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:12.450054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:12.470572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.473666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.476616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.480305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.839413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:12.840624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:12.871991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.876641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:12.878025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:12.878947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.096667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.113742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.121909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.127904 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0cba2631-e0ce-471c-bd6f-02407a7aef60 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.678644 Jul 14 14:44:13.130526 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 719/1497] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:12 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:13.149323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bae44c56-f460-499a-ade9-aebb449015d1 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Action: 'create', calling method: .version_select at 0x7fdbf314b3a0>, body: {"pool": "non_exist_pool"} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:13.518453 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-bae44c56-f460-499a-ade9-aebb449015d1 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] HTTP exception thrown: Floating IP pool not found. Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bae44c56-f460-499a-ade9-aebb449015d1 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Request method failure captured: Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 26 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cu6aGvew5DHQDe_Kc2-f7Cse58yKl0Ve2GHcEFPZTe3nf7ps8BywBBIaHc5H9o0e5MrEH9qYviW3wDf6BViVpqaxjC-VbAwqxi7tpnceLxan_IhkzSmPCcXyvvCYAkyYnz1Q6q_H6jQv5B602TIpq3nkKE5eQFJ3Difxo-zI4fPHE0 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: ce7cf1e8497849e7ad92895c0d5a98ae Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1404452134 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1404452134 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: ce7cf1e8497849e7ad92895c0d5a98ae Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1404452134 Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPsNegativeTestJSON-1404452134-project Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c27fb61960bd4f2799a99406923a518b Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1404452134-project Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: {"pool": "non_exist_pool"} Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: exception: Floating IP pool not found. Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'pool': 'non_exist_pool'}} Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:13.523053 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:13.530400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Jul 14 14:44:13.530400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:13.533277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bae44c56-f460-499a-ade9-aebb449015d1 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Returning 404 to user: Floating IP pool not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:13.535697 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bae44c56-f460-499a-ade9-aebb449015d1 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.392667 Jul 14 14:44:13.542184 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 720/1498] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:44:13 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:44:13.564039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:13.566963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:13.611491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.613155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.617151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.618270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.755775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2deda01949ad4a5eb16842b00afe7567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a999d9d8991476983a97cb975c6302a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:13.766413 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-383aff93-7923-4823-82b4-6d59c9026273 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 200 len: 1613 microversion: 2.1 time: 0.217061 Jul 14 14:44:13.767034 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 721/1499] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:13 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 1613 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:13.783233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:13.786478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:13.814236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.814802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.818388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:13.821306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:13.914338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10e1472c-bdd1-41cc-b39a-c220f81dd36e tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1535 microversion: 2.1 time: 1.474919 Jul 14 14:44:13.914936 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 779/1500] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:12 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1535 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:13.928897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e41ffa64-4908-4460-a056-eba623f0dbe5 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Calling method '.version_select at 0x7fdbf2b25b80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.021026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.036965 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6779db8-4e5c-4fcf-a144-cffc73d636c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1276 microversion: 2.1 time: 0.268677 Jul 14 14:44:14.049871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 722/1501] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:13 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1276 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:14.054145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-e41ffa64-4908-4460-a056-eba623f0dbe5 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP ef367033-4174-4629-9ff6-cdfb7027e3eb could not be found", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:44:14.055091 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e41ffa64-4908-4460-a056-eba623f0dbe5 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] HTTP exception thrown: Floating IP not found for ID ef367033-4174-4629-9ff6-cdfb7027e3eb Jul 14 14:44:14.057697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-384cb726-af2f-4e92-ab71-9856ab8b1960 req-8dce86b8-d8ed-4921-b1a7-87b480c43802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1", "name": "network-vif-deleted", "tag": "aa1b56f3-5a23-4109-a088-bc3e84fe5bf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e41ffa64-4908-4460-a056-eba623f0dbe5 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Request method failure captured: Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-floating-ips/ef367033-4174-4629-9ff6-cdfb7027e3eb HTTP/1.1 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cu6aGvew5DHQDe_Kc2-f7Cse58yKl0Ve2GHcEFPZTe3nf7ps8BywBBIaHc5H9o0e5MrEH9qYviW3wDf6BViVpqaxjC-VbAwqxi7tpnceLxan_IhkzSmPCcXyvvCYAkyYnz1Q6q_H6jQv5B602TIpq3nkKE5eQFJ3Difxo-zI4fPHE0 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: ce7cf1e8497849e7ad92895c0d5a98ae Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1404452134 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ce7cf1e8497849e7ad92895c0d5a98ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1404452134 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: ce7cf1e8497849e7ad92895c0d5a98ae Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1404452134 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsNegativeTestJSON-1404452134-project Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c27fb61960bd4f2799a99406923a518b Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1404452134-project Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: exception: Floating IP not found for ID ef367033-4174-4629-9ff6-cdfb7027e3eb Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'ef367033-4174-4629-9ff6-cdfb7027e3eb'} Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP ef367033-4174-4629-9ff6-cdfb7027e3eb could not be found Jul 14 14:44:14.059116 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e805f92-b891-4788-8437-8342cbf621bd'] Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID ef367033-4174-4629-9ff6-cdfb7027e3eb. Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID ef367033-4174-4629-9ff6-cdfb7027e3eb Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID ef367033-4174-4629-9ff6-cdfb7027e3eb Jul 14 14:44:14.064752 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:44:14.071062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e41ffa64-4908-4460-a056-eba623f0dbe5 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] Returning 404 to user: Floating IP not found for ID ef367033-4174-4629-9ff6-cdfb7027e3eb {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:14.071062 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e41ffa64-4908-4460-a056-eba623f0dbe5 tempest-FloatingIPsNegativeTestJSON-1404452134 tempest-FloatingIPsNegativeTestJSON-1404452134-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/ef367033-4174-4629-9ff6-cdfb7027e3eb" status: 404 len: 111 microversion: 2.1 time: 0.147841 Jul 14 14:44:14.071677 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 780/1502] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:44:13 2022] DELETE /compute/v2.1/os-floating-ips/ef367033-4174-4629-9ff6-cdfb7027e3eb => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:14.080699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.084492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.096555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-384cb726-af2f-4e92-ab71-9856ab8b1960 req-8dce86b8-d8ed-4921-b1a7-87b480c43802 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.100775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-384cb726-af2f-4e92-ab71-9856ab8b1960 req-8dce86b8-d8ed-4921-b1a7-87b480c43802 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.106655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.107751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.110299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.111835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.135202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-384cb726-af2f-4e92-ab71-9856ab8b1960 req-8dce86b8-d8ed-4921-b1a7-87b480c43802 service nova] Creating event network-vif-deleted:aa1b56f3-5a23-4109-a088-bc3e84fe5bf2 for instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 on n-h2-768852-23 Jul 14 14:44:14.152488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-384cb726-af2f-4e92-ab71-9856ab8b1960 req-8dce86b8-d8ed-4921-b1a7-87b480c43802 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095856 Jul 14 14:44:14.156682 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 723/1503] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:14.171070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.175580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.220673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.224833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.230194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.235138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.914301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.928377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.935418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:14.942863 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8781250-c10f-4a58-bfb8-c2aeb2e510d0 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.779846 Jul 14 14:44:14.943864 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 724/1504] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:14.957113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:14.958055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] [instance: 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:14.976158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.976942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:14.978029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:14.978686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.014177 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] HTTP exception thrown: Instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 could not be found. Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Request method failure captured: Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 HTTP/1.1 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cq8t3oVU8etBlOnAuJ3KgUh2rptjfyQrdJNnTbW56RwnE-GWj9EAiynsHoZ4IEitCTthvrzDUQ2kjQxIbFRJBG1EAasQ0JE-fDhtHJmThuG4AFaTwzZI9LJ1CjvkSRdeOZn6OGmF9ZXEheZS8CZAeCYqbEtnOSE9qJrqp6o0JU3sg0 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2a999d9d8991476983a97cb975c6302a Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesAdminNegativeTest-1395457122 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2a999d9d8991476983a97cb975c6302a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2a999d9d8991476983a97cb975c6302a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2a999d9d8991476983a97cb975c6302a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2a999d9d8991476983a97cb975c6302a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesAdminNegativeTest-1395457122 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2a999d9d8991476983a97cb975c6302a Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1395457122 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesAdminNegativeTest-1395457122-project Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2deda01949ad4a5eb16842b00afe7567 Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesAdminNegativeTest-1395457122-project Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 could not be found. Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1'} Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 could not be found. Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 could not be found. Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:15.020159 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 could not be found. Jul 14 14:44:15.025162 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:15.028616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Returning 404 to user: Instance 2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:15.029904 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8326927f-438c-4009-8f82-fbda2165a5f6 tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1" status: 404 len: 111 microversion: 2.1 time: 0.084806 Jul 14 14:44:15.035851 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 725/1505] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/2ae0bb7b-6d6a-4f08-964b-74b7cb8fbed1 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:15.050714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-140a5c2d-132d-4a81-9616-2ce0dc0c223f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] Calling method '.version_select at 0x7fdbf31b6040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.113941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca8fc037-18d3-4e09-8fc4-7d26c5c7adfc tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1535 microversion: 2.1 time: 1.040396 Jul 14 14:44:15.115221 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-140a5c2d-132d-4a81-9616-2ce0dc0c223f tempest-VolumesAdminNegativeTest-1395457122 tempest-VolumesAdminNegativeTest-1395457122-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-860994581" status: 202 len: 0 microversion: 2.1 time: 0.074193 Jul 14 14:44:15.115923 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 781/1506] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:14 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1535 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:15.123001 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 726/1507] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:44:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-860994581 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:44:15.139979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24bb4cf6-4893-42a4-8bd8-6d5be82eb159 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.145656 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:44:15.145656 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:44:15.146199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.146704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.148645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24bb4cf6-4893-42a4-8bd8-6d5be82eb159 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.150211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24bb4cf6-4893-42a4-8bd8-6d5be82eb159 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.151826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24bb4cf6-4893-42a4-8bd8-6d5be82eb159 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.152564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24bb4cf6-4893-42a4-8bd8-6d5be82eb159 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.157060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.157610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.158601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.159136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.289043 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24bb4cf6-4893-42a4-8bd8-6d5be82eb159 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.157098 Jul 14 14:44:15.294250 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 727/1508] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:15.311107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-768852-23", "block_migration": false, "disk_over_commit": false}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:15.332627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.349198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.350177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.351245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.352869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.389996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lazy-loading 'flavor' on Instance uuid e7b060b5-502d-43ad-b5d9-487f0a89e438 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:15.415244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Going to try to live migrate instance to n-h1-768852-23 {{(pid=125966) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:44:15.716558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:15.739802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b548a8e-b6fb-41fe-b261-ebe3a5bce612 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 0.620756 Jul 14 14:44:15.741919 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 782/1509] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:15.966609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:15.966609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:15.990660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.993796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:15.994709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:15.995174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.307465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.341552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.343380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:16.345394 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4cf123bb-71c9-48ba-ac20-de092f5e4356 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.385834 Jul 14 14:44:16.346425 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 783/1510] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:15 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:16.763808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:16.764438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:16.776574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:16.781216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.782882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.784810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:16.786379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:16.852851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:17.554927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:17.586692 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5f93a6d1-c3a6-45f8-9704-10f915fb6e81 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 0.827031 Jul 14 14:44:17.591195 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 784/1511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:16 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:17.610981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:17.616225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:17.640200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.641840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:17.646091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:17.648350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.440432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:18.455311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.479546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.485218 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3bd48734-edbb-475a-a82f-a30cc28a5db9 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438/action" status: 202 len: 0 microversion: 2.1 time: 3.183052 Jul 14 14:44:18.486769 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 728/1512] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:15 2022] POST /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438/action => generated 0 bytes in 3186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:44:18.492074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:18.495192 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60f30fde-ba26-4e9d-ad30-41f7e5b08eed tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.901729 Jul 14 14:44:18.500829 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 785/1513] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:17 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:18.535428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:18.551610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:18.569839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.570592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.572229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.574516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.614606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:18.616142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:18.624382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.625233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:18.626299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:18.626936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.717772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:19.740176 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-33670d4a-6caf-48aa-a38c-b9c47b85f304 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.247130 Jul 14 14:44:19.753204 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 729/1514] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:18 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:19.768462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:19.769597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:19.779700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.780843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.782054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:19.782915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:19.932328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:19.946875 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8bfff1e5-b90c-4016-8adc-9023507e3fff tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 1.342587 Jul 14 14:44:19.948139 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 786/1515] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:18 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:20.482454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:20.500350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:20.501938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:20.503190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0587ecb8-00d1-4bee-b742-8c5215066cd4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.748527 Jul 14 14:44:20.527329 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 730/1516] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:19 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:20.761712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:20.763001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:20.782398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:20.784134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:20.802857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:20.806176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:20.980129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:20.991020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:21.072258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.073294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.119482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.125848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.762524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:21.830647 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44e1cb0e-81b5-41aa-b38f-76ec37199f19 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.068633 Jul 14 14:44:21.843363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 787/1517] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:20 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:21.882301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-81627c69-43a0-4a72-b877-d8411b554614 req-413398f9-d789-448d-954f-32576adf6668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b94f2422-b740-4908-9dc5-514fb8b99257", "tag": "62beb0f4-308f-4b74-86e1-e346e3c55e99"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:21.928085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-81627c69-43a0-4a72-b877-d8411b554614 req-413398f9-d789-448d-954f-32576adf6668 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:21.929428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-81627c69-43a0-4a72-b877-d8411b554614 req-413398f9-d789-448d-954f-32576adf6668 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:21.992864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-81627c69-43a0-4a72-b877-d8411b554614 req-413398f9-d789-448d-954f-32576adf6668 service nova] Creating event network-changed:62beb0f4-308f-4b74-86e1-e346e3c55e99 for instance b94f2422-b740-4908-9dc5-514fb8b99257 on n-h1-768852-23 Jul 14 14:44:22.034134 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-81627c69-43a0-4a72-b877-d8411b554614 req-413398f9-d789-448d-954f-32576adf6668 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172552 Jul 14 14:44:22.039818 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 788/1518] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:22.063021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.066044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.080251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.081358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.082870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.083350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.116764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:22.135616 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9deb473a-5998-4ff0-8b74-fa5a2291bc3b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 1.164382 Jul 14 14:44:22.143563 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 731/1519] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:20 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:22.619666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.620752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.629764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.630706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.631787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.632607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.663903 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] HTTP exception thrown: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Request method failure captured: Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 HTTP/1.1 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cr1BKHiZkBDJF25GFcsCMNqD6XT1nE3GirML-FKB3-w_8208YE-xkm_vsdGGZCkRk8J5Nn-8PzM46nQ642-hH8lvqWnPfpnECfIpj6UoifyHcTJG36yE0xcZXmYMA5Jb5SHpOqvb4xT7j4dXSJMUmGXKXnO_ss68l27SJKTZoGFBgM Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: d42c6a91fbc440a6a4e4f9a4cf6caaf7 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: d42c6a91fbc440a6a4e4f9a4cf6caaf7 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachSCSIVolumeTestJSON-1787154509-project Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a900db43445e48a5a09451a909a074d1 Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1787154509-project Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a8ab0475-3f12-4654-90aa-a9836585f0e9'} Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:22.668750 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.684565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.688159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Returning 404 to user: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:22.690177 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b303a1f-2641-4dcd-be77-6bd26bf96b99 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 404 len: 111 microversion: 2.1 time: 0.071842 Jul 14 14:44:22.692692 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 732/1520] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:44:22 2022] DELETE /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:22.715056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.717087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] [instance: a8ab0475-3f12-4654-90aa-a9836585f0e9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.735781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.737150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.739467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.743596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.829334 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] HTTP exception thrown: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Request method failure captured: Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 HTTP/1.1 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cr1BKHiZkBDJF25GFcsCMNqD6XT1nE3GirML-FKB3-w_8208YE-xkm_vsdGGZCkRk8J5Nn-8PzM46nQ642-hH8lvqWnPfpnECfIpj6UoifyHcTJG36yE0xcZXmYMA5Jb5SHpOqvb4xT7j4dXSJMUmGXKXnO_ss68l27SJKTZoGFBgM Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: d42c6a91fbc440a6a4e4f9a4cf6caaf7 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/d42c6a91fbc440a6a4e4f9a4cf6caaf7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: d42c6a91fbc440a6a4e4f9a4cf6caaf7 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1787154509 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachSCSIVolumeTestJSON-1787154509-project Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a900db43445e48a5a09451a909a074d1 Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1787154509-project Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a8ab0475-3f12-4654-90aa-a9836585f0e9'} Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:44:22.836964 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. Jul 14 14:44:22.843685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:44:22.847839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] Returning 404 to user: Instance a8ab0475-3f12-4654-90aa-a9836585f0e9 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:44:22.850404 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2955a3fe-f393-4402-bf1e-4659213945b2 tempest-AttachSCSIVolumeTestJSON-1787154509 tempest-AttachSCSIVolumeTestJSON-1787154509-project] 10.222.0.98 "GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9" status: 404 len: 111 microversion: 2.1 time: 0.152552 Jul 14 14:44:22.858932 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 733/1521] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:22 2022] GET /compute/v2.1/servers/a8ab0475-3f12-4654-90aa-a9836585f0e9 => generated 111 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:44:22.877695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:22.882718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:22.914199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.915545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:22.917491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:22.933794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.052543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.109175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.132616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.133912 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a8795310-fa29-4526-8fcc-577f1a57c394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.092209 Jul 14 14:44:23.141762 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 789/1522] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:22 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:23.180611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:23.184350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:23.203723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.205094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.211221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:23.214822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:23.936362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:23.949866 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fcceadb-0815-4e40-a62f-18ecc39ba984 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 0.791894 Jul 14 14:44:23.972408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 790/1523] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:23 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:24.096294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4db2669f-c3df-4544-a2d3-794e2e392cb4 req-e01bde1c-e4b4-4e40-85b1-e8e4de66c302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde86f6d-6561-44c7-b3c0-46cb586ab9ca", "name": "network-vif-unplugged", "status": "completed", "tag": "2660e2f0-d5e5-47e4-805e-17cfccb97fbf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:24.152116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4db2669f-c3df-4544-a2d3-794e2e392cb4 req-e01bde1c-e4b4-4e40-85b1-e8e4de66c302 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.153831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4db2669f-c3df-4544-a2d3-794e2e392cb4 req-e01bde1c-e4b4-4e40-85b1-e8e4de66c302 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.221013 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4db2669f-c3df-4544-a2d3-794e2e392cb4 req-e01bde1c-e4b4-4e40-85b1-e8e4de66c302 service nova] Creating event network-vif-unplugged:2660e2f0-d5e5-47e4-805e-17cfccb97fbf for instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca on n-h1-768852-23 Jul 14 14:44:24.246077 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4db2669f-c3df-4544-a2d3-794e2e392cb4 req-e01bde1c-e4b4-4e40-85b1-e8e4de66c302 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.156424 Jul 14 14:44:24.256855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 791/1524] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:44:24.294166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:24.305424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:24.341489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:24.376238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.377136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.381888 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2da7165-c1ba-426c-a9a2-63ed002bd4c1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.518508 Jul 14 14:44:24.384508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:24.387501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:24.401273 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 734/1525] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:22 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:24.976545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:24.977217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:24.996078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:25.002183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:25.003123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:25.003604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:25.180108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:25.196037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:25.201858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:25.222336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:25.228314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:25.233662 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-054326bc-e69d-48b0-a338-5792397dbe32 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.974116 Jul 14 14:44:25.248962 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 792/1526] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:24 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:25.428270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:25.435137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:25.470187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:25.472131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:25.473506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:25.475798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.358060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.380210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33c5f5dd-a6a4-4140-90b3-c7beb19c94c0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 0.962788 Jul 14 14:44:26.380881 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 793/1527] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:25 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:26.387653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:26.388663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:26.393800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:26.409220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.413626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.415050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.415837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.517992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:26.536942 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9976ff1-fc41-4d0f-a2d8-ad7c3137504f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 1.566526 Jul 14 14:44:26.538570 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 735/1528] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:24 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:26.548563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9d9ee306-8f8c-42cb-b967-a67ad3a8640e req-286ae3cc-7f9f-478f-8cb2-643f4c439b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cde86f6d-6561-44c7-b3c0-46cb586ab9ca", "tag": "2660e2f0-d5e5-47e4-805e-17cfccb97fbf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:26.574820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9d9ee306-8f8c-42cb-b967-a67ad3a8640e req-286ae3cc-7f9f-478f-8cb2-643f4c439b58 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:26.579351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9d9ee306-8f8c-42cb-b967-a67ad3a8640e req-286ae3cc-7f9f-478f-8cb2-643f4c439b58 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:26.655101 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9d9ee306-8f8c-42cb-b967-a67ad3a8640e req-286ae3cc-7f9f-478f-8cb2-643f4c439b58 service nova] Creating event network-changed:2660e2f0-d5e5-47e4-805e-17cfccb97fbf for instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca on n-h1-768852-23 Jul 14 14:44:26.683540 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9d9ee306-8f8c-42cb-b967-a67ad3a8640e req-286ae3cc-7f9f-478f-8cb2-643f4c439b58 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137902 Jul 14 14:44:26.685300 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 736/1529] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:27.409349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:27.410186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:27.430011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.430467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.434811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.435873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.523715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:27.537236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:27.548055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:27.564399 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ceb509bd-98ea-4be9-8d82-0db278bd850c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.181623 Jul 14 14:44:27.565376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 794/1530] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:26 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:27.579811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:27.581191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:27.592572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.593404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:27.598074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:27.598816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:28.432460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:28.447327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c0939caf-0a3a-4d38-89c0-404dc971d334 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 0.880558 Jul 14 14:44:28.449067 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 795/1531] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:27 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:28.595363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:28.597652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:28.608574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:28.609496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:28.610665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:28.611407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:28.635985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:28.663901 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6bbc23e-6413-4050-9ad8-1f025bd124ad tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.256190 Jul 14 14:44:28.669682 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 737/1532] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:27 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:29.481458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:29.486419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:29.521280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:29.525871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:29.538736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:29.540817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:29.605675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:30.044521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:30.087738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:30.102745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:30.108547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86149e7e-90a2-481b-aed4-11c7d06346cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.517138 Jul 14 14:44:30.110832 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 796/1533] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:28 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:30.149311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:30.156853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:30.210648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.213271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.220492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.225599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.595872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:30.613080 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc4f756a-88c6-4a00-80f6-e35a58e5125f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 1.138958 Jul 14 14:44:30.615244 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 738/1534] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:29 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:30.775239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5e1674d5-0a7e-4def-80ab-53a0e8ee1964 req-a653770d-6ac0-4e75-82d4-4e03a8f207e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94f2422-b740-4908-9dc5-514fb8b99257", "name": "network-vif-plugged", "status": "completed", "tag": "62beb0f4-308f-4b74-86e1-e346e3c55e99"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:30.795644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5e1674d5-0a7e-4def-80ab-53a0e8ee1964 req-a653770d-6ac0-4e75-82d4-4e03a8f207e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:30.797374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5e1674d5-0a7e-4def-80ab-53a0e8ee1964 req-a653770d-6ac0-4e75-82d4-4e03a8f207e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:30.827187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5e1674d5-0a7e-4def-80ab-53a0e8ee1964 req-a653770d-6ac0-4e75-82d4-4e03a8f207e0 service nova] Creating event network-vif-plugged:62beb0f4-308f-4b74-86e1-e346e3c55e99 for instance b94f2422-b740-4908-9dc5-514fb8b99257 on n-h1-768852-23 Jul 14 14:44:30.842606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5e1674d5-0a7e-4def-80ab-53a0e8ee1964 req-a653770d-6ac0-4e75-82d4-4e03a8f207e0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070093 Jul 14 14:44:30.843671 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 739/1535] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:44:31.155003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:31.161445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:31.189516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.192388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.200945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.203787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.628538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.646406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c8bc66a-c5ab-46fe-9528-a40b7c3a2c4d tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.524832 Jul 14 14:44:31.657489 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 797/1536] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:30 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:31.663447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:31.664362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:31.672938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.673817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.674878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:31.675559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:31.899035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.936912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.938811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:31.954325 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2156b6c9-ad84-42ef-a264-b4d69c68755f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.811837 Jul 14 14:44:31.966212 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 740/1537] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:31 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:32.294714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:32.318782 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67e96b66-683b-410a-857b-29c0ac0f4a49 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1318 microversion: 2.1 time: 0.658867 Jul 14 14:44:32.320597 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 798/1538] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:31 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1318 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:32.669772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:32.674028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:32.723700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:32.724719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.726189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:32.726971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:32.910554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-96cd390b-2212-4f22-b663-320036ce26aa req-387ac597-a245-408a-baa8-d200f3e671a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde86f6d-6561-44c7-b3c0-46cb586ab9ca", "name": "network-vif-unplugged", "status": "completed", "tag": "2660e2f0-d5e5-47e4-805e-17cfccb97fbf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:32.996201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-96cd390b-2212-4f22-b663-320036ce26aa req-387ac597-a245-408a-baa8-d200f3e671a0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.002742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-96cd390b-2212-4f22-b663-320036ce26aa req-387ac597-a245-408a-baa8-d200f3e671a0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.047449 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-96cd390b-2212-4f22-b663-320036ce26aa req-387ac597-a245-408a-baa8-d200f3e671a0 service nova] Creating event network-vif-unplugged:2660e2f0-d5e5-47e4-805e-17cfccb97fbf for instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca on n-h1-768852-23 Jul 14 14:44:33.070499 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-96cd390b-2212-4f22-b663-320036ce26aa req-387ac597-a245-408a-baa8-d200f3e671a0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167875 Jul 14 14:44:33.075940 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 799/1539] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:33.090395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:33.091757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.115100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.133702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.135923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.140247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.713273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.736142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.768206 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4466e42b-8d2e-44be-8934-97655c9b9a36 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.097774 Jul 14 14:44:33.774619 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 741/1540] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:32 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:33.792994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.802102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:33.807039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:33.809268 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cc1e2d3a-9e5b-4a2d-b2db-91986aedf3ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.725734 Jul 14 14:44:33.810114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:33.811695 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 800/1541] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:33 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:33.825428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:33.829172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.830610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:33.832976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:33.834234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.810503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:34.811361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:34.823784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.826524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:34.830231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:34.832990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.488761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:35.504702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-395f2217-602d-4e1b-90a4-dcbaa5785ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1508 microversion: 2.1 time: 1.726877 Jul 14 14:44:35.505381 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 742/1542] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:33 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1508 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:35.528570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:35.529288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:35.550940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.551421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:35.560697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:35.561235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.598069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.628317 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aba70f8b-a4fc-4792-ae43-615d39a0d20c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.827529 Jul 14 14:44:36.630723 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 801/1543] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:34 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:36.637726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:36.638662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:36.648479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.649239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.650304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:36.651197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:36.835712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.855756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.860732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:36.865587 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7e0531d-f5f6-4113-a058-23fccfcbb435 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.357209 Jul 14 14:44:36.867613 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 743/1544] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:35 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:37.168706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:37.183833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be204217-9402-4d53-80dd-af7adfcf8c23 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1508 microversion: 2.1 time: 0.547606 Jul 14 14:44:37.184732 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 802/1545] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:36 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1508 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:37.248489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:37.256302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:37.279623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.281217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.283925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.285523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.515604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:44:37.516978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:44:37.520113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:44:37.537554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:44:37.539183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:44:37.653083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:37.654059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:37.673602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.674473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.675576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.676315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.759982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:37.795224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.796480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:37.799321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:37.800366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.003998 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9798ef7b-f40f-4b23-b757-e819507feb45 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "POST /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257/action" status: 202 len: 1110 microversion: 2.1 time: 0.773659 Jul 14 14:44:38.035317 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 744/1546] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:44:37 2022] POST /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257/action => generated 1110 bytes in 799 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:44:38.104426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.105687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.107567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:38.118571 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ce73579-8d85-4bf0-b715-d43a313e2947 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 0.470251 Jul 14 14:44:38.131498 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 803/1547] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:37 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:38.140112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.140745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.153525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.154887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.163850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:38.172608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:38.210018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.210796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.212210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:38.234661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:38.795940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:38.806700 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85380c34-ed93-4e80-8359-5449b2d8a4d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 0.664495 Jul 14 14:44:38.820549 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 804/1548] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:39.144006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:39.147033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:39.163401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.167706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.168703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.171829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.217310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:39.236928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:39.241771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:39.244847 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a34a025-9d53-4201-8bba-76b9a71caf91 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.181765 Jul 14 14:44:39.247230 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 745/1549] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:38 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:39.523705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:39.551931 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-42bc80af-e74e-4fb8-b91f-8b43620e9e1e tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 0.416206 Jul 14 14:44:39.552778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 805/1550] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:39 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:39.833091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:39.834696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:39.858932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.860405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:39.864171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:39.864646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.274776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:40.280327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:40.303535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:40.305322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:40.307758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:40.312500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.092121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.139978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.151190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.158922 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6cac5319-7bb3-4c20-92af-4edd9726f6e1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.895038 Jul 14 14:44:41.164807 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 806/1551] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:40 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:41.188205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:41.191749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:41.228380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.234629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.236628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:41.240791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:41.249996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:41.284034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-125ee002-4eea-4904-bc57-8bb50278e2c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.458787 Jul 14 14:44:41.285983 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 746/1552] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:39 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:42.153605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:42.173921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-083cbe4c-4d98-4019-978a-54f09b2e8c48 req-0e55dc5c-f723-4d07-9ae5-13714a386047 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b060b5-502d-43ad-b5d9-487f0a89e438", "name": "network-vif-unplugged", "status": "completed", "tag": "d7920837-2445-4490-b644-0e5e66a09961"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:42.191505 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85271bf5-6a6b-4fc2-8d89-52592ffc720c tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.021966 Jul 14 14:44:42.194151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-083cbe4c-4d98-4019-978a-54f09b2e8c48 req-0e55dc5c-f723-4d07-9ae5-13714a386047 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.196754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-083cbe4c-4d98-4019-978a-54f09b2e8c48 req-0e55dc5c-f723-4d07-9ae5-13714a386047 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.215467 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 807/1553] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:41 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:42.222596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:42.225855 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-083cbe4c-4d98-4019-978a-54f09b2e8c48 req-0e55dc5c-f723-4d07-9ae5-13714a386047 service nova] Creating event network-vif-unplugged:d7920837-2445-4490-b644-0e5e66a09961 for instance e7b060b5-502d-43ad-b5d9-487f0a89e438 on n-h2-768852-23 Jul 14 14:44:42.227244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:42.240834 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-083cbe4c-4d98-4019-978a-54f09b2e8c48 req-0e55dc5c-f723-4d07-9ae5-13714a386047 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072906 Jul 14 14:44:42.245047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 747/1554] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:44:42.271878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.272471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.273575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.274108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.324769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:42.338481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:42.355523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.355992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:42.356849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:42.357298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.250236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.309972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.314274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.317355 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53dd6978-5e4d-42bc-98d7-dd7ccb789bf1 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.099946 Jul 14 14:44:43.320040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 808/1555] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:42 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:43.332689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:43.337009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:43.358060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.360430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.364462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:43.365660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:43.456825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:43.481460 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-863fe999-fabc-4c31-b733-79310ab5385f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.166283 Jul 14 14:44:43.485369 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 748/1556] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:42 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:44.346875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:44.347860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:44.375735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.377223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.381105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.390820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.577383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:44.612866 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-683c58ca-3b94-4b88-b57e-5a91b23cc320 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.289303 Jul 14 14:44:44.631092 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 809/1557] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:43 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:44.640789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:44.645780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:44.674053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.674839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.684751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:44.686131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:44.700712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:45.517033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.580980 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a334ecfb-4338-4513-b32d-2707104404b5 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 0.957545 Jul 14 14:44:45.608605 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 810/1558] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:44 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:45.627695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f1bc6d35-aa93-490d-874a-f2e18e9acd81 req-fb92ea5d-88cb-4125-8604-b7c8d98c8508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7b060b5-502d-43ad-b5d9-487f0a89e438", "tag": "d7920837-2445-4490-b644-0e5e66a09961"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:45.691034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f1bc6d35-aa93-490d-874a-f2e18e9acd81 req-fb92ea5d-88cb-4125-8604-b7c8d98c8508 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.693490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f1bc6d35-aa93-490d-874a-f2e18e9acd81 req-fb92ea5d-88cb-4125-8604-b7c8d98c8508 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.735880 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f1bc6d35-aa93-490d-874a-f2e18e9acd81 req-fb92ea5d-88cb-4125-8604-b7c8d98c8508 service nova] Creating event network-changed:d7920837-2445-4490-b644-0e5e66a09961 for instance e7b060b5-502d-43ad-b5d9-487f0a89e438 on n-h2-768852-23 Jul 14 14:44:45.761708 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f1bc6d35-aa93-490d-874a-f2e18e9acd81 req-fb92ea5d-88cb-4125-8604-b7c8d98c8508 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149838 Jul 14 14:44:45.771931 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 811/1559] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:45.773025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.782744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.784278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:45.786464 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55edf678-f03b-447a-b05d-e23f04e5a7fa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 1.442798 Jul 14 14:44:45.799566 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 749/1560] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:44 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:45.818541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:45.824755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:45.874481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.875832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:45.877805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:45.882608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.614288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:46.615247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:46.625588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.632086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.633358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.634101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.824086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:46.837362 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1a00c6db-8579-420a-bdee-2e8f399f7b1a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.063671 Jul 14 14:44:46.838054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 812/1561] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:45 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:46.847540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:46.852235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:46.870911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.871683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:46.872711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:46.873334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.668038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:47.697214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:47.701645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:47.704332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-58008bea-b5fc-43fd-ae6f-9a4ee9680ce8 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.864084 Jul 14 14:44:47.720676 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 813/1562] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:46 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:47.870795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:47.875519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:47.896537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.901535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.904354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:47.910507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:47.962216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:47.996393 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b958251c-5543-4719-8c2a-fd41628284c8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.384268 Jul 14 14:44:48.010112 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 750/1563] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:46 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:48.735594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:48.736434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:48.761112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:48.761581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:48.762416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:48.763034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:48.987518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:49.014796 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc2298bc-0e87-4c73-af15-dbb35b2966b7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.151006 Jul 14 14:44:49.015889 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 814/1564] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:47 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:49.037313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:49.041749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:49.067951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:49.068791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:49.070350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:49.071077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:49.589028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:49.603095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:49.613116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:49.625187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eac31dd3-0a37-4f5e-a86f-5ba674db6e49 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1486 microversion: 2.25 time: 0.893816 Jul 14 14:44:49.625973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 751/1565] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:48 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1486 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:50.034789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.038481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:50.050567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.056464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.058286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.059034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.159934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:50.170238 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9acfebcf-887e-4ff7-a06f-5b71ca186e62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.140814 Jul 14 14:44:50.175714 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 815/1566] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:49 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:50.656872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:50.657604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:50.668751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.674346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:50.675593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:50.676270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.335340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.381534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.386052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.391055 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-054249c4-155d-4fa3-a99d-12306c72685e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1476 microversion: 2.25 time: 0.737929 Jul 14 14:44:51.393824 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 816/1567] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1476 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:51.415083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:51.416556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:51.439230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:51.442408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.443262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.450349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.451038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.470575 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-067a43fb-a988-4fe7-a4d0-91db347405bb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.439490 Jul 14 14:44:51.473385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 752/1568] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:50 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:51.487573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11807ff6-0479-4a77-88cf-a0ba30e11cac tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '.version_select at 0x7fdbf3273790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:51.491679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11807ff6-0479-4a77-88cf-a0ba30e11cac tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.492609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11807ff6-0479-4a77-88cf-a0ba30e11cac tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.518788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11807ff6-0479-4a77-88cf-a0ba30e11cac tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 3896 microversion: 2.25 time: 0.042082 Jul 14 14:44:51.529989 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 753/1569] 10.222.0.98 () {60 vars in 1183 bytes} [Thu Jul 14 14:44:51 2022] GET /compute/v2.1/os-migrations => generated 3896 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:51.546010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:51.547540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:51.563070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.564348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:51.568074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:51.569007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.270602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:52.286061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7cf6f76-010a-4a61-a218-2394a9ac942b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 0.890674 Jul 14 14:44:52.290226 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 817/1570] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:51 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:52.494115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:52.496491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:52.513278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.515657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:52.516833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:52.518531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.149779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:53.168319 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b40f51e5-6983-454c-a432-d79d3b5673a9 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 0.679155 Jul 14 14:44:53.171755 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 818/1571] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:52 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:44:53.193535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ddcc61ba-b19a-4c95-a3b8-8f755d39d0f6 req-d027d6d7-8d15-4472-a071-86b30f7e3b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b060b5-502d-43ad-b5d9-487f0a89e438", "name": "network-vif-unplugged", "status": "completed", "tag": "d7920837-2445-4490-b644-0e5e66a09961"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:53.228687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ddcc61ba-b19a-4c95-a3b8-8f755d39d0f6 req-d027d6d7-8d15-4472-a071-86b30f7e3b7a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.230342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ddcc61ba-b19a-4c95-a3b8-8f755d39d0f6 req-d027d6d7-8d15-4472-a071-86b30f7e3b7a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.246358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:53.258999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] Lazy-loading 'services' on Instance uuid cde86f6d-6561-44c7-b3c0-46cb586ab9ca {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:44:53.295384 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ddcc61ba-b19a-4c95-a3b8-8f755d39d0f6 req-d027d6d7-8d15-4472-a071-86b30f7e3b7a service nova] Creating event network-vif-unplugged:d7920837-2445-4490-b644-0e5e66a09961 for instance e7b060b5-502d-43ad-b5d9-487f0a89e438 on n-h2-768852-23 Jul 14 14:44:53.309219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ddcc61ba-b19a-4c95-a3b8-8f755d39d0f6 req-d027d6d7-8d15-4472-a071-86b30f7e3b7a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135635 Jul 14 14:44:53.314042 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 819/1572] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:53.323721 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c31c7c5a-1d23-417e-b921-394389b3ee0e tempest-LiveAutoBlockMigrationV225Test-2055446503 tempest-LiveAutoBlockMigrationV225Test-2055446503-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1970 microversion: 2.25 time: 1.778177 Jul 14 14:44:53.333690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 754/1573] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:51 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1970 bytes in 1786 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:53.357292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.361647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:53.362704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.363241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:53.376219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.387553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.389662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.389931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.391246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.391930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.392805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.396334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.464147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:44:53.762097 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf6a5187-c01c-4bf8-8099-55bfdda7628f tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 204 len: 0 microversion: 2.25 time: 0.402002 Jul 14 14:44:53.765461 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 755/1574] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:44:53 2022] DELETE /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:44:53.777160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:53.780177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:53.794902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.796106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:53.797383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:53.798103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.350422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.380817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.382699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.386623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:54.390270 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-458d129a-414d-4068-8a6d-4829b4ab7394 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1482 microversion: 2.25 time: 0.618644 Jul 14 14:44:54.390901 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 756/1575] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:53 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1482 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:54.406104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:54.406266 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4413572c-cf45-47c5-a4b1-30fad3b89d11 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.083360 Jul 14 14:44:54.408163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:54.418247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 820/1576] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:53 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:54.437877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.440372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.441733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:54.465086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:54.722631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1326357935", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "781c86c8-ccd7-4cf6-aab5-956819ecdda1"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:54.856270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] validate_networks() for [('781c86c8-ccd7-4cf6-aab5-956819ecdda1', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:44:55.288058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:55.301704 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c21aa8ba-a299-4b3e-a726-fa1967773f32 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 0.905737 Jul 14 14:44:55.311633 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 757/1577] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:54 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:55.426599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:55.428187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:55.441748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.442578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:55.445009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:55.446903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:56.764765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:56.781167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:56.783169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:56.786004 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15ddf919-350d-4528-b0a4-eba3dad4d082 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1482 microversion: 2.25 time: 1.364038 Jul 14 14:44:56.802772 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 758/1578] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:55 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1482 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:44:56.814514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:56.815481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:56.829313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:56.830050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:56.831368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:56.833553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.296768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:44:58.297573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:44:58.297783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:44:58.298057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:44:58.298471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:44:58.303561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=56 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:44:58.318984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.328145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.329284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.329735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.372378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Getting quotas for project 9aea3a0d9920482abbbcb6c186504ed2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:44:58.389981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Getting quotas for user 8413b54e750c4f178c419c2b4f31d38e and project 9aea3a0d9920482abbbcb6c186504ed2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:44:58.413497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Going to run 2 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:44:58.422434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: c2ec69c9-3f5b-42a4-89f5-49c7eb47b345] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:44:58.531234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:58.551079 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b121064d-dae2-4a4e-8ffa-c5f29e6d0a15 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.746639 Jul 14 14:44:58.553562 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 759/1579] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:56 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:58.560715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:58.561782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:58.569674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.570408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.571739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.573114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.631577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=c2ec69c9-3f5b-42a4-89f5-49c7eb47b345,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:44:58.835332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b53c8a47-27c2-49d6-9e41-3668d73fb226 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.412960 Jul 14 14:44:58.837872 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 821/1580] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:44:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 4419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:44:58.880481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4f557c69-0f43-483c-b84c-e9a59cf55f77 req-b5275067-fede-47a5-9e42-d9b986b00266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cde86f6d-6561-44c7-b3c0-46cb586ab9ca", "name": "network-vif-deleted", "tag": "2660e2f0-d5e5-47e4-805e-17cfccb97fbf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:44:58.922159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4f557c69-0f43-483c-b84c-e9a59cf55f77 req-b5275067-fede-47a5-9e42-d9b986b00266 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:58.923218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4f557c69-0f43-483c-b84c-e9a59cf55f77 req-b5275067-fede-47a5-9e42-d9b986b00266 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:58.981075 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4f557c69-0f43-483c-b84c-e9a59cf55f77 req-b5275067-fede-47a5-9e42-d9b986b00266 service nova] Creating event network-vif-deleted:2660e2f0-d5e5-47e4-805e-17cfccb97fbf for instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca on n-h2-768852-23 Jul 14 14:44:59.013993 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4f557c69-0f43-483c-b84c-e9a59cf55f77 req-b5275067-fede-47a5-9e42-d9b986b00266 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154864 Jul 14 14:44:59.018503 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 822/1581] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:44:59.059739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:59.065842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:59.106746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.111034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.115426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.118561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.645896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.666315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.669589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.677618 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47680221-0918-461d-ba7e-43b61fb2e21e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1265 microversion: 2.25 time: 0.654891 Jul 14 14:44:59.680712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.682488 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 823/1582] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:44:59 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1265 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:44:59.698421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:59.707521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:44:59.714914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Searching by: {'deleted': False, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:44:59.723993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-801629bd-b1d4-471a-9208-1e6ed9040917 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.168562 Jul 14 14:44:59.725078 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 760/1583] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:58 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:44:59.769930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.777003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.783929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:44:59.785779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.785779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.788945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:44:59.850138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.855887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.864554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:44:59.869502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:44:59.965521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2bc1bc57-511e-4247-bdcc-fbf13dacaea7 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.274088 Jul 14 14:44:59.966662 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 824/1584] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:44:59 2022] GET /compute/v2.1/servers => generated 677 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:00.012205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-363d5fae-2f5e-48ec-9056-098a91c38847 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:00.012918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-363d5fae-2f5e-48ec-9056-098a91c38847 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:00.688564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-363d5fae-2f5e-48ec-9056-098a91c38847 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.700548 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-363d5fae-2f5e-48ec-9056-098a91c38847 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1220 microversion: 2.1 time: 0.724033 Jul 14 14:45:00.703256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 825/1585] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:59 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1220 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:00.709337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:00.710268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:00.733818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.734680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.737028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:00.737972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:00.963795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.973398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:00.987836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22f7be92-f8b2-454c-beaf-b48bdc2a5226 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 1.239035 Jul 14 14:45:00.989155 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 761/1586] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:44:59 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:00.999482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:01.002009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:01.002851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:01.008380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:01.010903 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b01a3b1-5453-4326-841b-d26c3ae85a35 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1265 microversion: 2.25 time: 0.305907 Jul 14 14:45:01.019321 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 826/1587] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:00 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1265 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:01.035547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.036333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.037345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.038138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.721027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:01.722340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:01.740848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.740848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.741462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:01.741949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:01.941917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:01.953112 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5bd54cd5-bc39-4fcb-b482-ec108cb4775b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1216 microversion: 2.1 time: 0.236013 Jul 14 14:45:01.955081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 827/1588] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:01 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1216 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:02.021880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:02.023011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:02.043112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.044967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.047792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.050118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.120362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.137260 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8acbe496-b18f-4aae-ac71-149dec60c3c7 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.146595 Jul 14 14:45:02.161252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 762/1589] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:00 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:02.188905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:02.195215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:02.230078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.230542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.231423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:02.242658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:02.442830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.471722 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e145c447-981e-4b76-a56d-b212e40f18cc tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 0.455446 Jul 14 14:45:02.473849 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 828/1590] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:02 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:02.509805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.534092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.542516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:02.551924 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e3e2860-1418-4f8d-abf6-d96ab7c99241 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1265 microversion: 2.25 time: 0.381001 Jul 14 14:45:02.553439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 763/1591] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:02 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1265 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:02.978635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:02.982371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:03.013342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.015796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.019762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.023479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.210410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-934988516", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:03.364594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] validate_networks() for [('e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:03.424569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:03.446884 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-96e2d6cf-1015-490d-bddc-a1eef283f59a tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1278 microversion: 2.1 time: 0.477074 Jul 14 14:45:03.450569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 764/1592] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:02 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1278 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:03.463563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:03.465216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:03.487876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.489994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:03.489994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:03.495201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.169728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.188944 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8c4354a-6d82-4455-ba37-e6d0409ff140 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 0.732863 Jul 14 14:45:04.203750 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 765/1593] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:03 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:04.233519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:04.234177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:04.255859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:04.266995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.267546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.268589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.269052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.859742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:04.873466 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a109288b-2038-4eeb-8c8b-8d7bb47165fe tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1515 microversion: 2.1 time: 0.668519 Jul 14 14:45:04.883814 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 766/1594] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:04 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1515 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:04.891936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:04.893103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:04.924226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.924697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:04.925529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:04.926005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.048158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:05.049652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:05.052211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:05.053050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:05.056358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:05.077894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.106196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.108061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.111513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.112374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.126005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.138945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.151973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8069e69f-201a-4839-ae3f-63a539b32cf2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1265 microversion: 2.25 time: 0.263755 Jul 14 14:45:05.161473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 767/1595] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:04 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1265 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:05.185633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:05.193413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:05.216457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:05.222465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.229478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.231666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.233373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.242375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for user 331a222a893c4f84a08abf11333c7449 and project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:05.340035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:05.353537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:05.620894 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e187d9af-5811-43d2-9d09-8b13ec149063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.140441 Jul 14 14:45:05.622161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 829/1596] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:45:05.651177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:05.652270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:05.684151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.685208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.686943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:05.690454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:05.786955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:05.832617 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74d58eb6-4d62-48ae-ad0f-fed7cf4adc46 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1278 microversion: 2.1 time: 0.668936 Jul 14 14:45:05.838139 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 768/1597] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:05 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1278 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:05.871190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c116013-02b7-47ec-b7ba-280917753f21 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:05.872475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c116013-02b7-47ec-b7ba-280917753f21 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:06.079398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c116013-02b7-47ec-b7ba-280917753f21 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:06.088832 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c116013-02b7-47ec-b7ba-280917753f21 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1207 microversion: 2.1 time: 0.249054 Jul 14 14:45:06.094878 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 769/1598] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:05 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1207 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:06.999597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.010264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1979490-f792-4284-9232-277d62cd6a68 tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.030436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-acc2ad53-3846-455b-b357-9c94965a6688 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1392 microversion: 2.1 time: 1.406382 Jul 14 14:45:07.037937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 830/1599] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:05 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1392 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:07.049055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1979490-f792-4284-9232-277d62cd6a68 tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.950121 Jul 14 14:45:07.051144 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 770/1600] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:45:06 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:07.073677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.074633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:07.106509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.108629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:07.118215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.128655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.133393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.134543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.147547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.148528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.152771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.158865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.242382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:07.606682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.635526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:07.640925 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-81d8012d-f9dc-4fca-9e1e-e192b550e92b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1521 microversion: 2.1 time: 0.600329 Jul 14 14:45:07.654791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.662829 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 831/1601] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:07 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:07.688996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.690460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.690867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:07.692188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:07.693437 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2e195fb1-1e19-453a-8bf5-56e1a9f00cdc tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1265 microversion: 2.25 time: 0.633783 Jul 14 14:45:07.694951 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 771/1602] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:07 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1265 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:07.717907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.719081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.720872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.721274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:07.722034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:07.724334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.752077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.754661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:07.756029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:07.756483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.031261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.054949 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c5dab344-692c-42e1-968d-b70cfd937928 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1259 microversion: 2.1 time: 0.358572 Jul 14 14:45:08.073732 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 772/1603] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:07 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1259 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:08.093573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:08.094277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:08.117562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.118351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.120776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.122513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.911119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:08.930149 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e4ec9b6-9175-45b6-bdd2-6ac77cdbb1f1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 1.265345 Jul 14 14:45:08.935876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 832/1604] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:07 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:08.948826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:08.952845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:08.966862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.978244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:08.985849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:08.992446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.243736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.264805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ea4eda10-5ba8-4635-b764-101be859e65f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1382 microversion: 2.1 time: 1.192643 Jul 14 14:45:09.266693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 773/1605] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:08 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1382 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:09.290184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:09.293848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:09.312822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.313819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.316120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.318788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.520786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.536664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.542153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.546081 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62862bbe-9cd8-43d8-ac93-1378e51e80cf tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 200 len: 1265 microversion: 2.25 time: 0.276826 Jul 14 14:45:09.576771 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 774/1606] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:09 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 1265 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:09.599849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54e2004c-3515-4883-bb14-42899900836f tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1849171350", "imageRef": "a33277c3-74ab-41d7-a87a-f4cf838bd3f6", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:09.796020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-54e2004c-3515-4883-bb14-42899900836f tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:09.862676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:09.876662 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c4dcf69f-fa3b-4c18-87dc-6a26e3b02a60 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1521 microversion: 2.1 time: 0.938122 Jul 14 14:45:09.878931 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 833/1607] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:08 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1521 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:09.887790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:09.888927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:09.914886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.919222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:09.923844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:09.924750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.275612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:10.287230 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2369173a-6d5f-4381-b912-4d03676baa9e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1265 microversion: 2.1 time: 0.406044 Jul 14 14:45:10.298860 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 834/1608] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:09 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1265 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:10.304279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d02a85f1-131c-41f4-bf08-8715c90876e0 req-9230fee4-ddab-44ad-9d0e-894641e5372b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94f2422-b740-4908-9dc5-514fb8b99257", "name": "network-vif-unplugged", "status": "completed", "tag": "62beb0f4-308f-4b74-86e1-e346e3c55e99"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:10.330254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d02a85f1-131c-41f4-bf08-8715c90876e0 req-9230fee4-ddab-44ad-9d0e-894641e5372b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.331726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d02a85f1-131c-41f4-bf08-8715c90876e0 req-9230fee4-ddab-44ad-9d0e-894641e5372b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.361375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d02a85f1-131c-41f4-bf08-8715c90876e0 req-9230fee4-ddab-44ad-9d0e-894641e5372b service nova] Creating event network-vif-unplugged:62beb0f4-308f-4b74-86e1-e346e3c55e99 for instance b94f2422-b740-4908-9dc5-514fb8b99257 on n-h1-768852-23 Jul 14 14:45:10.379110 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d02a85f1-131c-41f4-bf08-8715c90876e0 req-9230fee4-ddab-44ad-9d0e-894641e5372b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078246 Jul 14 14:45:10.381697 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 835/1609] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:10.394088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e529eb59-ba20-45fc-a630-4379162948c4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '.version_select at 0x7fdbf2b0adc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:10.397799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e529eb59-ba20-45fc-a630-4379162948c4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.405710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e529eb59-ba20-45fc-a630-4379162948c4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.441995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e529eb59-ba20-45fc-a630-4379162948c4 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 3118 microversion: 2.1 time: 0.058563 Jul 14 14:45:10.442599 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 836/1610] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:45:10 2022] GET /compute/v2.1/os-migrations => generated 3118 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:10.458210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:10.459034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:10.473510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.474008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:10.474789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:10.475228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.006233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-54e2004c-3515-4883-bb14-42899900836f tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] HTTP exception thrown: Flavor's memory is too small for requested image. Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54e2004c-3515-4883-bb14-42899900836f tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] Request method failure captured: Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 143 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CvxzC-mn_hY2q0AncmT1YADmkuSnAzrP5gIr_crjhoHRYK_lS4dWti-_py-b_hGygc6v5_QhOxwCvkj9GYbmVf14ZLAPtUq_Se5v41p1lT38BsRPUFJtjsrj6rsZKX14nMC24EY5SjjwJVa1Rbi-fEonw4DSu0ALZuLMa9RXoO_4UY Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 60b320e0b7ce431785574f9a5adb0c68 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FlavorsV2NegativeTest-256225995 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/60b320e0b7ce431785574f9a5adb0c68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_60b320e0b7ce431785574f9a5adb0c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/60b320e0b7ce431785574f9a5adb0c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/60b320e0b7ce431785574f9a5adb0c68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FlavorsV2NegativeTest-256225995 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 60b320e0b7ce431785574f9a5adb0c68 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-256225995 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FlavorsV2NegativeTest-256225995-project Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: af4ad52fb5b64c1cae79cc8758f9b406 Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FlavorsV2NegativeTest-256225995-project Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1849171350", "imageRef": "a33277c3-74ab-41d7-a87a-f4cf838bd3f6", "flavorRef": "452"}} Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: exception: Flavor's memory is too small for requested image. Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1849171350', 'imageRef': 'a33277c3-74ab-41d7-a87a-f4cf838bd3f6', 'flavorRef': '452'}}} Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1667, in _create_instance Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1005, in _checks_for_create_and_rebuild Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 669, in _validate_flavor_image Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 737, in _validate_flavor_image_nostatus Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:45:11.011325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 870, in create Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Jul 14 14:45:11.017504 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.022014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54e2004c-3515-4883-bb14-42899900836f tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:11.023297 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54e2004c-3515-4883-bb14-42899900836f tempest-FlavorsV2NegativeTest-256225995 tempest-FlavorsV2NegativeTest-256225995-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.443454 Jul 14 14:45:11.044350 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 775/1611] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:09 2022] POST /compute/v2.1/servers => generated 93 bytes in 1467 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:45:11.052727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:11.054316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:11.065366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.066342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.067962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.068720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.462061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:11.481186 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6eb073e7-9313-406b-8721-a3da9284754e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 1.033608 Jul 14 14:45:11.483821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 837/1612] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:10 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:11.512702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:11.513450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: cde86f6d-6561-44c7-b3c0-46cb586ab9ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:11.534069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.535259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.540382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.541139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.574871 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] HTTP exception thrown: Instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca could not be found. Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Request method failure captured: Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca HTTP/1.1 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnYiFmtRXm2zUDE4MFWtt6EWPWhSlx3gFX_2Qxl5UEXOutgKNJ-t1A4IGPLAir7-1ersxtPXMuxsF-JSvxmdwIzFwQo7QWhsxkN6HaBYBzr70C1Ek1-ZlB976rXgWQLt2tsMYU0KiXSiC7wAEsu4c8AjJCWrJx4f7WMWRnI8keW-F8 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: aeb3928894284b77b4aea925a38470ba Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca could not be found. Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'cde86f6d-6561-44c7-b3c0-46cb586ab9ca'} Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca could not be found. Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca could not be found. Jul 14 14:45:11.583655 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca could not be found. Jul 14 14:45:11.590618 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:11.593821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Returning 404 to user: Instance cde86f6d-6561-44c7-b3c0-46cb586ab9ca could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:11.595024 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-95031f26-8888-4e15-af81-677aeb7c19d3 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca" status: 404 len: 111 microversion: 2.25 time: 0.097606 Jul 14 14:45:11.596507 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 838/1613] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:11 2022] GET /compute/v2.1/servers/cde86f6d-6561-44c7-b3c0-46cb586ab9ca => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:11.614403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:11.615564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:11.625607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.626430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.627492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.628193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.820597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-61b4ff44-d245-430b-8aef-dc78fc68d353 tempest-LiveMigrationTest-1267260543 tempest-LiveMigrationTest-1267260543-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1535 microversion: 2.1 time: 0.771741 Jul 14 14:45:11.834531 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 776/1614] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:11 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1535 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:11.849040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:11.849040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:11.882585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.883038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:11.886091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:11.887765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.256673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.258861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:12.286652 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22d9c533-ebc8-427d-b187-0e27b333e49c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1521 microversion: 2.1 time: 0.688461 Jul 14 14:45:12.288138 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 839/1615] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:11 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:12.289708 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16ee363d-7546-4bc0-9f9f-78ac05eafe9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1265 microversion: 2.1 time: 0.454195 Jul 14 14:45:12.301056 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 777/1616] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:11 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1265 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:12.302325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ef5638ab-172f-44e9-bdaf-f3b0791180fe req-20a19e2d-52cc-4457-b82a-a59f851ade59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e878a48-864c-4baa-a78b-b7904e1d5947", "tag": "56b4b66f-5fff-48fd-8a3a-eec9bc1fe627"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:12.325061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:12.325903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ef5638ab-172f-44e9-bdaf-f3b0791180fe req-20a19e2d-52cc-4457-b82a-a59f851ade59 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.326354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ef5638ab-172f-44e9-bdaf-f3b0791180fe req-20a19e2d-52cc-4457-b82a-a59f851ade59 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.328903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:12.356628 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ef5638ab-172f-44e9-bdaf-f3b0791180fe req-20a19e2d-52cc-4457-b82a-a59f851ade59 service nova] Creating event network-changed:56b4b66f-5fff-48fd-8a3a-eec9bc1fe627 for instance 9e878a48-864c-4baa-a78b-b7904e1d5947 on n-h2-768852-23 Jul 14 14:45:12.360171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.361289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.363137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.363967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ef5638ab-172f-44e9-bdaf-f3b0791180fe req-20a19e2d-52cc-4457-b82a-a59f851ade59 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074244 Jul 14 14:45:12.364928 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 840/1617] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:12.365512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.416832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5e1dbeb8-ecf1-40dd-9ca8-2d4a375398de req-de5d1a57-53a4-49aa-8cd0-88ad7f847b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94f2422-b740-4908-9dc5-514fb8b99257", "name": "network-vif-plugged", "status": "completed", "tag": "62beb0f4-308f-4b74-86e1-e346e3c55e99"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:12.442685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5e1dbeb8-ecf1-40dd-9ca8-2d4a375398de req-de5d1a57-53a4-49aa-8cd0-88ad7f847b3a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.443132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5e1dbeb8-ecf1-40dd-9ca8-2d4a375398de req-de5d1a57-53a4-49aa-8cd0-88ad7f847b3a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.448748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:12.477872 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5e1dbeb8-ecf1-40dd-9ca8-2d4a375398de req-de5d1a57-53a4-49aa-8cd0-88ad7f847b3a service nova] Creating event network-vif-plugged:62beb0f4-308f-4b74-86e1-e346e3c55e99 for instance b94f2422-b740-4908-9dc5-514fb8b99257 on n-h1-768852-23 Jul 14 14:45:12.487884 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5e1dbeb8-ecf1-40dd-9ca8-2d4a375398de req-de5d1a57-53a4-49aa-8cd0-88ad7f847b3a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074139 Jul 14 14:45:12.490841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 841/1618] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:12.506703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:12.518682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:12.539709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.545151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.546357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.547113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.674138 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fa4aca4-4a7d-4be6-89e4-64b9af6cdf0a tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 204 len: 0 microversion: 2.1 time: 0.361678 Jul 14 14:45:12.677026 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 778/1619] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:12 2022] DELETE /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:12.715670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:12.717098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:12.750469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.751340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:12.752925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:12.753742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.288601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:13.307939 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65198bad-48b1-41d0-9382-48dc70accdeb tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 0.809848 Jul 14 14:45:13.323333 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 842/1620] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:12 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:13.328187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b2d96dd8-9c4d-4f15-b5ae-22cc86aa0802 req-ac3cb43b-bf9f-402d-bc65-d95a0a68b23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2ec69c9-3f5b-42a4-89f5-49c7eb47b345", "tag": "b9069033-6805-45c0-ad9a-c4a6644ff560"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:13.339624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b2d96dd8-9c4d-4f15-b5ae-22cc86aa0802 req-ac3cb43b-bf9f-402d-bc65-d95a0a68b23e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.340542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b2d96dd8-9c4d-4f15-b5ae-22cc86aa0802 req-ac3cb43b-bf9f-402d-bc65-d95a0a68b23e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.354220 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b2d96dd8-9c4d-4f15-b5ae-22cc86aa0802 req-ac3cb43b-bf9f-402d-bc65-d95a0a68b23e service nova] Creating event network-changed:b9069033-6805-45c0-ad9a-c4a6644ff560 for instance c2ec69c9-3f5b-42a4-89f5-49c7eb47b345 on n-h1-768852-23 Jul 14 14:45:13.359981 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b2d96dd8-9c4d-4f15-b5ae-22cc86aa0802 req-ac3cb43b-bf9f-402d-bc65-d95a0a68b23e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035473 Jul 14 14:45:13.361433 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 843/1621] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:13.373937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:13.375366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:13.384184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.386167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:13.387574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:13.388325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.300543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:14.344538 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70a3454a-193d-4f33-a098-d92c5f10d54f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1521 microversion: 2.1 time: 0.981458 Jul 14 14:45:14.345354 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 844/1622] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:13 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1521 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:14.351140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:14.352384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:14.359581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.360393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.361460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.362128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.465630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:14.491992 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9efb9b4-dd1c-420d-82b8-5a3927b1bdd0 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1388 microversion: 2.1 time: 1.805019 Jul 14 14:45:14.492812 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 779/1623] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:12 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1388 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:45:14.508816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:14.509460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:14.535829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.536296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:14.537148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:14.537596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.147244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:15.236122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:15.315962 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7379dc68-8080-4ffe-b80e-53b4b1e72708 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 0.951926 Jul 14 14:45:15.331632 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 845/1624] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:14 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:15.364831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:15.365592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:15.389144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=14 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:15.409823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.410995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.412698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.413688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.757563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:15.777048 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74c40d58-266c-493e-884e-badde96239e1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 1.272238 Jul 14 14:45:15.783231 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 780/1625] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:14 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:15.804044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:15.808562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:15.830924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.831480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:15.832478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:15.833722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:16.089328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:16.155071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:16.167359 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73d08e54-12ae-4b80-a65a-80bf49baa1da tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1521 microversion: 2.1 time: 0.807160 Jul 14 14:45:16.168182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 846/1626] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:15 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1521 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:16.347431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:16.349095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:16.370594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:16.371403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:16.372511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:16.373198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.219050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:17.233756 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ae775de-eea9-466a-909e-c004866f5b62 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 0.890615 Jul 14 14:45:17.248508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 847/1627] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:16 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:17.279448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c5719c07-0a6c-436f-8d1c-a2433dc278d5 req-b865145a-f839-46ae-98cd-88bcd8beb849 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7b060b5-502d-43ad-b5d9-487f0a89e438", "name": "network-vif-deleted", "tag": "d7920837-2445-4490-b644-0e5e66a09961"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:17.310313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c5719c07-0a6c-436f-8d1c-a2433dc278d5 req-b865145a-f839-46ae-98cd-88bcd8beb849 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.310781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c5719c07-0a6c-436f-8d1c-a2433dc278d5 req-b865145a-f839-46ae-98cd-88bcd8beb849 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.346705 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c5719c07-0a6c-436f-8d1c-a2433dc278d5 req-b865145a-f839-46ae-98cd-88bcd8beb849 service nova] Creating event network-vif-deleted:d7920837-2445-4490-b644-0e5e66a09961 for instance e7b060b5-502d-43ad-b5d9-487f0a89e438 on n-h1-768852-23 Jul 14 14:45:17.377916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c5719c07-0a6c-436f-8d1c-a2433dc278d5 req-b865145a-f839-46ae-98cd-88bcd8beb849 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126957 Jul 14 14:45:17.387200 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 848/1628] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:17.409281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:17.410009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:17.443489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.445355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.447359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.448492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.767379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:17.783655 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-20c6bc75-ad50-4f17-97d2-94142ab38652 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1388 microversion: 2.1 time: 1.998032 Jul 14 14:45:17.789304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 781/1629] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:15 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1388 bytes in 2005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:17.821297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:17.826070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:17.864378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.868695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:17.869845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:17.877171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:18.138440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:18.153277 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a67c33ed-2cc8-42d3-87be-034590fbecbd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 0.764324 Jul 14 14:45:18.153890 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 849/1630] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:17 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:18.276617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:18.277235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:18.299256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:18.300156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:18.301573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:18.302357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.182796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:20.202224 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d43a23e0-b519-461f-9a80-54579101792c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1506 microversion: 2.1 time: 2.410126 Jul 14 14:45:20.215313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 782/1631] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:17 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1506 bytes in 2414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:20.224338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:20.227347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:20.265266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.266141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.268745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.272426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.433685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:20.449454 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15787879-e1fb-49de-bdb9-10fa7e966b9f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1183 microversion: 2.1 time: 0.243827 Jul 14 14:45:20.453332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:20.458957 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 783/1632] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:20 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:20.475395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d6930bb4-029e-4607-9cb9-1cc7156e892f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 2.205718 Jul 14 14:45:20.480605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:20.481594 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 850/1633] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:18 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:20.486868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:20.490708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:20.495894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:20.514335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.517527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.518278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.518657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.519631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.520333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.520622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.521412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:20.620348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:20.943407 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f076339-c1be-40e0-9522-9a224dd65f24 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 204 len: 0 microversion: 2.25 time: 0.481595 Jul 14 14:45:20.946791 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 784/1634] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:45:20 2022] DELETE /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:45:20.959527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6e71456d-7c7d-4fb9-874f-ad52efbbf4c9 req-9f44bc15-cf76-45e4-84a8-8d67fd649c3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80f2e64a-ba04-4c1b-a5e0-695662b50049", "tag": "1a777028-769e-451b-9c9e-fb8e866176b6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:20.987979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6e71456d-7c7d-4fb9-874f-ad52efbbf4c9 req-9f44bc15-cf76-45e4-84a8-8d67fd649c3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:20.988771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6e71456d-7c7d-4fb9-874f-ad52efbbf4c9 req-9f44bc15-cf76-45e4-84a8-8d67fd649c3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.024782 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6e71456d-7c7d-4fb9-874f-ad52efbbf4c9 req-9f44bc15-cf76-45e4-84a8-8d67fd649c3b service nova] Creating event network-changed:1a777028-769e-451b-9c9e-fb8e866176b6 for instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 on n-h2-768852-23 Jul 14 14:45:21.035174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6e71456d-7c7d-4fb9-874f-ad52efbbf4c9 req-9f44bc15-cf76-45e4-84a8-8d67fd649c3b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085762 Jul 14 14:45:21.036038 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 785/1635] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:21.052908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:21.058465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:21.085559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.090972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:21.093362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.094232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.094678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.109412 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5229514-6b28-4b08-92f2-af7316156a82 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 0.625865 Jul 14 14:45:21.120251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 851/1636] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:20 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:21.125972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:21.126910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:21.135628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.136391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.137386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.138030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.160129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:21.716069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:21.729643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:21.732527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:21.734067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-902f519a-0012-4be3-8537-2bc24c4d7bfa tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1729 microversion: 2.25 time: 0.612417 Jul 14 14:45:21.747906 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 852/1637] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:21 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1729 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:21.753381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:21.756560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:21.757628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:21.767054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.769119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.770491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.771221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.772080 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-61d06e72-3ad3-4d35-a4a5-fe38ed904a62 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 200 len: 1506 microversion: 2.1 time: 0.734548 Jul 14 14:45:21.773157 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 786/1638] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:21 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 1506 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:21.778684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:21.782699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:21.790525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:21.805405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.805855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:21.807494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:21.808105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:22.950444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:22.977988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0790d20b-6ab8-40e6-818f-0e9a0f0c6e0f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1183 microversion: 2.1 time: 1.228471 Jul 14 14:45:22.995384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 853/1639] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:21 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1183 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:23.008062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.008835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.029866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.030319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.031122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.042777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.092112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:23.117789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.136427 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-179d2baa-a672-4992-a587-0b6a71efab2c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 1.353652 Jul 14 14:45:23.139827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 787/1640] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:21 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:23.159538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.166540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.206907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.207432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.208516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.211220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.268229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:23.290764 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1cf974ae-d6f5-4dc7-987e-1e302ea4a254 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 204 len: 0 microversion: 2.1 time: 0.302615 Jul 14 14:45:23.297409 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 854/1641] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:22 2022] DELETE /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:23.317331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:23.318299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:23.327799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.328137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.328922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:23.329359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:23.912449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.963870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.984348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:23.987116 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-afc777bb-37e8-4bd0-bd22-3ddb597f71d4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1729 microversion: 2.25 time: 0.687006 Jul 14 14:45:24.003836 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 855/1642] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:23 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1729 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:24.029268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-2125940322", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e576d3b6-a989-4f8c-ac73-d2914dd9164a"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:24.222075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] validate_networks() for [('e576d3b6-a989-4f8c-ac73-d2914dd9164a', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:25.652574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:25.665117 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c932d28f-0401-4699-a6a1-281af414add9 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 2.523680 Jul 14 14:45:25.684856 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 788/1643] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:23 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:25.695700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6e371d01-5860-42ee-b4a0-da14fc280eb5 req-1fa20fe1-44d3-483c-9be1-acc41aeda25d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e878a48-864c-4baa-a78b-b7904e1d5947", "name": "network-vif-plugged", "status": "completed", "tag": "56b4b66f-5fff-48fd-8a3a-eec9bc1fe627"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:25.717452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6e371d01-5860-42ee-b4a0-da14fc280eb5 req-1fa20fe1-44d3-483c-9be1-acc41aeda25d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.718341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6e371d01-5860-42ee-b4a0-da14fc280eb5 req-1fa20fe1-44d3-483c-9be1-acc41aeda25d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.750938 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6e371d01-5860-42ee-b4a0-da14fc280eb5 req-1fa20fe1-44d3-483c-9be1-acc41aeda25d service nova] Creating event network-vif-plugged:56b4b66f-5fff-48fd-8a3a-eec9bc1fe627 for instance 9e878a48-864c-4baa-a78b-b7904e1d5947 on n-h2-768852-23 Jul 14 14:45:25.773100 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6e371d01-5860-42ee-b4a0-da14fc280eb5 req-1fa20fe1-44d3-483c-9be1-acc41aeda25d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086816 Jul 14 14:45:25.774148 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 789/1644] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:25.783148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:25.787376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:25.808880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.809515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.810467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.811028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.854955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:25.856239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:25.856919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:25.857542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:25.858131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:25.885967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.887000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.896879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:25.897669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:25.968677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Getting quotas for project 33d5773713f8495c9018a5aaed6fd744. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:25.985489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Getting quotas for user c2e85acbfcdc4b3a813830d6723b006f and project 33d5773713f8495c9018a5aaed6fd744. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:26.037868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:26.041784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:26.175677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5322087e-7102-4bb1-a983-4363b04619f3 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.169626 Jul 14 14:45:26.177870 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 856/1645] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:45:26.190971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:26.192059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:26.208484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.209695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.210861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.211642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.537184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:26.548907 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a7db9ef-f113-44db-87e8-3e434400c9fb tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1183 microversion: 2.1 time: 0.772357 Jul 14 14:45:26.550693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 790/1646] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:25 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1183 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:26.578979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:26.580536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:26.605003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.605975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.608114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:26.614290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:26.992978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:27.041542 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-126be25e-f767-473f-88d1-07b0ca2060a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 0.861099 Jul 14 14:45:27.046619 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 857/1647] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:26 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:27.070001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5b22eb1e-75bf-44e5-90ea-d1fe47590097 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:27.072281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5b22eb1e-75bf-44e5-90ea-d1fe47590097 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:27.416800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5b22eb1e-75bf-44e5-90ea-d1fe47590097 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:27.425761 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5b22eb1e-75bf-44e5-90ea-d1fe47590097 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1218 microversion: 2.1 time: 0.362240 Jul 14 14:45:27.430713 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 858/1648] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:27 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1218 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:27.442232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:27.444210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:27.465059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:27.465860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:27.469403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:27.471261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.082596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:28.146971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:28.162375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:28.170563 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12c10706-69d4-45d9-9b62-694c4de95d8a tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1729 microversion: 2.25 time: 1.611155 Jul 14 14:45:28.174202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 791/1649] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:26 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1729 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:28.212114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:28.218757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:28.222587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:28.240898 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ea542e3-84b1-4055-9b46-edb550d98a35 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1320 microversion: 2.1 time: 0.807102 Jul 14 14:45:28.255813 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 859/1650] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:27 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1320 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:28.272419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:28.273593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.274573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:28.275387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.278622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4d0c2174-9f82-43ef-b00c-598c388ec605 req-c5a820ff-9f14-4ddb-8518-dee3ed31a0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ec69c9-3f5b-42a4-89f5-49c7eb47b345", "name": "network-vif-plugged", "status": "completed", "tag": "b9069033-6805-45c0-ad9a-c4a6644ff560"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:28.341604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4d0c2174-9f82-43ef-b00c-598c388ec605 req-c5a820ff-9f14-4ddb-8518-dee3ed31a0fe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:28.341604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4d0c2174-9f82-43ef-b00c-598c388ec605 req-c5a820ff-9f14-4ddb-8518-dee3ed31a0fe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.406154 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4d0c2174-9f82-43ef-b00c-598c388ec605 req-c5a820ff-9f14-4ddb-8518-dee3ed31a0fe service nova] Creating event network-vif-plugged:b9069033-6805-45c0-ad9a-c4a6644ff560 for instance c2ec69c9-3f5b-42a4-89f5-49c7eb47b345 on n-h1-768852-23 Jul 14 14:45:28.442226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4d0c2174-9f82-43ef-b00c-598c388ec605 req-c5a820ff-9f14-4ddb-8518-dee3ed31a0fe service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176772 Jul 14 14:45:28.448706 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 860/1651] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:28.474496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:28.476627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:28.515521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:28.516922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.518704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:28.523057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.718086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:28.738658 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e1ffeac-9481-4f18-b430-4b2351ac9be1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1183 microversion: 2.1 time: 0.560455 Jul 14 14:45:28.744492 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 792/1652] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:28 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1183 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:28.807360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d2cd09cf-be38-4bb9-841f-fc8f4c315d12 req-edd2ebd3-e60a-4459-8b46-991ac4f00207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b94f2422-b740-4908-9dc5-514fb8b99257", "name": "network-vif-deleted", "tag": "62beb0f4-308f-4b74-86e1-e346e3c55e99"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:28.839222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d2cd09cf-be38-4bb9-841f-fc8f4c315d12 req-edd2ebd3-e60a-4459-8b46-991ac4f00207 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:28.843492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d2cd09cf-be38-4bb9-841f-fc8f4c315d12 req-edd2ebd3-e60a-4459-8b46-991ac4f00207 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:28.983643 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d2cd09cf-be38-4bb9-841f-fc8f4c315d12 req-edd2ebd3-e60a-4459-8b46-991ac4f00207 service nova] Creating event network-vif-deleted:62beb0f4-308f-4b74-86e1-e346e3c55e99 for instance b94f2422-b740-4908-9dc5-514fb8b99257 on n-h1-768852-23 Jul 14 14:45:28.995775 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d2cd09cf-be38-4bb9-841f-fc8f4c315d12 req-edd2ebd3-e60a-4459-8b46-991ac4f00207 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246756 Jul 14 14:45:29.001335 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 793/1653] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:29.023471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:29.026564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:29.041546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.042866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.044812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.046434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.270428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.282986 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44a89609-e659-4404-b6be-f3442cc3077f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 0.832002 Jul 14 14:45:29.291029 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 861/1654] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:28 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:29.414033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.428924 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19f0f7a8-fd99-4694-98d3-9218d7d00dfd tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1278 microversion: 2.1 time: 0.425589 Jul 14 14:45:29.432795 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 794/1655] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:29 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1278 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:29.441297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:29.450320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1896631556", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f9874e65-6a5a-4909-a616-16d8c1f3be84"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:29.455987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:29.472815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.475420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.478379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.478865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.575345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] validate_networks() for [('f9874e65-6a5a-4909-a616-16d8c1f3be84', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:29.897608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.917821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.920793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:29.922713 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ffee36c-ecc4-4f82-9f54-b8c2627596ad tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1662 microversion: 2.25 time: 0.487575 Jul 14 14:45:29.923680 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 795/1656] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:29 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1662 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:29.939434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:29.944382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:29.965914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.966839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:29.968016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:29.968721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.614611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.627677 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4491726-46a2-4262-a740-448172787263 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 200 len: 1509 microversion: 2.1 time: 0.698189 Jul 14 14:45:30.631879 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 796/1657] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:29 2022] GET /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 1509 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:30.640021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.647811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.661950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.662939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.667562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.668271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.691992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:30.693089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:30.693763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:30.695136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:30.695826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:30.718995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.722956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.724215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.724843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.792140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Getting quotas for project a22f9857a34e48f7bc5d2bd97ef02b14. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:30.807493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Getting quotas for user f1d8ca06f8d2469382275fd2e36c538c and project a22f9857a34e48f7bc5d2bd97ef02b14. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:30.847874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:30.855724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:30.882953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:30.893701 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-566ec92c-d209-4b2f-8f77-8aa3968ad775 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 200 len: 1183 microversion: 2.1 time: 0.259922 Jul 14 14:45:30.903963 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 797/1658] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 1183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:30.911207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:30.919154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:30.943239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.944169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:30.945497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:30.946310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.019048 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25cbf699-3341-49a3-8323-0cf544bb7f71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.726185 Jul 14 14:45:31.020086 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 862/1659] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:45:31.026809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.027537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.034940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.035554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.036356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.037073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.173745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.187263 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c8b65d9d-8f34-4c9c-97a9-7d99a611381a tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1276 microversion: 2.1 time: 0.166017 Jul 14 14:45:31.210315 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 863/1660] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:31.218001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fd70fcb5-430e-4df4-ab84-e4bca147e683 req-155bc124-76e9-4611-8010-422804dfc19e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af4b5e3c-acb9-4a72-950d-fbeeaea1f43c", "name": "network-vif-deleted", "tag": "7ed5d206-01c7-4418-b25a-71c095637230"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:31.229668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fd70fcb5-430e-4df4-ab84-e4bca147e683 req-155bc124-76e9-4611-8010-422804dfc19e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.230599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fd70fcb5-430e-4df4-ab84-e4bca147e683 req-155bc124-76e9-4611-8010-422804dfc19e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.255482 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fd70fcb5-430e-4df4-ab84-e4bca147e683 req-155bc124-76e9-4611-8010-422804dfc19e service nova] Creating event network-vif-deleted:7ed5d206-01c7-4418-b25a-71c095637230 for instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c on n-h2-768852-23 Jul 14 14:45:31.275075 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fd70fcb5-430e-4df4-ab84-e4bca147e683 req-155bc124-76e9-4611-8010-422804dfc19e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063242 Jul 14 14:45:31.276324 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 864/1661] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:31.299600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.300344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: c2ec69c9-3f5b-42a4-89f5-49c7eb47b345] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.329414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.329902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.330970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.331458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.481504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.507542 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-956d97d0-e3c4-435c-b636-1780ac0dfc2a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 0.585871 Jul 14 14:45:31.509903 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 798/1662] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:30 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:31.518598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.519837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:31.542594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.550438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.555464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.556753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.634774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.635927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.635927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lazy-loading 'fault' on Instance uuid af4b5e3c-acb9-4a72-950d-fbeeaea1f43c {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:31.768393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:31.781130 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29de5058-b04b-4fa0-98a0-4a8ae9234edf tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/c2ec69c9-3f5b-42a4-89f5-49c7eb47b345" status: 200 len: 1508 microversion: 2.1 time: 0.501463 Jul 14 14:45:31.782633 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 865/1663] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/c2ec69c9-3f5b-42a4-89f5-49c7eb47b345 => generated 1508 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:31.788398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9806f2bd-03cc-4cf1-878e-c48d82136f5b req-3491e746-9f90-489c-87f8-af809d93d243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f2e64a-ba04-4c1b-a5e0-695662b50049", "name": "network-vif-plugged", "status": "completed", "tag": "1a777028-769e-451b-9c9e-fb8e866176b6"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:31.800962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9806f2bd-03cc-4cf1-878e-c48d82136f5b req-3491e746-9f90-489c-87f8-af809d93d243 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:31.803312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9806f2bd-03cc-4cf1-878e-c48d82136f5b req-3491e746-9f90-489c-87f8-af809d93d243 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:31.858202 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9806f2bd-03cc-4cf1-878e-c48d82136f5b req-3491e746-9f90-489c-87f8-af809d93d243 service nova] Creating event network-vif-plugged:1a777028-769e-451b-9c9e-fb8e866176b6 for instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 on n-h2-768852-23 Jul 14 14:45:31.873798 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9806f2bd-03cc-4cf1-878e-c48d82136f5b req-3491e746-9f90-489c-87f8-af809d93d243 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088873 Jul 14 14:45:31.875794 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 866/1664] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:31.888411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b77b26da-4c01-49de-9700-4dedce61cd41 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:31.891059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b77b26da-4c01-49de-9700-4dedce61cd41 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.092959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b77b26da-4c01-49de-9700-4dedce61cd41 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:32.138826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b77b26da-4c01-49de-9700-4dedce61cd41 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1224 microversion: 2.1 time: 0.260349 Jul 14 14:45:32.163160 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 867/1665] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1224 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:32.181739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.201367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: c2ec69c9-3f5b-42a4-89f5-49c7eb47b345] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.245367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.248536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.251681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.254590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.357057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: c2ec69c9-3f5b-42a4-89f5-49c7eb47b345] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:32.590425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:32.608779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:32.613647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:32.617892 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c562fe12-8d2f-4efd-8fad-beec1b1c3092 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 200 len: 1373 microversion: 2.25 time: 1.106375 Jul 14 14:45:32.623590 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 799/1666] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:31 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 1373 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:32.633725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.637472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: e7b060b5-502d-43ad-b5d9-487f0a89e438] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.659675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.664199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.665580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.666348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.705102 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] HTTP exception thrown: Instance e7b060b5-502d-43ad-b5d9-487f0a89e438 could not be found. Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Request method failure captured: Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 HTTP/1.1 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoFYJbWrcmWZZZ5hNC9FRWxT37HF6JnDQ8WEerQO1kzZp_4k1mCSQv7NYx6RZrk0WM0rJSKt_hAgT7PdcluavBAtVnAUEDqXPBe-BoDQdwX9RgamGFeMERe4JKJGkzCKwkkhiAtXVGKkf7X64gQUGTmf9nNVP1A6rbSZPfuUyJ252w Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c46a694ba42e4d1ba55d161224195378"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveMigrationTest-470070867 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveMigrationTest-470070867-project Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 038556a90129478eb04699f574ea7e1b Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveMigrationTest-470070867-project Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e7b060b5-502d-43ad-b5d9-487f0a89e438 could not be found. Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e7b060b5-502d-43ad-b5d9-487f0a89e438'} Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7b060b5-502d-43ad-b5d9-487f0a89e438 could not be found. Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7b060b5-502d-43ad-b5d9-487f0a89e438 could not be found. Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:32.707406 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7b060b5-502d-43ad-b5d9-487f0a89e438 could not be found. Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:32.717745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Returning 404 to user: Instance e7b060b5-502d-43ad-b5d9-487f0a89e438 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:32.723526 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ecff6139-f18d-4172-b107-8092bec92ab4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438" status: 404 len: 111 microversion: 2.1 time: 0.093826 Jul 14 14:45:32.724349 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 800/1667] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:32 2022] GET /compute/v2.1/servers/e7b060b5-502d-43ad-b5d9-487f0a89e438 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:32.733628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.734683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.764674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.769804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.775820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.780679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.832379 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fdb8aede-5839-448c-98ac-c8609cbada80 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c2ec69c9-3f5b-42a4-89f5-49c7eb47b345" status: 204 len: 0 microversion: 2.1 time: 0.666682 Jul 14 14:45:32.847297 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 868/1668] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:32 2022] DELETE /compute/v2.1/servers/c2ec69c9-3f5b-42a4-89f5-49c7eb47b345 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:32.869376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:32.879908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:32.911841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.912777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:32.914216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:32.914991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.394924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.411352 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-90e6a53a-0dcf-4527-9959-1ab90b99e888 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1276 microversion: 2.1 time: 0.684765 Jul 14 14:45:33.416505 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 801/1669] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:32 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1276 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.428204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.429191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:33.448227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.451227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.452086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.453189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.453831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.461239 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93d957e4-340c-46f7-ba7e-5d8c05343295 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 0.608742 Jul 14 14:45:33.478935 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 869/1670] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:32 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.494069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.495384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:33.504644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.505620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.508384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.509901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.512998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 9e878a48-864c-4baa-a78b-b7904e1d5947] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:33.740061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c48495fb-b6ae-4cf8-9f2f-c2b738fba399 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947" status: 204 len: 0 microversion: 2.1 time: 0.320378 Jul 14 14:45:33.753630 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 802/1671] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:33 2022] DELETE /compute/v2.1/servers/9e878a48-864c-4baa-a78b-b7904e1d5947 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:33.766013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.766670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: af4b5e3c-acb9-4a72-950d-fbeeaea1f43c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:33.776165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.776629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.777640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:33.778236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:33.780688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:33.802277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:33.806854 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] HTTP exception thrown: Instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c could not be found. Jul 14 14:45:33.810039 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b298495a-2e7e-4e5d-848b-1a2af9602871 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1276 microversion: 2.1 time: 0.323886 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Request method failure captured: Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c HTTP/1.1 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CnYiFmtRXm2zUDE4MFWtt6EWPWhSlx3gFX_2Qxl5UEXOutgKNJ-t1A4IGPLAir7-1ersxtPXMuxsF-JSvxmdwIzFwQo7QWhsxkN6HaBYBzr70C1Ek1-ZlB976rXgWQLt2tsMYU0KiXSiC7wAEsu4c8AjJCWrJx4f7WMWRnI8keW-F8 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: aeb3928894284b77b4aea925a38470ba Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c could not be found. Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'af4b5e3c-acb9-4a72-950d-fbeeaea1f43c'} Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c could not be found. Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c could not be found. Jul 14 14:45:33.810463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c could not be found. Jul 14 14:45:33.815114 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:33.817443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Returning 404 to user: Instance af4b5e3c-acb9-4a72-950d-fbeeaea1f43c could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:33.819530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 870/1672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:33 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1276 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:33.830735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57dcab3a-dbac-44f8-b693-e901661bc6f2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c" status: 404 len: 111 microversion: 2.25 time: 0.073792 Jul 14 14:45:33.834709 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 803/1673] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:33 2022] GET /compute/v2.1/servers/af4b5e3c-acb9-4a72-950d-fbeeaea1f43c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:33.847160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-487e78a9-f627-4a80-a054-c9f52015d2d5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '.version_select at 0x7fdbf2aaac10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:33.938785 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-487e78a9-f627-4a80-a054-c9f52015d2d5 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766830501" status: 204 len: 0 microversion: 2.25 time: 0.099330 Jul 14 14:45:33.952913 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 871/1674] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:45:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766830501 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:45:34.027734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-677148049", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "781c86c8-ccd7-4cf6-aab5-956819ecdda1"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:34.334982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] validate_networks() for [('781c86c8-ccd7-4cf6-aab5-956819ecdda1', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:45:34.452974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:34.453629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:34.488983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.492072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.497784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.507859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.755179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:34.760032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:34.777390 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cf655f89-d57b-45c1-aab4-2174ea31f644 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1276 microversion: 2.1 time: 0.338124 Jul 14 14:45:34.796512 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 872/1675] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:34 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:34.802255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:34.803210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:34.825772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.826639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:34.827766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:34.828462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.164050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:36.204494 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5b3e4da1-bccc-400a-ac65-790a8295d810 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1307 microversion: 2.1 time: 1.401570 Jul 14 14:45:36.207626 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 873/1676] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:34 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1307 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:36.238448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:36.240030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:36.261146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.268410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.272948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.276853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.491707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:36.522390 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d96110ed-f211-45d8-b627-f0676390a766 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1282 microversion: 2.1 time: 0.309891 Jul 14 14:45:36.528272 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 874/1677] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:36 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1282 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:36.552280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:36.554343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:36.585029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.586631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:36.593228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:36.599101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.413920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:37.443355 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10c4c2da-3029-4cc4-92bc-0fe3fc13fa3e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 0.913279 Jul 14 14:45:37.449366 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 875/1678] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:36 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:37.457749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:37.465078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:37.489660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.495667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.501092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.502415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.753203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:37.764888 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-629b686f-4f7a-49a4-936d-8958c085248a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1487 microversion: 2.1 time: 0.313790 Jul 14 14:45:37.766364 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 876/1679] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:37 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1487 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:37.771746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d4c0f918-fbe4-491e-a45c-0000557435a5 req-7d5fbdeb-62d0-418a-ba4f-c1c2a435da3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2ec69c9-3f5b-42a4-89f5-49c7eb47b345", "name": "network-vif-deleted", "tag": "b9069033-6805-45c0-ad9a-c4a6644ff560"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:37.783671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d4c0f918-fbe4-491e-a45c-0000557435a5 req-7d5fbdeb-62d0-418a-ba4f-c1c2a435da3e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.784488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d4c0f918-fbe4-491e-a45c-0000557435a5 req-7d5fbdeb-62d0-418a-ba4f-c1c2a435da3e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.805964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d4c0f918-fbe4-491e-a45c-0000557435a5 req-7d5fbdeb-62d0-418a-ba4f-c1c2a435da3e service nova] Creating event network-vif-deleted:b9069033-6805-45c0-ad9a-c4a6644ff560 for instance c2ec69c9-3f5b-42a4-89f5-49c7eb47b345 on n-h1-768852-23 Jul 14 14:45:37.817213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d4c0f918-fbe4-491e-a45c-0000557435a5 req-7d5fbdeb-62d0-418a-ba4f-c1c2a435da3e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049052 Jul 14 14:45:37.818560 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 877/1680] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:37.834548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:37.836072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:37.850293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.851071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.853006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:37.853972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:37.949926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:37.963190 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d30cfb0d-e416-4546-9eab-85afa1e598dd tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1282 microversion: 2.1 time: 0.137039 Jul 14 14:45:37.964029 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 878/1681] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:37 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:37.970093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:37.977335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:37.994325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:45:37.994908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:45:37.995260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:45:37.995787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:45:37.996364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:45:37.999925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:38.010437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.010958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.012011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.012470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.058953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:38.061097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.065370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.068699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.069819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.142695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Getting quotas for project 9aea3a0d9920482abbbcb6c186504ed2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:45:38.158958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Getting quotas for user 8413b54e750c4f178c419c2b4f31d38e and project 9aea3a0d9920482abbbcb6c186504ed2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:45:38.241816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Going to run 2 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:45:38.274134 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7252364-f34d-4f92-a770-1e360b56e495 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 204 len: 0 microversion: 2.25 time: 0.308469 Jul 14 14:45:38.274921 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 879/1682] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:45:37 2022] DELETE /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:45:38.279878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:38.288371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:38.288868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.317438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=3,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:38.329067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.337219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.339245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.340778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.380397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=5a23bc51-4fb5-43b5-b1fb-2570dad40226,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:45:38.531783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5563d010-d798-435d-8794-89a0f6704b32 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049/action" status: 202 len: 0 microversion: 2.1 time: 0.254893 Jul 14 14:45:38.537627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 880/1683] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:38 2022] POST /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:38.549430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.550989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.568942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.569932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.572132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.572925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.609838 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d10f4610-f7f2-4873-bbc4-ef9c2fae3bfe tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 4.610520 Jul 14 14:45:38.616262 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 804/1684] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:45:33 2022] POST /compute/v2.1/servers => generated 32 bytes in 4619 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:45:38.629071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.630012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.662793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.663760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.666045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.670199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.914492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.930652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.932387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:38.936830 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57531991-d4cb-49a3-8e82-360248577f23 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1550 microversion: 2.25 time: 0.397079 Jul 14 14:45:38.939126 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 881/1685] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1550 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:38.946539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:38.947571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:38.976806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.979258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:38.983424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:38.984749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.283625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.293396 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-404a7e21-dd78-4bc1-aa21-6198e01c3ba1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1492 microversion: 2.1 time: 0.352237 Jul 14 14:45:39.303328 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 882/1686] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1492 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.303328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.313197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.313197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Searching by: {'deleted': False, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:45:39.341027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.341738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.342646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.343165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.398888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:45:39.441964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fdb0663d-3680-4c5a-8f0a-becb480818bd tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.145818 Jul 14 14:45:39.453151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 883/1687] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers => generated 1003 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.453151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.453151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:39.457966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.458424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.459529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:39.459738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:39.588299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.600921 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3363c3ac-2c32-408f-bb5f-43390c8f8807 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1282 microversion: 2.1 time: 0.156544 Jul 14 14:45:39.603971 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 884/1688] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1282 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.617400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c83628bb-0a09-41af-8186-fdc10347f54e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.624220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c83628bb-0a09-41af-8186-fdc10347f54e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:39.730924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c83628bb-0a09-41af-8186-fdc10347f54e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:39.747419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c83628bb-0a09-41af-8186-fdc10347f54e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1217 microversion: 2.1 time: 0.141184 Jul 14 14:45:39.749747 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 885/1689] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1217 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:39.976593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:39.977455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:39.994648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.001330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.002654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.002654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.315094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:40.331607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:40.333397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:40.334767 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10c69449-b2d9-4353-a485-60d361da2013 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1550 microversion: 2.25 time: 0.364100 Jul 14 14:45:40.341466 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 886/1690] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:39 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1550 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:40.347653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:40.359776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:40.366882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.367381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.368769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.369269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.762465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:40.778958 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3db5ef2-e603-444a-9742-9f4f66fad9ba tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 200 len: 1472 microversion: 2.1 time: 0.436549 Jul 14 14:45:40.811370 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 887/1691] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:40 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 1472 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:40.826978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:40.830711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:40.860527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.861092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.861938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:40.862449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:40.867534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:41.201141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.227352 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b392ce8-f271-4f56-a172-018760324b71 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1282 microversion: 2.1 time: 0.413751 Jul 14 14:45:41.227352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 888/1692] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:40 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1282 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:41.227931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:41.228724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:41.251817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.254181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.260063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.260804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.369152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.372640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:41.387671 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57989d70-7186-47a1-92f7-dbf56526b43e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 2.769701 Jul 14 14:45:41.388173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2df18f61-b571-4be3-9e36-1e1c96dc269f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1269 microversion: 2.1 time: 0.164323 Jul 14 14:45:41.389014 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 889/1693] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:41 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:41.390662 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 805/1694] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:38 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 2774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:41.400745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:41.401953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:41.403600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1894674921"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:41.404772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:41.417799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.418096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.422132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.423370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.424236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.424975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.425128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:41.425543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:41.518802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:42.110204 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9c65b7c6-4550-44a1-859f-43c96b07f78f tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 204 len: 0 microversion: 2.1 time: 0.711357 Jul 14 14:45:42.115157 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 806/1695] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:41 2022] DELETE /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:42.129288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:42.131158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:42.143426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.144283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.146002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.148047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.610260 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c390d82-58ea-4983-97d8-bff7f2da1a97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049/action" status: 202 len: 0 microversion: 2.1 time: 1.219965 Jul 14 14:45:42.616810 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 890/1696] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:45:41 2022] POST /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049/action => generated 0 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:45:42.630999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cd839ac7-9d5c-4865-876a-0914706548f5 req-2f26cf0f-0a6f-49e0-9641-52982e3e5565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e878a48-864c-4baa-a78b-b7904e1d5947", "name": "network-vif-deleted", "tag": "56b4b66f-5fff-48fd-8a3a-eec9bc1fe627"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:42.661179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cd839ac7-9d5c-4865-876a-0914706548f5 req-2f26cf0f-0a6f-49e0-9641-52982e3e5565 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.661841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cd839ac7-9d5c-4865-876a-0914706548f5 req-2f26cf0f-0a6f-49e0-9641-52982e3e5565 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.707000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cd839ac7-9d5c-4865-876a-0914706548f5 req-2f26cf0f-0a6f-49e0-9641-52982e3e5565 service nova] Creating event network-vif-deleted:56b4b66f-5fff-48fd-8a3a-eec9bc1fe627 for instance 9e878a48-864c-4baa-a78b-b7904e1d5947 on n-h2-768852-23 Jul 14 14:45:42.722498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cd839ac7-9d5c-4865-876a-0914706548f5 req-2f26cf0f-0a6f-49e0-9641-52982e3e5565 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103583 Jul 14 14:45:42.723239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 891/1697] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:42.734592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:42.735814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:42.747571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.748262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:42.749111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:42.749872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.094644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:43.133099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:43.136956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:43.150954 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b99bd8d-f35c-4041-9fe1-89f1f3a25fdd tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1550 microversion: 2.25 time: 1.031766 Jul 14 14:45:43.152885 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 807/1698] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:42 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1550 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:43.183134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:43.184702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:43.215233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.226406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.230900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.235700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.730440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:43.743717 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1652f09-9146-4737-8b37-f74829a90c68 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1669 microversion: 2.1 time: 1.011392 Jul 14 14:45:43.745089 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 892/1699] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:42 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1669 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:43.755106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:43.757674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:43.785927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.786386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:43.787237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:43.788108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.073446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.107596 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-abb09a7b-f86e-47af-9730-8f1c626de426 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1275 microversion: 2.1 time: 0.351274 Jul 14 14:45:44.108546 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 893/1700] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:43 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1275 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:44.118876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.120682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.137984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.140638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.142531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.145675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.226059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.254430 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-917abb80-4e2b-4d44-a562-0d6b1c50c2b9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 1.096481 Jul 14 14:45:44.255473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 808/1701] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:43 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:44.312772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-017ed16e-22f3-4bca-a8dd-719f5b0c4be0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bfb5e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.468319 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-017ed16e-22f3-4bca-a8dd-719f5b0c4be0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.162440 Jul 14 14:45:44.478194 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 809/1702] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:44.500823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.510148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.550095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.551330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.553328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.554443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.722434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.735462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.736673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lazy-loading 'fault' on Instance uuid e9124379-a3fd-4713-95b4-58082d5fbfd5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:44.788324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.830680 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73e2fa52-363c-40c7-ae73-a18c5fc83ff1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 0.719398 Jul 14 14:45:44.841942 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 894/1703] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:44.862257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:44.866781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:44.883542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.886214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.888406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:44.889504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:44.938827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.970911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.977514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:44.991317 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5652344-780b-4a67-9a89-75541e393204 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 200 len: 1352 microversion: 2.25 time: 0.509640 Jul 14 14:45:45.003339 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 810/1704] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 1352 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:45.013602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9fe2b56f-261e-49fb-9faf-9d76200002c5 req-a739af7d-a70b-44f0-b665-c7802acff2bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1f58dec-0020-4bce-9a9d-9686eb2c59fa", "tag": "7c7a36ea-9457-428c-88e9-4eda827252d0"}, {"server_uuid": "e9124379-a3fd-4713-95b4-58082d5fbfd5", "name": "network-vif-deleted", "tag": "bfb56fd2-1132-4057-9a78-9ff419df67a8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:45.055155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9fe2b56f-261e-49fb-9faf-9d76200002c5 req-a739af7d-a70b-44f0-b665-c7802acff2bc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.057332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9fe2b56f-261e-49fb-9faf-9d76200002c5 req-a739af7d-a70b-44f0-b665-c7802acff2bc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.109005 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9fe2b56f-261e-49fb-9faf-9d76200002c5 req-a739af7d-a70b-44f0-b665-c7802acff2bc service nova] Creating event network-changed:7c7a36ea-9457-428c-88e9-4eda827252d0 for instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa on n-h1-768852-23 Jul 14 14:45:45.114826 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9fe2b56f-261e-49fb-9faf-9d76200002c5 req-a739af7d-a70b-44f0-b665-c7802acff2bc service nova] Creating event network-vif-deleted:bfb56fd2-1132-4057-9a78-9ff419df67a8 for instance e9124379-a3fd-4713-95b4-58082d5fbfd5 on n-h2-768852-23 Jul 14 14:45:45.148152 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9fe2b56f-261e-49fb-9faf-9d76200002c5 req-a739af7d-a70b-44f0-b665-c7802acff2bc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.146908 Jul 14 14:45:45.153681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 811/1705] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:45.165120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:45.166900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.199915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.201360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.203100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.204601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.453888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:45.468388 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d35c982-3293-4521-bd65-e8e1a1201c2b tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1275 microversion: 2.1 time: 0.312262 Jul 14 14:45:45.480848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 812/1706] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:45 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1275 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:45.487486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:45.489153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:45.507105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.507810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.509573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:45.510258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:45.918963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:45.957595 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b501946d-5f67-40bf-8d05-4c8ed3949d95 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 0.474580 Jul 14 14:45:45.965188 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 813/1707] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:45 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:45.981922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d8a0db6-8057-4b43-9612-95fb3072d947 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bfcee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.127210 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d8a0db6-8057-4b43-9612-95fb3072d947 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.150506 Jul 14 14:45:46.139380 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 814/1708] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:45 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:46.139380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.140059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.161927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.164064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.166137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.167099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.242264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.274059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1579d61a-faf7-43d7-96e5-b7727b89f4f4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1669 microversion: 2.1 time: 1.428409 Jul 14 14:45:46.280196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 895/1709] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:44 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1669 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:46.325963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.326645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: e9124379-a3fd-4713-95b4-58082d5fbfd5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.350834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.353496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.354442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.354883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.394312 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] HTTP exception thrown: Instance e9124379-a3fd-4713-95b4-58082d5fbfd5 could not be found. Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Request method failure captured: Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 HTTP/1.1 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CnYiFmtRXm2zUDE4MFWtt6EWPWhSlx3gFX_2Qxl5UEXOutgKNJ-t1A4IGPLAir7-1ersxtPXMuxsF-JSvxmdwIzFwQo7QWhsxkN6HaBYBzr70C1Ek1-ZlB976rXgWQLt2tsMYU0KiXSiC7wAEsu4c8AjJCWrJx4f7WMWRnI8keW-F8 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: aeb3928894284b77b4aea925a38470ba Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance e9124379-a3fd-4713-95b4-58082d5fbfd5 could not be found. Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e9124379-a3fd-4713-95b4-58082d5fbfd5'} Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9124379-a3fd-4713-95b4-58082d5fbfd5 could not be found. Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9124379-a3fd-4713-95b4-58082d5fbfd5 could not be found. Jul 14 14:45:46.396736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9124379-a3fd-4713-95b4-58082d5fbfd5 could not be found. Jul 14 14:45:46.403872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:45:46.406311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Returning 404 to user: Instance e9124379-a3fd-4713-95b4-58082d5fbfd5 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:46.408489 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c06ffd6-aac1-49c5-8bd6-22625a41c10c tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5" status: 404 len: 111 microversion: 2.25 time: 0.114232 Jul 14 14:45:46.409637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 896/1710] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/e9124379-a3fd-4713-95b4-58082d5fbfd5 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:46.427820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.428751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.457149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.457901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.458923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.459962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.534163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:46.736063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:46.751682 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0bb90138-b092-4f15-a29a-9cf0860dd6f4 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 204 len: 0 microversion: 2.25 time: 0.335440 Jul 14 14:45:46.754386 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 897/1711] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:45:46 2022] DELETE /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:45:46.779512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.780461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.789518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.790179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.790950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.795819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.801161 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4477362-c639-4baa-ad4c-189c1b2f9c2d tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 0.662734 Jul 14 14:45:46.807096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 815/1712] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:46.833293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:46.838402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:46.865486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.873697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:46.879825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:46.880590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.095576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:47.172625 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e1e2410-88ec-45cc-b2b0-fbde9978f902 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1275 microversion: 2.1 time: 0.408759 Jul 14 14:45:47.184258 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 898/1713] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1275 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:47.190205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:47.191100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:47.200778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.207165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:47.208584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:47.209292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.110767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:48.206181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:48.253430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.269700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.272284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.283153 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c58e3258-1ab2-4f10-9e41-a215cbe78a6e tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1564 microversion: 2.25 time: 1.459523 Jul 14 14:45:48.283880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 816/1714] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:46 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1564 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:48.299548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ac084a2-dcff-4d93-9f99-7d9d9df3ddb1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b8a1f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.394305 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ac084a2-dcff-4d93-9f99-7d9d9df3ddb1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.109090 Jul 14 14:45:48.402238 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 817/1715] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:48.409484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.410532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.423371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.424327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.425583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.426541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.702643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.720123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-200552c9-c16e-40c7-9c7f-e9d7bcb85666 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1602 microversion: 2.1 time: 0.316137 Jul 14 14:45:48.725665 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 818/1716] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1602 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:48.729711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:48.730352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:48.749320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.749741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.750688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.751149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.873080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:48.885512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-302be042-6647-402c-a71e-3f5722263f10 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 1.699683 Jul 14 14:45:48.900470 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 899/1717] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:47 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:48.914276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-696e06d9-a4e1-405f-a050-4e83ce9ecd79 req-a59f7027-729a-4dc6-859c-ec986afbbc5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:48.949273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-696e06d9-a4e1-405f-a050-4e83ce9ecd79 req-a59f7027-729a-4dc6-859c-ec986afbbc5c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:48.950369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-696e06d9-a4e1-405f-a050-4e83ce9ecd79 req-a59f7027-729a-4dc6-859c-ec986afbbc5c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:48.992480 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-696e06d9-a4e1-405f-a050-4e83ce9ecd79 req-a59f7027-729a-4dc6-859c-ec986afbbc5c service nova] Creating event network-changed:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:45:49.018142 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-696e06d9-a4e1-405f-a050-4e83ce9ecd79 req-a59f7027-729a-4dc6-859c-ec986afbbc5c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112663 Jul 14 14:45:49.020643 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 900/1718] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:49.037379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:49.041642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:49.064372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.067248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.074044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.074829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.356158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:49.744498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=18 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:49.828340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:49.864971 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cbc48950-5518-4e75-9262-f4f154c5f3b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 1.142564 Jul 14 14:45:49.884353 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 819/1719] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:48 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:49.893303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0d3f9a30-9ed7-41bb-a54c-947a5a309525 req-447aff1f-63e1-4347-9e2b-dac2c2ffba8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f2e64a-ba04-4c1b-a5e0-695662b50049", "name": "network-vif-plugged", "status": "completed", "tag": "1a777028-769e-451b-9c9e-fb8e866176b6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:49.930773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0d3f9a30-9ed7-41bb-a54c-947a5a309525 req-447aff1f-63e1-4347-9e2b-dac2c2ffba8d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:49.932037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0d3f9a30-9ed7-41bb-a54c-947a5a309525 req-447aff1f-63e1-4347-9e2b-dac2c2ffba8d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:49.972716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0d3f9a30-9ed7-41bb-a54c-947a5a309525 req-447aff1f-63e1-4347-9e2b-dac2c2ffba8d service nova] Creating event network-vif-plugged:1a777028-769e-451b-9c9e-fb8e866176b6 for instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 on n-h2-768852-23 Jul 14 14:45:49.999488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0d3f9a30-9ed7-41bb-a54c-947a5a309525 req-447aff1f-63e1-4347-9e2b-dac2c2ffba8d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112553 Jul 14 14:45:50.003716 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 820/1720] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:50.028388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:50.033071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:50.078020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.081958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.082839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:50.090242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:50.904730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.949533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.980592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:50.988223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eef524aa-55ca-4d57-b09e-373904d61256 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1564 microversion: 2.25 time: 0.976235 Jul 14 14:45:50.989830 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 821/1721] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1564 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:51.000208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67ace6f6-bee1-4535-81b2-4a60e3efe710 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf31e11f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.062067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.108484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-458ef0e9-cd0e-4ffc-8add-844ae07bab20 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 2.085941 Jul 14 14:45:51.124275 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 901/1722] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:49 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 2103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:51.156115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.157268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.177547 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67ace6f6-bee1-4535-81b2-4a60e3efe710 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.186207 Jul 14 14:45:51.179017 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 822/1723] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:50 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:51.192446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.198787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.202521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.205995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.208535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.217035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.230024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.239718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.240916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.242743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.686738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:51.698549 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c2be95d-4b87-4f8f-9d71-1bba874ff254 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 0.517420 Jul 14 14:45:51.715718 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 823/1724] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:51.722110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:51.722923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:51.736886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.737634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.738624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:51.740251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:51.811630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:52.338628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.353430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aff38e11-7dd2-439f-8e2a-5afb8c7d5db1 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 200 len: 1602 microversion: 2.1 time: 1.224403 Jul 14 14:45:52.356840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 902/1725] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 1602 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:52.371461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1f09575a-d51e-424a-96cd-405b69ca0d67 req-477dc7b2-779e-4c38-b6b1-526b5d993f83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d0e571-c557-48c6-90e4-e442642d46c5", "name": "network-vif-deleted", "tag": "6ba63c73-6333-45d6-bc42-bdcb5d30ae36"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:52.401684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1f09575a-d51e-424a-96cd-405b69ca0d67 req-477dc7b2-779e-4c38-b6b1-526b5d993f83 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.403467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1f09575a-d51e-424a-96cd-405b69ca0d67 req-477dc7b2-779e-4c38-b6b1-526b5d993f83 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.464089 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1f09575a-d51e-424a-96cd-405b69ca0d67 req-477dc7b2-779e-4c38-b6b1-526b5d993f83 service nova] Creating event network-vif-deleted:6ba63c73-6333-45d6-bc42-bdcb5d30ae36 for instance 26d0e571-c557-48c6-90e4-e442642d46c5 on n-h2-768852-23 Jul 14 14:45:52.487958 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1f09575a-d51e-424a-96cd-405b69ca0d67 req-477dc7b2-779e-4c38-b6b1-526b5d993f83 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126846 Jul 14 14:45:52.489346 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 903/1726] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:52.505148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:52.509265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:52.541705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.544232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.548376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.549433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.625249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:45:52.656226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:52.663530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.666189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.667842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lazy-loading 'fault' on Instance uuid 26d0e571-c557-48c6-90e4-e442642d46c5 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:45:52.668204 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e91799d0-2ebe-411f-b442-668599927900 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 0.950928 Jul 14 14:45:52.688852 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 824/1727] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:51 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:52.706122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:52.708879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:52.725527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.728835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.730058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:52.731923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:52.890415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.015685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.015685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aeb3928894284b77b4aea925a38470ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e033f599b294c1f9a66eb4703aba0e6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.042556 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f0dd5aab-ccd8-4526-8144-f75230ecd1c2 tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 200 len: 1352 microversion: 2.25 time: 0.551647 Jul 14 14:45:53.053670 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 904/1728] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:52 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 1352 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:45:53.059207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6594b7c-4db8-4c4d-bbc6-370000adf58e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2aa3040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.167337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6594b7c-4db8-4c4d-bbc6-370000adf58e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.111995 Jul 14 14:45:53.169445 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 905/1729] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:53.178259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-32f963be-8f0f-471d-8dd6-cb86f4d5e04f req-8d1c875a-972a-4418-a6c6-0977c14a43e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f58dec-0020-4bce-9a9d-9686eb2c59fa", "name": "network-vif-plugged", "status": "completed", "tag": "7c7a36ea-9457-428c-88e9-4eda827252d0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:53.192207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-32f963be-8f0f-471d-8dd6-cb86f4d5e04f req-8d1c875a-972a-4418-a6c6-0977c14a43e5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.192943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-32f963be-8f0f-471d-8dd6-cb86f4d5e04f req-8d1c875a-972a-4418-a6c6-0977c14a43e5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.214954 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-32f963be-8f0f-471d-8dd6-cb86f4d5e04f req-8d1c875a-972a-4418-a6c6-0977c14a43e5 service nova] Creating event network-vif-plugged:7c7a36ea-9457-428c-88e9-4eda827252d0 for instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa on n-h1-768852-23 Jul 14 14:45:53.230246 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-32f963be-8f0f-471d-8dd6-cb86f4d5e04f req-8d1c875a-972a-4418-a6c6-0977c14a43e5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058448 Jul 14 14:45:53.231547 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 906/1730] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:53.247100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-16121535-764e-4004-b134-b584b7bff358 req-5387f1e5-c721-446b-aba7-a31f844ca2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1f9073a-036c-4e55-ad3b-9fe405f9f1d3", "name": "network-vif-deleted", "tag": "5ba83425-caaf-4292-8d46-778b77d4fd16"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:53.277077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-16121535-764e-4004-b134-b584b7bff358 req-5387f1e5-c721-446b-aba7-a31f844ca2f9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.277564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-16121535-764e-4004-b134-b584b7bff358 req-5387f1e5-c721-446b-aba7-a31f844ca2f9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.303581 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-16121535-764e-4004-b134-b584b7bff358 req-5387f1e5-c721-446b-aba7-a31f844ca2f9 service nova] Creating event network-vif-deleted:5ba83425-caaf-4292-8d46-778b77d4fd16 for instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 on n-h1-768852-23 Jul 14 14:45:53.324860 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-16121535-764e-4004-b134-b584b7bff358 req-5387f1e5-c721-446b-aba7-a31f844ca2f9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091519 Jul 14 14:45:53.328934 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 907/1731] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:53.346045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.346792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:53.354008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.364070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.365211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.365894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.481956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:53.518033 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a61b8b71-cb27-4fab-9b17-ed90a3f77ce3 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 0.827661 Jul 14 14:45:53.533047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 825/1732] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:52 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:53.546271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.547900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: d1f9073a-036c-4e55-ad3b-9fe405f9f1d3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:53.560592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.561636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.567000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.568181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.605943 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] HTTP exception thrown: Instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 could not be found. Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Request method failure captured: Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 HTTP/1.1 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoFYJbWrcmWZZZ5hNC9FRWxT37HF6JnDQ8WEerQO1kzZp_4k1mCSQv7NYx6RZrk0WM0rJSKt_hAgT7PdcluavBAtVnAUEDqXPBe-BoDQdwX9RgamGFeMERe4JKJGkzCKwkkhiAtXVGKkf7X64gQUGTmf9nNVP1A6rbSZPfuUyJ252w Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c46a694ba42e4d1ba55d161224195378"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveMigrationTest-470070867 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveMigrationTest-470070867-project Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 038556a90129478eb04699f574ea7e1b Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveMigrationTest-470070867-project Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 could not be found. Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd1f9073a-036c-4e55-ad3b-9fe405f9f1d3'} Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 could not be found. Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 could not be found. Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:53.612268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:53.618499 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:53.618499 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:53.618499 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:53.618499 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:53.618499 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 could not be found. Jul 14 14:45:53.618499 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:53.619579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Returning 404 to user: Instance d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:53.623712 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cae9796d-9de5-47a5-88b5-5ae09bdfeef3 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3" status: 404 len: 111 microversion: 2.1 time: 0.094940 Jul 14 14:45:53.627886 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 826/1733] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/servers/d1f9073a-036c-4e55-ad3b-9fe405f9f1d3 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:45:53.657699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a28e3a35-6313-4651-8788-fc3b49abe678 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '.version_select at 0x7fdbf2b8ac10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.698968 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a28e3a35-6313-4651-8788-fc3b49abe678 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180841770" status: 202 len: 0 microversion: 2.1 time: 0.054137 Jul 14 14:45:53.699634 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 827/1734] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:45:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1180841770 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:45:53.736123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:53.737808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:53.759784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.760803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:53.763756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:53.764648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.133633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:54.152018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dab2dcfb-6910-473e-8c94-118290f529e4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 0.451251 Jul 14 14:45:54.162169 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 828/1735] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:54.168239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:54.172907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] [instance: 26d0e571-c557-48c6-90e4-e442642d46c5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:54.188643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.189759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.190805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.192778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.228710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] HTTP exception thrown: Instance 26d0e571-c557-48c6-90e4-e442642d46c5 could not be found. Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Request method failure captured: Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 HTTP/1.1 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CnYiFmtRXm2zUDE4MFWtt6EWPWhSlx3gFX_2Qxl5UEXOutgKNJ-t1A4IGPLAir7-1ersxtPXMuxsF-JSvxmdwIzFwQo7QWhsxkN6HaBYBzr70C1Ek1-ZlB976rXgWQLt2tsMYU0KiXSiC7wAEsu4c8AjJCWrJx4f7WMWRnI8keW-F8 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.25 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6e033f599b294c1f9a66eb4703aba0e6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 6e033f599b294c1f9a66eb4703aba0e6 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-970660682 Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: aeb3928894284b77b4aea925a38470ba Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-970660682-project Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 26d0e571-c557-48c6-90e4-e442642d46c5 could not be found. Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '26d0e571-c557-48c6-90e4-e442642d46c5'} Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26d0e571-c557-48c6-90e4-e442642d46c5 could not be found. Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26d0e571-c557-48c6-90e4-e442642d46c5 could not be found. Jul 14 14:45:54.230830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26d0e571-c557-48c6-90e4-e442642d46c5 could not be found. Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] Returning 404 to user: Instance 26d0e571-c557-48c6-90e4-e442642d46c5 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e15af1b-c563-4df7-9268-4000d35ef6bb tempest-LiveAutoBlockMigrationV225Test-970660682 tempest-LiveAutoBlockMigrationV225Test-970660682-project] 10.222.0.98 "GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5" status: 404 len: 111 microversion: 2.25 time: 0.068711 Jul 14 14:45:54.243557 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 829/1736] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:45:54 2022] GET /compute/v2.1/servers/26d0e571-c557-48c6-90e4-e442642d46c5 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:45:54.252525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b88d324-cb5b-4b0d-8705-8bd51e2d566f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf309e160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:54.532071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b88d324-cb5b-4b0d-8705-8bd51e2d566f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.288181 Jul 14 14:45:54.538838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 830/1737] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:54 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:54.566013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:54.571783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:54.611862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.612758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:54.621118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:54.622070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.247554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:55.256500 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1972bc40-7680-4ed6-b54b-d6ce2003f843 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 1.925745 Jul 14 14:45:55.261618 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 908/1738] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:53 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:55.276802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:55.283863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:55.295875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.296607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:55.297600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:55.298223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.148274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:56.166614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:56.204347 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3252a2e2-21d5-4a47-ad86-f72edad119d4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1318 microversion: 2.1 time: 0.940855 Jul 14 14:45:56.210266 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 909/1739] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:55 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1318 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:56.212748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-895d4c61-f14d-4815-9172-a7d788585b29 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 1.669718 Jul 14 14:45:56.218488 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 831/1740] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:54 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:56.237489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c45d6356-29b9-4006-8d57-f5ac89e763e8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bfc160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:56.363455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6dc12afd-ee5d-45f5-9d39-453e0f40edbd tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Action: 'create', calling method: .version_select at 0x7fdbf2aa3e50>, body: {"pool": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:56.369954 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c45d6356-29b9-4006-8d57-f5ac89e763e8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.146709 Jul 14 14:45:56.376616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 832/1741] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:56 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:56.382784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6932cfe0-f73e-4e76-87a5-37f35ae4f9f8 req-89f825f9-e7eb-4889-9bfb-2d2196629f2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a23bc51-4fb5-43b5-b1fb-2570dad40226", "tag": "021d89aa-25e1-46e7-b11c-c7f418841f4e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:45:56.420089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6932cfe0-f73e-4e76-87a5-37f35ae4f9f8 req-89f825f9-e7eb-4889-9bfb-2d2196629f2e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:56.421053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6932cfe0-f73e-4e76-87a5-37f35ae4f9f8 req-89f825f9-e7eb-4889-9bfb-2d2196629f2e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.435791 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6932cfe0-f73e-4e76-87a5-37f35ae4f9f8 req-89f825f9-e7eb-4889-9bfb-2d2196629f2e service nova] Creating event network-changed:021d89aa-25e1-46e7-b11c-c7f418841f4e for instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 on n-h1-768852-23 Jul 14 14:45:56.442890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6932cfe0-f73e-4e76-87a5-37f35ae4f9f8 req-89f825f9-e7eb-4889-9bfb-2d2196629f2e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064392 Jul 14 14:45:56.444635 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 833/1742] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:45:56.460840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:56.464633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:56.480493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:56.481979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:56.484970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:56.486416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.078841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:57.161620 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f61a41f-8b90-4420-83e0-82f916b049f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 0.701907 Jul 14 14:45:57.169887 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 834/1743] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:56 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:57.258267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:57.274641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:57.325331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.326917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.329008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.341313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.902065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:57.916611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-239d0686-3b9c-4f97-a2f5-1c37595e08e8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1508 microversion: 2.1 time: 0.681383 Jul 14 14:45:57.923597 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 835/1744] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:57 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1508 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:57.929662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:57.939759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:57.947623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.948088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:57.948914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:57.949365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.551580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:58.567165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-23744de3-5adc-4631-b970-62e34cc388b2 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 0.646020 Jul 14 14:45:58.570350 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 836/1745] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:57 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:58.581117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:58.585403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:58.605325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.606110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.607138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.607801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.645941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:45:58.802259 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cfc2cf3a-6371-4075-8a43-c996e5d7a580 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "DELETE /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 204 len: 0 microversion: 2.1 time: 0.227686 Jul 14 14:45:58.806102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 837/1746] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:45:58 2022] DELETE /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:45:58.824179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6d9cc72-fe0c-4eb5-bf74-6e4c5ea5bcc1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b485e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:58.950203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6d9cc72-fe0c-4eb5-bf74-6e4c5ea5bcc1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.142109 Jul 14 14:45:58.953062 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 838/1747] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:45:58 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:58.964107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:58.965445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:58.972466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.973269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:58.974309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:58.974951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.784352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:45:59.800355 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c44a94d-23c4-4a6e-ab3b-b026834a6ef2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1508 microversion: 2.1 time: 0.843688 Jul 14 14:45:59.801076 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 839/1748] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:58 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1508 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:45:59.824473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:45:59.825842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:45:59.851386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.855492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:45:59.856539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:45:59.861080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:00.470297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:00.492270 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa928123-e19a-47c0-bc78-aec6c1aacc35 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 0.688298 Jul 14 14:46:00.522326 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 840/1749] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:45:59 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:00.549994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:00.565113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:00.590671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:00.592484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:00.597115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:00.601663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:01.306718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:01.318625 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5bb838d8-5f70-422b-9e65-28f8fa8f6311 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1486 microversion: 2.1 time: 0.793305 Jul 14 14:46:01.319746 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 841/1750] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:00 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1486 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:01.568618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3395c5f0-7c20-4189-9bbc-9fbd42ecb169 req-fd6d3043-9e6d-4bfe-aa84-1dfea14eab7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38badc8c-f888-4aa7-ad66-12ac0db9285d", "tag": "2795d223-7186-4ebd-8d07-d8ed27d74302"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:01.593264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3395c5f0-7c20-4189-9bbc-9fbd42ecb169 req-fd6d3043-9e6d-4bfe-aa84-1dfea14eab7b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:01.599944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3395c5f0-7c20-4189-9bbc-9fbd42ecb169 req-fd6d3043-9e6d-4bfe-aa84-1dfea14eab7b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:01.653128 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3395c5f0-7c20-4189-9bbc-9fbd42ecb169 req-fd6d3043-9e6d-4bfe-aa84-1dfea14eab7b service nova] Creating event network-changed:2795d223-7186-4ebd-8d07-d8ed27d74302 for instance 38badc8c-f888-4aa7-ad66-12ac0db9285d on n-h1-768852-23 Jul 14 14:46:01.665265 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3395c5f0-7c20-4189-9bbc-9fbd42ecb169 req-fd6d3043-9e6d-4bfe-aa84-1dfea14eab7b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343683 Jul 14 14:46:01.670838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 842/1751] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:01.683470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:01.695033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:01.738142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:01.738857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:01.740086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:01.740776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:02.549330 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6dc12afd-ee5d-45f5-9d39-453e0f40edbd tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.334946 Jul 14 14:46:02.557716 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 910/1752] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:45:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:02.563756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:02.573965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:02.589463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:02.592132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:02.594269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:02.596303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:02.717428 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2b8b0b8e-9a95-4c69-a452-716563b65b79 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "PUT /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1080 microversion: 2.1 time: 0.157946 Jul 14 14:46:02.730806 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 911/1753] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 14:46:02 2022] PUT /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1080 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:02.751389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f9ed153-7bf3-49db-a7fa-1c7cf818a6c6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a3ac10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:02.856583 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f9ed153-7bf3-49db-a7fa-1c7cf818a6c6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.119403 Jul 14 14:46:02.857214 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 912/1754] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:02 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:02.900439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-541c820a-6927-4c18-a5ec-91de1bc61465 req-6909c4b6-bc17-46b4-9d66-beab03684695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "name": "network-vif-plugged", "status": "completed", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:02.950080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-541c820a-6927-4c18-a5ec-91de1bc61465 req-6909c4b6-bc17-46b4-9d66-beab03684695 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:02.963574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-541c820a-6927-4c18-a5ec-91de1bc61465 req-6909c4b6-bc17-46b4-9d66-beab03684695 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.012430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-541c820a-6927-4c18-a5ec-91de1bc61465 req-6909c4b6-bc17-46b4-9d66-beab03684695 service nova] Creating event network-vif-plugged:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:46:03.033399 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-541c820a-6927-4c18-a5ec-91de1bc61465 req-6909c4b6-bc17-46b4-9d66-beab03684695 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161654 Jul 14 14:46:03.048103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:03.052653 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 913/1755] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:03.084254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:03.085160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:03.101428 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a5a1814-f2a4-4fb4-9691-938e929436c4 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 1.428306 Jul 14 14:46:03.104804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:03.105404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.106375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:03.109013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.110269 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 843/1756] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:01 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:03.147954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:03.152001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:03.184872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:03.186018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.192915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:03.194046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:03.729186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:03.746498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-216dd7eb-2157-49c7-96da-938ffaf8a275 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1324 microversion: 2.1 time: 0.685951 Jul 14 14:46:03.763051 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 914/1757] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:03 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1324 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:03.768696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56d7aa10-bca5-47bb-b444-e145fdf24b98 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Calling method '.version_select at 0x7fdbf2a3e430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:04.047061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:04.065390 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e9bea256-681a-4139-816f-c5198e949c33 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 200 len: 1486 microversion: 2.1 time: 0.952202 Jul 14 14:46:04.067087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 844/1758] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:03 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 1486 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:04.085114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:04.091058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:04.104055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:04.108661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:04.111903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:04.114607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:04.117388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:04.596585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:04.608324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a02da2f9-6514-4a27-8675-6b19b317c599 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1506 microversion: 2.1 time: 0.539296 Jul 14 14:46:04.614032 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 845/1759] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:04 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1506 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:04.628028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19b43c70-cd1c-4f9f-825c-2e366a5f5656 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b5a4c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:04.769397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19b43c70-cd1c-4f9f-825c-2e366a5f5656 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.153383 Jul 14 14:46:04.772149 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 846/1760] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:04 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:04.782975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:04.784982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:04.798559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:04.799761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:04.801500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:04.803189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:04.817501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:05.013867 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56d7aa10-bca5-47bb-b444-e145fdf24b98 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips/b3fbbdc2-8b4e-4dd5-a238-59918555446f" status: 200 len: 142 microversion: 2.1 time: 1.249418 Jul 14 14:46:05.015441 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 915/1761] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:46:03 2022] GET /compute/v2.1/os-floating-ips/b3fbbdc2-8b4e-4dd5-a238-59918555446f => generated 142 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:05.268404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:05.288860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff51cc1e-527d-41b0-9425-9d2eedbf09a8 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 0.505044 Jul 14 14:46:05.300289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 847/1762] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:04 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:05.313471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:05.313978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:05.327482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:05.327950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.328783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:05.329230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.341299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:05.345639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:05.373242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:05.373928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.375249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:05.380528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.522579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:05.691521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:05.701466 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fee9adf4-2290-48a5-b6eb-3c9ddd4b846c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1506 microversion: 2.1 time: 0.399949 Jul 14 14:46:05.714894 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 848/1763] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:05 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1506 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:05.725993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:05.727099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:05.734197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:05.735526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.736657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:05.737294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:05.936522 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e1e5b0b-5ffe-4bfb-813b-dc6e8e35b7df tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 204 len: 0 microversion: 2.42 time: 0.918834 Jul 14 14:46:05.938792 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 916/1764] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:05 2022] DELETE /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:46:05.967681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e918fa68-df13-4080-9a32-10a09ed9afc0 req-982669c2-0bc8-417f-b6a5-dd3629db6b7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18214402-1f83-4d57-bec8-4da01f6dd94b", "name": "network-vif-deleted", "tag": "0aec2091-5fb0-4ec6-93e8-855eee85736e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:06.017418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e918fa68-df13-4080-9a32-10a09ed9afc0 req-982669c2-0bc8-417f-b6a5-dd3629db6b7e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.022744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e918fa68-df13-4080-9a32-10a09ed9afc0 req-982669c2-0bc8-417f-b6a5-dd3629db6b7e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.047973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:06.058065 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7357191-3392-43d1-881e-2177615c4b88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1519 microversion: 2.1 time: 0.341576 Jul 14 14:46:06.064824 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 849/1765] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:05 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1519 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:06.069905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44acdb36-f4cc-4210-8e8c-c0f54fbf9a32 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Calling method '.version_select at 0x7fdbf306e700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:06.072562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e918fa68-df13-4080-9a32-10a09ed9afc0 req-982669c2-0bc8-417f-b6a5-dd3629db6b7e service nova] Creating event network-vif-deleted:0aec2091-5fb0-4ec6-93e8-855eee85736e for instance 18214402-1f83-4d57-bec8-4da01f6dd94b on n-h1-768852-23 Jul 14 14:46:06.089961 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e918fa68-df13-4080-9a32-10a09ed9afc0 req-982669c2-0bc8-417f-b6a5-dd3629db6b7e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146211 Jul 14 14:46:06.092034 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 917/1766] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:06.140628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7128cc13-7c27-465f-a477-0d00a9cd6f11 req-4d64bdb9-466e-46cc-ab13-619b38b70595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a23bc51-4fb5-43b5-b1fb-2570dad40226", "name": "network-vif-plugged", "status": "completed", "tag": "021d89aa-25e1-46e7-b11c-c7f418841f4e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:06.152894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7128cc13-7c27-465f-a477-0d00a9cd6f11 req-4d64bdb9-466e-46cc-ab13-619b38b70595 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.156452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7128cc13-7c27-465f-a477-0d00a9cd6f11 req-4d64bdb9-466e-46cc-ab13-619b38b70595 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.173311 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7128cc13-7c27-465f-a477-0d00a9cd6f11 req-4d64bdb9-466e-46cc-ab13-619b38b70595 service nova] Creating event network-vif-plugged:021d89aa-25e1-46e7-b11c-c7f418841f4e for instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 on n-h1-768852-23 Jul 14 14:46:06.185159 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7128cc13-7c27-465f-a477-0d00a9cd6f11 req-4d64bdb9-466e-46cc-ab13-619b38b70595 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090805 Jul 14 14:46:06.186682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 918/1767] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:06.193892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:06.207257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 18214402-1f83-4d57-bec8-4da01f6dd94b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:06.215576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.216690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.217863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.218394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.235208 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] HTTP exception thrown: Instance 18214402-1f83-4d57-bec8-4da01f6dd94b could not be found. Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Request method failure captured: Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b HTTP/1.1 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CoFYJbWrcmWZZZ5hNC9FRWxT37HF6JnDQ8WEerQO1kzZp_4k1mCSQv7NYx6RZrk0WM0rJSKt_hAgT7PdcluavBAtVnAUEDqXPBe-BoDQdwX9RgamGFeMERe4JKJGkzCKwkkhiAtXVGKkf7X64gQUGTmf9nNVP1A6rbSZPfuUyJ252w Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c46a694ba42e4d1ba55d161224195378"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-LiveMigrationTest-470070867 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-LiveMigrationTest-470070867-project Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 038556a90129478eb04699f574ea7e1b Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-LiveMigrationTest-470070867-project Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 18214402-1f83-4d57-bec8-4da01f6dd94b could not be found. Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '18214402-1f83-4d57-bec8-4da01f6dd94b'} Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18214402-1f83-4d57-bec8-4da01f6dd94b could not be found. Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18214402-1f83-4d57-bec8-4da01f6dd94b could not be found. Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:06.237638 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:06.243808 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:06.243808 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:06.243808 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:06.243808 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:06.243808 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18214402-1f83-4d57-bec8-4da01f6dd94b could not be found. Jul 14 14:46:06.243808 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:06.245944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Returning 404 to user: Instance 18214402-1f83-4d57-bec8-4da01f6dd94b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:06.247477 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b772899e-bbd9-4165-98ba-df04680f16e8 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b" status: 404 len: 111 microversion: 2.1 time: 0.059291 Jul 14 14:46:06.248371 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 919/1768] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:06 2022] GET /compute/v2.1/servers/18214402-1f83-4d57-bec8-4da01f6dd94b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:06.254005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:06.256260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:06.267722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.268609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.270156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.271044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.447689 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44acdb36-f4cc-4210-8e8c-c0f54fbf9a32 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.381515 Jul 14 14:46:06.448883 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 850/1769] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:46:06 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:06.453710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b13c99ba-2c76-46b0-9745-416529e18505 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bfb0d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:06.502477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:06.502477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:06.502477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:06.502477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:06.502477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:06.574945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b13c99ba-2c76-46b0-9745-416529e18505 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.124907 Jul 14 14:46:06.575581 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 851/1770] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:06 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:06.581154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:06.582106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:06.592245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.593388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.595648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.596846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.603598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:06.635675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.635675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.635675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:06.635675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:06.752024 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a1624a5-2bca-46f0-ba04-df257b8fa6ed tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "POST /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa/action" status: 202 len: 1112 microversion: 2.1 time: 0.500124 Jul 14 14:46:06.754937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 920/1771] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:06 2022] POST /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa/action => generated 1112 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 14:46:06.763338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ed82a7b-c800-4f40-8127-f47d784e8be9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'create', calling method: .version_select at 0x7fdbf2bc6820>, body: {"pool": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:07.122539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.135649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.137986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.140039 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-731fff20-5ae4-4dcc-b52a-0a7a89d9ccb6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2964 microversion: 2.42 time: 0.563238 Jul 14 14:46:07.141205 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 852/1772] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:06 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2964 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:07.146368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:07.147348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:07.154976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:07.155849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:07.156852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:07.157622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:07.206896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:07.331404 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a219112-98f8-4fc9-a7c5-3898183c38fe tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "DELETE /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 204 len: 0 microversion: 2.1 time: 0.186984 Jul 14 14:46:07.336086 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 853/1773] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:46:07 2022] DELETE /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:07.345211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:07.346716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:07.355570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:07.356673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:07.358551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:07.359416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:07.603802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:07.634310 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2377f1bc-4b99-42a7-a503-68723d28a331 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 0.294912 Jul 14 14:46:07.638398 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 854/1774] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:07 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:07.648014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41352b80-380f-46cc-b9ec-c61aa32e06b7 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Calling method '.version_select at 0x7fdbf2ba1280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:09.920837 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ed82a7b-c800-4f40-8127-f47d784e8be9 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.164281 Jul 14 14:46:09.922269 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 921/1775] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:46:06 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:09.939663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:09.940301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:09.949437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:09.964644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:09.965550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:09.966643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:09.969705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.203417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:10.230339 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4cba1b2e-ac24-4f02-aae6-19f7d269feef tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.305224 Jul 14 14:46:10.233146 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 922/1776] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:09 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:10.244187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:10.245737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:10.276520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:10.277970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.279794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:10.280818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.423344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '038556a90129478eb04699f574ea7e1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c46a694ba42e4d1ba55d161224195378', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:10.433421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-930f2311-29ff-4f92-a7d0-1f4660470519 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 200 len: 1457 microversion: 2.1 time: 0.198387 Jul 14 14:46:10.434444 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 923/1777] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:10 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 1457 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:10.439812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90afa372-d72b-4484-92d5-71e2c07fe00c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a535e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:10.517086 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-90afa372-d72b-4484-92d5-71e2c07fe00c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1412 microversion: 2.1 time: 0.081487 Jul 14 14:46:10.518264 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 924/1778] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:10 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:10.525347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:10.526324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:10.534997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:10.535706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.537007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:10.537332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:10.854310 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41352b80-380f-46cc-b9ec-c61aa32e06b7 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/b3fbbdc2-8b4e-4dd5-a238-59918555446f" status: 202 len: 0 microversion: 2.1 time: 3.214180 Jul 14 14:46:10.855453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 855/1779] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:46:07 2022] DELETE /compute/v2.1/os-floating-ips/b3fbbdc2-8b4e-4dd5-a238-59918555446f => generated 0 bytes in 3216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:46:11.027576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4e891728-b929-42ea-b93d-bb97ecd16201 req-64294a46-ed6a-496f-9050-8ff0c16cbb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38badc8c-f888-4aa7-ad66-12ac0db9285d", "name": "network-vif-plugged", "status": "completed", "tag": "2795d223-7186-4ebd-8d07-d8ed27d74302"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:11.046515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4e891728-b929-42ea-b93d-bb97ecd16201 req-64294a46-ed6a-496f-9050-8ff0c16cbb2c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:11.047865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4e891728-b929-42ea-b93d-bb97ecd16201 req-64294a46-ed6a-496f-9050-8ff0c16cbb2c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:11.074772 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4e891728-b929-42ea-b93d-bb97ecd16201 req-64294a46-ed6a-496f-9050-8ff0c16cbb2c service nova] Creating event network-vif-plugged:2795d223-7186-4ebd-8d07-d8ed27d74302 for instance 38badc8c-f888-4aa7-ad66-12ac0db9285d on n-h1-768852-23 Jul 14 14:46:11.088731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4e891728-b929-42ea-b93d-bb97ecd16201 req-64294a46-ed6a-496f-9050-8ff0c16cbb2c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230737 Jul 14 14:46:11.090269 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 856/1780] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:11.109392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:11.111184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:11.142129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:11.145625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:11.149450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:11.157776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:11.731695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:11.746180 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8a5837d-0c7a-4c83-befc-8182f492030c tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1317 microversion: 2.1 time: 0.654029 Jul 14 14:46:11.747218 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 857/1781] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:11 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1317 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:11.760716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-5835682", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f9874e65-6a5a-4909-a616-16d8c1f3be84"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:11.885315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] validate_networks() for [('f9874e65-6a5a-4909-a616-16d8c1f3be84', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:12.084348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:12.107197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:12.108878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:12.110567 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-efdc93d6-5f9d-442b-af9c-7b01cc68b878 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2964 microversion: 2.42 time: 1.591017 Jul 14 14:46:12.111479 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 925/1782] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:10 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2964 bytes in 1592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:12.327908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-26977a82-e2d5-41f1-b829-b959c15135fb req-ca1856d0-6133-4934-9de1-156ad3337a58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e1c9f04-7d06-489f-a719-417c45f7ecaa", "name": "network-vif-deleted", "tag": "cb666f3c-3c5d-4e61-ba94-a69732fa4ee5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:12.343229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-26977a82-e2d5-41f1-b829-b959c15135fb req-ca1856d0-6133-4934-9de1-156ad3337a58 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:12.344003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-26977a82-e2d5-41f1-b829-b959c15135fb req-ca1856d0-6133-4934-9de1-156ad3337a58 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:12.357482 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-26977a82-e2d5-41f1-b829-b959c15135fb req-ca1856d0-6133-4934-9de1-156ad3337a58 service nova] Creating event network-vif-deleted:cb666f3c-3c5d-4e61-ba94-a69732fa4ee5 for instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa on n-h2-768852-23 Jul 14 14:46:12.364393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-26977a82-e2d5-41f1-b829-b959c15135fb req-ca1856d0-6133-4934-9de1-156ad3337a58 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251426 Jul 14 14:46:12.371545 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 926/1783] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:12.385300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f8eabfe0-1a21-41c4-b501-3ea4f50bd8d0 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Action: 'create', calling method: .version_select at 0x7fdbf2a204c0>, body: {"pool": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:13.324991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:13.326755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:13.328025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:13.329043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:13.330535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:13.350445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.352456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.354417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.355607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.394428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Getting quotas for project a22f9857a34e48f7bc5d2bd97ef02b14. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:13.404644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Getting quotas for user f1d8ca06f8d2469382275fd2e36c538c and project a22f9857a34e48f7bc5d2bd97ef02b14. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:13.429580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:13.434282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:13.562657 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04717b60-d588-411c-bf6d-f817f37903f7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.813669 Jul 14 14:46:13.565856 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 858/1784] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:13.580545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:13.582239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:13.604653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.606515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:13.608460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:13.609659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.003427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:14.017598 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62d29075-b380-44e9-b639-c26d9eb92b93 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.449733 Jul 14 14:46:14.021880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 859/1785] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:13 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:14.031140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:14.031826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] [instance: 4e1c9f04-7d06-489f-a719-417c45f7ecaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:14.056143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:14.056893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.057753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:14.058204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.129720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] HTTP exception thrown: Instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa could not be found. Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Request method failure captured: Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa HTTP/1.1 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CoFYJbWrcmWZZZ5hNC9FRWxT37HF6JnDQ8WEerQO1kzZp_4k1mCSQv7NYx6RZrk0WM0rJSKt_hAgT7PdcluavBAtVnAUEDqXPBe-BoDQdwX9RgamGFeMERe4JKJGkzCKwkkhiAtXVGKkf7X64gQUGTmf9nNVP1A6rbSZPfuUyJ252w Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c46a694ba42e4d1ba55d161224195378"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c46a694ba42e4d1ba55d161224195378"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveMigrationTest-470070867 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c46a694ba42e4d1ba55d161224195378 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveMigrationTest-470070867 Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveMigrationTest-470070867-project Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 038556a90129478eb04699f574ea7e1b Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveMigrationTest-470070867-project Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa could not be found. Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '4e1c9f04-7d06-489f-a719-417c45f7ecaa'} Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa could not be found. Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa could not be found. Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:14.134408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa could not be found. Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] Returning 404 to user: Instance 4e1c9f04-7d06-489f-a719-417c45f7ecaa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:14.148397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-964ed71f-1ef7-4e18-87dc-b2d0b8f1bec4 tempest-LiveMigrationTest-470070867 tempest-LiveMigrationTest-470070867-project] 10.222.0.98 "GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa" status: 404 len: 111 microversion: 2.1 time: 0.123086 Jul 14 14:46:14.150944 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 860/1786] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:14 2022] GET /compute/v2.1/servers/4e1c9f04-7d06-489f-a719-417c45f7ecaa => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:14.160630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd13a6fc-4901-4e52-8b09-85b04c3c91e2 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b6a160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:14.249791 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fd13a6fc-4901-4e52-8b09-85b04c3c91e2 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1421 microversion: 2.1 time: 0.095061 Jul 14 14:46:14.265252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 861/1787] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:14 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1421 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:14.293542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:14.298414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:14.314956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:14.316144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.324480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:14.325296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:14.951153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.007045 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf59f496-220b-488c-8b96-93260a6fa494 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 200 len: 1505 microversion: 2.1 time: 0.738515 Jul 14 14:46:15.011781 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 862/1788] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:14 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 1505 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:15.042633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:15.044606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:15.061135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:15.062614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:15.064716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:15.065807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:15.758939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.786504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.788631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:15.792993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f3bed37-b8f4-4836-8862-6ff79c867344 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2943 microversion: 2.42 time: 0.778929 Jul 14 14:46:15.796158 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 863/1789] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:15 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2943 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:15.808297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:15.810006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:15.827522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:15.829916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:15.830812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:15.831257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.024759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.037286 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8453d703-af02-48b9-a610-349b731d3778 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1281 microversion: 2.1 time: 0.239631 Jul 14 14:46:16.041676 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 864/1790] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:15 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1281 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:16.051558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-19d44188-db45-422d-929c-f47a4661ade0 req-ee38bc67-1214-4ec7-9fa7-8019694cfa99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-unplugged", "status": "completed", "tag": "c3c6e28a-5abb-499b-9d2c-08703e602c92"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:16.075482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-19d44188-db45-422d-929c-f47a4661ade0 req-ee38bc67-1214-4ec7-9fa7-8019694cfa99 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.075930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-19d44188-db45-422d-929c-f47a4661ade0 req-ee38bc67-1214-4ec7-9fa7-8019694cfa99 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.097597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-19d44188-db45-422d-929c-f47a4661ade0 req-ee38bc67-1214-4ec7-9fa7-8019694cfa99 service nova] Creating event network-vif-unplugged:c3c6e28a-5abb-499b-9d2c-08703e602c92 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:16.116657 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-19d44188-db45-422d-929c-f47a4661ade0 req-ee38bc67-1214-4ec7-9fa7-8019694cfa99 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072930 Jul 14 14:46:16.117887 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 865/1791] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:16.133428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1fd477ff-8dd9-4e73-b262-c7e4c681b675 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b6df70>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:16.202494 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1fd477ff-8dd9-4e73-b262-c7e4c681b675 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 200 len: 1421 microversion: 2.1 time: 0.078471 Jul 14 14:46:16.203104 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 866/1792] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:16 2022] GET /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 1421 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:16.208625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:16.210119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:16.217237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.217689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.218485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.218925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.699447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:16.735306 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-72cb4b20-2403-4884-ae8b-422c5ca36444 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.529784 Jul 14 14:46:16.738778 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 867/1793] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:16 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:16.747378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:16.748703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:16.762400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.764153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:16.765654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:16.767972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:17.217996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:17.244843 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-929effd1-49cb-4460-a30b-83db12706bed tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226" status: 200 len: 1505 microversion: 2.1 time: 0.498676 Jul 14 14:46:17.264249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 868/1794] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:16 2022] GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226 => generated 1505 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:17.280315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f3657fef-ed27-48d2-b231-14e8df00c255 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b6a3a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:18.479215 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f3657fef-ed27-48d2-b231-14e8df00c255 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 204 len: 0 microversion: 2.1 time: 1.212922 Jul 14 14:46:18.487664 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 869/1795] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:17 2022] DELETE /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 0 bytes in 1218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:18.510486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:18.520957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:18.566809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:18.568606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.578553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:18.585241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.686877 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f8eabfe0-1a21-41c4-b501-3ea4f50bd8d0 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.313076 Jul 14 14:46:18.689203 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 927/1796] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:46:12 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:18.702033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:18.705589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:18.786792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:18.792524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.801887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:18.805698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:18.872840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:19.207787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.235553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:19.254681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.258501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.267718 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-007d16fe-ed73-4f85-9877-4cededf15b8c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2922 microversion: 2.42 time: 0.774153 Jul 14 14:46:19.270961 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 870/1797] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:18 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2922 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:19.282095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:19.283110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:19.310905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.311701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.313180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.313997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.352662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.368938 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-876f2595-032d-4698-8bc7-591eb685a6d5 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1321 microversion: 2.1 time: 0.675310 Jul 14 14:46:19.391601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:19.391948 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 928/1798] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:18 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1321 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:19.414778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:19.418601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:19.436993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.437974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.444480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.445818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.586636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f529d0fa-98b8-4b3a-b22b-0945a5129402 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226" status: 204 len: 0 microversion: 2.1 time: 0.312329 Jul 14 14:46:19.588099 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 871/1799] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:46:19 2022] DELETE /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:19.596734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-unplugged", "status": "completed", "tag": "0760b55f-c71b-47a8-9fc4-8e71037f0156"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-unplugged", "status": "completed", "tag": "aad3ef53-ce16-4b02-a1b5-5f7e52a7985d"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-unplugged", "status": "completed", "tag": "f26436fc-3fd6-47ef-906d-83794b61754d"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-unplugged", "status": "completed", "tag": "ac4d4f21-84d8-472e-a32d-f8dbffcec22f"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-unplugged", "status": "completed", "tag": "ad8cd311-4741-44e0-8060-a4915242cfdd"}, {"server_uuid": "80f2e64a-ba04-4c1b-a5e0-695662b50049", "name": "network-vif-unplugged", "status": "completed", "tag": "1a777028-769e-451b-9c9e-fb8e866176b6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:19.619764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.621684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.660941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Creating event network-vif-unplugged:0760b55f-c71b-47a8-9fc4-8e71037f0156 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:19.662178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Creating event network-vif-unplugged:aad3ef53-ce16-4b02-a1b5-5f7e52a7985d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:19.663220 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Creating event network-vif-unplugged:f26436fc-3fd6-47ef-906d-83794b61754d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:19.664992 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Creating event network-vif-unplugged:ac4d4f21-84d8-472e-a32d-f8dbffcec22f for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:19.669694 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Creating event network-vif-unplugged:ad8cd311-4741-44e0-8060-a4915242cfdd for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:19.671260 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] Creating event network-vif-unplugged:1a777028-769e-451b-9c9e-fb8e866176b6 for instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 on n-h2-768852-23 Jul 14 14:46:19.693788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-41b4bc42-9d09-457c-80a4-891e93c4a750 req-2eff8ec9-adcc-4e0b-9efd-83538df1b21a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1050 microversion: 2.1 time: 0.103534 Jul 14 14:46:19.696338 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 872/1800] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 1050 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:19.712422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:19.714694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:19.732928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.735595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.750563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:19.751964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:19.856103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:19.890905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:19.901167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-95c28104-dbf5-48e5-a5f8-ef5d478a76ab tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.506056 Jul 14 14:46:19.906109 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 929/1801] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:19 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:19.923452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70fe6caf-ffcb-4bd3-98bf-55937ec2d7a8 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Calling method '.version_select at 0x7fdbf2a209d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:20.047024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0fce8fcf-0310-4548-bbe4-de04104acc5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 204 len: 0 microversion: 2.1 time: 0.347199 Jul 14 14:46:20.051845 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 873/1802] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:46:19 2022] DELETE /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:20.058216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:20.059742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:20.073339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.074343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.076007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.077244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.162959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:20.329011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-69b64d8f-920a-4313-a70c-6a4f2c608c5e tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "DELETE /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 204 len: 0 microversion: 2.1 time: 0.278065 Jul 14 14:46:20.333320 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 874/1803] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:46:20 2022] DELETE /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:20.348169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e7db3999-9add-416a-aa0f-de1ffb034a64 req-9d8940f8-7428-4b0d-9542-1b1528cb3b89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b45efd5-48a1-471f-b6bb-7797893a6416", "tag": "06449245-1597-46db-8d5c-878ca35fa42c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:20.378337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e7db3999-9add-416a-aa0f-de1ffb034a64 req-9d8940f8-7428-4b0d-9542-1b1528cb3b89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.379192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e7db3999-9add-416a-aa0f-de1ffb034a64 req-9d8940f8-7428-4b0d-9542-1b1528cb3b89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.408312 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e7db3999-9add-416a-aa0f-de1ffb034a64 req-9d8940f8-7428-4b0d-9542-1b1528cb3b89 service nova] Creating event network-changed:06449245-1597-46db-8d5c-878ca35fa42c for instance 6b45efd5-48a1-471f-b6bb-7797893a6416 on n-h2-768852-23 Jul 14 14:46:20.419989 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e7db3999-9add-416a-aa0f-de1ffb034a64 req-9d8940f8-7428-4b0d-9542-1b1528cb3b89 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084220 Jul 14 14:46:20.426063 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 875/1804] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:20.433923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:20.435038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:20.449244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.450837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.452161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:20.452834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:20.773121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:20.792120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:20.796001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:20.797738 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6cf69bef-791f-4c1c-a44e-c55029eb8618 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2875 microversion: 2.42 time: 0.369314 Jul 14 14:46:20.798867 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 876/1805] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:20 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2875 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:20.806936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1027314793", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:20.912598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] validate_networks() for [('e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:21.574932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:21.575383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:21.575859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:21.576256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:21.576900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:21.593429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.594250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.595775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.596554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.635059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:21.650156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for user 331a222a893c4f84a08abf11333c7449 and project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:21.675929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:21.683469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:21.713941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=4,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:21.811613 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d9d7556e-053a-4d9b-8841-7bf4fc4406ed tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.011037 Jul 14 14:46:21.819765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 877/1806] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:21.825451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:21.826409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:21.841993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.842920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:21.844700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:21.845477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.057373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70fe6caf-ffcb-4bd3-98bf-55937ec2d7a8 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc" status: 202 len: 0 microversion: 2.1 time: 2.145889 Jul 14 14:46:22.059086 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 930/1807] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:46:19 2022] DELETE /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc => generated 0 bytes in 2152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:46:22.071374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:22.072976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:22.096270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.097468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.099605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.101304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.559795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:22.569696 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1853ea8d-1cdc-4624-919b-98243cb0cac1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226" status: 200 len: 1511 microversion: 2.1 time: 0.748500 Jul 14 14:46:22.571252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 878/1808] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:21 2022] GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226 => generated 1511 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:22.576706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-eb81fbd3-17f0-44b5-abd7-69107e3539a9 req-e01d8798-d78e-4bc6-b2b6-155c51e4c3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-deleted", "tag": "ac4d4f21-84d8-472e-a32d-f8dbffcec22f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:22.588507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-eb81fbd3-17f0-44b5-abd7-69107e3539a9 req-e01d8798-d78e-4bc6-b2b6-155c51e4c3df service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.589238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-eb81fbd3-17f0-44b5-abd7-69107e3539a9 req-e01d8798-d78e-4bc6-b2b6-155c51e4c3df service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.607665 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-eb81fbd3-17f0-44b5-abd7-69107e3539a9 req-e01d8798-d78e-4bc6-b2b6-155c51e4c3df service nova] Creating event network-vif-deleted:ac4d4f21-84d8-472e-a32d-f8dbffcec22f for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:22.614355 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-eb81fbd3-17f0-44b5-abd7-69107e3539a9 req-e01d8798-d78e-4bc6-b2b6-155c51e4c3df service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041258 Jul 14 14:46:22.615389 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 879/1809] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:22.621098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:22.622160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:22.635166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.635927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.636842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.637935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.867478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:22.869984 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12b9c85b-e720-4c59-b947-0410aa438090 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.252913 Jul 14 14:46:22.877236 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 880/1810] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:22 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:22.887482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:22.888209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:22.899230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.899734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.901359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:22.901822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:22.993320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:23.001868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7956d04-cd39-4edc-8b94-6722b61c9ff9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1212 microversion: 2.1 time: 0.123350 Jul 14 14:46:23.003062 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 881/1811] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:22 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1212 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:23.008694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:23.009366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:23.018609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:23.020044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:23.029135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:23.034065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:23.037308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:23.040267 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-957eda25-54a5-4b82-be85-3158126fc6c8 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1321 microversion: 2.1 time: 0.979614 Jul 14 14:46:23.049057 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 931/1812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:22 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1321 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:23.069476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3d8c145-6b74-4bac-a320-b2da489dc4e2 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Calling method '.version_select at 0x7fdbf2a3b5e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:23.207323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-a3d8c145-6b74-4bac-a320-b2da489dc4e2 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3144283a-d445-41b0-a2d8-072f32bdfdcc could not be found", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:46:23.208056 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a3d8c145-6b74-4bac-a320-b2da489dc4e2 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] HTTP exception thrown: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3d8c145-6b74-4bac-a320-b2da489dc4e2 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Request method failure captured: Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc HTTP/1.1 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CwjgEEf7ECZqLBfp9Qxy56CWrvpgTWTUey7wkDAw6ahwQkbjlW-gF4fQABxYNAtzSvClU22ALkhFyerFYIKaSGsJ_3Jn4TIWWVfCNT51UAnl6R8Q6R4cCMaLkE1G_IkMF5grAhactcYdQOhHl1Kb-cges4MQe8wN5qOYw-2xsGjpH0 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 31fb1cd55dab4d8da62307c0cf3b202d Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsTestJSON-1790715086 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsTestJSON-1790715086 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 31fb1cd55dab4d8da62307c0cf3b202d Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1790715086 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsTestJSON-1790715086-project Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: d10ce7ab4eb844f790a7c66bbdf69c20 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsTestJSON-1790715086-project Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: exception: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '3144283a-d445-41b0-a2d8-072f32bdfdcc'} Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3144283a-d445-41b0-a2d8-072f32bdfdcc could not be found Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e69e2cc2-4019-4e70-ada5-5aecc9e7e38e'] Jul 14 14:46:23.210214 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc. Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3d8c145-6b74-4bac-a320-b2da489dc4e2 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Returning 404 to user: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3d8c145-6b74-4bac-a320-b2da489dc4e2 tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc" status: 404 len: 111 microversion: 2.1 time: 0.148355 Jul 14 14:46:23.220371 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 932/1813] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:46:23 2022] GET /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:23.227617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e6a7c27-d6a6-440c-81ad-a2601d844f4a tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Calling method '.version_select at 0x7fdbf2a20c10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:23.427084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-2e6a7c27-d6a6-440c-81ad-a2601d844f4a tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 3144283a-d445-41b0-a2d8-072f32bdfdcc could not be found", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:46:23.429232 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2e6a7c27-d6a6-440c-81ad-a2601d844f4a tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] HTTP exception thrown: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e6a7c27-d6a6-440c-81ad-a2601d844f4a tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Request method failure captured: Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc HTTP/1.1 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CwjgEEf7ECZqLBfp9Qxy56CWrvpgTWTUey7wkDAw6ahwQkbjlW-gF4fQABxYNAtzSvClU22ALkhFyerFYIKaSGsJ_3Jn4TIWWVfCNT51UAnl6R8Q6R4cCMaLkE1G_IkMF5grAhactcYdQOhHl1Kb-cges4MQe8wN5qOYw-2xsGjpH0 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 31fb1cd55dab4d8da62307c0cf3b202d Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsTestJSON-1790715086 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/31fb1cd55dab4d8da62307c0cf3b202d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsTestJSON-1790715086 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 31fb1cd55dab4d8da62307c0cf3b202d Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsTestJSON-1790715086 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsTestJSON-1790715086-project Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: d10ce7ab4eb844f790a7c66bbdf69c20 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsTestJSON-1790715086-project Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: exception: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '3144283a-d445-41b0-a2d8-072f32bdfdcc'} Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 3144283a-d445-41b0-a2d8-072f32bdfdcc could not be found Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-63a533c3-7b3c-41c7-96af-75d964076ba4'] Jul 14 14:46:23.440004 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc. Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc Jul 14 14:46:23.445807 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:23.451333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e6a7c27-d6a6-440c-81ad-a2601d844f4a tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] Returning 404 to user: Floating IP not found for ID 3144283a-d445-41b0-a2d8-072f32bdfdcc {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:23.458502 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e6a7c27-d6a6-440c-81ad-a2601d844f4a tempest-FloatingIPsTestJSON-1790715086 tempest-FloatingIPsTestJSON-1790715086-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc" status: 404 len: 111 microversion: 2.1 time: 0.239485 Jul 14 14:46:23.465373 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 933/1814] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:46:23 2022] DELETE /compute/v2.1/os-floating-ips/3144283a-d445-41b0-a2d8-072f32bdfdcc => generated 111 bytes in 248 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:23.591382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:23.592509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:23.606638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:23.607339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:23.608249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:23.609351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:24.169792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.196147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.197587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:24.198925 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d4c8a7d1-91be-4baa-a863-67889dccd72d tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2875 microversion: 2.42 time: 1.194853 Jul 14 14:46:24.199765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 882/1815] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:23 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2875 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:24.215517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:24.216436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:24.232273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:24.233124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:24.234173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:24.234808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.008599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.052063 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44f38f63-301c-40d9-b439-5ea1a44d60b4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.850271 Jul 14 14:46:25.063335 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 883/1816] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:24 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:25.083712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:25.086514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8413b54e750c4f178c419c2b4f31d38e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9aea3a0d9920482abbbcb6c186504ed2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.095840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:25.121727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.122877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.124619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.130688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.166307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e9f4f6fb-a7d3-401e-a44d-b1c681233f5f tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226" status: 200 len: 1511 microversion: 2.1 time: 1.581290 Jul 14 14:46:25.170433 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 934/1817] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:23 2022] GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226 => generated 1511 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:25.213821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:25.214983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:25.233026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.233488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.234495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.234948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:25.496219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.526484 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-730fd103-829d-4004-8d58-df4fb52fa5a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1266 microversion: 2.1 time: 0.468858 Jul 14 14:46:25.528120 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 884/1818] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:25 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1266 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:25.907348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:25.919934 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0888d132-c88d-4aec-bcc8-b975bbef9773 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1321 microversion: 2.1 time: 0.747195 Jul 14 14:46:25.928303 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 935/1819] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:25 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1321 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:25.952082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0cd3a014-1cc6-4101-915c-1edaf96ad9f4 req-8dccfcde-61c8-4622-bae7-738327a9e8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-deleted", "tag": "ad8cd311-4741-44e0-8060-a4915242cfdd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:25.974969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0cd3a014-1cc6-4101-915c-1edaf96ad9f4 req-8dccfcde-61c8-4622-bae7-738327a9e8c4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:25.976899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0cd3a014-1cc6-4101-915c-1edaf96ad9f4 req-8dccfcde-61c8-4622-bae7-738327a9e8c4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.011701 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0cd3a014-1cc6-4101-915c-1edaf96ad9f4 req-8dccfcde-61c8-4622-bae7-738327a9e8c4 service nova] Creating event network-vif-deleted:ad8cd311-4741-44e0-8060-a4915242cfdd for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:26.024566 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0cd3a014-1cc6-4101-915c-1edaf96ad9f4 req-8dccfcde-61c8-4622-bae7-738327a9e8c4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092258 Jul 14 14:46:26.028526 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 936/1820] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:26.043114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:26.044477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:26.066917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.072440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.073804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.075516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.178059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-297184887", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:26.353303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:26.855858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:26.857120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:26.857806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:26.858419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:26.859032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:26.875447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.875926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.876790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:26.877237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:26.892449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:26.921628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Getting quotas for project 1c56ef362cf84d91bb841ab512e3665e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:26.931547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Getting quotas for user df11930b59684df585c3b90e0300aeb3 and project 1c56ef362cf84d91bb841ab512e3665e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:26.955648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:26.959298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:27.013854 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cfe5ba8d-1802-436f-916a-37ce030b213f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.481788 Jul 14 14:46:27.020021 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 885/1821] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:27.037078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-077b7144-2b82-4c42-80b9-ffff63d23523 req-31c6666d-5e31-4c05-9bc1-5296351dc433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80f2e64a-ba04-4c1b-a5e0-695662b50049", "name": "network-vif-deleted", "tag": "1a777028-769e-451b-9c9e-fb8e866176b6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:27.050677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-077b7144-2b82-4c42-80b9-ffff63d23523 req-31c6666d-5e31-4c05-9bc1-5296351dc433 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.051657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-077b7144-2b82-4c42-80b9-ffff63d23523 req-31c6666d-5e31-4c05-9bc1-5296351dc433 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.071723 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-077b7144-2b82-4c42-80b9-ffff63d23523 req-31c6666d-5e31-4c05-9bc1-5296351dc433 service nova] Creating event network-vif-deleted:1a777028-769e-451b-9c9e-fb8e866176b6 for instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 on n-h2-768852-23 Jul 14 14:46:27.080468 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-077b7144-2b82-4c42-80b9-ffff63d23523 req-31c6666d-5e31-4c05-9bc1-5296351dc433 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063309 Jul 14 14:46:27.081462 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 886/1822] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:27.089602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.090801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.103646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.104484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.105659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.106321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.569869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.580156 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf49dd68-1e85-4de7-853d-5d3f6dede594 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 0.496204 Jul 14 14:46:27.581507 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 887/1823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:27.603177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.605432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 5a23bc51-4fb5-43b5-b1fb-2570dad40226] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.618326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.619014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.620851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.621288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.640239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] HTTP exception thrown: Instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 could not be found. Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Request method failure captured: Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226 HTTP/1.1 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CvlooVd2l6ZOqBRwXRd5kB06XiDHn1Viqe_YfgkU-3e6zTPanQOAjrlvj2Fn7izWvISZOisqmm_NAt7YM-BShvqXtUHGrLaM5qTBWHYcQzIH9Scq1kPPlGITRrsFkqbpTZyZotS8mxG3Xksj8ar4m5MA3hfvwAnDTYIur2PrJ8VntQ Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 9aea3a0d9920482abbbcb6c186504ed2 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MultipleCreateTestJSON-1522127122 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MultipleCreateTestJSON-1522127122 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 9aea3a0d9920482abbbcb6c186504ed2 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1522127122 Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MultipleCreateTestJSON-1522127122-project Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8413b54e750c4f178c419c2b4f31d38e Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MultipleCreateTestJSON-1522127122-project Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 could not be found. Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '5a23bc51-4fb5-43b5-b1fb-2570dad40226'} Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 could not be found. Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 could not be found. Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:27.642228 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 could not be found. Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Returning 404 to user: Instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01a7d101-2ccf-4132-8d16-b0053587fbb1 tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226" status: 404 len: 111 microversion: 2.1 time: 0.061242 Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 888/1824] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/5a23bc51-4fb5-43b5-b1fb-2570dad40226 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.659843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.665872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.666341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.667168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.668274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.762660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.792799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.797526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.801805 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bea88ed6-8dec-47ed-bd68-dcbcd905f8a0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2714 microversion: 2.42 time: 1.770175 Jul 14 14:46:27.803355 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 937/1825] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:26 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2714 bytes in 1774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:27.814866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.817413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.818572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.833755 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c10c9631-a61f-4687-9f51-b354996f1727 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1266 microversion: 2.1 time: 0.182694 Jul 14 14:46:27.837563 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 889/1826] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:27.847598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.854624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.858163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-82146442-7953-4649-9247-8dbc7c8b26b4 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:27.859036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-82146442-7953-4649-9247-8dbc7c8b26b4 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:27.859787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:27.861547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:27.973083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-82146442-7953-4649-9247-8dbc7c8b26b4 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:27.982190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-82146442-7953-4649-9247-8dbc7c8b26b4 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1218 microversion: 2.1 time: 0.142740 Jul 14 14:46:27.984780 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 890/1827] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:27.996738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3f376e89-eab3-4489-a5e0-b1b898f4691d req-536a4ebb-3f12-4c1e-a19e-c30080aacebb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b45efd5-48a1-471f-b6bb-7797893a6416", "name": "network-vif-plugged", "status": "completed", "tag": "06449245-1597-46db-8d5c-878ca35fa42c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:28.017751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3f376e89-eab3-4489-a5e0-b1b898f4691d req-536a4ebb-3f12-4c1e-a19e-c30080aacebb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.019001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3f376e89-eab3-4489-a5e0-b1b898f4691d req-536a4ebb-3f12-4c1e-a19e-c30080aacebb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.058648 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3f376e89-eab3-4489-a5e0-b1b898f4691d req-536a4ebb-3f12-4c1e-a19e-c30080aacebb service nova] Creating event network-vif-plugged:06449245-1597-46db-8d5c-878ca35fa42c for instance 6b45efd5-48a1-471f-b6bb-7797893a6416 on n-h2-768852-23 Jul 14 14:46:28.076553 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3f376e89-eab3-4489-a5e0-b1b898f4691d req-536a4ebb-3f12-4c1e-a19e-c30080aacebb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089108 Jul 14 14:46:28.077912 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 891/1828] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:28.092213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:28.093359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] [instance: 38badc8c-f888-4aa7-ad66-12ac0db9285d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:28.106989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.107942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.109089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.113811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.141123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] HTTP exception thrown: Instance 38badc8c-f888-4aa7-ad66-12ac0db9285d could not be found. Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Request method failure captured: Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d HTTP/1.1 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CvlooVd2l6ZOqBRwXRd5kB06XiDHn1Viqe_YfgkU-3e6zTPanQOAjrlvj2Fn7izWvISZOisqmm_NAt7YM-BShvqXtUHGrLaM5qTBWHYcQzIH9Scq1kPPlGITRrsFkqbpTZyZotS8mxG3Xksj8ar4m5MA3hfvwAnDTYIur2PrJ8VntQ Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 9aea3a0d9920482abbbcb6c186504ed2 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MultipleCreateTestJSON-1522127122 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/9aea3a0d9920482abbbcb6c186504ed2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MultipleCreateTestJSON-1522127122 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 9aea3a0d9920482abbbcb6c186504ed2 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1522127122 Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MultipleCreateTestJSON-1522127122-project Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8413b54e750c4f178c419c2b4f31d38e Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MultipleCreateTestJSON-1522127122-project Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 38badc8c-f888-4aa7-ad66-12ac0db9285d could not be found. Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '38badc8c-f888-4aa7-ad66-12ac0db9285d'} Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38badc8c-f888-4aa7-ad66-12ac0db9285d could not be found. Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38badc8c-f888-4aa7-ad66-12ac0db9285d could not be found. Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:28.143222 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38badc8c-f888-4aa7-ad66-12ac0db9285d could not be found. Jul 14 14:46:28.150217 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:28.156795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] Returning 404 to user: Instance 38badc8c-f888-4aa7-ad66-12ac0db9285d could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:28.157977 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed246362-d4d7-4118-a41d-ce422579c0cc tempest-MultipleCreateTestJSON-1522127122 tempest-MultipleCreateTestJSON-1522127122-project] 10.222.0.98 "GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d" status: 404 len: 111 microversion: 2.1 time: 0.074210 Jul 14 14:46:28.159305 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 892/1829] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:28 2022] GET /compute/v2.1/servers/38badc8c-f888-4aa7-ad66-12ac0db9285d => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:46:28.165560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ea407640-4cc5-4639-a790-ee2eb144160e req-f9ce95c5-4bb5-40fe-9230-ea65e9561532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a23bc51-4fb5-43b5-b1fb-2570dad40226", "name": "network-vif-deleted", "tag": "021d89aa-25e1-46e7-b11c-c7f418841f4e"}, {"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-deleted", "tag": "f26436fc-3fd6-47ef-906d-83794b61754d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:28.177989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ea407640-4cc5-4639-a790-ee2eb144160e req-f9ce95c5-4bb5-40fe-9230-ea65e9561532 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.178741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ea407640-4cc5-4639-a790-ee2eb144160e req-f9ce95c5-4bb5-40fe-9230-ea65e9561532 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.215321 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ea407640-4cc5-4639-a790-ee2eb144160e req-f9ce95c5-4bb5-40fe-9230-ea65e9561532 service nova] Creating event network-vif-deleted:021d89aa-25e1-46e7-b11c-c7f418841f4e for instance 5a23bc51-4fb5-43b5-b1fb-2570dad40226 on n-h1-768852-23 Jul 14 14:46:28.217190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ea407640-4cc5-4639-a790-ee2eb144160e req-f9ce95c5-4bb5-40fe-9230-ea65e9561532 service nova] Creating event network-vif-deleted:f26436fc-3fd6-47ef-906d-83794b61754d for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:28.235898 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ea407640-4cc5-4639-a790-ee2eb144160e req-f9ce95c5-4bb5-40fe-9230-ea65e9561532 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068802 Jul 14 14:46:28.249129 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 893/1830] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:28.616697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:28.619008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:28.659168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.660089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:28.661635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:28.662367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.041909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.059694 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f32a502-f67e-4a24-8eaa-4688bdcdd6f3 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1321 microversion: 2.1 time: 1.253391 Jul 14 14:46:29.080045 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 938/1831] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:27 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1321 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:29.096049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:29.097823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:29.113392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.114728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.116751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.119474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.690126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.708006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5475945e-3ded-4d98-a2e8-f079f71dc267 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 1.103692 Jul 14 14:46:29.725001 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 894/1832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:28 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:46:29.733803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:29.734735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:29.744911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.748432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.749941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.750736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.788167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.811645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.815048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:29.817970 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8634744b-5f65-44ad-a57a-9bf6cb24dd53 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2439 microversion: 2.42 time: 0.735656 Jul 14 14:46:29.819495 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 939/1833] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:29 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2439 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:29.852621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:29.854297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:29.867624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.868935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:29.870735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:29.871945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.096569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:30.122677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e440ee5-c950-46c3-ad88-c65628f5fdcd tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1276 microversion: 2.1 time: 0.277939 Jul 14 14:46:30.125640 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 940/1834] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:29 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1276 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:30.140392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-501822f3-aa8c-4b17-a0cb-6cf068e692a1 req-2571cbd6-2603-45cb-8b9f-fa69c2443d08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38badc8c-f888-4aa7-ad66-12ac0db9285d", "name": "network-vif-deleted", "tag": "2795d223-7186-4ebd-8d07-d8ed27d74302"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:30.152652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-501822f3-aa8c-4b17-a0cb-6cf068e692a1 req-2571cbd6-2603-45cb-8b9f-fa69c2443d08 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.153581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-501822f3-aa8c-4b17-a0cb-6cf068e692a1 req-2571cbd6-2603-45cb-8b9f-fa69c2443d08 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.169693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-501822f3-aa8c-4b17-a0cb-6cf068e692a1 req-2571cbd6-2603-45cb-8b9f-fa69c2443d08 service nova] Creating event network-vif-deleted:2795d223-7186-4ebd-8d07-d8ed27d74302 for instance 38badc8c-f888-4aa7-ad66-12ac0db9285d on n-h1-768852-23 Jul 14 14:46:30.175789 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-501822f3-aa8c-4b17-a0cb-6cf068e692a1 req-2571cbd6-2603-45cb-8b9f-fa69c2443d08 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046142 Jul 14 14:46:30.177320 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 941/1835] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:30.193426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:30.196081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:30.210304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.211227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.214080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.214080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.222900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:30.236681 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aac0bc6b-d2b3-419d-81df-7dd495109ca7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1308 microversion: 2.1 time: 0.508007 Jul 14 14:46:30.247068 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 895/1836] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:29 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1308 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:30.748398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:30.752224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:30.781989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.785156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:30.788495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:30.792398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.503148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:31.515633 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22bc3f19-1fb1-4895-b27c-129c88060d88 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1321 microversion: 2.1 time: 1.336615 Jul 14 14:46:31.518484 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 942/1837] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:30 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1321 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:31.530261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:31.530904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:31.589344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.590507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.594047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.596190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.799774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:31.828499 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e3d0ce96-66a8-45f9-b717-3989172551de tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1517 microversion: 2.1 time: 1.099102 Jul 14 14:46:31.830826 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 896/1838] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:30 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1517 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:31.840850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:31.842577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:31.856367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.857930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:31.859912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:31.861243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.070902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.097448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8b1295d8-afc7-4581-a5c8-6f7620248f34 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1276 microversion: 2.1 time: 0.263513 Jul 14 14:46:32.100877 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 897/1839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:31 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1276 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:32.130303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:32.133954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:32.168335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:32.169339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.170728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:32.172121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.670376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.691440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.693610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:32.698804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-45cea726-eb0b-44be-b7fe-9b8d941eb00e tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2392 microversion: 2.42 time: 1.174564 Jul 14 14:46:32.699490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 943/1840] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:31 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2392 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:32.716644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:32.720008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:32.749454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:32.750468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:32.751897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:32.760191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.388786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:33.441424 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-336b8c69-973d-4196-a4fa-ed40f9776c00 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1308 microversion: 2.1 time: 1.332743 Jul 14 14:46:33.443800 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 898/1841] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:32 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1308 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:33.454224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6cfac36a-56c5-461c-81ed-c1171d469ab8 req-3030f1e3-6739-4056-9201-69859f8a8320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "225f3940-0dbc-41c1-bf0b-9043e402e6ca", "tag": "b85248f6-5ba1-442f-92e6-c64ef45c05fe"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:33.475926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6cfac36a-56c5-461c-81ed-c1171d469ab8 req-3030f1e3-6739-4056-9201-69859f8a8320 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.478406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6cfac36a-56c5-461c-81ed-c1171d469ab8 req-3030f1e3-6739-4056-9201-69859f8a8320 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.537858 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6cfac36a-56c5-461c-81ed-c1171d469ab8 req-3030f1e3-6739-4056-9201-69859f8a8320 service nova] Creating event network-changed:b85248f6-5ba1-442f-92e6-c64ef45c05fe for instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca on n-h1-768852-23 Jul 14 14:46:33.565000 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6cfac36a-56c5-461c-81ed-c1171d469ab8 req-3030f1e3-6739-4056-9201-69859f8a8320 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118400 Jul 14 14:46:33.574193 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 899/1842] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:33.591652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:33.596134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:33.612843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.614039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.615995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:33.620702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:33.964606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:33.995334 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca5a5d45-c635-4897-9e21-21f06dddde3c tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 200 len: 1517 microversion: 2.1 time: 1.282347 Jul 14 14:46:33.999696 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 944/1843] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:32 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 1517 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:34.013327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:34.013995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:34.023719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:34.024161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:34.028511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:34.029231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:34.325052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:34.334478 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-75a31dfb-8c16-410b-a268-be55a062c24e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1523 microversion: 2.1 time: 0.757926 Jul 14 14:46:34.338471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 900/1844] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:33 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1523 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:34.372059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:34.373407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:34.390614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:34.391886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:34.392918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:34.393545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.000734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.014680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.023810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.023810 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-555237ea-fb37-4bb9-a0ad-2851e01056f1 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 2392 microversion: 2.42 time: 0.663580 Jul 14 14:46:35.028368 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 901/1845] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:34 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 2392 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:35.041478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.83"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:35.043135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:35.053291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:35.053981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.056671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:35.057553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.099686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Acquired lock "refresh_cache-b7776d80-93f5-470b-8b17-b002137b94a1" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:46:35.215330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.224901 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c66eddfa-3884-4724-90ab-f7ec871ac559 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 1.223880 Jul 14 14:46:35.225517 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 945/1846] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:33 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:35.230640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:35.231639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:35.246056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:35.247446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.249164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:35.250054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.888384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:35.905411 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd5f5619-c140-4704-a058-a16f4ce34d92 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1308 microversion: 2.1 time: 0.678127 Jul 14 14:46:35.907702 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 946/1847] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:35 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1308 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:35.917145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:35.919107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:35.930920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:35.932376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:35.933863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:35.934580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.568024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:36.600378 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7dd67a56-522c-410d-8baf-d129d9eb815c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1523 microversion: 2.1 time: 0.690048 Jul 14 14:46:36.603718 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 947/1848] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:35 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1523 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:36.610052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a3a8aafe-f93f-441f-9764-67e6a63604aa req-e0393566-1f7f-4d93-9cbd-6031c9f0b3c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f58dec-0020-4bce-9a9d-9686eb2c59fa", "name": "network-vif-plugged", "status": "completed", "tag": "7c7a36ea-9457-428c-88e9-4eda827252d0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:36.625705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a3a8aafe-f93f-441f-9764-67e6a63604aa req-e0393566-1f7f-4d93-9cbd-6031c9f0b3c4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.626209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a3a8aafe-f93f-441f-9764-67e6a63604aa req-e0393566-1f7f-4d93-9cbd-6031c9f0b3c4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.669660 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a3a8aafe-f93f-441f-9764-67e6a63604aa req-e0393566-1f7f-4d93-9cbd-6031c9f0b3c4 service nova] Creating event network-vif-plugged:7c7a36ea-9457-428c-88e9-4eda827252d0 for instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa on n-h1-768852-23 Jul 14 14:46:36.702886 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a3a8aafe-f93f-441f-9764-67e6a63604aa req-e0393566-1f7f-4d93-9cbd-6031c9f0b3c4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096230 Jul 14 14:46:36.708044 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 948/1849] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:36.721847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-466c21b7-7a84-4660-91d4-cf1ccec95e9d req-ffa3164f-4c11-48a9-b7dc-02a93f83b6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-deleted", "tag": "0760b55f-c71b-47a8-9fc4-8e71037f0156"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:36.755070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-466c21b7-7a84-4660-91d4-cf1ccec95e9d req-ffa3164f-4c11-48a9-b7dc-02a93f83b6e7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.757110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-466c21b7-7a84-4660-91d4-cf1ccec95e9d req-ffa3164f-4c11-48a9-b7dc-02a93f83b6e7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.811219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-466c21b7-7a84-4660-91d4-cf1ccec95e9d req-ffa3164f-4c11-48a9-b7dc-02a93f83b6e7 service nova] Creating event network-vif-deleted:0760b55f-c71b-47a8-9fc4-8e71037f0156 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:36.836820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-466c21b7-7a84-4660-91d4-cf1ccec95e9d req-ffa3164f-4c11-48a9-b7dc-02a93f83b6e7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125462 Jul 14 14:46:36.843978 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 949/1850] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:36.880649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:36.881778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:36.886826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:36.893385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.894159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.895152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:36.895795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:36.936062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:37.461239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:37.478541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:37.484448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:37.485464 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8521120-d196-4873-bdbc-23d20e367304 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.639255 Jul 14 14:46:37.490174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 950/1851] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:36 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:37.503079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:37.511106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:37.526872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.528800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:37.532218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:37.532685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:37.977486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=20 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:38.369443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:38.396651 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6e444c4-ce3e-43dd-9162-dbbc5e804385 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 0.904981 Jul 14 14:46:38.397509 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 951/1852] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:37 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:38.412197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:38.413030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:38.437224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:38.438638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:38.443227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:38.446593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:39.110080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:39.141271 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10ea3f60-9c8f-4cea-8197-e6381c6959b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1308 microversion: 2.1 time: 0.738676 Jul 14 14:46:39.166169 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 952/1853] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:38 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1308 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:39.186240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:39.190419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:39.207139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:39.208311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:39.209988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:39.210822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:39.914765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:39.928764 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be0de1b6-2607-407d-a1ee-74d04fcd15c7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1508 microversion: 2.1 time: 0.759634 Jul 14 14:46:39.930020 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 953/1854] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:39 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1508 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:39.949180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:39.951223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:39.971518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:39.971975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:39.972792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:39.973231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.167885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:40.207406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:40.212925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:40.217642 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7dbd790-14ed-4c9d-94eb-e53aa606b4e6 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.285782 Jul 14 14:46:40.220365 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 954/1855] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:39 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:40.232587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a2ffc5aa-d0ac-4577-9ee7-e3410fe27d1d req-65412464-a7e9-413f-b2aa-290008a2e93a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d90f15b-b309-497e-89c0-887f83d172e1", "tag": "68120eb9-edd3-4ca2-847c-5e19bcf5641e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:40.253194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=56 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:40.261721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a2ffc5aa-d0ac-4577-9ee7-e3410fe27d1d req-65412464-a7e9-413f-b2aa-290008a2e93a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.262924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a2ffc5aa-d0ac-4577-9ee7-e3410fe27d1d req-65412464-a7e9-413f-b2aa-290008a2e93a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.293889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a2ffc5aa-d0ac-4577-9ee7-e3410fe27d1d req-65412464-a7e9-413f-b2aa-290008a2e93a service nova] Creating event network-changed:68120eb9-edd3-4ca2-847c-5e19bcf5641e for instance 0d90f15b-b309-497e-89c0-887f83d172e1 on n-h2-768852-23 Jul 14 14:46:40.303517 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a2ffc5aa-d0ac-4577-9ee7-e3410fe27d1d req-65412464-a7e9-413f-b2aa-290008a2e93a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079801 Jul 14 14:46:40.305519 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 955/1856] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:40.319157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-47d6f8bd-8e0b-4949-8351-88cc0b56ff3a req-7deb43e4-b09c-42fa-921e-d01c8a7e5a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e84cbe00-18fa-4256-828b-59afa58e12f0", "name": "network-vif-deleted", "tag": "c3c6e28a-5abb-499b-9d2c-08703e602c92"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:40.339966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-47d6f8bd-8e0b-4949-8351-88cc0b56ff3a req-7deb43e4-b09c-42fa-921e-d01c8a7e5a40 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.340584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-47d6f8bd-8e0b-4949-8351-88cc0b56ff3a req-7deb43e4-b09c-42fa-921e-d01c8a7e5a40 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.359030 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-47d6f8bd-8e0b-4949-8351-88cc0b56ff3a req-7deb43e4-b09c-42fa-921e-d01c8a7e5a40 service nova] Creating event network-vif-deleted:c3c6e28a-5abb-499b-9d2c-08703e602c92 for instance e84cbe00-18fa-4256-828b-59afa58e12f0 on n-h1-768852-23 Jul 14 14:46:40.364796 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-47d6f8bd-8e0b-4949-8351-88cc0b56ff3a req-7deb43e4-b09c-42fa-921e-d01c8a7e5a40 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056231 Jul 14 14:46:40.366104 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 956/1857] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:40.373223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:40.374341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:40.382301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.383120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.384175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.384844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.595074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:40.608093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0103c1f5-87f2-46bb-bebc-ef26c5f3fa05 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 0.240074 Jul 14 14:46:40.609309 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 957/1858] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:40 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:40.623964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dcad88e0-9afa-4fdb-a855-44cb0c1e4c93 req-efc760d6-3891-4394-ad6e-872aeedb76b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f3940-0dbc-41c1-bf0b-9043e402e6ca", "name": "network-vif-plugged", "status": "completed", "tag": "b85248f6-5ba1-442f-92e6-c64ef45c05fe"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:40.636192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dcad88e0-9afa-4fdb-a855-44cb0c1e4c93 req-efc760d6-3891-4394-ad6e-872aeedb76b8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.637026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dcad88e0-9afa-4fdb-a855-44cb0c1e4c93 req-efc760d6-3891-4394-ad6e-872aeedb76b8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.666224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dcad88e0-9afa-4fdb-a855-44cb0c1e4c93 req-efc760d6-3891-4394-ad6e-872aeedb76b8 service nova] Creating event network-vif-plugged:b85248f6-5ba1-442f-92e6-c64ef45c05fe for instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca on n-h1-768852-23 Jul 14 14:46:40.673121 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dcad88e0-9afa-4fdb-a855-44cb0c1e4c93 req-efc760d6-3891-4394-ad6e-872aeedb76b8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062110 Jul 14 14:46:40.674472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 958/1859] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:40.688255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:40.689422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:40.697906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.708257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:40.710047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:40.710728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.124517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:41.149942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ceafc229-2ade-4805-bd6b-c856bcc54223 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 200 len: 1508 microversion: 2.1 time: 0.471530 Jul 14 14:46:41.151159 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 959/1860] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:40 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:41.172625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:41.174058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:41.188181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.189072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.192784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.193506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.431075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:41.442067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4e30e22-5a67-4699-b656-f4db5bf77529 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1308 microversion: 2.1 time: 0.289462 Jul 14 14:46:41.452890 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 960/1861] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:41 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1308 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:41.458913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:41.459630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:41.468147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.468672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.469751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.470053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.504602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:46:41.655780 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14df2b5b-13a3-42b6-bb7e-92196e1c9f7c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 204 len: 0 microversion: 2.1 time: 0.209954 Jul 14 14:46:41.656200 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 961/1862] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:46:41 2022] DELETE /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:41.662063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:41.662787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:41.675920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.679839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.682118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.683720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.779806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:41.790295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:41.792001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:41.793278 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88634247-2d44-4740-be01-482b1aaa7e18 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.135881 Jul 14 14:46:41.795081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 962/1863] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:41 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:41.815783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:41.824929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:41.837621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.838102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.838931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:41.842349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:41.968094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Building network info cache for instance {{(pid=125966) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:46:42.089409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:42.111433 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-acd02210-1679-4ad9-ae5d-c12e27c7f974 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 0.314739 Jul 14 14:46:42.136401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 963/1864] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:41 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:42.155125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1288668116", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e576d3b6-a989-4f8c-ac73-d2914dd9164a"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:42.286085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] validate_networks() for [('e576d3b6-a989-4f8c-ac73-d2914dd9164a', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:43.295596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:43.296283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:43.296753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:43.297387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:43.298650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:43.332260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:43.332877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:43.333757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:43.334219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:43.399132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Getting quotas for project 33d5773713f8495c9018a5aaed6fd744. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:43.404454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Getting quotas for user c2e85acbfcdc4b3a813830d6723b006f and project 33d5773713f8495c9018a5aaed6fd744. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:43.439714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:43.442449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:43.558063 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c5d8254-3058-4330-8076-707784c99f7b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.418362 Jul 14 14:46:43.559363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 964/1865] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:43.615257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:43.616314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:43.681729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:43.704582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:43.722798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:43.731114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:44.210422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:44.220256 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7de94bc9-9b26-49be-b991-56bb0b3cb15b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1488 microversion: 2.1 time: 0.637957 Jul 14 14:46:44.221430 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 965/1866] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:43 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1488 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:44.235828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ca5d51fa-b57f-46fa-bfe9-e1baa717198d req-ad7936a9-9df9-47f2-a989-9b59c5a8bd3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:44.273732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ca5d51fa-b57f-46fa-bfe9-e1baa717198d req-ad7936a9-9df9-47f2-a989-9b59c5a8bd3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:44.277238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ca5d51fa-b57f-46fa-bfe9-e1baa717198d req-ad7936a9-9df9-47f2-a989-9b59c5a8bd3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:44.300297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ca5d51fa-b57f-46fa-bfe9-e1baa717198d req-ad7936a9-9df9-47f2-a989-9b59c5a8bd3b service nova] Creating event network-changed:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:46:44.333455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ca5d51fa-b57f-46fa-bfe9-e1baa717198d req-ad7936a9-9df9-47f2-a989-9b59c5a8bd3b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109291 Jul 14 14:46:44.335709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 966/1867] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:44.343979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:44.347559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:44.384209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:44.388342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:44.390273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:44.397714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:44.529692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:44.561044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:44.563905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:44.572055 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c34d516a-4892-4272-8fd5-b277b9e8c87c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.234528 Jul 14 14:46:44.573588 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 967/1868] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:44 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:44.586368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fbb3d813-b90e-4d51-8989-5d0e663a57cc tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf29fcf70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:44.680156 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fbb3d813-b90e-4d51-8989-5d0e663a57cc tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843" status: 200 len: 637 microversion: 2.1 time: 0.104990 Jul 14 14:46:44.681138 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 968/1869] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:46:44 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843 => generated 637 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:44.707041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:44.713965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:44.735741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:44.746263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:44.748934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:44.749846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:45.052190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=63 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:45.388710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:45.399033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:45.401879 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aa2f8e7d-276d-4794-9065-71b62f97ce88 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 0.705684 Jul 14 14:46:45.403469 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 969/1870] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:44 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:45.425244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:45.426875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:45.440762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:45.441601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:45.443164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:45.443998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:45.606978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:45.640025 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63f8cd55-3d5e-428a-b41f-2030427a33b6 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1270 microversion: 2.1 time: 0.234694 Jul 14 14:46:45.644512 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 970/1871] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:45 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1270 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:45.656050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5bb12787-0a1d-49e0-b720-44a9c2b31055 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:45.666155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bb12787-0a1d-49e0-b720-44a9c2b31055 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:45.668763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bb12787-0a1d-49e0-b720-44a9c2b31055 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:45.852549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bb12787-0a1d-49e0-b720-44a9c2b31055 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Going to try to stop instance {{(pid=125965) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:46:45.947783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5bb12787-0a1d-49e0-b720-44a9c2b31055 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca/action" status: 202 len: 0 microversion: 2.1 time: 0.301151 Jul 14 14:46:45.949170 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 971/1872] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:45 2022] POST /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:46:45.955997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dfbdda18-bd6c-4b55-9a3b-186f3aee8594 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2a1eaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:46.035547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-dfbdda18-bd6c-4b55-9a3b-186f3aee8594 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:46.042209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-dfbdda18-bd6c-4b55-9a3b-186f3aee8594 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:46.779587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Updating instance_info_cache with network_info: [{"id": "dfc535b7-fcfc-455f-9212-5d4a90568b51", "address": "fa:16:3e:e8:ab:aa", "network": {"id": "f9874e65-6a5a-4909-a616-16d8c1f3be84", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-540124292-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a22f9857a34e48f7bc5d2bd97ef02b14", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfc535b7-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125966) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:46:46.800397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Releasing lock "refresh_cache-b7776d80-93f5-470b-8b17-b002137b94a1" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:46:46.804796 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-634d97e1-39c5-411a-ad8b-6bc10a88de58 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action" status: 202 len: 0 microversion: 2.1 time: 11.772533 Jul 14 14:46:46.810823 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 902/1873] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:35 2022] POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action => generated 0 bytes in 11777 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:46:46.824689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-30a56c2e-3038-4823-9f59-7e8de72f770b req-66f0b18f-d3da-46b8-8bad-fdb810ad0043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1f58dec-0020-4bce-9a9d-9686eb2c59fa", "name": "network-vif-deleted", "tag": "7c7a36ea-9457-428c-88e9-4eda827252d0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:46.848988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-30a56c2e-3038-4823-9f59-7e8de72f770b req-66f0b18f-d3da-46b8-8bad-fdb810ad0043 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.849464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-30a56c2e-3038-4823-9f59-7e8de72f770b req-66f0b18f-d3da-46b8-8bad-fdb810ad0043 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:46.850513 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dfbdda18-bd6c-4b55-9a3b-186f3aee8594 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.899333 Jul 14 14:46:46.853090 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 972/1874] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:45 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:46.890996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:46.892999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:46.902519 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-30a56c2e-3038-4823-9f59-7e8de72f770b req-66f0b18f-d3da-46b8-8bad-fdb810ad0043 service nova] Creating event network-vif-deleted:7c7a36ea-9457-428c-88e9-4eda827252d0 for instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa on n-h1-768852-23 Jul 14 14:46:46.924820 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-30a56c2e-3038-4823-9f59-7e8de72f770b req-66f0b18f-d3da-46b8-8bad-fdb810ad0043 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114187 Jul 14 14:46:46.926749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.927770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:46.932548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.933898 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 903/1875] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:46.936843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:46.953057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:46.958345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:46.983433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.984345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:46.985983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:46.987184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.182693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.229294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.233540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.236474 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-42c89af4-40bf-4df0-b8b2-8cc5ad32ad6b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.374948 Jul 14 14:46:47.253488 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 973/1876] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:46 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:47.274981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:47.276882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:47.294165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:47.295472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.297286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:47.298095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.523680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.558100 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a131fb69-d8f7-4d08-a7c6-e65073312b9f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 0.302058 Jul 14 14:46:47.571633 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 974/1877] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:47 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:47.582362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:47.584540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:47.606250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:47.607110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.612866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:47.613615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:47.938415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.962708 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-18032de4-15a5-4fa6-8e95-460ddbd51d4f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1318 microversion: 2.1 time: 0.386772 Jul 14 14:46:47.963711 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 975/1878] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:47 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1318 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:47.967990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:47.984676 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8bbbf1e2-0287-408e-b7e1-f1664477d691 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 1.045123 Jul 14 14:46:47.987914 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 904/1879] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:46 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:47.989600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.83"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:47.994310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:48.018333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21f018fc-2676-4a9b-b75d-875177135b10 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf2acd700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:48.022082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.025320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:48.026973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.027791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:48.098231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Acquired lock "refresh_cache-6b45efd5-48a1-471f-b6bb-7797893a6416" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:46:48.744577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21f018fc-2676-4a9b-b75d-875177135b10 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "DELETE /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.755285 Jul 14 14:46:48.745366 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 905/1880] 10.222.0.98 () {58 vars in 1295 bytes} [Thu Jul 14 14:46:47 2022] DELETE /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata/os_version => generated 0 bytes in 757 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:46:48.750313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-81e531a9-2537-4771-bc4e-145de32c9ced req-6997956f-910c-4372-80f5-06c01252c163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d90f15b-b309-497e-89c0-887f83d172e1", "name": "network-vif-plugged", "status": "completed", "tag": "68120eb9-edd3-4ca2-847c-5e19bcf5641e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:48.766138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81e531a9-2537-4771-bc4e-145de32c9ced req-6997956f-910c-4372-80f5-06c01252c163 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.770392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81e531a9-2537-4771-bc4e-145de32c9ced req-6997956f-910c-4372-80f5-06c01252c163 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:48.818416 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-81e531a9-2537-4771-bc4e-145de32c9ced req-6997956f-910c-4372-80f5-06c01252c163 service nova] Creating event network-vif-plugged:68120eb9-edd3-4ca2-847c-5e19bcf5641e for instance 0d90f15b-b309-497e-89c0-887f83d172e1 on n-h2-768852-23 Jul 14 14:46:48.830051 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-81e531a9-2537-4771-bc4e-145de32c9ced req-6997956f-910c-4372-80f5-06c01252c163 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081856 Jul 14 14:46:48.840816 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 906/1881] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:48.859800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:48.860771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:48.889389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.890730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:48.891829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:48.892502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:48.992231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.021255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.026154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.028659 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-adb25d50-abb0-4fb0-a80c-b3890eb27d3c tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.185581 Jul 14 14:46:49.046129 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 907/1882] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:48 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:49.067985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:49.068605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:49.075660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.076282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.077232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.077680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.648557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:49.713519 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bb055bfb-c650-4692-b894-9aef41827e0c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1318 microversion: 2.1 time: 0.662087 Jul 14 14:46:49.714585 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 908/1883] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:49 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1318 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:49.743378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-910cbb2a-32a0-4286-8510-170d39b28958 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf2ba1670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:49.816610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-910cbb2a-32a0-4286-8510-170d39b28958 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 37 microversion: 2.1 time: 0.087978 Jul 14 14:46:49.818577 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 909/1884] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:46:49 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 37 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:49.834036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:49.834667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:49.849882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.850704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.855985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:49.857969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:49.872373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:50.243100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:50.254730 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db467fcd-eadb-4f86-9430-bd4af1b98d76 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1318 microversion: 2.1 time: 0.433446 Jul 14 14:46:50.267417 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 910/1885] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:49 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1318 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:50.276372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:50.277521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:50.293296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:50.294298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:50.295662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:50.296426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:50.946732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:50.977952 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff31e7ce-3a9b-41c8-a3fe-85044ae22ae8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.708499 Jul 14 14:46:50.983607 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 911/1886] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:50 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:51.020324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a783395a-5620-4beb-b1a5-22cd81500ed4 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2acd550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:51.168317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a783395a-5620-4beb-b1a5-22cd81500ed4 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:51.179991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a783395a-5620-4beb-b1a5-22cd81500ed4 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:51.683014 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a783395a-5620-4beb-b1a5-22cd81500ed4 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.668774 Jul 14 14:46:51.684005 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 912/1887] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:50 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:51.689697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:51.690345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:51.711461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:51.712029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:51.712879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:51.713352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.200715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.213261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.215106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.216598 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a50bc057-4cf5-4860-96d7-faae1ea5185f tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.531595 Jul 14 14:46:52.217805 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 913/1888] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:51 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:52.222656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0c429919-3aa5-4845-8d98-6ba8cb5c3b14 req-252a687b-6d17-4cb1-b158-0ff6bbbc2db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a18c3086-b5d1-4580-8331-faa594d62ef1", "tag": "0ee38e2a-8cd4-47a5-a879-ad9a54abb678"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:52.233833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0c429919-3aa5-4845-8d98-6ba8cb5c3b14 req-252a687b-6d17-4cb1-b158-0ff6bbbc2db9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.234656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0c429919-3aa5-4845-8d98-6ba8cb5c3b14 req-252a687b-6d17-4cb1-b158-0ff6bbbc2db9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.248667 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0c429919-3aa5-4845-8d98-6ba8cb5c3b14 req-252a687b-6d17-4cb1-b158-0ff6bbbc2db9 service nova] Creating event network-changed:0ee38e2a-8cd4-47a5-a879-ad9a54abb678 for instance a18c3086-b5d1-4580-8331-faa594d62ef1 on n-h1-768852-23 Jul 14 14:46:52.254065 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0c429919-3aa5-4845-8d98-6ba8cb5c3b14 req-252a687b-6d17-4cb1-b158-0ff6bbbc2db9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034857 Jul 14 14:46:52.254798 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 914/1889] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:52.260559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:52.262106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:52.271806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.272939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.273833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.274353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.468430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.478666 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c6085ba-ce51-4874-b40f-78093441eda5 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1468 microversion: 2.1 time: 0.221133 Jul 14 14:46:52.479968 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 915/1890] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:52 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1468 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:52.485328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:52.486198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:52.494368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.495105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.496117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.496724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.731305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:52.742472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c753280-36e0-403a-bf65-e651fd803907 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1318 microversion: 2.1 time: 0.260472 Jul 14 14:46:52.743098 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 916/1891] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:52 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:52.764499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c064adf-87c7-40f2-aa63-7090bd529f36 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf2ad0700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:52.827957 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c064adf-87c7-40f2-aa63-7090bd529f36 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.082631 Jul 14 14:46:52.830843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 917/1892] 10.222.0.98 () {58 vars in 1289 bytes} [Thu Jul 14 14:46:52 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata/os_distro => generated 33 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:52.839391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:52.840259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:52.848856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.852755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:52.853919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:52.855832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.130284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:53.143931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad01503d-f8ea-4279-920e-796684b8a3b9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.311669 Jul 14 14:46:53.145565 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 918/1893] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:52 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:53.364756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:53.670184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1040471524", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": "none"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:53.803685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:53.805283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:53.807057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:53.807871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:53.809524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:53.822379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:53.823118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.824014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:53.824458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:53.849549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Getting quotas for project 8367f06d1b2b4cd4a95a8bcbd5036287. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:53.861262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Getting quotas for user 6d8f172412334ae48bc109a50ee084fd and project 8367f06d1b2b4cd4a95a8bcbd5036287. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:53.883709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:53.886295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:53.958096 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.network.neutron [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] re-assign floating IP 172.25.1.83 from instance b7776d80-93f5-470b-8b17-b002137b94a1 Jul 14 14:46:53.993917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9c18d1f-0206-42cd-9658-861cb8782cdc tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.846257 Jul 14 14:46:53.997897 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 919/1894] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:46:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:46:54.070751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Building network info cache for instance {{(pid=125965) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:46:54.388617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-425528208", "block_migration": true, "disk_over_commit": false}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:54.391005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:54.415636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.416446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.417933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:54.418748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:54.514193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lazy-loading 'flavor' on Instance uuid 0d90f15b-b309-497e-89c0-887f83d172e1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:46:54.619759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Going to try to live migrate instance to tempest-host-425528208 {{(pid=125966) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 14:46:54.666965 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] HTTP exception thrown: Compute host tempest-host-425528208 could not be found. Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Request method failure captured: Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1/action HTTP/1.1 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 106 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CxA4yjn2jefAWh6yI6fVf1npdLCHK03WRLgILQNeET6uWfWDXukuzFRhpMiO_HdxjU_fghcS-xI4dAUecU62LBTgV1eyp_vi_ooB_bfTRD55O8rz9qCcKoOqLzWQezHx-4HGT-yCaWnowQ5r-eFn-sT4uigVGoSql0zkTWqi3PvsyQ Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b31d622e4c4441f1a96a35d8f0fe1591 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveMigrationNegativeTest-1898809701 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveMigrationNegativeTest-1898809701 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b31d622e4c4441f1a96a35d8f0fe1591 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1898809701 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveMigrationNegativeTest-1898809701-project-admin Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 5bf9508bcf2745e689b69f42d54ea483 Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveMigrationNegativeTest-1898809701-project-admin Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: {"os-migrateLive": {"host": "tempest-host-425528208", "block_migration": true, "disk_over_commit": false}} Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: exception: Compute host tempest-host-425528208 could not be found. Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0d90f15b-b309-497e-89c0-887f83d172e1', 'body': {'os-migrateLive': {'host': 'tempest-host-425528208', 'block_migration': True, 'disk_over_commit': False}}} Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5355, in live_migrate Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Jul 14 14:46:54.689911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-425528208 could not be found. Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-425528208 could not be found. Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-425528208 could not be found. Jul 14 14:46:54.694068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:46:54.699742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Returning 400 to user: Compute host tempest-host-425528208 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:54.701133 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e3df42e-9706-43b0-b5d2-2f4cb88929d3 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1/action" status: 400 len: 99 microversion: 2.1 time: 0.701653 Jul 14 14:46:54.705502 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 920/1895] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Jul 14 14:46:53 2022] POST /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1/action => generated 99 bytes in 707 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:46:54.714124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f57bc8e4-e01f-4109-90d5-a73756227183 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2aca040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:54.802909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f57bc8e4-e01f-4109-90d5-a73756227183 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:54.809371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f57bc8e4-e01f-4109-90d5-a73756227183 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:55.512974 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f57bc8e4-e01f-4109-90d5-a73756227183 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.805478 Jul 14 14:46:55.514396 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 921/1896] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:54 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:55.525106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:55.526316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:55.535724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.536396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.538913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.538913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.719187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.721091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Updating instance_info_cache with network_info: [{"id": "dfc535b7-fcfc-455f-9212-5d4a90568b51", "address": "fa:16:3e:e8:ab:aa", "network": {"id": "f9874e65-6a5a-4909-a616-16d8c1f3be84", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-540124292-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a22f9857a34e48f7bc5d2bd97ef02b14", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfc535b7-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125965) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:46:55.744431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.747946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:55.750627 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1cb8e9a2-f727-4625-9a01-5f79155a8cee tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.234347 Jul 14 14:46:55.751767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 922/1897] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:55 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:55.752754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Building network info cache for instance {{(pid=125965) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:46:55.760793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:55.762342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:55.783684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.785349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:55.788874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:55.791219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.055893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:56.260379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:56.274929 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c902467-d4f1-4866-af29-5c768f368933 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1318 microversion: 2.1 time: 0.520519 Jul 14 14:46:56.276320 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 923/1898] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:55 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1318 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:56.284441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:56.285459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:56.295417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.296264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.298222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.299078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.417650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:56.429343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:56.431816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:56.433491 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8f73cc6-1e12-4075-aa76-ac45caffae55 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42" status: 200 len: 1336 microversion: 2.47 time: 0.155771 Jul 14 14:46:56.434459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 924/1899] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:56 2022] GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 => generated 1336 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:56.440357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:56.441278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:56.449763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.451059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.451703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:56.452382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:56.937088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:56.954894 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e240854a-744a-4e1b-87f7-1de7f5be0132 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.518638 Jul 14 14:46:56.956439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 925/1900] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:56 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:56.970735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-75381e26-82ef-4c15-a50f-2646581e0650 req-d8d5af44-3963-4713-a5f0-83df093e324b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}, {"name": "network-changed", "server_uuid": "6b45efd5-48a1-471f-b6bb-7797893a6416", "tag": "06449245-1597-46db-8d5c-878ca35fa42c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:56.994652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-75381e26-82ef-4c15-a50f-2646581e0650 req-d8d5af44-3963-4713-a5f0-83df093e324b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.000246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-75381e26-82ef-4c15-a50f-2646581e0650 req-d8d5af44-3963-4713-a5f0-83df093e324b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.035776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-75381e26-82ef-4c15-a50f-2646581e0650 req-d8d5af44-3963-4713-a5f0-83df093e324b service nova] Creating event network-changed:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:46:57.036550 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-75381e26-82ef-4c15-a50f-2646581e0650 req-d8d5af44-3963-4713-a5f0-83df093e324b service nova] Creating event network-changed:06449245-1597-46db-8d5c-878ca35fa42c for instance 6b45efd5-48a1-471f-b6bb-7797893a6416 on n-h2-768852-23 Jul 14 14:46:57.049799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-75381e26-82ef-4c15-a50f-2646581e0650 req-d8d5af44-3963-4713-a5f0-83df093e324b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.091663 Jul 14 14:46:57.050989 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 926/1901] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:57.062958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.067075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:57.099057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.099917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.101450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.102271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.347651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Updating instance_info_cache with network_info: [{"id": "06449245-1597-46db-8d5c-878ca35fa42c", "address": "fa:16:3e:61:fc:dc", "network": {"id": "f9874e65-6a5a-4909-a616-16d8c1f3be84", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-540124292-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a22f9857a34e48f7bc5d2bd97ef02b14", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap06449245-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125965) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:46:57.396841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Releasing lock "refresh_cache-6b45efd5-48a1-471f-b6bb-7797893a6416" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:46:57.399406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5a48c05-d8d8-48e3-82c6-3e9d1581c877 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416/action" status: 202 len: 0 microversion: 2.1 time: 9.428946 Jul 14 14:46:57.401416 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 976/1902] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:47 2022] POST /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416/action => generated 0 bytes in 9437 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:46:57.418499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df379281-c518-4a98-ae15-5401e40a06c6 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf29fc160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.527487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.531406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df379281-c518-4a98-ae15-5401e40a06c6 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.123963 Jul 14 14:46:57.532005 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 977/1903] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:57.538864 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0adaba96-e730-47e7-9666-99e4c1e80037 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1468 microversion: 2.1 time: 0.486146 Jul 14 14:46:57.545470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1444336658", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": "none"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:57.553283 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 927/1904] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1468 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:57.573647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.574335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:57.600673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.601168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.604342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.604728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.698623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:57.699035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:57.701296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:57.703472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:57.704420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:57.735997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.736826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.738782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.740141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.784162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Getting quotas for project 8367f06d1b2b4cd4a95a8bcbd5036287. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:57.799428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Getting quotas for user 6d8f172412334ae48bc109a50ee084fd and project 8367f06d1b2b4cd4a95a8bcbd5036287. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:57.824984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.840586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.847145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:57.849187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:57.854020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:57.859013 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab9f3600-1af1-48c8-a846-33d5e46438f0 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.300935 Jul 14 14:46:57.873807 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 928/1905] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:57.884518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:57.890600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:57.908422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.910791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:57.912110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:57.914074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:58.014696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef2f8bfc-17a6-4af7-ae66-a841cb4ee303 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.474433 Jul 14 14:46:58.016578 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 978/1906] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:46:58.055786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.83"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:58.427788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:58.468347 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b87e641-f8cc-4b90-9039-0b1a5be94a0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1318 microversion: 2.1 time: 0.590728 Jul 14 14:46:58.470529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 929/1907] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:57 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1318 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:58.490760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8e340cb-187d-4f2e-a260-fa8a60d9dc01 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2b3d670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:58.702906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d8e340cb-187d-4f2e-a260-fa8a60d9dc01 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:58.729887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d8e340cb-187d-4f2e-a260-fa8a60d9dc01 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:59.083048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:59.098655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.103859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.105082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.105767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.178730 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8e340cb-187d-4f2e-a260-fa8a60d9dc01 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.706744 Jul 14 14:46:59.183675 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 930/1908] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:46:58 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:46:59.196364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1231169072", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:59.264686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:46:59.467833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] HTTP exception thrown: Floating IP 172.25.1.83 is not associated with instance b7776d80-93f5-470b-8b17-b002137b94a1. Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Request method failure captured: Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action HTTP/1.1 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 48 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CwI93aVnZ-dDsCZCEowGBC9Gf5I-5BhAODhPez-4fUfYvhmW1VoyE7isLocKtpkk7V-QdLY0yEE1fQzye8mBJxY9UbzOojHmNIOObw96ZZswt2rg_TI2ZOQWdnOVnct51zVPxJp9yt-WucdVnjextg4_LicxCvQ6K2h0WeP05bgUaY Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: f1d8ca06f8d2469382275fd2e36c538c Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: {"removeFloatingIp": {"address": "172.25.1.83"}} Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: exception: Floating IP 172.25.1.83 is not associated with instance b7776d80-93f5-470b-8b17-b002137b94a1. Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b7776d80-93f5-470b-8b17-b002137b94a1', 'body': {'removeFloatingIp': {'address': '172.25.1.83'}}} Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.1.83 is not associated with instance b7776d80-93f5-470b-8b17-b002137b94a1. Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.1.83 is not associated with instance b7776d80-93f5-470b-8b17-b002137b94a1. Jul 14 14:46:59.471399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:46:59.476177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Returning 409 to user: Floating IP 172.25.1.83 is not associated with instance b7776d80-93f5-470b-8b17-b002137b94a1. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:46:59.476177 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1013185-276c-4d26-886b-4c8a21dd2526 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action" status: 409 len: 145 microversion: 2.1 time: 1.445572 Jul 14 14:46:59.476808 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 979/1909] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:46:58 2022] POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action => generated 145 bytes in 1451 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:46:59.487459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:59.488634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:59.499914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.500455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.501459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.503078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.617131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:46:59.618871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:46:59.618871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:46:59.619311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:46:59.620073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:46:59.637819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.638444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.639857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.640404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.685297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Getting quotas for project 1c56ef362cf84d91bb841ab512e3665e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:46:59.690780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Getting quotas for user df11930b59684df585c3b90e0300aeb3 and project 1c56ef362cf84d91bb841ab512e3665e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:46:59.707669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:46:59.710586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:46:59.720015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:46:59.731318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1031957-fc9d-4808-8143-7257f580ddd6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.252811 Jul 14 14:46:59.731946 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 980/1910] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:46:59 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:46:59.744548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:59.745758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:59.759464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.760047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.761285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.761425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.787856 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fa9bb06-53ed-4f97-9fca-17473d1ebb96 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607026 Jul 14 14:46:59.795071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 931/1911] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:46:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:46:59.800543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ba6fe74d-a49f-4ec0-8a0c-85b2774044ad req-7b777264-b30f-43af-8b19-6c2e358e0483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18c3086-b5d1-4580-8331-faa594d62ef1", "name": "network-vif-plugged", "status": "completed", "tag": "0ee38e2a-8cd4-47a5-a879-ad9a54abb678"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:46:59.809013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:46:59.830603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ba6fe74d-a49f-4ec0-8a0c-85b2774044ad req-7b777264-b30f-43af-8b19-6c2e358e0483 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.832500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ba6fe74d-a49f-4ec0-8a0c-85b2774044ad req-7b777264-b30f-43af-8b19-6c2e358e0483 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.856393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-951876d9-27a6-4a34-a472-d34c3c68cf75 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "PUT /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1048 microversion: 2.47 time: 0.122337 Jul 14 14:46:59.857071 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 981/1912] 10.222.0.98 () {62 vars in 1296 bytes} [Thu Jul 14 14:46:59 2022] PUT /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1048 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:46:59.885501 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ba6fe74d-a49f-4ec0-8a0c-85b2774044ad req-7b777264-b30f-43af-8b19-6c2e358e0483 service nova] Creating event network-vif-plugged:0ee38e2a-8cd4-47a5-a879-ad9a54abb678 for instance a18c3086-b5d1-4580-8331-faa594d62ef1 on n-h1-768852-23 Jul 14 14:46:59.906268 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ba6fe74d-a49f-4ec0-8a0c-85b2774044ad req-7b777264-b30f-43af-8b19-6c2e358e0483 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109706 Jul 14 14:46:59.910443 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 932/1913] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:46:59.923717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:46:59.924533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:46:59.942073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.942639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:46:59.946370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:46:59.948148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.105222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.108563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:00.122626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.125887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.127780 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-486528f7-27db-4c2f-8053-4771696d8a07 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.216402 Jul 14 14:47:00.128475 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 933/1914] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:46:59 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:00.148525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b982211-2709-40d6-9504-53d8eb444f86 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2b6a040>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:00.195228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d57688b-0b60-4b5b-829e-89f19f52ae19 tempest-NetworksTest-617557915 tempest-NetworksTest-617557915-project-admin] Calling method '.version_select at 0x7fdbf2a3b3a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:00.270464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5b982211-2709-40d6-9504-53d8eb444f86 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:00.278205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5b982211-2709-40d6-9504-53d8eb444f86 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:00.496029 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d57688b-0b60-4b5b-829e-89f19f52ae19 tempest-NetworksTest-617557915 tempest-NetworksTest-617557915-project-admin] 10.222.0.98 "GET /compute/v2.1/os-networks" status: 200 len: 6712 microversion: 2.1 time: 0.635944 Jul 14 14:47:00.496989 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 982/1915] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:46:59 2022] GET /compute/v2.1/os-networks => generated 6712 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:00.507446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.83"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:00.681696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:00.705380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.706590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.708423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.711503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.754615 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b982211-2709-40d6-9504-53d8eb444f86 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 64 microversion: 2.1 time: 0.624117 Jul 14 14:47:00.756246 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 934/1916] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:00 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 64 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:00.763881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:00.764590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:00.773035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.773504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.774299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.774740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.964653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:00.973375 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e076b760-27dd-4e4e-8b4f-d3b49071d3d8 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1318 microversion: 2.1 time: 0.214422 Jul 14 14:47:00.974651 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 935/1917] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:00 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:00.979777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:00.980712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:00.991092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.991911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:00.992949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:00.993390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.017680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Acquired lock "refresh_cache-6b45efd5-48a1-471f-b6bb-7797893a6416" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:47:01.084408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.094706 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77c5842d-2bb7-44f1-bb41-a13fa71237fe tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1223 microversion: 2.1 time: 0.118402 Jul 14 14:47:01.095969 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 936/1918] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:00 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:01.106925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.111771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:01.125636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.126522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.127951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.128745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.246970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.258389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.260188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.263405 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc7f8a99-f89d-423a-8e80-043cb8f19b19 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1336 microversion: 2.47 time: 0.164826 Jul 14 14:47:01.273984 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 937/1919] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1336 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:01.279315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99b0e28a-4ede-4aaa-8e4a-f330db609360 tempest-NetworksTest-617557915 tempest-NetworksTest-617557915-project-admin] Calling method '.version_select at 0x7fdbf2b6db80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.410028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99b0e28a-4ede-4aaa-8e4a-f330db609360 tempest-NetworksTest-617557915 tempest-NetworksTest-617557915-project-admin] 10.222.0.98 "GET /compute/v2.1/os-networks/91cb616b-4d80-46c0-9cdc-6a18fbc05771" status: 200 len: 652 microversion: 2.1 time: 0.134402 Jul 14 14:47:01.411767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 938/1920] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/os-networks/91cb616b-4d80-46c0-9cdc-6a18fbc05771 => generated 652 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:01.424117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.425418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:01.438155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.439093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.440671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.441553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.716616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.734342 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02228b7b-a93d-4cac-8118-5e21dcd0aedb tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.320521 Jul 14 14:47:01.736115 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 939/1921] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:01.748653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d17c12a-9f37-42d1-abd2-51856762cd69 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf2a49670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.816456 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d17c12a-9f37-42d1-abd2-51856762cd69 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 64 microversion: 2.1 time: 0.078365 Jul 14 14:47:01.818066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 940/1922] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 64 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:01.828184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:01.829474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:01.840097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.841051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.842609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:01.843527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:01.961118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.970712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.972587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2020ca323f8947adb35690d56979724d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93c4325b23c544eab268df27d8f485af', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:01.974010 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a7c9758-2c45-48be-a777-edbec2778087 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 200 len: 1603 microversion: 2.42 time: 0.155092 Jul 14 14:47:01.975997 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 941/1923] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 1603 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:01.981137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e6defd1-c3e8-41c6-b8a1-cae501daca33 tempest-NetworksTest-617557915 tempest-NetworksTest-617557915-project-admin] Calling method '.version_select at 0x7fdbf2acaa60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:02.016826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Building network info cache for instance {{(pid=125965) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:47:02.323223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e6defd1-c3e8-41c6-b8a1-cae501daca33 tempest-NetworksTest-617557915 tempest-NetworksTest-617557915-project-admin] 10.222.0.98 "GET /compute/v2.1/os-networks" status: 200 len: 6712 microversion: 2.1 time: 0.345572 Jul 14 14:47:02.323871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 942/1924] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:47:01 2022] GET /compute/v2.1/os-networks => generated 6712 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:02.331639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae393a3f-a470-4180-99fc-815da443e592 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2a58430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:02.422073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-ae393a3f-a470-4180-99fc-815da443e592 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:02.436074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-ae393a3f-a470-4180-99fc-815da443e592 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:03.073226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae393a3f-a470-4180-99fc-815da443e592 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.747751 Jul 14 14:47:03.074768 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 943/1925] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:02 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:03.086579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.087618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.105169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.106297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.108972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.110702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.518546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.528620 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cccbacc4-20ad-481b-90aa-3e4f8806871b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1509 microversion: 2.1 time: 0.452401 Jul 14 14:47:03.532096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 944/1926] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1509 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:03.542943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-25742820-b7c8-49fd-b416-dc5ecfb7f7d2 req-d4c7f5be-bdc0-49a8-98e3-9e42dd179643 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b45efd5-48a1-471f-b6bb-7797893a6416", "tag": "06449245-1597-46db-8d5c-878ca35fa42c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:03.567162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-25742820-b7c8-49fd-b416-dc5ecfb7f7d2 req-d4c7f5be-bdc0-49a8-98e3-9e42dd179643 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.568093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-25742820-b7c8-49fd-b416-dc5ecfb7f7d2 req-d4c7f5be-bdc0-49a8-98e3-9e42dd179643 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.591649 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-25742820-b7c8-49fd-b416-dc5ecfb7f7d2 req-d4c7f5be-bdc0-49a8-98e3-9e42dd179643 service nova] Creating event network-changed:06449245-1597-46db-8d5c-878ca35fa42c for instance 6b45efd5-48a1-471f-b6bb-7797893a6416 on n-h2-768852-23 Jul 14 14:47:03.604399 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-25742820-b7c8-49fd-b416-dc5ecfb7f7d2 req-d4c7f5be-bdc0-49a8-98e3-9e42dd179643 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071584 Jul 14 14:47:03.605492 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 945/1927] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:03.621679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.622871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.637292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.637292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.638906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.639769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.768849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Updating instance_info_cache with network_info: [{"id": "06449245-1597-46db-8d5c-878ca35fa42c", "address": "fa:16:3e:61:fc:dc", "network": {"id": "f9874e65-6a5a-4909-a616-16d8c1f3be84", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-540124292-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a22f9857a34e48f7bc5d2bd97ef02b14", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap06449245-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125965) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:47:03.794535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Releasing lock "refresh_cache-6b45efd5-48a1-471f-b6bb-7797893a6416" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:47:03.796095 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5a700573-8f16-4888-837e-96a7a768762e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416/action" status: 202 len: 0 microversion: 2.1 time: 3.297372 Jul 14 14:47:03.797674 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 983/1928] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:00 2022] POST /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416/action => generated 0 bytes in 3300 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:47:03.800511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.809094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.809964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.819488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.820236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.821335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.821788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.830413 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0403acea-48a9-4b67-9a68-60f042693a90 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1277 microversion: 2.1 time: 0.219289 Jul 14 14:47:03.849681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 946/1929] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1277 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:03.855111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.860680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.877395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.878330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.879855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.880721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.951492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.967573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.969812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:03.972505 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2adef37e-5702-44b7-b88e-bbc76c12afe5 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1357 microversion: 2.47 time: 0.169359 Jul 14 14:47:03.974260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 984/1930] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:03.983009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:03.984161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:03.996272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.997350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:03.999148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:03.999817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.021060 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] HTTP exception thrown: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Request method failure captured: Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 HTTP/1.1 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CqZut_RYLU9rkaYWGF9iCz-4BGvu7oQVYUnpv_p_TF5WqNcXEUXgAQEOiyVR2kqKPO9lGpDMSMn3ihtk_RWJ79xsGkryq8jD3MbJYaTVPODASz56V7KooNXviwdLQ3kY4GiW2Vnc79U2_-L8zq2OqtFieNuSIwqdXAeEiqBRxdEKYQ Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.42 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 93c4325b23c544eab268df27d8f485af Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93c4325b23c544eab268df27d8f485af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93c4325b23c544eab268df27d8f485af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93c4325b23c544eab268df27d8f485af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93c4325b23c544eab268df27d8f485af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 93c4325b23c544eab268df27d8f485af Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TaggedBootDevicesTest_v242-1301915344-project Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2020ca323f8947adb35690d56979724d Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1301915344-project Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e84cbe00-18fa-4256-828b-59afa58e12f0'} Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:04.023488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Returning 404 to user: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:04.028010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2af1a9e-35a0-49b8-914d-489b7a01d005 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 404 len: 111 microversion: 2.42 time: 0.049322 Jul 14 14:47:04.030989 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 985/1931] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:47:04.037754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b738b598-1410-4c98-a47b-02ff035c53e1 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update', calling method: .version_select at 0x7fdbf2a201f0>, body: {"meta": {"os_version": "alt"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:04.106822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b738b598-1410-4c98-a47b-02ff035c53e1 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:04.113372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b738b598-1410-4c98-a47b-02ff035c53e1 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:04.118618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:04.168377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.196784 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f600db15-b24a-4e4f-8275-14d27be350b8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.341173 Jul 14 14:47:04.211696 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 947/1932] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:03 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:04.228693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:04.229355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:04.247388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.247847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.248657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.249097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.771623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:04.787544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bece846-1c16-411e-83a4-8801c7824173 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1509 microversion: 2.1 time: 0.574385 Jul 14 14:47:04.795353 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 948/1933] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:04 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:04.802847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:04.804316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:04.818850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.819446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.820417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.820872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.862717 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b738b598-1410-4c98-a47b-02ff035c53e1 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.830399 Jul 14 14:47:04.864324 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 986/1934] 10.222.0.98 () {60 vars in 1312 bytes} [Thu Jul 14 14:47:04 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata/os_version => generated 31 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:04.874283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:04.880423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:04.900503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:04.908956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.909750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:04.912085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:04.915668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.077320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9479bdd7-f9f5-4ffa-9180-bd805b2bb5cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 204 len: 0 microversion: 2.1 time: 0.278635 Jul 14 14:47:05.078351 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 949/1935] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:04 2022] DELETE /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:05.078758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:05.079627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:05.085421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:05.086229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:05.087908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:05.098510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05ac3da6-0da5-4b85-9fa0-ef224b1a5907 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '.version_select at 0x7fdbf2a6f670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:05.145553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=4,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:05.147744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05ac3da6-0da5-4b85-9fa0-ef224b1a5907 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-545208601" status: 204 len: 0 microversion: 2.42 time: 0.065976 Jul 14 14:47:05.149128 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 950/1936] 10.222.0.98 () {60 vars in 1258 bytes} [Thu Jul 14 14:47:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-545208601 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:47:05.160209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:05.164643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.178796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.180283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.186256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.187456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.229807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.280070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.280901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.282139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.282752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.329349 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f816a115-34d1-4e12-afa3-f9a914219144 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "POST /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be/action" status: 202 len: 1079 microversion: 2.47 time: 0.462598 Jul 14 14:47:05.330468 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 987/1937] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:47:04 2022] POST /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be/action => generated 1079 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:47:05.345152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:05.347475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.357002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.357809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.358771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.359885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.392541 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08db9b26-74ac-49cd-8fcc-1ae43d6ba12b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "PUT /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1081 microversion: 2.1 time: 0.241449 Jul 14 14:47:05.393685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 951/1938] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 14:47:05 2022] PUT /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1081 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:05.400265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-047d2b05-0031-4a67-8d29-cbe5d522d77d tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf2ad0700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:05.462852 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-047d2b05-0031-4a67-8d29-cbe5d522d77d tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 58 microversion: 2.1 time: 0.067327 Jul 14 14:47:05.471918 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 952/1939] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:47:05 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 58 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:05.474335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.83"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:05.476330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.486182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.486762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.487623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.488071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.525379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Acquired lock "refresh_cache-b7776d80-93f5-470b-8b17-b002137b94a1" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:47:05.758732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:05.775719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df500c59-a21c-4393-952f-5092d3ad454b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1319 microversion: 2.1 time: 0.443230 Jul 14 14:47:05.777338 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 988/1940] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:05 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:05.795679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:05.796790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:05.822992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.824021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:05.825994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:05.826817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.470517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.484017 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc3d7447-a1cb-4355-b7be-a776047f96d7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.704442 Jul 14 14:47:06.487320 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 989/1941] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:05 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:06.503057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:06.511841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:06.523547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.523815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.524812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.525333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.672853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.689076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.695844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:06.698380 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1be85ffb-9b85-4de6-9db6-02563f5e0204 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.204428 Jul 14 14:47:06.699098 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 990/1942] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:06 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:06.705504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:06.708413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:06.739529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.741354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:06.744624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:06.746053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:07.423736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:07.462848 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-494f39ee-e0d2-4ec9-a786-a34c97227c0b tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1507 microversion: 2.1 time: 0.754224 Jul 14 14:47:07.467068 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 991/1943] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:06 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1507 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:07.478253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-11bb9661-4127-4d2e-a57e-f9361a53c3ad tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'update_all', calling method: .version_select at 0x7fdbf2a14e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:07.569158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-11bb9661-4127-4d2e-a57e-f9361a53c3ad tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:07.579426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-11bb9661-4127-4d2e-a57e-f9361a53c3ad tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:07.761398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:08.107743 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-11bb9661-4127-4d2e-a57e-f9361a53c3ad tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 61 microversion: 2.1 time: 0.636712 Jul 14 14:47:08.114856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 992/1944] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:07 2022] PUT /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 61 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:08.114856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.114856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.123079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.123079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.123943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.124391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.327179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:08.339329 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-007146de-2d7f-4571-86ac-a52e44178671 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1319 microversion: 2.1 time: 0.227479 Jul 14 14:47:08.339329 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 993/1945] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1319 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:08.346555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fce0c1ae-8a19-4fb1-9a4d-a4d3b0b45af7 req-2f354063-8b6c-4ccc-8194-c7c0a9f73939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e18247a-2872-48b0-a756-53392137efb5", "tag": "f640afe3-678d-481d-9d02-9c156197231d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:08.357132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fce0c1ae-8a19-4fb1-9a4d-a4d3b0b45af7 req-2f354063-8b6c-4ccc-8194-c7c0a9f73939 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.357792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fce0c1ae-8a19-4fb1-9a4d-a4d3b0b45af7 req-2f354063-8b6c-4ccc-8194-c7c0a9f73939 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.374576 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fce0c1ae-8a19-4fb1-9a4d-a4d3b0b45af7 req-2f354063-8b6c-4ccc-8194-c7c0a9f73939 service nova] Creating event network-changed:f640afe3-678d-481d-9d02-9c156197231d for instance 2e18247a-2872-48b0-a756-53392137efb5 on n-h1-768852-23 Jul 14 14:47:08.383143 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fce0c1ae-8a19-4fb1-9a4d-a4d3b0b45af7 req-2f354063-8b6c-4ccc-8194-c7c0a9f73939 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043401 Jul 14 14:47:08.387488 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 994/1946] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:08.395074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.396295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.418118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.418118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.418118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.418118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.727147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:08.738946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69147b10-8ad0-463b-af34-f7e9bc2f5178 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1507 microversion: 2.1 time: 0.349562 Jul 14 14:47:08.740259 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 995/1947] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1507 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:08.763528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:08.765001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:08.776538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.777759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.781043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:08.782083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:08.959178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Building network info cache for instance {{(pid=125966) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:47:09.141211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.159796 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a90d3eb8-4597-4748-bf21-bd2e469e5cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.416084 Jul 14 14:47:09.162384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 996/1948] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:08 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:09.188777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:09.190518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:09.218291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:09.220831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:09.241373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:09.243109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:09.656497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:09.656762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.721474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.725968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:09.731933 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b77fea3c-ec1a-4195-b3e5-79c046b84202 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.566937 Jul 14 14:47:09.743352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 997/1949] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:09 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:09.748983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a879f5d5-0f7b-4c8f-b935-4b443b1967f6 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Action: 'create', calling method: .version_select at 0x7fdbf2a61af0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:09.826824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a879f5d5-0f7b-4c8f-b935-4b443b1967f6 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:09.832711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a879f5d5-0f7b-4c8f-b935-4b443b1967f6 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Getting quotas for user 7be704e59540422f94bae37a4d36dbdb and project 78242c6301c94132a739c3390dfcbe99. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:10.685681 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a879f5d5-0f7b-4c8f-b935-4b443b1967f6 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "POST /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 85 microversion: 2.1 time: 0.940336 Jul 14 14:47:10.688376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 998/1950] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Jul 14 14:47:09 2022] POST /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 85 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:10.722205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-95edf984-cdd3-4bde-a71f-9e32b7a119ef req-53c093b9-82ea-4d5f-908d-96227b398c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b45efd5-48a1-471f-b6bb-7797893a6416", "name": "network-vif-deleted", "tag": "06449245-1597-46db-8d5c-878ca35fa42c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:10.736412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-95edf984-cdd3-4bde-a71f-9e32b7a119ef req-53c093b9-82ea-4d5f-908d-96227b398c9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.737652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-95edf984-cdd3-4bde-a71f-9e32b7a119ef req-53c093b9-82ea-4d5f-908d-96227b398c9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.773676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-95edf984-cdd3-4bde-a71f-9e32b7a119ef req-53c093b9-82ea-4d5f-908d-96227b398c9c service nova] Creating event network-vif-deleted:06449245-1597-46db-8d5c-878ca35fa42c for instance 6b45efd5-48a1-471f-b6bb-7797893a6416 on n-h2-768852-23 Jul 14 14:47:10.793612 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-95edf984-cdd3-4bde-a71f-9e32b7a119ef req-53c093b9-82ea-4d5f-908d-96227b398c9c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100744 Jul 14 14:47:10.794888 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 999/1951] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:10.802329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:10.804976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:10.816132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.816698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.817544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.818309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.938937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c581efce-df17-4f32-a62c-e72dc708231e tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "PUT /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1083 microversion: 2.1 time: 0.140189 Jul 14 14:47:10.942491 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1000/1952] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 14:47:10 2022] PUT /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1083 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:10.962580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:10.963799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:10.971559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.972411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.973814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:10.974582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:10.980133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Updating instance_info_cache with network_info: [{"id": "dfc535b7-fcfc-455f-9212-5d4a90568b51", "address": "fa:16:3e:e8:ab:aa", "network": {"id": "f9874e65-6a5a-4909-a616-16d8c1f3be84", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-540124292-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a22f9857a34e48f7bc5d2bd97ef02b14", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfc535b7-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125966) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:47:11.010453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Releasing lock "refresh_cache-b7776d80-93f5-470b-8b17-b002137b94a1" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:47:11.014412 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e3cd3c3-4a8e-4cbd-bbd7-9ca49bf7cd11 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action" status: 202 len: 0 microversion: 2.1 time: 5.546923 Jul 14 14:47:11.017914 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 953/1953] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:05 2022] POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action => generated 0 bytes in 5553 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:47:11.036610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:11.041103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:11.058575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.060734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.062484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.063465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.699537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:11.708308 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec39a903-f4bf-442a-803b-f865d0cdc93f tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1319 microversion: 2.1 time: 0.764035 Jul 14 14:47:11.711330 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1001/1954] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:10 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1319 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:11.714890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93c98ff4-1684-4a6e-b98d-170a4a525380 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] Calling method '.version_select at 0x7fdbf2986430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:11.791302 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93c98ff4-1684-4a6e-b98d-170a4a525380 tempest-ImagesMetadataTestJSON-1995377137 tempest-ImagesMetadataTestJSON-1995377137-project] 10.222.0.98 "GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata" status: 200 len: 85 microversion: 2.1 time: 0.080727 Jul 14 14:47:11.792327 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1002/1955] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/images/490c10ce-40ce-43b8-8160-7dd4213d2843/metadata => generated 85 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:47:11.800872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:11.802143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:11.881009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.884865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.885164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:11.885618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:11.944503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:11.963847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:11.973515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d39e3f49-e534-4c7f-8833-7d9ab2ba5df8 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.952877 Jul 14 14:47:11.983396 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 954/1956] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:12.004526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:12.005720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:12.020121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.021145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.022660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.029377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.045793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.075478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.080330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.085646 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3545338-e6ee-4a7b-802a-a1cb78c3008c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.291104 Jul 14 14:47:12.087522 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1003/1957] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:12.123576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02df66b3-1a6c-4039-b862-f418c0829377 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '.version_select at 0x7fdbf2ae2d30>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:12.478645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=32 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:12.631204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02df66b3-1a6c-4039-b862-f418c0829377 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips/4ec931c1-49cf-42c0-9aeb-20998ef82b15" status: 200 len: 183 microversion: 2.1 time: 0.541949 Jul 14 14:47:12.632438 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1004/1958] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:47:12 2022] GET /compute/v2.1/os-floating-ips/4ec931c1-49cf-42c0-9aeb-20998ef82b15 => generated 183 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:12.649483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.83"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:12.708662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:12.724798 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c01320f-3327-4186-a131-67e8f77efdf4 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1509 microversion: 2.1 time: 0.738570 Jul 14 14:47:12.726626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 955/1959] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:11 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1509 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:12.743316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:12.744544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:12.758116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.759064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:12.760264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:12.770355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.074231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.097217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.098000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.099524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.100349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.337995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.352507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a853c979-d8ab-417c-a0e6-360d23c8b81a tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1319 microversion: 2.1 time: 0.624181 Jul 14 14:47:13.353563 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 956/1960] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:12 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1319 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:13.371235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.372343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:13.386901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.387392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.388200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.388637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.823519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:13.851577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d97204d8-9a17-48dd-9c13-12decaf90b65 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1509 microversion: 2.1 time: 0.484244 Jul 14 14:47:13.854954 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 957/1961] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1509 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:13.866291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-283db88a-bd15-46ba-96fe-c781b152c15c req-fbc88343-1b15-433e-b783-33580ba5c616 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:13.897638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-283db88a-bd15-46ba-96fe-c781b152c15c req-fbc88343-1b15-433e-b783-33580ba5c616 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:13.898920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-283db88a-bd15-46ba-96fe-c781b152c15c req-fbc88343-1b15-433e-b783-33580ba5c616 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:13.914685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Acquired lock "refresh_cache-b7776d80-93f5-470b-8b17-b002137b94a1" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:47:13.932223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-283db88a-bd15-46ba-96fe-c781b152c15c req-fbc88343-1b15-433e-b783-33580ba5c616 service nova] Creating event network-changed:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:47:13.946219 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-283db88a-bd15-46ba-96fe-c781b152c15c req-fbc88343-1b15-433e-b783-33580ba5c616 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088170 Jul 14 14:47:13.947514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 958/1962] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:13.963990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:13.965595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.017088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.020641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.023915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.026482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.550430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.565021 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae1b64dd-a144-40ed-8311-b7698b0cd711 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.614302 Jul 14 14:47:14.566087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 959/1963] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:13 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:14.577600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.578259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.600987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.601943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.603076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.612144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.881936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.907044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.916937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:14.920204 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d341d6eb-0447-4e79-9db2-50191dc7312a tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.352997 Jul 14 14:47:14.927873 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 960/1964] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:14 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:14.947661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:14.953140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:14.974781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.977498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:14.982847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:14.984793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.054896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:15.251509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c0b9fc3-bd47-439e-9811-d16152be1ae7 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 204 len: 0 microversion: 2.1 time: 0.318739 Jul 14 14:47:15.252623 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 961/1965] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:14 2022] DELETE /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:15.260712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.261487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.268707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.269494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.270818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.271467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.665931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:15.684384 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2c6ec5e-c8a9-460d-b5c0-8514dd35e32c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1319 microversion: 2.1 time: 0.430190 Jul 14 14:47:15.685305 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 962/1966] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:15.690817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.693708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.707178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.710878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.712502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.712950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.784878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:15.880477 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Instance is already in deleting state, ignoring this request Jul 14 14:47:15.881994 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21946cda-2110-4655-a6b9-071bbced28f1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 204 len: 0 microversion: 2.1 time: 0.194795 Jul 14 14:47:15.884671 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 963/1967] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:15 2022] DELETE /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:15.891776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e8bd074e-46db-4362-a39b-87ad1a57caac req-6076b42d-33e9-408b-86d9-d477662d7483 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e18247a-2872-48b0-a756-53392137efb5", "name": "network-vif-plugged", "status": "completed", "tag": "f640afe3-678d-481d-9d02-9c156197231d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:15.912042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e8bd074e-46db-4362-a39b-87ad1a57caac req-6076b42d-33e9-408b-86d9-d477662d7483 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.913832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e8bd074e-46db-4362-a39b-87ad1a57caac req-6076b42d-33e9-408b-86d9-d477662d7483 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.933072 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e8bd074e-46db-4362-a39b-87ad1a57caac req-6076b42d-33e9-408b-86d9-d477662d7483 service nova] Creating event network-vif-plugged:f640afe3-678d-481d-9d02-9c156197231d for instance 2e18247a-2872-48b0-a756-53392137efb5 on n-h1-768852-23 Jul 14 14:47:15.940177 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e8bd074e-46db-4362-a39b-87ad1a57caac req-6076b42d-33e9-408b-86d9-d477662d7483 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052927 Jul 14 14:47:15.946560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Building network info cache for instance {{(pid=125965) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:47:15.955150 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 964/1968] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:15.967775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:15.968795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:15.995643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.996093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:15.997109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:15.997700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.413637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.425350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c60311b-3050-4dff-b6d4-d648325c6d09 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1498 microversion: 2.1 time: 0.464997 Jul 14 14:47:16.425350 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 965/1969] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:15 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1498 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:16.431934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:16.432618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:16.442940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.444262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.446087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.446545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.722554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:16.738123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e8a83966-d210-499e-a362-32c57e651aa2 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1515 microversion: 2.1 time: 0.311231 Jul 14 14:47:16.739395 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 966/1970] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:16 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:16.755834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6711a099-19d4-4f72-833f-488235029478 req-0dd0d2ed-91c2-4f03-a330-857ebb7ddc98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:16.772880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6711a099-19d4-4f72-833f-488235029478 req-0dd0d2ed-91c2-4f03-a330-857ebb7ddc98 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.773986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6711a099-19d4-4f72-833f-488235029478 req-0dd0d2ed-91c2-4f03-a330-857ebb7ddc98 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.799552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6711a099-19d4-4f72-833f-488235029478 req-0dd0d2ed-91c2-4f03-a330-857ebb7ddc98 service nova] Creating event network-changed:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:47:16.813514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6711a099-19d4-4f72-833f-488235029478 req-0dd0d2ed-91c2-4f03-a330-857ebb7ddc98 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071776 Jul 14 14:47:16.815517 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 967/1971] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:16.824905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:16.825992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:16.836740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.838094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:16.840004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:16.842839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.189672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.215691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.220203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.223211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d642f3d-4865-45ce-87d2-1c04eb3e8562 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.405399 Jul 14 14:47:17.241739 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 968/1972] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:16 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:17.258977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:17.260194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:17.273688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.274896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.278000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.279046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.673315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:17.674461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Updating instance_info_cache with network_info: [{"id": "dfc535b7-fcfc-455f-9212-5d4a90568b51", "address": "fa:16:3e:e8:ab:aa", "network": {"id": "f9874e65-6a5a-4909-a616-16d8c1f3be84", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-540124292-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "a22f9857a34e48f7bc5d2bd97ef02b14", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapdfc535b7-fc", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125965) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:47:17.685814 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-882f8792-2860-4db0-a56f-46b6d5e065f6 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1319 microversion: 2.1 time: 0.442363 Jul 14 14:47:17.686732 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 969/1973] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:17 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1319 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:17.695346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:17.698096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:17.708134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.709067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.710297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.711165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.720850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Releasing lock "refresh_cache-b7776d80-93f5-470b-8b17-b002137b94a1" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:47:17.722470 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-deffd934-9626-4961-81b7-3b1b7031efc4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action" status: 202 len: 0 microversion: 2.1 time: 5.079171 Jul 14 14:47:17.728840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1005/1974] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:12 2022] POST /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1/action => generated 0 bytes in 5086 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:47:17.760044 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] HTTP exception thrown: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Request method failure captured: Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 HTTP/1.1 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CqZut_RYLU9rkaYWGF9iCz-4BGvu7oQVYUnpv_p_TF5WqNcXEUXgAQEOiyVR2kqKPO9lGpDMSMn3ihtk_RWJ79xsGkryq8jD3MbJYaTVPODASz56V7KooNXviwdLQ3kY4GiW2Vnc79U2_-L8zq2OqtFieNuSIwqdXAeEiqBRxdEKYQ Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.42 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 93c4325b23c544eab268df27d8f485af Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93c4325b23c544eab268df27d8f485af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93c4325b23c544eab268df27d8f485af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93c4325b23c544eab268df27d8f485af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93c4325b23c544eab268df27d8f485af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 93c4325b23c544eab268df27d8f485af Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TaggedBootDevicesTest_v242-1301915344-project Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2020ca323f8947adb35690d56979724d Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1301915344-project Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e84cbe00-18fa-4256-828b-59afa58e12f0'} Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:17.772234 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:17.776048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Returning 404 to user: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:17.779003 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74e5abb9-0f0c-45f8-ad3b-0674bf30ad25 tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 404 len: 111 microversion: 2.42 time: 0.087890 Jul 14 14:47:17.782855 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 970/1975] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:17 2022] DELETE /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:47:17.799845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:17.803774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:17.827736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.831655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.833119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:17.847438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:17.860369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:18.152606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1510630951", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:18.252128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:18.319111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.347248 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8c6f5bee-6ee8-4fa9-9d7f-ad785f0878c9 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 200 len: 1475 microversion: 2.1 time: 0.560661 Jul 14 14:47:18.368292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 971/1976] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:17 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 1475 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:18.375096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.376322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.384902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.387345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.388516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.389372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.411177 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] HTTP exception thrown: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Request method failure captured: Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 HTTP/1.1 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CwI93aVnZ-dDsCZCEowGBC9Gf5I-5BhAODhPez-4fUfYvhmW1VoyE7isLocKtpkk7V-QdLY0yEE1fQzye8mBJxY9UbzOojHmNIOObw96ZZswt2rg_TI2ZOQWdnOVnct51zVPxJp9yt-WucdVnjextg4_LicxCvQ6K2h0WeP05bgUaY Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f1d8ca06f8d2469382275fd2e36c538c Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6b45efd5-48a1-471f-b6bb-7797893a6416'} Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:18.416169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.420215 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.422895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Returning 404 to user: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:18.424314 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-958b6c53-dcc2-46dd-bfc5-917aafbd15a4 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 404 len: 111 microversion: 2.1 time: 0.054646 Jul 14 14:47:18.425881 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 972/1977] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:18 2022] DELETE /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:18.437795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.438586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.451408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:18.462119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.462823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.465753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.466580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.574413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:18.575078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:18.575365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:18.575820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:18.576252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:18.588561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.589074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.590098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.590636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.600455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e85acbfcdc4b3a813830d6723b006f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33d5773713f8495c9018a5aaed6fd744', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.609041 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c56d831-9c6a-4f30-a5ba-3b1dbc900dc9 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 200 len: 1303 microversion: 2.1 time: 0.181668 Jul 14 14:47:18.610386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Getting quotas for project 294ea301498240ec8101929ae3f9e4e4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:18.613789 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 973/1978] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 1303 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:18.615668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Getting quotas for user ba43227f00d04dccac9ebe6c38aae925 and project 294ea301498240ec8101929ae3f9e4e4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:18.623213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.624408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] [instance: e84cbe00-18fa-4256-828b-59afa58e12f0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.628822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:18.631718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:18.646524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.647896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.649407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.650252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.680175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] HTTP exception thrown: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Request method failure captured: Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 HTTP/1.1 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CqZut_RYLU9rkaYWGF9iCz-4BGvu7oQVYUnpv_p_TF5WqNcXEUXgAQEOiyVR2kqKPO9lGpDMSMn3ihtk_RWJ79xsGkryq8jD3MbJYaTVPODASz56V7KooNXviwdLQ3kY4GiW2Vnc79U2_-L8zq2OqtFieNuSIwqdXAeEiqBRxdEKYQ Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.42 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 93c4325b23c544eab268df27d8f485af Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93c4325b23c544eab268df27d8f485af"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_93c4325b23c544eab268df27d8f485af"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/93c4325b23c544eab268df27d8f485af"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/93c4325b23c544eab268df27d8f485af"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 93c4325b23c544eab268df27d8f485af Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1301915344 Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TaggedBootDevicesTest_v242-1301915344-project Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2020ca323f8947adb35690d56979724d Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1301915344-project Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e84cbe00-18fa-4256-828b-59afa58e12f0'} Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.683559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.687487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] Returning 404 to user: Instance e84cbe00-18fa-4256-828b-59afa58e12f0 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:18.687956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b75ed0c3-a5ad-43b8-ba3a-f7a2cc71f6bb tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955077 Jul 14 14:47:18.687956 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1006/1979] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:47:18.688422 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-49abddc7-e590-4559-a008-f6a93a9bba0b tempest-TaggedBootDevicesTest_v242-1301915344 tempest-TaggedBootDevicesTest_v242-1301915344-project] 10.222.0.98 "GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0" status: 404 len: 111 microversion: 2.42 time: 0.070497 Jul 14 14:47:18.688422 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 974/1980] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/e84cbe00-18fa-4256-828b-59afa58e12f0 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:47:18.705419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.707320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.719244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.720081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.721505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.722297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.834018 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53d39500-6dbf-41df-b92a-6ee443a3703d tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] 10.222.0.98 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.146383 Jul 14 14:47:18.845037 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1007/1981] 10.222.0.98 () {58 vars in 1127 bytes} [Thu Jul 14 14:47:18 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 14:47:18.863404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-375305028"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:18.865082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.886340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.889557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.890477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.892358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.899439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.910746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.913293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:18.914866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-430ad768-c597-4249-8117-d60e475b9bc9 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.225883 Jul 14 14:47:18.915955 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 975/1982] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:18.921842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:18.923050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: 6b45efd5-48a1-471f-b6bb-7797893a6416] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:18.934514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:18.937502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.939730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.942798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:18.945508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:18.993479 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] HTTP exception thrown: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Request method failure captured: Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 HTTP/1.1 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CwI93aVnZ-dDsCZCEowGBC9Gf5I-5BhAODhPez-4fUfYvhmW1VoyE7isLocKtpkk7V-QdLY0yEE1fQzye8mBJxY9UbzOojHmNIOObw96ZZswt2rg_TI2ZOQWdnOVnct51zVPxJp9yt-WucdVnjextg4_LicxCvQ6K2h0WeP05bgUaY Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f1d8ca06f8d2469382275fd2e36c538c Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6b45efd5-48a1-471f-b6bb-7797893a6416'} Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:18.996533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Returning 404 to user: Instance 6b45efd5-48a1-471f-b6bb-7797893a6416 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1f2c216-b710-445f-9d17-a325aedb5690 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416" status: 404 len: 111 microversion: 2.1 time: 0.082133 Jul 14 14:47:19.001536 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 976/1983] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:18 2022] GET /compute/v2.1/servers/6b45efd5-48a1-471f-b6bb-7797893a6416 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:19.009783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00ebae0a-b391-4eab-8c38-84c9489be623 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.010868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00ebae0a-b391-4eab-8c38-84c9489be623 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.106731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-00ebae0a-b391-4eab-8c38-84c9489be623 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:19.119590 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00ebae0a-b391-4eab-8c38-84c9489be623 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1214 microversion: 2.1 time: 0.117491 Jul 14 14:47:19.120522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 977/1984] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:19.127484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.128112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.136546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.137030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.137845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.138289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.345637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:19.349287 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-618e55f5-6a09-4436-b371-63c790e4a141 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca/action" status: 202 len: 0 microversion: 2.1 time: 0.501599 Jul 14 14:47:19.350340 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1008/1985] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:18 2022] POST /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca/action => generated 0 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:47:19.359704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc02328d-8ca1-46b4-9f48-a85a64e4fc2a tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Calling method '.version_select at 0x7fdbf2b1ba60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.370768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fcb450c4-7d3b-470a-b083-55e3dfffd67e tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1468 microversion: 2.1 time: 0.246450 Jul 14 14:47:19.386065 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 978/1986] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1468 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:19.392254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a9857d3f-d07c-4ffe-9ec4-5ef9f1e9e195 req-f0fc0e50-a88d-4cbd-934b-6346a0d55314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a18c3086-b5d1-4580-8331-faa594d62ef1", "name": "network-vif-deleted", "tag": "0ee38e2a-8cd4-47a5-a879-ad9a54abb678"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:19.401996 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-bc02328d-8ca1-46b4-9f48-a85a64e4fc2a tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] HTTP exception thrown: Image not found. Jul 14 14:47:19.403302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a9857d3f-d07c-4ffe-9ec4-5ef9f1e9e195 req-f0fc0e50-a88d-4cbd-934b-6346a0d55314 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc02328d-8ca1-46b4-9f48-a85a64e4fc2a tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Request method failure captured: Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cx1R5JcIDaJZ8ZesJb-eC3L4jS3svZzBAvBlhHKByLA7ONBMyF5cJz3Mb6cEwJpZKKIljncm_xof0b61j3WaGs_ccCjSaVC-PLE2RJuywVZBwtYzpDiikuE9t-3s7rthOpDt6JM6nIoCgkZmoF6X7za2ay_Au-1jJd3hmdiH_nHTrw Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_47959e88148b44629bb66b4e53004b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/47959e88148b44629bb66b4e53004b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 8d0cfcf1405940568d9c8fd72d679f2b Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '-1'} Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.403979 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc02328d-8ca1-46b4-9f48-a85a64e4fc2a tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc02328d-8ca1-46b4-9f48-a85a64e4fc2a tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] 10.222.0.98 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.053620 Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1009/1987] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 14:47:19 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:47:19.412895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6596779-919e-4f3e-9603-bb68545a7738 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '.version_select at 0x7fdbf2b1b670>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.415442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a9857d3f-d07c-4ffe-9ec4-5ef9f1e9e195 req-f0fc0e50-a88d-4cbd-934b-6346a0d55314 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.429897 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a9857d3f-d07c-4ffe-9ec4-5ef9f1e9e195 req-f0fc0e50-a88d-4cbd-934b-6346a0d55314 service nova] Creating event network-vif-deleted:0ee38e2a-8cd4-47a5-a879-ad9a54abb678 for instance a18c3086-b5d1-4580-8331-faa594d62ef1 on n-h1-768852-23 Jul 14 14:47:19.435788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a9857d3f-d07c-4ffe-9ec4-5ef9f1e9e195 req-f0fc0e50-a88d-4cbd-934b-6346a0d55314 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047520 Jul 14 14:47:19.436916 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 979/1988] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:19.444179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b9a9f25-9763-42fd-92be-19c311f062a7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b3d940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.518423 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b9a9f25-9763-42fd-92be-19c311f062a7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.079850 Jul 14 14:47:19.519153 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 980/1989] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:19.533111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:19.533918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.541745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.542300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.543207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.543748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.573384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lazy-loading 'flavor' on Instance uuid 2e18247a-2872-48b0-a756-53392137efb5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:47:19.673322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c06adac9-5f21-4966-b2f4-3f0e08429bbb tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5/action" status: 202 len: 0 microversion: 2.1 time: 0.151120 Jul 14 14:47:19.674001 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 981/1990] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:19 2022] POST /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:47:19.680550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b10d6a88-191f-438f-a1fb-3c5ffa138771 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Calling method '.version_select at 0x7fdbf2a6f940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.728092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b10d6a88-191f-438f-a1fb-3c5ffa138771 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] HTTP exception thrown: Image not found. Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b10d6a88-191f-438f-a1fb-3c5ffa138771 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Request method failure captured: Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/e93759e9-6ca3-4c46-bddd-9d9b313875aj HTTP/1.1 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cx1R5JcIDaJZ8ZesJb-eC3L4jS3svZzBAvBlhHKByLA7ONBMyF5cJz3Mb6cEwJpZKKIljncm_xof0b61j3WaGs_ccCjSaVC-PLE2RJuywVZBwtYzpDiikuE9t-3s7rthOpDt6JM6nIoCgkZmoF6X7za2ay_Au-1jJd3hmdiH_nHTrw Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_47959e88148b44629bb66b4e53004b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/47959e88148b44629bb66b4e53004b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8d0cfcf1405940568d9c8fd72d679f2b Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e93759e9-6ca3-4c46-bddd-9d9b313875aj'} Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e93759e9-6ca3-4c46-bddd-9d9b313875aj to delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e93759e9-6ca3-4c46-bddd-9d9b313875aj could not be found. Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.730298 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:47:19.734382 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.736893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b10d6a88-191f-438f-a1fb-3c5ffa138771 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:19.736893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b10d6a88-191f-438f-a1fb-3c5ffa138771 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] 10.222.0.98 "DELETE /compute/v2.1/images/e93759e9-6ca3-4c46-bddd-9d9b313875aj" status: 404 len: 62 microversion: 2.1 time: 0.060651 Jul 14 14:47:19.741721 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 982/1991] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] DELETE /compute/v2.1/images/e93759e9-6ca3-4c46-bddd-9d9b313875aj => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:47:19.747501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.748519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: a18c3086-b5d1-4580-8331-faa594d62ef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.758876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.759690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.760792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.761421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.787740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] HTTP exception thrown: Instance a18c3086-b5d1-4580-8331-faa594d62ef1 could not be found. Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Request method failure captured: Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 HTTP/1.1 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cu12ybnjTetGC2MWdtEddnIIRyg8FcFVSFWpyXMRF_DCbH0sAO5Z4Za4lEpakmFo4T53lw6QouxbgsjG0C0_IokoDt_DCrZXwEMvbhTK6L_5Icj2k-LKLbqqvk1VN9yVZs2VH-_I0hnVxsEaEDnyEDjmTCqcxNOa75fYOV7gEjh1uA Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c2e85acbfcdc4b3a813830d6723b006f Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a18c3086-b5d1-4580-8331-faa594d62ef1 could not be found. Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a18c3086-b5d1-4580-8331-faa594d62ef1'} Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a18c3086-b5d1-4580-8331-faa594d62ef1 could not be found. Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a18c3086-b5d1-4580-8331-faa594d62ef1 could not be found. Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:19.789780 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a18c3086-b5d1-4580-8331-faa594d62ef1 could not be found. Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Returning 404 to user: Instance a18c3086-b5d1-4580-8331-faa594d62ef1 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79400ea7-fb8a-425e-9095-1087abc2729c tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1" status: 404 len: 111 microversion: 2.1 time: 0.048418 Jul 14 14:47:19.793242 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 983/1992] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/a18c3086-b5d1-4580-8331-faa594d62ef1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:19.799098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:19.799927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:19.807582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.808142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.809029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:19.809562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:19.994128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.002902 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6c085e0-626e-496c-9000-7c9b908f4f83 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1476 microversion: 2.1 time: 0.209548 Jul 14 14:47:20.003568 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 984/1993] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:19 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1476 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:20.008894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7d03529-f96a-41b0-8d74-9f801294bb34 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Calling method '.version_select at 0x7fdbf2a65d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.028592 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a7d03529-f96a-41b0-8d74-9f801294bb34 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] HTTP exception thrown: Image not found. Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7d03529-f96a-41b0-8d74-9f801294bb34 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Request method failure captured: Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/6a4529f3-7e87-4674-b178-6c6e0815408e1 HTTP/1.1 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cx1R5JcIDaJZ8ZesJb-eC3L4jS3svZzBAvBlhHKByLA7ONBMyF5cJz3Mb6cEwJpZKKIljncm_xof0b61j3WaGs_ccCjSaVC-PLE2RJuywVZBwtYzpDiikuE9t-3s7rthOpDt6JM6nIoCgkZmoF6X7za2ay_Au-1jJd3hmdiH_nHTrw Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_47959e88148b44629bb66b4e53004b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/47959e88148b44629bb66b4e53004b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8d0cfcf1405940568d9c8fd72d679f2b Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6a4529f3-7e87-4674-b178-6c6e0815408e1'} Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6a4529f3-7e87-4674-b178-6c6e0815408e1 to delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6a4529f3-7e87-4674-b178-6c6e0815408e1 could not be found. Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.030811 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:47:20.034774 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.040770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7d03529-f96a-41b0-8d74-9f801294bb34 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.045793 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a7d03529-f96a-41b0-8d74-9f801294bb34 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] 10.222.0.98 "DELETE /compute/v2.1/images/6a4529f3-7e87-4674-b178-6c6e0815408e1" status: 404 len: 62 microversion: 2.1 time: 0.036973 Jul 14 14:47:20.046664 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 985/1994] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:20 2022] DELETE /compute/v2.1/images/6a4529f3-7e87-4674-b178-6c6e0815408e1 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:47:20.056212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.056968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.078551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.080732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.087923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.088816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.107643 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] HTTP exception thrown: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Request method failure captured: Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa HTTP/1.1 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cu12ybnjTetGC2MWdtEddnIIRyg8FcFVSFWpyXMRF_DCbH0sAO5Z4Za4lEpakmFo4T53lw6QouxbgsjG0C0_IokoDt_DCrZXwEMvbhTK6L_5Icj2k-LKLbqqvk1VN9yVZs2VH-_I0hnVxsEaEDnyEDjmTCqcxNOa75fYOV7gEjh1uA Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c2e85acbfcdc4b3a813830d6723b006f Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f1f58dec-0020-4bce-9a9d-9686eb2c59fa'} Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:20.109661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.113445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.116381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Returning 404 to user: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.117836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-738055f8-6cfc-47cc-8b1c-124aefb3164f tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 404 len: 111 microversion: 2.1 time: 0.069818 Jul 14 14:47:20.118725 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 986/1995] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:20 2022] DELETE /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:20.125186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.126202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.134531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.135532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.136594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.137456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.211846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.220697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.222640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.224137 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d64c5e3-b4b0-40cd-8ef8-bc105dd69266 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.103640 Jul 14 14:47:20.225390 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 987/1996] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:20.230337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b629647-ab02-47c5-99d7-69b25c59d64d tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Calling method '.version_select at 0x7fdbf2a65d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.254805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5b629647-ab02-47c5-99d7-69b25c59d64d tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] HTTP exception thrown: Image not found. Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b629647-ab02-47c5-99d7-69b25c59d64d tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Request method failure captured: Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/tempest-invalid-20966812 HTTP/1.1 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cx1R5JcIDaJZ8ZesJb-eC3L4jS3svZzBAvBlhHKByLA7ONBMyF5cJz3Mb6cEwJpZKKIljncm_xof0b61j3WaGs_ccCjSaVC-PLE2RJuywVZBwtYzpDiikuE9t-3s7rthOpDt6JM6nIoCgkZmoF6X7za2ay_Au-1jJd3hmdiH_nHTrw Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_47959e88148b44629bb66b4e53004b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/47959e88148b44629bb66b4e53004b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8d0cfcf1405940568d9c8fd72d679f2b Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'tempest-invalid-20966812'} Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-20966812 to delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-20966812 could not be found. Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.257549 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.261764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b629647-ab02-47c5-99d7-69b25c59d64d tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.262982 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b629647-ab02-47c5-99d7-69b25c59d64d tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] 10.222.0.98 "DELETE /compute/v2.1/images/tempest-invalid-20966812" status: 404 len: 62 microversion: 2.1 time: 0.035087 Jul 14 14:47:20.267231 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 988/1997] 10.222.0.98 () {58 vars in 1199 bytes} [Thu Jul 14 14:47:20 2022] DELETE /compute/v2.1/images/tempest-invalid-20966812 => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:47:20.273441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.274172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: f1f58dec-0020-4bce-9a9d-9686eb2c59fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.282297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.282748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.283569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.284008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.299440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] HTTP exception thrown: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Request method failure captured: Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa HTTP/1.1 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cu12ybnjTetGC2MWdtEddnIIRyg8FcFVSFWpyXMRF_DCbH0sAO5Z4Za4lEpakmFo4T53lw6QouxbgsjG0C0_IokoDt_DCrZXwEMvbhTK6L_5Icj2k-LKLbqqvk1VN9yVZs2VH-_I0hnVxsEaEDnyEDjmTCqcxNOa75fYOV7gEjh1uA Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c2e85acbfcdc4b3a813830d6723b006f Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f1f58dec-0020-4bce-9a9d-9686eb2c59fa'} Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.301329 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Returning 404 to user: Instance f1f58dec-0020-4bce-9a9d-9686eb2c59fa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d02ef3c-2151-40b8-a419-3f4a598b2c25 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa" status: 404 len: 111 microversion: 2.1 time: 0.034624 Jul 14 14:47:20.305482 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 989/1998] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/f1f58dec-0020-4bce-9a9d-9686eb2c59fa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:20.310442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.311461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.319254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.319901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.320792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.321333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.396032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:20.405855 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7311b5f9-56c1-4472-9875-a88127cd12a6 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1266 microversion: 2.1 time: 0.100667 Jul 14 14:47:20.406872 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 990/1999] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1266 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:20.412671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aed90cf2-e776-4371-b95d-0a9271d77243 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Calling method '.version_select at 0x7fdbf2b3d040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.433432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6596779-919e-4f3e-9603-bb68545a7738 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/4ec931c1-49cf-42c0-9aeb-20998ef82b15" status: 202 len: 0 microversion: 2.1 time: 1.025772 Jul 14 14:47:20.435448 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1010/2000] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:47:19 2022] DELETE /compute/v2.1/os-floating-ips/4ec931c1-49cf-42c0-9aeb-20998ef82b15 => generated 0 bytes in 1027 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:47:20.439302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.439934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.445367 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-aed90cf2-e776-4371-b95d-0a9271d77243 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] HTTP exception thrown: Image not found. Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aed90cf2-e776-4371-b95d-0a9271d77243 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Request method failure captured: Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/7e616673-d2e0-4b77-826c-0feeb7c2f64d HTTP/1.1 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cx1R5JcIDaJZ8ZesJb-eC3L4jS3svZzBAvBlhHKByLA7ONBMyF5cJz3Mb6cEwJpZKKIljncm_xof0b61j3WaGs_ccCjSaVC-PLE2RJuywVZBwtYzpDiikuE9t-3s7rthOpDt6JM6nIoCgkZmoF6X7za2ay_Au-1jJd3hmdiH_nHTrw Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_47959e88148b44629bb66b4e53004b44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47959e88148b44629bb66b4e53004b44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/47959e88148b44629bb66b4e53004b44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 47959e88148b44629bb66b4e53004b44 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-320634588 Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8d0cfcf1405940568d9c8fd72d679f2b Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-320634588-project Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '7e616673-d2e0-4b77-826c-0feeb7c2f64d'} Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7e616673-d2e0-4b77-826c-0feeb7c2f64d to delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7e616673-d2e0-4b77-826c-0feeb7c2f64d could not be found. Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.447119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aed90cf2-e776-4371-b95d-0a9271d77243 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.450521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aed90cf2-e776-4371-b95d-0a9271d77243 tempest-ImagesDeleteNegativeTestJSON-320634588 tempest-ImagesDeleteNegativeTestJSON-320634588-project] 10.222.0.98 "DELETE /compute/v2.1/images/7e616673-d2e0-4b77-826c-0feeb7c2f64d" status: 404 len: 62 microversion: 2.1 time: 0.039875 Jul 14 14:47:20.452636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.452636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.452918 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 991/2001] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] DELETE /compute/v2.1/images/7e616673-d2e0-4b77-826c-0feeb7c2f64d => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:47:20.453045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.453045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.460193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.460696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.472095 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] HTTP exception thrown: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Request method failure captured: Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 HTTP/1.1 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cu12ybnjTetGC2MWdtEddnIIRyg8FcFVSFWpyXMRF_DCbH0sAO5Z4Za4lEpakmFo4T53lw6QouxbgsjG0C0_IokoDt_DCrZXwEMvbhTK6L_5Icj2k-LKLbqqvk1VN9yVZs2VH-_I0hnVxsEaEDnyEDjmTCqcxNOa75fYOV7gEjh1uA Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c2e85acbfcdc4b3a813830d6723b006f Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b94f2422-b740-4908-9dc5-514fb8b99257'} Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:20.474046 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.477554 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.479484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Returning 404 to user: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.481567 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e6044d36-ec9b-4166-8815-3d67b84221a1 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 404 len: 111 microversion: 2.1 time: 0.045231 Jul 14 14:47:20.482264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.482716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.483997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.484112 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1011/2002] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:20 2022] DELETE /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:20.484203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.494590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.495514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] [instance: b94f2422-b740-4908-9dc5-514fb8b99257] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.502910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.503848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.504828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.505575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.532200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:20.540743 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] HTTP exception thrown: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Request method failure captured: Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 HTTP/1.1 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cu12ybnjTetGC2MWdtEddnIIRyg8FcFVSFWpyXMRF_DCbH0sAO5Z4Za4lEpakmFo4T53lw6QouxbgsjG0C0_IokoDt_DCrZXwEMvbhTK6L_5Icj2k-LKLbqqvk1VN9yVZs2VH-_I0hnVxsEaEDnyEDjmTCqcxNOa75fYOV7gEjh1uA Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/33d5773713f8495c9018a5aaed6fd744"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 33d5773713f8495c9018a5aaed6fd744 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1643229695 Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c2e85acbfcdc4b3a813830d6723b006f Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerDiskConfigTestJSON-1643229695-project Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b94f2422-b740-4908-9dc5-514fb8b99257'} Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:20.543869 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:20.548027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] Returning 404 to user: Instance b94f2422-b740-4908-9dc5-514fb8b99257 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:20.549531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2967faa9-4fd4-4797-94ee-87f54f872167 tempest-ServerDiskConfigTestJSON-1643229695 tempest-ServerDiskConfigTestJSON-1643229695-project] 10.222.0.98 "GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257" status: 404 len: 111 microversion: 2.1 time: 0.061596 Jul 14 14:47:20.551484 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1012/2003] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/b94f2422-b740-4908-9dc5-514fb8b99257 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:20.565564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-40ed7cd6-cf29-4aef-a1fd-a159607e0520 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a3b5e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.638652 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-40ed7cd6-cf29-4aef-a1fd-a159607e0520 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.085756 Jul 14 14:47:20.640716 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1013/2004] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:20.728198 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44d36072-83e2-407d-a84f-d8a4394a88cb tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 204 len: 0 microversion: 2.1 time: 0.276926 Jul 14 14:47:20.729378 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 992/2005] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:20 2022] DELETE /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:20.739759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:20.740462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:20.751075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.751075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:20.752231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:20.753061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.022729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.023610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.031472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.032178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.033217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.034033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.252058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.270010 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68aac457-6877-407d-bf24-a955a36e209d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1459 microversion: 2.1 time: 0.243429 Jul 14 14:47:21.270871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 993/2006] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1459 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.276156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.277035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.291745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.292533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.293868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.294838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.403257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.413932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.415987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.418229 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13f757b3-e193-4e7e-ac94-c53268971dbd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.146106 Jul 14 14:47:21.431340 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 994/2007] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:21.437471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.438589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.446417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.447153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.448145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.448685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.449285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.454605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:21.457221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-efa93eac-1df7-4a06-a58e-e0c7f35fece7 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1525 microversion: 2.1 time: 0.723150 Jul 14 14:47:21.466456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1014/2008] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:20 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1525 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.471767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.472745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:21.481361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.482113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.483139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.483971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.634687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:21.651849 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a44e9805-8f7e-418c-8eb7-048a81caf639 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1272 microversion: 2.1 time: 0.184066 Jul 14 14:47:21.652790 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1015/2009] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1272 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.658864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-690dca57-346c-4867-a9ce-3ac88ef39119 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a143a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.716657 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-690dca57-346c-4867-a9ce-3ac88ef39119 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.062527 Jul 14 14:47:21.718260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1016/2010] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.903040 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3374d34e-d75d-4b29-bfbf-ad45dc3779d0 tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1612 microversion: 2.1 time: 0.469887 Jul 14 14:47:21.903995 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 995/2011] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1612 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:21.930082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-baa18120-fa63-472c-895a-98ee305e9a8c tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:21.939193 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:47:21.939193 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:47:21.942843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-baa18120-fa63-472c-895a-98ee305e9a8c tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.943958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-baa18120-fa63-472c-895a-98ee305e9a8c tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:21.953709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-baa18120-fa63-472c-895a-98ee305e9a8c tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:21.956088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-baa18120-fa63-472c-895a-98ee305e9a8c tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.050711 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-baa18120-fa63-472c-895a-98ee305e9a8c tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.133101 Jul 14 14:47:22.053771 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1017/2012] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 14:47:21 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:22.063835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": true, "disk_over_commit": false}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:22.065054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.081289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.081935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.083008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.083635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.129978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Lazy-loading 'flavor' on Instance uuid 2e18247a-2872-48b0-a756-53392137efb5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:47:22.146357 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 2e18247a-2872-48b0-a756-53392137efb5 while it is in vm_state suspended Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Request method failure captured: Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5/action HTTP/1.1 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 98 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CxA4yjn2jefAWh6yI6fVf1npdLCHK03WRLgILQNeET6uWfWDXukuzFRhpMiO_HdxjU_fghcS-xI4dAUecU62LBTgV1eyp_vi_ooB_bfTRD55O8rz9qCcKoOqLzWQezHx-4HGT-yCaWnowQ5r-eFn-sT4uigVGoSql0zkTWqi3PvsyQ Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b31d622e4c4441f1a96a35d8f0fe1591 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveMigrationNegativeTest-1898809701 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b31d622e4c4441f1a96a35d8f0fe1591"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveMigrationNegativeTest-1898809701 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b31d622e4c4441f1a96a35d8f0fe1591 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1898809701 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveMigrationNegativeTest-1898809701-project-admin Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 5bf9508bcf2745e689b69f42d54ea483 Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveMigrationNegativeTest-1898809701-project-admin Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: {"os-migrateLive": {"host": "n-h2-768852-23", "block_migration": true, "disk_over_commit": false}} Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot 'os-migrateLive' instance 2e18247a-2872-48b0-a756-53392137efb5 while it is in vm_state suspended Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2e18247a-2872-48b0-a756-53392137efb5', 'body': {'os-migrateLive': {'host': 'n-h2-768852-23', 'block_migration': True, 'disk_over_commit': False}}} Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2e18247a-2872-48b0-a756-53392137efb5 in vm_state suspended. Cannot live_migrate while the instance is in this state. Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:22.148886 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 2e18247a-2872-48b0-a756-53392137efb5 while it is in vm_state suspended Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 2e18247a-2872-48b0-a756-53392137efb5 while it is in vm_state suspended Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 2e18247a-2872-48b0-a756-53392137efb5 while it is in vm_state suspended {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-85f3cd1a-5115-4a1d-9ea3-d116e6871fee tempest-LiveMigrationNegativeTest-1898809701 tempest-LiveMigrationNegativeTest-1898809701-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5/action" status: 409 len: 155 microversion: 2.1 time: 0.090455 Jul 14 14:47:22.157521 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 996/2013] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:47:22 2022] POST /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5/action => generated 155 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 14:47:22.174511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.176313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.192136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.194525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.196712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.197728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.291216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:22.448058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.451296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.496148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.497647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.500735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.502995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.606535 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2e80225-40bf-47f4-98c5-1f7c4c23ffec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 204 len: 0 microversion: 2.1 time: 0.439683 Jul 14 14:47:22.611222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1018/2014] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:22 2022] DELETE /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:22.632165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.634253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.647558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.652847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.656020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.658229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.813919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:22.844290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:22.856339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:22.861063 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a694b39b-35d1-4db8-9771-2bd7ec3658c4 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.423080 Jul 14 14:47:22.864209 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 997/2015] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:22.893537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:22.895211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:22.923890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.926800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:22.933853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:22.935667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.153537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.183919 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c3cb1f9-40c1-40c6-a1c2-1fb3de43292e tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1525 microversion: 2.1 time: 0.570404 Jul 14 14:47:23.194246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1019/2016] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1525 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:23.212576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:23.213673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:23.268523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.269377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.270816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.271714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.556192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:23.566723 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21008b5f-6c6d-42b8-b946-0157949f4789 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1465 microversion: 2.1 time: 0.698083 Jul 14 14:47:23.567487 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 998/2017] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:22 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1465 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:23.575308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de473206-f2c5-4546-b7d4-1a47689f0b71 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a6f8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:23.642071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de473206-f2c5-4546-b7d4-1a47689f0b71 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.070769 Jul 14 14:47:23.644996 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 999/2018] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:23 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:23.893797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:23.894353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:23.908785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.911861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:23.916174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:23.918048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.233907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.263672 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a54c1310-dc14-42ce-aed3-e2f0fe05bcf9 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 1.063292 Jul 14 14:47:24.268597 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1020/2019] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:23 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:24.296320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:24.314714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:24.353027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.356156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.359902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.369640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.396217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.406594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.413541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.416635 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd9a686b-d98f-4618-81c1-9d16b2a41276 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.526654 Jul 14 14:47:24.418410 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1000/2020] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:23 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:24.457878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e37175f4-9235-4b95-a61c-353ad2924b3b req-9db08d4e-3feb-4f30-8925-d7730fc40ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7776d80-93f5-470b-8b17-b002137b94a1", "name": "network-vif-deleted", "tag": "dfc535b7-fcfc-455f-9212-5d4a90568b51"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:24.502767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e37175f4-9235-4b95-a61c-353ad2924b3b req-9db08d4e-3feb-4f30-8925-d7730fc40ead service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.506930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e37175f4-9235-4b95-a61c-353ad2924b3b req-9db08d4e-3feb-4f30-8925-d7730fc40ead service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.569660 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e37175f4-9235-4b95-a61c-353ad2924b3b req-9db08d4e-3feb-4f30-8925-d7730fc40ead service nova] Creating event network-vif-deleted:dfc535b7-fcfc-455f-9212-5d4a90568b51 for instance b7776d80-93f5-470b-8b17-b002137b94a1 on n-h2-768852-23 Jul 14 14:47:24.616308 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e37175f4-9235-4b95-a61c-353ad2924b3b req-9db08d4e-3feb-4f30-8925-d7730fc40ead service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.178402 Jul 14 14:47:24.617337 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1001/2021] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:24.625311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:24.626347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:24.638061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.644100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.645335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:24.646199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:24.853250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1d8ca06f8d2469382275fd2e36c538c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22f9857a34e48f7bc5d2bd97ef02b14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:24.907705 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5aaea1e-a19e-4931-9d00-2643bf544a1d tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 200 len: 1309 microversion: 2.1 time: 0.630655 Jul 14 14:47:24.909000 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1021/2022] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:24 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 1309 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:24.930477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b92537dc-5010-4692-916c-65aed86162af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b30d30>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.068451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.087213 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f2e06e0a-f76d-4503-938d-2284f07e57ec tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1465 microversion: 2.1 time: 0.467566 Jul 14 14:47:25.089250 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1002/2023] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:24 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1465 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:25.101063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c659eb94-6f8e-4817-b365-73fe60a7c492 req-7360f98e-389e-4505-bc45-a0613484b9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f3940-0dbc-41c1-bf0b-9043e402e6ca", "name": "network-vif-plugged", "status": "completed", "tag": "b85248f6-5ba1-442f-92e6-c64ef45c05fe"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:25.122935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c659eb94-6f8e-4817-b365-73fe60a7c492 req-7360f98e-389e-4505-bc45-a0613484b9a3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.124603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c659eb94-6f8e-4817-b365-73fe60a7c492 req-7360f98e-389e-4505-bc45-a0613484b9a3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.155654 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b92537dc-5010-4692-916c-65aed86162af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.224250 Jul 14 14:47:25.156681 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c659eb94-6f8e-4817-b365-73fe60a7c492 req-7360f98e-389e-4505-bc45-a0613484b9a3 service nova] Creating event network-vif-plugged:b85248f6-5ba1-442f-92e6-c64ef45c05fe for instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca on n-h1-768852-23 Jul 14 14:47:25.156943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1022/2024] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:24 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:25.170773 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c659eb94-6f8e-4817-b365-73fe60a7c492 req-7360f98e-389e-4505-bc45-a0613484b9a3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076072 Jul 14 14:47:25.173110 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1003/2025] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:25.314661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.315945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:25.341065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.344064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.351388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.353661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.471463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:25.476689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:25.539824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.543971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.556824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:25.562187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:25.937994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.975512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.986854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:25.989824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4c00caa3-cfe6-4d88-8b52-b552bc060b86 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.533087 Jul 14 14:47:26.004881 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1004/2026] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:25 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:26.018930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.019973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] [instance: b7776d80-93f5-470b-8b17-b002137b94a1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:26.028799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.029631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.030937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.031715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.064735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] HTTP exception thrown: Instance b7776d80-93f5-470b-8b17-b002137b94a1 could not be found. Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Request method failure captured: Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 HTTP/1.1 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CwI93aVnZ-dDsCZCEowGBC9Gf5I-5BhAODhPez-4fUfYvhmW1VoyE7isLocKtpkk7V-QdLY0yEE1fQzye8mBJxY9UbzOojHmNIOObw96ZZswt2rg_TI2ZOQWdnOVnct51zVPxJp9yt-WucdVnjextg4_LicxCvQ6K2h0WeP05bgUaY Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a22f9857a34e48f7bc5d2bd97ef02b14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a22f9857a34e48f7bc5d2bd97ef02b14 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-237160824 Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f1d8ca06f8d2469382275fd2e36c538c Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-237160824-project Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b7776d80-93f5-470b-8b17-b002137b94a1 could not be found. Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b7776d80-93f5-470b-8b17-b002137b94a1'} Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7776d80-93f5-470b-8b17-b002137b94a1 could not be found. Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7776d80-93f5-470b-8b17-b002137b94a1 could not be found. Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:26.067455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7776d80-93f5-470b-8b17-b002137b94a1 could not be found. Jul 14 14:47:26.073577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:26.080262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] Returning 404 to user: Instance b7776d80-93f5-470b-8b17-b002137b94a1 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:26.094812 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4261b940-0565-477e-b662-997e4a005799 tempest-FloatingIPsAssociationTestJSON-237160824 tempest-FloatingIPsAssociationTestJSON-237160824-project] 10.222.0.98 "GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1" status: 404 len: 111 microversion: 2.1 time: 0.071411 Jul 14 14:47:26.100789 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1005/2027] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/servers/b7776d80-93f5-470b-8b17-b002137b94a1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:26.123242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.137911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:26.159861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.160327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.161257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:26.161812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:26.517657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:26.532507 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5805eae4-e0c3-4415-a750-90086b9e74d7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 1.246981 Jul 14 14:47:26.545187 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1023/2028] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:25 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:26.557957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aef54428-2aa0-4cad-9af5-10240f825a1e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b1b790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.688790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:26.750261 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f02ecf8-3025-4b7d-98ec-2502347802ad tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1465 microversion: 2.1 time: 0.635266 Jul 14 14:47:26.763535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1006/2029] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1465 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:26.796496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f90a705-a2d5-4800-98c4-b71760fb7b4f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a6f550>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:26.834722 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aef54428-2aa0-4cad-9af5-10240f825a1e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.287083 Jul 14 14:47:26.836687 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1024/2030] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:26.925796 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f90a705-a2d5-4800-98c4-b71760fb7b4f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/101b136a-1636-4deb-9d97-b8f095a0b71c" status: 200 len: 662 microversion: 2.1 time: 0.150867 Jul 14 14:47:26.935079 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1007/2031] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/images/101b136a-1636-4deb-9d97-b8f095a0b71c => generated 662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:26.940523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00e7ec0f-944d-4bed-93c5-830f23bebc1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b0a0d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.022883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.023623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.038053 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00e7ec0f-944d-4bed-93c5-830f23bebc1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/101b136a-1636-4deb-9d97-b8f095a0b71c" status: 200 len: 662 microversion: 2.1 time: 0.103036 Jul 14 14:47:27.039799 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1025/2032] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:26 2022] GET /compute/v2.1/images/101b136a-1636-4deb-9d97-b8f095a0b71c => generated 662 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:27.055374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9d7cded0-0a54-42f6-80a2-abdde93e801b req-95236f32-83cf-40be-87b6-1531387c61a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e18247a-2872-48b0-a756-53392137efb5", "name": "network-vif-deleted", "tag": "f640afe3-678d-481d-9d02-9c156197231d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:27.055570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.058358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.067411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.068122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.085139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:27.108155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9d7cded0-0a54-42f6-80a2-abdde93e801b req-95236f32-83cf-40be-87b6-1531387c61a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.110824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9d7cded0-0a54-42f6-80a2-abdde93e801b req-95236f32-83cf-40be-87b6-1531387c61a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.160563 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9d7cded0-0a54-42f6-80a2-abdde93e801b req-95236f32-83cf-40be-87b6-1531387c61a8 service nova] Creating event network-vif-deleted:f640afe3-678d-481d-9d02-9c156197231d for instance 2e18247a-2872-48b0-a756-53392137efb5 on n-h1-768852-23 Jul 14 14:47:27.187306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9d7cded0-0a54-42f6-80a2-abdde93e801b req-95236f32-83cf-40be-87b6-1531387c61a8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145943 Jul 14 14:47:27.191790 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1026/2033] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:27.358569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.391867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.396459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:27.407403 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e5ad8d0-f9a5-49cd-ae94-a18bb9446d93 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.390369 Jul 14 14:47:27.410146 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1008/2034] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:47:27.553798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.554719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.582305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.589893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.594756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.598302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.774506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:27.776275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:27.810970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.812796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.814853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:27.816096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:27.999468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.000868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.001995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lazy-loading 'fault' on Instance uuid 2e18247a-2872-48b0-a756-53392137efb5 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:47:28.381420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.439929 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e9dfc1c-46f9-46ee-9565-78bb13645a76 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 0.891912 Jul 14 14:47:28.468638 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1027/2035] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:28.491572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60797020-f338-4e10-9b91-e9d967445d5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a200d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:28.623857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=24 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:28.784028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:28.814555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ee6e9648-a954-49fe-936a-4feffa726362 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 200 len: 1309 microversion: 2.1 time: 1.049822 Jul 14 14:47:28.826662 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1009/2036] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:27 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 1309 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:28.846170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:28.847804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:28.872501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.876684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:28.878978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:28.880194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.117241 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60797020-f338-4e10-9b91-e9d967445d5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.655170 Jul 14 14:47:29.119682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:29.134823 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1028/2037] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:28 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:29.158965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7aa508b3-8f9d-42dc-8b6f-c38024ea5ca6 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b0ab80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.239501 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7aa508b3-8f9d-42dc-8b6f-c38024ea5ca6 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/a6e5a31a-5dca-465f-ae05-cff77a71dcdd" status: 200 len: 661 microversion: 2.1 time: 0.103173 Jul 14 14:47:29.250306 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1029/2038] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:29 2022] GET /compute/v2.1/images/a6e5a31a-5dca-465f-ae05-cff77a71dcdd => generated 661 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:29.266149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3adb4722-b4d0-40b0-b4f4-17a8b5823a7f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf3435790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.368837 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3adb4722-b4d0-40b0-b4f4-17a8b5823a7f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/a6e5a31a-5dca-465f-ae05-cff77a71dcdd" status: 200 len: 661 microversion: 2.1 time: 0.115191 Jul 14 14:47:29.373258 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1030/2039] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:29 2022] GET /compute/v2.1/images/a6e5a31a-5dca-465f-ae05-cff77a71dcdd => generated 661 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:29.379400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fa660b23-bfd5-48fc-99be-1fdbdbe3bdd7 req-a605fa30-e80a-4b79-8d4c-86d0ed9411fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bfd7888-3b07-4c8f-a9cc-104769edf3f7", "tag": "764fad28-c009-4b35-9778-7e32be78c7bf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:29.412130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fa660b23-bfd5-48fc-99be-1fdbdbe3bdd7 req-a605fa30-e80a-4b79-8d4c-86d0ed9411fb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.420521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fa660b23-bfd5-48fc-99be-1fdbdbe3bdd7 req-a605fa30-e80a-4b79-8d4c-86d0ed9411fb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.429339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:29.443715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:29.453176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:29.455455 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43c2a25e-7206-4f9f-93bf-e9bb0855c95c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.626708 Jul 14 14:47:29.456067 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1010/2040] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:28 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:29.477047 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fa660b23-bfd5-48fc-99be-1fdbdbe3bdd7 req-a605fa30-e80a-4b79-8d4c-86d0ed9411fb service nova] Creating event network-changed:764fad28-c009-4b35-9778-7e32be78c7bf for instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 on n-h1-768852-23 Jul 14 14:47:29.497120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.500862 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fa660b23-bfd5-48fc-99be-1fdbdbe3bdd7 req-a605fa30-e80a-4b79-8d4c-86d0ed9411fb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125727 Jul 14 14:47:29.507726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:29.508193 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1031/2041] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:29.539000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.539519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.540361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.540839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.844243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.846586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 2e18247a-2872-48b0-a756-53392137efb5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:29.867307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.868073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.869101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.871354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.923024 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] HTTP exception thrown: Instance 2e18247a-2872-48b0-a756-53392137efb5 could not be found. Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Request method failure captured: Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 HTTP/1.1 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cw-vyZEJzDG1kkZfThwQoxvZcORAoL5pWLwSboEpZc5Y5-wRVBgjNa9guWV173CE_j5yo-pLKRFbyL4P-S12bC4NWbMI3ICXxluEgO_S1t03-7p97DuPSAdW4bePwyoR_ejUbMiYB0It7JoYBCHudqbclMZN7S0KRGIyeRMTaQ-9q8 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1c56ef362cf84d91bb841ab512e3665e Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-LiveMigrationNegativeTest-1183470725 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-LiveMigrationNegativeTest-1183470725 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1c56ef362cf84d91bb841ab512e3665e Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1183470725 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-LiveMigrationNegativeTest-1183470725-project Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: df11930b59684df585c3b90e0300aeb3 Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-LiveMigrationNegativeTest-1183470725-project Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2e18247a-2872-48b0-a756-53392137efb5 could not be found. Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2e18247a-2872-48b0-a756-53392137efb5'} Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e18247a-2872-48b0-a756-53392137efb5 could not be found. Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e18247a-2872-48b0-a756-53392137efb5 could not be found. Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:29.934271 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e18247a-2872-48b0-a756-53392137efb5 could not be found. Jul 14 14:47:29.937937 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:29.954203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Returning 404 to user: Instance 2e18247a-2872-48b0-a756-53392137efb5 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:29.955520 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6204d31e-aa45-4b93-82ac-f304eb23a93b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5" status: 404 len: 111 microversion: 2.1 time: 0.115927 Jul 14 14:47:29.963613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1032/2042] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:29 2022] GET /compute/v2.1/servers/2e18247a-2872-48b0-a756-53392137efb5 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:29.977816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:29.988158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:29.996035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:29.996867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:29.998014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.004469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.006984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.021050 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-881e9f5b-79f3-49e1-a0c1-d66c4161b25c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 0.547565 Jul 14 14:47:30.022634 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1011/2043] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:29 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:30.079159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:30.152723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5b3198b-546f-4ebe-82c5-7182e77758ce tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a38d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:30.277379 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7bcbd556-cf80-41f3-8ecc-0f282e0ce19c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 204 len: 0 microversion: 2.1 time: 0.309060 Jul 14 14:47:30.285123 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1033/2044] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:29 2022] DELETE /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:30.310416 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5b3198b-546f-4ebe-82c5-7182e77758ce tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.162557 Jul 14 14:47:30.312037 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1012/2045] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:30 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:30.318683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:30.321340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:30.339759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.340810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.341854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.348471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.433223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:30.492589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:30.493224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:30.507176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.507676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.513358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:30.513867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:30.844939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.908288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.925704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:30.935239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12b27a2e-26ef-4e6a-999c-c6005b0d9731 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.447335 Jul 14 14:47:30.936416 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1013/2046] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:30 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:31.068756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.070669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:31.093088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.093622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.094534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.095034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.523160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.537454 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ccd873ae-43ee-4e9a-a37f-b91ffa73e4b7 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 0.502625 Jul 14 14:47:31.551330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1014/2047] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:31.551330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94746cad-df65-486a-ad40-822af6e9654d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a38e50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.587578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:31.602349 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d105553-e9f5-4911-b6e4-8f559a913a5b tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1474 microversion: 2.1 time: 1.310780 Jul 14 14:47:31.603030 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1034/2048] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:30 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1474 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:31.611227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30259c08-104a-4306-bb88-5408a4020542 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b1b040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.659864 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94746cad-df65-486a-ad40-822af6e9654d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.120058 Jul 14 14:47:31.660841 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1015/2049] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:31.727152 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30259c08-104a-4306-bb88-5408a4020542 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/919de8d2-88b5-4e84-bf29-9bff4d602b01" status: 200 len: 662 microversion: 2.1 time: 0.119860 Jul 14 14:47:31.728182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1035/2050] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/images/919de8d2-88b5-4e84-bf29-9bff4d602b01 => generated 662 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:31.744124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0912333c-d966-4866-a994-1d8187d22659 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2acd820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.879941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0912333c-d966-4866-a994-1d8187d22659 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/919de8d2-88b5-4e84-bf29-9bff4d602b01" status: 200 len: 662 microversion: 2.1 time: 0.139686 Jul 14 14:47:31.881397 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1016/2051] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/images/919de8d2-88b5-4e84-bf29-9bff4d602b01 => generated 662 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:31.957708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:31.958485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:31.983925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.984490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.993027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:31.993682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:31.994192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:32.018238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-345796383", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:32.161000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:32.652861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:32.654213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:32.654872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:32.655495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:32.656076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:32.681501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.682209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.683189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.683816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.752549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Getting quotas for project accf60fb4fd44f6fa6f8cf9302662d68. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:32.758993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Getting quotas for user 9ac47e12cd544be0bb7a6c7616e1aaed and project accf60fb4fd44f6fa6f8cf9302662d68. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:32.794683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:32.796104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:32.798483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:32.836543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:32.846485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:32.849223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ebc5da8f-e844-4302-84fd-e777ae81df58 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.895749 Jul 14 14:47:32.860478 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1036/2052] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:31 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:47:32.876480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.889023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.910357 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f10ac57d-7785-43f2-b7b3-2024b0f70611 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.897738 Jul 14 14:47:32.911458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1017/2053] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:47:32.922088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:32.923063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:32.945459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.946088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.947045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.948219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.966805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.971877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:32.973894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:32.979697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.267311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:33.278524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9369e621-0f94-4788-8667-a7fe428f865c tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1474 microversion: 2.1 time: 0.365769 Jul 14 14:47:33.285900 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1018/2054] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:32 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1474 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:33.314566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-add276eb-f999-4e46-94c3-420f3fd274d0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a294c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:33.409978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-add276eb-f999-4e46-94c3-420f3fd274d0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.122620 Jul 14 14:47:33.420981 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1019/2055] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:33 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:33.426713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1381709312", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:33.552251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:33.882756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:33.883497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:33.884315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:33.885103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:33.885359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:33.919525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:33.920269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.928739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:33.931434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:33.962735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:33.988888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:33.998540 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-210bd270-f1a2-4d35-9e69-96561bf51bc2 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 1.129599 Jul 14 14:47:34.001605 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1037/2056] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:32 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:34.020801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:34.022972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:34.038188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.042097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.044314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.046595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.049340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:34.075639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Getting quotas for project accf60fb4fd44f6fa6f8cf9302662d68. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:34.105273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Getting quotas for user 9ac47e12cd544be0bb7a6c7616e1aaed and project accf60fb4fd44f6fa6f8cf9302662d68. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:34.158900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:34.166586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:34.347055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1aca8125-0796-406b-8c55-1969df6698f4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924648 Jul 14 14:47:34.358262 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1020/2057] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:47:34.363408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-89e97981-ff0c-4df1-a506-31c7c8f14844 req-da5abe92-5a2a-4ed1-a1fd-9e9b551fed26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d90f15b-b309-497e-89c0-887f83d172e1", "name": "network-vif-deleted", "tag": "68120eb9-edd3-4ca2-847c-5e19bcf5641e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:34.372735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-89e97981-ff0c-4df1-a506-31c7c8f14844 req-da5abe92-5a2a-4ed1-a1fd-9e9b551fed26 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.373188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-89e97981-ff0c-4df1-a506-31c7c8f14844 req-da5abe92-5a2a-4ed1-a1fd-9e9b551fed26 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.428282 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-89e97981-ff0c-4df1-a506-31c7c8f14844 req-da5abe92-5a2a-4ed1-a1fd-9e9b551fed26 service nova] Creating event network-vif-deleted:68120eb9-edd3-4ca2-847c-5e19bcf5641e for instance 0d90f15b-b309-497e-89c0-887f83d172e1 on n-h2-768852-23 Jul 14 14:47:34.443743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-89e97981-ff0c-4df1-a506-31c7c8f14844 req-da5abe92-5a2a-4ed1-a1fd-9e9b551fed26 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081124 Jul 14 14:47:34.448241 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1021/2058] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:34.469464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:34.470205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:34.498416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:34.517114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:34.525911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:34.533332 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7969a782-9cb8-4c2b-9c42-e261edb6490b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.526837 Jul 14 14:47:34.536646 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1038/2059] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:34 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:34.547549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.547549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.553898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.557313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.579904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9cd776ea-f692-49ac-9c0b-870388c0afe1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:34.582054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9cd776ea-f692-49ac-9c0b-870388c0afe1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:34.724083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9cd776ea-f692-49ac-9c0b-870388c0afe1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:34.733277 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9cd776ea-f692-49ac-9c0b-870388c0afe1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1218 microversion: 2.1 time: 0.175744 Jul 14 14:47:34.738183 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1039/2060] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:34 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1218 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:34.751325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9bf3624c-f3da-43d4-8908-f6ac694b0d96 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2af7e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:34.809280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:34.813096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:34.820806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lazy-loading 'fault' on Instance uuid 0d90f15b-b309-497e-89c0-887f83d172e1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:47:34.848778 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9bf3624c-f3da-43d4-8908-f6ac694b0d96 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.109039 Jul 14 14:47:34.849622 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1040/2061] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:34 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:35.019818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:35.020613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:35.046494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.046901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.057577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.060973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.709090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df11930b59684df585c3b90e0300aeb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c56ef362cf84d91bb841ab512e3665e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:35.729487 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8924d92d-2770-4afa-b6ac-23eab688a357 tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 200 len: 1308 microversion: 2.1 time: 1.279472 Jul 14 14:47:35.738163 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1022/2062] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:34 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 1308 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:35.757256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:35.760728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:35.789222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.793611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:35.795169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:35.805234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.153759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.164078 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b2fdd3a-89b3-4b35-a61c-22234984bc54 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 1.149214 Jul 14 14:47:36.173577 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1041/2063] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:35 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:36.217602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:36.225031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:36.265133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.271537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.281950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.289269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.577816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.602294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.611232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:36.625013 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-affe9f23-8b2e-44ea-a3bf-52f5aefc52b0 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.880428 Jul 14 14:47:36.626152 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1023/2064] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:35 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:36.667010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0ecc0de-d04b-4faf-826c-f04cf6399dd1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a6fb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:36.819808 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0ecc0de-d04b-4faf-826c-f04cf6399dd1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.192056 Jul 14 14:47:36.820571 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1024/2065] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:36 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:36.865633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:36.869918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] [instance: 0d90f15b-b309-497e-89c0-887f83d172e1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:36.905486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.905954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.909708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:36.910792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:36.964528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:37.002271 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-191a0d6c-39ac-4c05-b674-0928510c478a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1222 microversion: 2.1 time: 0.785239 Jul 14 14:47:37.005570 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1042/2066] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:36 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1222 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:37.042178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] HTTP exception thrown: Instance 0d90f15b-b309-497e-89c0-887f83d172e1 could not be found. Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Request method failure captured: Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 HTTP/1.1 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cw-vyZEJzDG1kkZfThwQoxvZcORAoL5pWLwSboEpZc5Y5-wRVBgjNa9guWV173CE_j5yo-pLKRFbyL4P-S12bC4NWbMI3ICXxluEgO_S1t03-7p97DuPSAdW4bePwyoR_ejUbMiYB0It7JoYBCHudqbclMZN7S0KRGIyeRMTaQ-9q8 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1c56ef362cf84d91bb841ab512e3665e Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-LiveMigrationNegativeTest-1183470725 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1c56ef362cf84d91bb841ab512e3665e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-LiveMigrationNegativeTest-1183470725 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1c56ef362cf84d91bb841ab512e3665e Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1183470725 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-LiveMigrationNegativeTest-1183470725-project Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: df11930b59684df585c3b90e0300aeb3 Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-LiveMigrationNegativeTest-1183470725-project Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 0d90f15b-b309-497e-89c0-887f83d172e1 could not be found. Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0d90f15b-b309-497e-89c0-887f83d172e1'} Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d90f15b-b309-497e-89c0-887f83d172e1 could not be found. Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d90f15b-b309-497e-89c0-887f83d172e1 could not be found. Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:37.057685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d90f15b-b309-497e-89c0-887f83d172e1 could not be found. Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] Returning 404 to user: Instance 0d90f15b-b309-497e-89c0-887f83d172e1 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:37.061253 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01bbf699-ff4d-4a09-954c-39f03691530d tempest-LiveMigrationNegativeTest-1183470725 tempest-LiveMigrationNegativeTest-1183470725-project] 10.222.0.98 "GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1" status: 404 len: 111 microversion: 2.1 time: 0.223294 Jul 14 14:47:37.072164 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1025/2067] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:36 2022] GET /compute/v2.1/servers/0d90f15b-b309-497e-89c0-887f83d172e1 => generated 111 bytes in 251 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:47:37.202107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:37.208378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:37.298566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.302584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:37.316076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.330107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:37.649642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:37.650799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:37.680488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.680961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:37.682472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:37.683385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.140010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.242016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.248318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.249206 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2ba6f526-5845-47fe-b153-43f8debf559b tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1366 microversion: 2.47 time: 0.607918 Jul 14 14:47:38.249793 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1026/2068] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:37 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1366 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:38.254573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-666435dd-68f9-4a3f-b6ef-b095527aa4b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf29e7310>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:38.340437 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-666435dd-68f9-4a3f-b6ef-b095527aa4b1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.089513 Jul 14 14:47:38.341415 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1027/2069] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:38 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:38.346762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:38.351144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:38.371354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:38.371794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.372615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:38.373050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:38.454413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:38.492935 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-241c529b-6628-4803-b19b-f0cdbd9cf26b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 1.299217 Jul 14 14:47:38.505108 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1043/2070] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:37 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:39.272107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:39.276024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:39.315673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.316189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.332688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.333955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.403229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:39.439207 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f562bf2d-4939-410c-ada5-a3d688eb3c1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1270 microversion: 2.1 time: 1.096225 Jul 14 14:47:39.447049 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1028/2071] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:38 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1270 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:39.467219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cdb72ad-f367-48fb-997e-980a18540534 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf29e7700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:39.620209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cdb72ad-f367-48fb-997e-980a18540534 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.170848 Jul 14 14:47:39.646860 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1029/2072] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:39 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:39.677637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:39.680568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:39.710606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.711640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.712873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:39.713855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:39.751884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:39.794186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:39.807368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:39.822115 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c3820170-9868-414a-83f0-8951bbcfb8bd tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1372 microversion: 2.47 time: 0.557166 Jul 14 14:47:39.830525 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1044/2073] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:39 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1372 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:40.485018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:40.486022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:40.516270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:40.517271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:40.518770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:40.519844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:40.780313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:40.832545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b02e4c93-5fc0-4a1a-ad36-f538a4f58ef4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1276 microversion: 2.1 time: 0.346355 Jul 14 14:47:40.837574 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1045/2074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:40 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1276 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:40.850158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe54a396-c02b-4cb1-ad81-e01216f59a9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf3946790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:40.970385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe54a396-c02b-4cb1-ad81-e01216f59a9c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.131165 Jul 14 14:47:40.971000 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1046/2075] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:40 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:40.992844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:40.993479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:41.014582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:41.020602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.022746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.027311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.028011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.048822 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80e683dd-a74d-42ab-8616-a1c3fbd66c71 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 1.397099 Jul 14 14:47:41.079532 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1030/2076] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:39 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:41.276788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:41.306498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:41.315261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:41.319393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e313612-8b3c-404c-b28e-f69c3eb25acf tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1372 microversion: 2.47 time: 0.338660 Jul 14 14:47:41.326541 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1047/2077] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:40 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1372 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:41.872864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:41.876224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:41.892358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.893514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.895237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:41.896875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:41.985982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b2d48ac-aa3e-478d-a65b-e3eb1eaecd39 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2adcb80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:42.080940 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b2d48ac-aa3e-478d-a65b-e3eb1eaecd39 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.098831 Jul 14 14:47:42.089488 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1048/2078] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:41 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:42.104412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:42.105483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:42.116911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:42.117408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.133869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:42.134558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.426253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.476730 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1cbf90f8-c611-4e70-96d6-7c7ea4f6c793 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1276 microversion: 2.1 time: 0.606286 Jul 14 14:47:42.482411 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1031/2079] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:41 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1276 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:42.520194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:42.529990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:42.553291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:42.565208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.570116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:42.571536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:42.773057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.819069 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e06fb6e3-02fe-4e89-a44e-e860ab7f8ac4 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 0.725796 Jul 14 14:47:42.820133 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1049/2080] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:42 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:42.910998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.925786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.933800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:42.935740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c8774f5e-1ba2-40b1-bec7-3070926dfce2 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1372 microversion: 2.47 time: 0.448294 Jul 14 14:47:42.940521 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1032/2081] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:42 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1372 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:43.097393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fa3eb459-2dfd-4762-bc4c-b98cfeedfb3c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b0a5e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:43.203364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-838b8a05-b188-43ea-979c-9944758c2154 req-e424a65e-b736-4773-acaf-cd1030e96f72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfd7888-3b07-4c8f-a9cc-104769edf3f7", "name": "network-vif-plugged", "status": "completed", "tag": "764fad28-c009-4b35-9778-7e32be78c7bf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:43.300370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-838b8a05-b188-43ea-979c-9944758c2154 req-e424a65e-b736-4773-acaf-cd1030e96f72 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.329228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-838b8a05-b188-43ea-979c-9944758c2154 req-e424a65e-b736-4773-acaf-cd1030e96f72 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.351025 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fa3eb459-2dfd-4762-bc4c-b98cfeedfb3c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.257450 Jul 14 14:47:43.387759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1050/2082] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:43 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:43.478193 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-838b8a05-b188-43ea-979c-9944758c2154 req-e424a65e-b736-4773-acaf-cd1030e96f72 service nova] Creating event network-vif-plugged:764fad28-c009-4b35-9778-7e32be78c7bf for instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 on n-h1-768852-23 Jul 14 14:47:43.502005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:43.503213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:43.524081 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-838b8a05-b188-43ea-979c-9944758c2154 req-e424a65e-b736-4773-acaf-cd1030e96f72 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.324044 Jul 14 14:47:43.536150 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1033/2083] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:43.543052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.544676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.546904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.549854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.830963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:43.846014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:43.847100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:43.850193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bcaecd6e-6075-4e4b-a18b-dae70dc00a66 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1276 microversion: 2.1 time: 0.352277 Jul 14 14:47:43.851204 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1051/2084] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:43 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1276 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:43.879012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.882073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.883695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:43.885020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:43.977775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:43.980874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:44.008562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.009761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.017033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.017502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:44.025025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.139256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:44.336395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:44.371541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:44.383916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:44.397475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2088fa45-c7e2-4739-b4c1-b7fec52d1619 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1357 microversion: 2.47 time: 0.430194 Jul 14 14:47:44.419032 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1052/2085] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:43 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1357 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:44.445357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b3d2362-9570-489a-8a72-9438a0d6a557 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2af71f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:44.637574 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b3d2362-9570-489a-8a72-9438a0d6a557 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.216227 Jul 14 14:47:44.658082 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1053/2086] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:44 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:44.674369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:44.690916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:44.699323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Searching by: {'deleted': False, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:47:44.719956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.721149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.725652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:44.726870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:44.830962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:45.100098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:47:45.359650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.381768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.382643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.406888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.408673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.477835 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87abcd9e-5640-4896-8bb4-efa7f5e2835c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.818146 Jul 14 14:47:45.491244 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1054/2087] 10.222.0.98 () {60 vars in 1186 bytes} [Thu Jul 14 14:47:44 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:45.491244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:45.491244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:45.500580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.501174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.501871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.502325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.890723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:45.954597 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5a7606c7-a9a4-411a-b248-7e5d2c419577 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1276 microversion: 2.1 time: 0.474344 Jul 14 14:47:45.964417 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1055/2088] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:45 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1276 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:45.975755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:45.976692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:45.985772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.986979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:45.988447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:45.989252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:46.045245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:46.113073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:46.287958 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d3c967f-2c58-4a66-bb4c-c6766900802f tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "DELETE /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 204 len: 0 microversion: 2.47 time: 0.318836 Jul 14 14:47:46.291036 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1056/2089] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:45 2022] DELETE /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:47:46.314998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d255b9c-6a49-473b-b845-bb16aa7b6612 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf31754c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:46.515030 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d255b9c-6a49-473b-b845-bb16aa7b6612 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.216150 Jul 14 14:47:46.522679 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1057/2090] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:46 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:46.753038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:46.772825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-004acb95-7869-4d3e-9137-f72cda617613 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1314 microversion: 2.1 time: 2.937026 Jul 14 14:47:46.784429 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1034/2091] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:43 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1314 bytes in 2950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:46.790377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:46.799438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:46.813871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.823410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:46.824468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:46.825081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:47.178900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1905120055", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:47.258411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:47:47.616270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:47.638540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:47.644764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:47.646823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68933228-18a2-41b7-98b6-d5df7beb183c tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1363 microversion: 2.47 time: 0.861036 Jul 14 14:47:47.647646 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1035/2092] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:46 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1363 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:47.664272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:47.668317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:47.684793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:47.685608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:47.689682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:47.690345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.041228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:47:48.075877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:47:48.075877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:47:48.075877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:47:48.075877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:47:48.075877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.076332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.079368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.079368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.173916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:48.179976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:47:48.183603 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1d3f52bd-44b6-4c78-8188-cfd873dfd6df tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 0.533772 Jul 14 14:47:48.191902 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1036/2093] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:47 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:48.192481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for user a185fa24374c417aa2bb9302a608cbcd and project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:47:48.213367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-118a6225-a020-4065-a5f0-45bba96561c6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a3e1f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.214849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:47:48.218395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:47:48.313618 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-118a6225-a020-4065-a5f0-45bba96561c6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.111903 Jul 14 14:47:48.325054 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1037/2094] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:48.351543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.352649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:48.359447 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c6c8955b-ea26-464f-92fe-65fab205a004 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832388 Jul 14 14:47:48.377524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.378524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.379820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.381368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.385341 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1058/2095] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:47:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:47:48.403035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6418097-6ff1-4e12-9e06-f2cbaff8c01e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.405338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6418097-6ff1-4e12-9e06-f2cbaff8c01e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:48.729136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b6418097-6ff1-4e12-9e06-f2cbaff8c01e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:48.737328 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6418097-6ff1-4e12-9e06-f2cbaff8c01e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1213 microversion: 2.1 time: 0.341971 Jul 14 14:47:48.741485 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1059/2096] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1213 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:48.758762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:48.759627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:48.776460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.778577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:48.780411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:48.782324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.098166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:49.142629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:49.155595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:49.166568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53519dcb-7472-4d99-9858-4ab478849053 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 200 len: 1363 microversion: 2.47 time: 0.417689 Jul 14 14:47:49.171053 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1060/2097] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 1363 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:49.214962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:49.216546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:49.245817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.250002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.255856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.259444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.797862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:49.809903 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28389923-bd2e-4f77-86ec-4cd8433e39c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 0.603341 Jul 14 14:47:49.812252 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1061/2098] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:49 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:49.825274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61c33b9d-dd60-4c21-be0e-ea4a5cce5b6c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf29f4ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:49.934138 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61c33b9d-dd60-4c21-be0e-ea4a5cce5b6c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.120646 Jul 14 14:47:49.935079 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1062/2099] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:49 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:49.947213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:49.947891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:49.973390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.973774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:49.975037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:49.975517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.159491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:50.173160 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05e74a4b-4f19-4afa-b68f-2f9baeb88692 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1464 microversion: 2.1 time: 1.842678 Jul 14 14:47:50.173974 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1038/2100] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:48 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1464 bytes in 1845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:50.189628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:50.190374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 076a5d69-a0a9-471f-bcc9-b7e9832cd5be] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:50.211097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.211600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.212473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.213140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.261129 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] HTTP exception thrown: Instance 076a5d69-a0a9-471f-bcc9-b7e9832cd5be could not be found. Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Request method failure captured: Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be HTTP/1.1 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cxb-dSmk6_DjpcGkH8nDEf_PyekW6Izootf7FAj5cMTXIjcE5aELa66o4dN3rxZ1PwgREKx4LO24z4RaJbrPWs0umCjazIzt5gQ6FUzLiUuhxWKBoY-Ch9Z3uzYwkslAv8vVd7Dbza_ttVxzC3EQzQomSEX3HADRLYor1mniJ1dNK8 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.47 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8367f06d1b2b4cd4a95a8bcbd5036287 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerShowV247Test-812883586 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerShowV247Test-812883586 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8367f06d1b2b4cd4a95a8bcbd5036287 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerShowV247Test-812883586 Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerShowV247Test-812883586-project Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 6d8f172412334ae48bc109a50ee084fd Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerShowV247Test-812883586-project Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 076a5d69-a0a9-471f-bcc9-b7e9832cd5be could not be found. Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '076a5d69-a0a9-471f-bcc9-b7e9832cd5be'} Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076a5d69-a0a9-471f-bcc9-b7e9832cd5be could not be found. Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076a5d69-a0a9-471f-bcc9-b7e9832cd5be could not be found. Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:50.262653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076a5d69-a0a9-471f-bcc9-b7e9832cd5be could not be found. Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Returning 404 to user: Instance 076a5d69-a0a9-471f-bcc9-b7e9832cd5be could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:50.273243 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fff7530e-38d7-4d93-98f1-661df4e91c62 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be" status: 404 len: 111 microversion: 2.47 time: 0.078971 Jul 14 14:47:50.280545 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1039/2101] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:50 2022] GET /compute/v2.1/servers/076a5d69-a0a9-471f-bcc9-b7e9832cd5be => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:47:50.493010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:50.506978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-155c3a02-7388-4eb4-b3ae-e1fb9431af58 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1209 microversion: 2.1 time: 0.570713 Jul 14 14:47:50.524009 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1063/2102] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:49 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1209 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:50.532862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:50.536543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:50.552940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.554264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.556017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.556637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.638318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:50.884549 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9bcee0d5-6d65-4c4e-b05e-6e2eeb426a27 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "DELETE /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42" status: 204 len: 0 microversion: 2.47 time: 0.358648 Jul 14 14:47:50.885904 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1064/2103] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:47:50 2022] DELETE /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:47:50.902317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:50.907553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:50.922853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.923815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.924780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:50.930866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:50.987628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5ad79269-d12d-4790-aefb-edc653a181ed tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Calling method '.version_select at 0x7fdbf2a6fe50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.010538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ad79269-d12d-4790-aefb-edc653a181ed tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.011347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ad79269-d12d-4790-aefb-edc653a181ed tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.051055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ad79269-d12d-4790-aefb-edc653a181ed tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.051528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ad79269-d12d-4790-aefb-edc653a181ed tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.079741 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5ad79269-d12d-4790-aefb-edc653a181ed tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] 10.222.0.98 "GET /compute/v2.1/os-simple-tenant-usage/294ea301498240ec8101929ae3f9e4e4?start=2022-07-13T14%3A47%3A50.192268&end=2022-07-15T14%3A47%3A50.192268" status: 200 len: 695 microversion: 2.1 time: 0.802049 Jul 14 14:47:51.080694 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1040/2104] 10.222.0.98 () {58 vars in 1411 bytes} [Thu Jul 14 14:47:50 2022] GET /compute/v2.1/os-simple-tenant-usage/294ea301498240ec8101929ae3f9e4e4?start=2022-07-13T14%3A47%3A50.192268&end=2022-07-15T14%3A47%3A50.192268 => generated 695 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:51.096086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.096708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:51.114110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.115800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.118291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.119622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.419859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:51.432797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:51.436503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:51.442478 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dec79960-7541-428e-a905-b66351239933 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42" status: 200 len: 1363 microversion: 2.47 time: 0.360654 Jul 14 14:47:51.456486 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1041/2105] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 => generated 1363 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:51.462765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f533add-5c44-4e85-b50b-6dcb099e7cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2984af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.564265 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f533add-5c44-4e85-b50b-6dcb099e7cd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.105779 Jul 14 14:47:51.565543 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1042/2106] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:51.573254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f017bc4e-5d66-446e-9d3b-8ad386aa7a9c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '.version_select at 0x7fdbf2984700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.604737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f017bc4e-5d66-446e-9d3b-8ad386aa7a9c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.614968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f017bc4e-5d66-446e-9d3b-8ad386aa7a9c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.647037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f017bc4e-5d66-446e-9d3b-8ad386aa7a9c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.647808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f017bc4e-5d66-446e-9d3b-8ad386aa7a9c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.667881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f017bc4e-5d66-446e-9d3b-8ad386aa7a9c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/os-simple-tenant-usage/294ea301498240ec8101929ae3f9e4e4?start=2022-07-13T14%3A47%3A50.192268&end=2022-07-15T14%3A47%3A50.192268" status: 200 len: 651 microversion: 2.1 time: 0.100998 Jul 14 14:47:51.682794 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1043/2107] 10.222.0.98 () {58 vars in 1411 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/os-simple-tenant-usage/294ea301498240ec8101929ae3f9e4e4?start=2022-07-13T14%3A47%3A50.192268&end=2022-07-15T14%3A47%3A50.192268 => generated 651 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:51.688073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:51.694930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:51.712439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.714520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:51.720206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:51.720913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.041486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:52.053375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-98e61529-fdfd-414a-82d9-aa5a004fe58b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 1.160664 Jul 14 14:47:52.059545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:52.072538 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1065/2108] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:50 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:52.081818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-97af8002-a751-4cc0-835c-406483f233da tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Calling method '.version_select at 0x7fdbf2bbeca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:52.087836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4bbd0e86-1814-42cc-b309-69b26b88764e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1271 microversion: 2.1 time: 0.403467 Jul 14 14:47:52.098039 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1044/2109] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:51 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1271 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:52.116824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97af8002-a751-4cc0-835c-406483f233da tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.126696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97af8002-a751-4cc0-835c-406483f233da tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.129118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bbce62b0-57d0-463f-ab19-aed9a643fbfc req-0b22bd5d-931b-48ec-8ae7-66aa92c653c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:52.159508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bbce62b0-57d0-463f-ab19-aed9a643fbfc req-0b22bd5d-931b-48ec-8ae7-66aa92c653c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.160626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bbce62b0-57d0-463f-ab19-aed9a643fbfc req-0b22bd5d-931b-48ec-8ae7-66aa92c653c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.178896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97af8002-a751-4cc0-835c-406483f233da tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.190064 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bbce62b0-57d0-463f-ab19-aed9a643fbfc req-0b22bd5d-931b-48ec-8ae7-66aa92c653c8 service nova] Creating event network-changed:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:47:52.190995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97af8002-a751-4cc0-835c-406483f233da tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.210772 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bbce62b0-57d0-463f-ab19-aed9a643fbfc req-0b22bd5d-931b-48ec-8ae7-66aa92c653c8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097593 Jul 14 14:47:52.211726 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1045/2110] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:52.465508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:52.466548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:52.481669 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-97af8002-a751-4cc0-835c-406483f233da tempest-TenantUsagesTestJSON-291431841 tempest-TenantUsagesTestJSON-291431841-project-admin] 10.222.0.98 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A47%3A50.192268&end=2022-07-15T14%3A47%3A50.192268&detailed=1" status: 200 len: 27026 microversion: 2.1 time: 0.416135 Jul 14 14:47:52.484074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.484531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.485344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.485786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.493375 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1066/2111] 10.222.0.98 () {58 vars in 1334 bytes} [Thu Jul 14 14:47:52 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-07-13T14%3A47%3A50.192268&end=2022-07-15T14%3A47%3A50.192268&detailed=1 => generated 27026 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:47:52.530146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:52.530919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:52.544218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.544986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.546509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.550329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.605623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:47:52.753910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:52.804852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91c43eaa-1788-4de8-9e1d-049c5d21b315 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 204 len: 0 microversion: 2.1 time: 0.278445 Jul 14 14:47:52.806225 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1067/2112] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:47:52 2022] DELETE /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:47:52.813502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c1a97ff-a9ea-4246-bec6-6e9c4163a897 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2ae2160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:52.908787 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c1a97ff-a9ea-4246-bec6-6e9c4163a897 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.101001 Jul 14 14:47:52.916231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1068/2113] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:52 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:52.916231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:52.916231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:52.924271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.924904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:52.925865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:52.926550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:53.327479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:53.335927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:53.343095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:53.345722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:53.347519 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-474bfc9c-01fa-4be1-b645-85b416784f51 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42" status: 200 len: 1363 microversion: 2.47 time: 0.886717 Jul 14 14:47:53.348703 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1046/2114] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:52 2022] GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 => generated 1363 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:47:53.361737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:53.362657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:53.381704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:53.382792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:53.384076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:53.385184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:53.727630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:53.753752 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2815995-bc55-40a8-99d8-edc9c4c8c15c tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1470 microversion: 2.1 time: 0.842226 Jul 14 14:47:53.762910 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1069/2115] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:52 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1470 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:53.774372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:53.775678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:53.794317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:53.795754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:53.797782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:53.798993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.044690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:54.065678 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c4827b8-a0d8-4daf-8030-a97db221cb94 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1271 microversion: 2.1 time: 0.299953 Jul 14 14:47:54.091443 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1070/2116] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:53 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1271 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:54.101017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06df947b-2382-4faf-853d-2a9b113f3773 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b0aee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:54.206907 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06df947b-2382-4faf-853d-2a9b113f3773 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.113634 Jul 14 14:47:54.220628 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1071/2117] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:54 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:54.387423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:54.388573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:54.412830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.413316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.424858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.425994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.639977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:54.654552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7bd5f562-2650-4ec4-9112-c10a2a115c28 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 1.303626 Jul 14 14:47:54.657417 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1047/2118] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:53 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:54.794930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:54.796142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:54.814940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.815830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:54.818887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:54.819676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.212610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:55.290612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:55.304484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d8f172412334ae48bc109a50ee084fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8367f06d1b2b4cd4a95a8bcbd5036287', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:55.306031 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df948cec-ab25-4509-bad3-2511cae1b637 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42" status: 200 len: 1363 microversion: 2.47 time: 0.928978 Jul 14 14:47:55.306982 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1072/2119] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:54 2022] GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 => generated 1363 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:47:55.316015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:55.316657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:55.362406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.363301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:55.370046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:55.370900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.467019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:57.482042 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a70b8eba-1e33-40f3-9d78-40153fe98454 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1470 microversion: 2.1 time: 2.693588 Jul 14 14:47:57.484014 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1048/2120] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:54 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1470 bytes in 2696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:57.496300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf490e31-f9f2-49c7-bba4-6f1cda13c21c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf29aa790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:57.563721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:57.602542 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62d683fe-5e27-4c49-b923-56073d8bf9ca tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 2.293973 Jul 14 14:47:57.633016 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1073/2121] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:55 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:57.650142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a7bc38ca-253f-4adc-ac9e-683137e802c2 req-705578b1-8a83-4349-89c1-67e35165efb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f3490c3-371d-4033-afe2-e2bf1b7bb517", "tag": "a95d4384-b690-4cd0-8f4e-719098d1cf4e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:57.704781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf490e31-f9f2-49c7-bba4-6f1cda13c21c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.219292 Jul 14 14:47:57.706249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1049/2122] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:57 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:57.706782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a7bc38ca-253f-4adc-ac9e-683137e802c2 req-705578b1-8a83-4349-89c1-67e35165efb6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.707800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a7bc38ca-253f-4adc-ac9e-683137e802c2 req-705578b1-8a83-4349-89c1-67e35165efb6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.717220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:57.717852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:57.729846 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a7bc38ca-253f-4adc-ac9e-683137e802c2 req-705578b1-8a83-4349-89c1-67e35165efb6 service nova] Creating event network-changed:a95d4384-b690-4cd0-8f4e-719098d1cf4e for instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 on n-h2-768852-23 Jul 14 14:47:57.736320 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a7bc38ca-253f-4adc-ac9e-683137e802c2 req-705578b1-8a83-4349-89c1-67e35165efb6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100956 Jul 14 14:47:57.737749 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1074/2123] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:47:57.740456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.740908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.741705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.742142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.745407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:57.746512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] [instance: 45fb76e6-8c79-4cc4-8de9-a7273e2eed42] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:57.754417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.756185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.757368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:57.758060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:57.786785 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] HTTP exception thrown: Instance 45fb76e6-8c79-4cc4-8de9-a7273e2eed42 could not be found. Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Request method failure captured: Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 HTTP/1.1 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cxb-dSmk6_DjpcGkH8nDEf_PyekW6Izootf7FAj5cMTXIjcE5aELa66o4dN3rxZ1PwgREKx4LO24z4RaJbrPWs0umCjazIzt5gQ6FUzLiUuhxWKBoY-Ch9Z3uzYwkslAv8vVd7Dbza_ttVxzC3EQzQomSEX3HADRLYor1mniJ1dNK8 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.47 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8367f06d1b2b4cd4a95a8bcbd5036287 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerShowV247Test-812883586 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8367f06d1b2b4cd4a95a8bcbd5036287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerShowV247Test-812883586 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8367f06d1b2b4cd4a95a8bcbd5036287 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerShowV247Test-812883586 Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerShowV247Test-812883586-project Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 6d8f172412334ae48bc109a50ee084fd Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerShowV247Test-812883586-project Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 45fb76e6-8c79-4cc4-8de9-a7273e2eed42 could not be found. Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '45fb76e6-8c79-4cc4-8de9-a7273e2eed42'} Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45fb76e6-8c79-4cc4-8de9-a7273e2eed42 could not be found. Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45fb76e6-8c79-4cc4-8de9-a7273e2eed42 could not be found. Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:47:57.789966 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45fb76e6-8c79-4cc4-8de9-a7273e2eed42 could not be found. Jul 14 14:47:57.793711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:47:57.796518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] Returning 404 to user: Instance 45fb76e6-8c79-4cc4-8de9-a7273e2eed42 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:47:57.798178 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70922efe-5cc4-40f9-a2b0-38aa03185a04 tempest-ServerShowV247Test-812883586 tempest-ServerShowV247Test-812883586-project] 10.222.0.98 "GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42" status: 404 len: 111 microversion: 2.47 time: 0.058904 Jul 14 14:47:57.799052 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1075/2124] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:47:57 2022] GET /compute/v2.1/servers/45fb76e6-8c79-4cc4-8de9-a7273e2eed42 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:47:58.041451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0803b04e-0638-44c0-b6df-ff945a6dd13a req-51254844-f5e5-49a1-9814-ca5b6f67ccf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570420f0-9812-4164-b136-02e3f8d2068d", "tag": "f3325209-778c-4269-b0f6-c9756ff6ad15"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:47:58.108760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0803b04e-0638-44c0-b6df-ff945a6dd13a req-51254844-f5e5-49a1-9814-ca5b6f67ccf2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:58.112534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0803b04e-0638-44c0-b6df-ff945a6dd13a req-51254844-f5e5-49a1-9814-ca5b6f67ccf2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:58.154138 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0803b04e-0638-44c0-b6df-ff945a6dd13a req-51254844-f5e5-49a1-9814-ca5b6f67ccf2 service nova] Creating event network-changed:f3325209-778c-4269-b0f6-c9756ff6ad15 for instance 570420f0-9812-4164-b136-02e3f8d2068d on n-h1-768852-23 Jul 14 14:47:58.181825 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0803b04e-0638-44c0-b6df-ff945a6dd13a req-51254844-f5e5-49a1-9814-ca5b6f67ccf2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142709 Jul 14 14:47:58.186972 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1076/2125] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:47:58.509039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:58.509938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:58.533001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:58.543893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:58.544831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:58.548927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:58.587894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:58.736444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:47:58.936702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:58.964764 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1aed3332-5828-4462-ad28-1989d39cd7cc tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1428 microversion: 2.1 time: 0.461962 Jul 14 14:47:58.968878 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1077/2126] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:58 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1428 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:47:58.981171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:58.984048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:47:59.000051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:59.003206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.006045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:47:59.008530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:47:59.818931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:47:59.835368 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d946ff24-1188-41f0-b400-874ca7eaf9c3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 0.864014 Jul 14 14:47:59.848393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1078/2127] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:58 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:47:59.855819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-acd253de-46e3-4f89-9ecc-b8bd218b4be6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bf25e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:47:59.925305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-acd253de-46e3-4f89-9ecc-b8bd218b4be6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.073934 Jul 14 14:47:59.927671 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1079/2128] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:47:59 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:00.031777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:00.033092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:00.105296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.119683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.121455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.123444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.313615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:00.325935 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1fef5048-53d5-4c8f-84a3-f4b958e37291 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1428 microversion: 2.1 time: 0.335189 Jul 14 14:48:00.326570 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1080/2129] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:59 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1428 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:00.338858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fb13719f-92c2-47b7-89f6-677b40ae81c7 req-59d5c859-6422-4758-82b1-5b37de283c51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bfd7888-3b07-4c8f-a9cc-104769edf3f7", "name": "network-vif-deleted", "tag": "764fad28-c009-4b35-9778-7e32be78c7bf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:00.356777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fb13719f-92c2-47b7-89f6-677b40ae81c7 req-59d5c859-6422-4758-82b1-5b37de283c51 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.357233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fb13719f-92c2-47b7-89f6-677b40ae81c7 req-59d5c859-6422-4758-82b1-5b37de283c51 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.382495 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fb13719f-92c2-47b7-89f6-677b40ae81c7 req-59d5c859-6422-4758-82b1-5b37de283c51 service nova] Creating event network-vif-deleted:764fad28-c009-4b35-9778-7e32be78c7bf for instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 on n-h1-768852-23 Jul 14 14:48:00.420568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fb13719f-92c2-47b7-89f6-677b40ae81c7 req-59d5c859-6422-4758-82b1-5b37de283c51 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092683 Jul 14 14:48:00.430985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1081/2130] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:00.855636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:00.857251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:00.868106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.876932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:00.881859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:00.882411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.465798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:01.495824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d486f33a-e66c-415c-8fbb-e4207192a5ef tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 0.637946 Jul 14 14:48:01.499479 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1082/2131] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:00 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:01.506478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9804dd69-ab3e-4238-8650-eebbf5d63bd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf3435e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:01.591106 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9804dd69-ab3e-4238-8650-eebbf5d63bd0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1411 microversion: 2.1 time: 0.090087 Jul 14 14:48:01.593048 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1083/2132] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:01 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1411 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:01.599803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:01.600837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:01.611304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.612175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.613418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.614237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.646304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:01.697966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:01.698745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:01.703856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lazy-loading 'fault' on Instance uuid 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:48:01.850918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ba43227f00d04dccac9ebe6c38aae925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294ea301498240ec8101929ae3f9e4e4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:01.881635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ab2dd48-70d0-49fe-b3e9-fb878be35566 tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 200 len: 1304 microversion: 2.1 time: 0.287243 Jul 14 14:48:01.890530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1084/2133] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:01 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 1304 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:02.145203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:02.160137 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a5607f2-2099-439d-b3ae-3deb766af61d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 4.451841 Jul 14 14:48:02.163576 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1050/2134] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:47:57 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 4457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:02.301199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:02.501249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1794536350", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": "none"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:02.522884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:02.525839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:02.566564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.568199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.569929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.571544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.629710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:02.640338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:02.641716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:02.642801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:02.647965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:02.675680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.677565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.679540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:02.681610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:02.728449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Getting quotas for project a0ebe694f2e34ee1a34caa32aba4d755. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:02.741977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Getting quotas for user 9a5792393e3f4517a52b4e84d5790ec8 and project a0ebe694f2e34ee1a34caa32aba4d755. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:02.768810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:48:02.774587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:02.842808 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-083b6fa0-d7c7-413b-a122-1253aaa3f664 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.548279 Jul 14 14:48:02.844754 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1085/2135] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:48:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 551 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:48:02.851550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de523b32-5391-4145-8f61-f19440644885 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b0a430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:02.926331 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de523b32-5391-4145-8f61-f19440644885 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1420 microversion: 2.1 time: 0.079501 Jul 14 14:48:02.928651 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1086/2136] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:02 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:02.935531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2f648f2-6afa-459e-8cf4-5d36cec8e0c6 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:02.936198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d2f648f2-6afa-459e-8cf4-5d36cec8e0c6 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:03.051144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d2f648f2-6afa-459e-8cf4-5d36cec8e0c6 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:03.069443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d2f648f2-6afa-459e-8cf4-5d36cec8e0c6 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:03.073610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d2f648f2-6afa-459e-8cf4-5d36cec8e0c6 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:03.076828 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2f648f2-6afa-459e-8cf4-5d36cec8e0c6 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1278 microversion: 2.54 time: 0.146581 Jul 14 14:48:03.077999 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1087/2137] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:02 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:03.087774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:03.089263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] [instance: 8bfd7888-3b07-4c8f-a9cc-104769edf3f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:03.102221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.103951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.107478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.110046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.147098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] HTTP exception thrown: Instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 could not be found. Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Request method failure captured: Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 HTTP/1.1 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cxz79tXEuvSyF-GHyqNRwnoDPSvHfkfLDK3RwZjGQJVoJVO9BlSMIoN5ODsC2WOIv66sVq46yf-Fkw7knZ0D9ceyJ7Ng-jbMDUAwaHEczZQLzt4Wh8dXB3fpJOjaS-EgGDxF9qP8ZjFEdKEJWynVw5afZ1Bj_kP80EoUFK8T8D_tOg Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 294ea301498240ec8101929ae3f9e4e4 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TenantUsagesTestJSON-2005135451 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/294ea301498240ec8101929ae3f9e4e4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_294ea301498240ec8101929ae3f9e4e4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/294ea301498240ec8101929ae3f9e4e4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/294ea301498240ec8101929ae3f9e4e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TenantUsagesTestJSON-2005135451 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 294ea301498240ec8101929ae3f9e4e4 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TenantUsagesTestJSON-2005135451 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TenantUsagesTestJSON-2005135451-project Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ba43227f00d04dccac9ebe6c38aae925 Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TenantUsagesTestJSON-2005135451-project Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 could not be found. Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '8bfd7888-3b07-4c8f-a9cc-104769edf3f7'} Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 could not be found. Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 could not be found. Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:03.151008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 could not be found. Jul 14 14:48:03.159927 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:03.166159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] Returning 404 to user: Instance 8bfd7888-3b07-4c8f-a9cc-104769edf3f7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:03.168173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77b8bc50-c94d-4b3c-915c-761a3359ca3b tempest-TenantUsagesTestJSON-2005135451 tempest-TenantUsagesTestJSON-2005135451-project] 10.222.0.98 "GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7" status: 404 len: 111 microversion: 2.1 time: 0.087787 Jul 14 14:48:03.169648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1088/2138] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:03 2022] GET /compute/v2.1/servers/8bfd7888-3b07-4c8f-a9cc-104769edf3f7 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:48:03.175196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f8be4d3e-0079-47f0-b41e-8c79a1575f46 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bc6310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:03.313901 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f8be4d3e-0079-47f0-b41e-8c79a1575f46 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 200 len: 1420 microversion: 2.1 time: 0.143011 Jul 14 14:48:03.314613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1089/2139] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:03 2022] GET /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:03.324747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:03.340749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:03.363329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.365452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.366589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:03.367517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:03.602220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:03.616471 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed49c2a9-bc02-43a2-9d02-7f363c08d892 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 0.299682 Jul 14 14:48:03.628021 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1090/2140] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:03 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:03.634566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e57bbcaa-60ac-40a5-b9f9-36cee0c8e4db tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2bbe040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:04.328628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:04.376887 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-35fffc36-b985-4500-b035-ce52c2b9e5e9 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 1.840315 Jul 14 14:48:04.378087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1051/2141] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:02 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:04.411018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:04.446638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:04.450398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:04.480392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:04.482554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:04.487217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:04.490425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.152225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:05.168412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:05.172170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:05.177687 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b2cbc43-b814-4ae0-9454-6475a2441f11 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1330 microversion: 2.54 time: 0.776719 Jul 14 14:48:05.181740 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1052/2142] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:04 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1330 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:05.195424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:05.196829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:05.213927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.216162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.221897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.222595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.392259 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e57bbcaa-60ac-40a5-b9f9-36cee0c8e4db tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 204 len: 0 microversion: 2.1 time: 1.762898 Jul 14 14:48:05.396888 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1091/2143] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:03 2022] DELETE /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 0 bytes in 1768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:05.404476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bebdc780-1dfd-452c-878c-f5d3e92445f8 req-4072b993-8818-4e16-a08e-f518fe190578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "name": "network-vif-plugged", "status": "completed", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:05.438683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bebdc780-1dfd-452c-878c-f5d3e92445f8 req-4072b993-8818-4e16-a08e-f518fe190578 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.443299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bebdc780-1dfd-452c-878c-f5d3e92445f8 req-4072b993-8818-4e16-a08e-f518fe190578 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.470687 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bebdc780-1dfd-452c-878c-f5d3e92445f8 req-4072b993-8818-4e16-a08e-f518fe190578 service nova] Creating event network-vif-plugged:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:48:05.484901 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bebdc780-1dfd-452c-878c-f5d3e92445f8 req-4072b993-8818-4e16-a08e-f518fe190578 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086286 Jul 14 14:48:05.487150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1092/2144] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:05.493842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:05.494867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:05.514627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.518987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.523948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.525053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.561317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:05.680130 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d91fa76-e906-4dd8-96e9-316d6640a62e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 204 len: 0 microversion: 2.1 time: 0.190099 Jul 14 14:48:05.681738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1093/2145] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:48:05 2022] DELETE /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:48:05.695144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:05.696264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:05.706395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.707148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:05.709167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:05.709855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:06.073896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:06.106916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20577147-d04e-43c4-852f-64aad1975e92 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 0.414952 Jul 14 14:48:06.109219 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1094/2146] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:05 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:06.146916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1974671672", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:06.284316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] validate_networks() for [('e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:48:07.045687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:07.065434 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bd3fa87-c7d0-42ca-a20f-ffacb0f50939 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 1.882254 Jul 14 14:48:07.066316 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1053/2147] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:05 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:07.073742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:07.074666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:07.082465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:07.084342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:07.085622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:07.086359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:07.331822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:07.342077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:07.351819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:07.353051 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-698c3205-1a62-4801-ad21-dca68954e05d tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1336 microversion: 2.54 time: 0.285598 Jul 14 14:48:07.353649 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1054/2148] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:07 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1336 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:07.369425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:07.370058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:07.387142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:07.389016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:07.390974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:07.391771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.004859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:08.005584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:08.006429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:08.007664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:08.008644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:08.048982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.049748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.051768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.052520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.089726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:08.103129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for user 331a222a893c4f84a08abf11333c7449 and project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:08.124208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:48:08.126828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:08.128195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:08.157205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c31c0b4-f3bd-4921-87e7-dbf45dd89a20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 0.800678 Jul 14 14:48:08.158134 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1055/2149] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:07 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:08.184264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-94f16999-646f-41fa-af5c-abe1e6594a98 req-d3e7a49a-5dc5-4597-a06c-18aa6e111a44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570420f0-9812-4164-b136-02e3f8d2068d", "name": "network-vif-plugged", "status": "completed", "tag": "f3325209-778c-4269-b0f6-c9756ff6ad15"}, {"server_uuid": "225f3940-0dbc-41c1-bf0b-9043e402e6ca", "name": "network-vif-unplugged", "status": "completed", "tag": "b85248f6-5ba1-442f-92e6-c64ef45c05fe"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:08.201861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-94f16999-646f-41fa-af5c-abe1e6594a98 req-d3e7a49a-5dc5-4597-a06c-18aa6e111a44 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.203062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-94f16999-646f-41fa-af5c-abe1e6594a98 req-d3e7a49a-5dc5-4597-a06c-18aa6e111a44 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.245823 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be66f440-e9c2-466c-978c-bd846676ae61 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.132865 Jul 14 14:48:08.247534 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1095/2150] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:48:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2137 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:48:08.257174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-94f16999-646f-41fa-af5c-abe1e6594a98 req-d3e7a49a-5dc5-4597-a06c-18aa6e111a44 service nova] Creating event network-vif-plugged:f3325209-778c-4269-b0f6-c9756ff6ad15 for instance 570420f0-9812-4164-b136-02e3f8d2068d on n-h1-768852-23 Jul 14 14:48:08.264239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-94f16999-646f-41fa-af5c-abe1e6594a98 req-d3e7a49a-5dc5-4597-a06c-18aa6e111a44 service nova] Creating event network-vif-unplugged:b85248f6-5ba1-442f-92e6-c64ef45c05fe for instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca on n-h1-768852-23 Jul 14 14:48:08.267350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:08.268009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:08.298371 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-94f16999-646f-41fa-af5c-abe1e6594a98 req-d3e7a49a-5dc5-4597-a06c-18aa6e111a44 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.124680 Jul 14 14:48:08.299499 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1056/2151] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:08.323847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c565ff41-5e0a-434b-afe1-6257d6406aea tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:08.324413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.324869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.329257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.330216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.336732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c565ff41-5e0a-434b-afe1-6257d6406aea tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:08.546461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c565ff41-5e0a-434b-afe1-6257d6406aea tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:08.579627 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c565ff41-5e0a-434b-afe1-6257d6406aea tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1208 microversion: 2.1 time: 0.265472 Jul 14 14:48:08.580861 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1057/2152] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:08 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1208 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:08.590589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:08.598038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:08.609246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.609986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.611230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:08.612353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:08.875012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:08.893515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:08.896408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:08.902854 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf9c9193-90b0-44eb-af77-c4fceb884893 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1336 microversion: 2.54 time: 0.317503 Jul 14 14:48:08.904446 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1058/2153] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:08 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1336 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:09.082735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:09.102582 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4732c62-9511-4270-9da6-1435bb482eb7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 0.846120 Jul 14 14:48:09.103707 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1096/2154] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:08 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.109566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-39b7915e-4384-44f1-bc2f-07ea8a58c5f6 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.127881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-39b7915e-4384-44f1-bc2f-07ea8a58c5f6 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.221839 Jul 14 14:48:09.149203 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1059/2155] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:08 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:09.155931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f36d6e2-def7-4be2-ba2c-b12480baac86 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.194396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.195550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:09.225251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.225508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f36d6e2-def7-4be2-ba2c-b12480baac86 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.084079 Jul 14 14:48:09.226001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.234106 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1097/2156] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.234318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.234318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.245332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2aed9c36-86bc-4c56-85bd-fc6db09915dc tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.283436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2aed9c36-86bc-4c56-85bd-fc6db09915dc tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.046337 Jul 14 14:48:09.285481 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1098/2157] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:48:09.303568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-11763ccc-6458-40b0-a29e-3f9cf6dbed15 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.320579 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-11763ccc-6458-40b0-a29e-3f9cf6dbed15 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025176 Jul 14 14:48:09.323226 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1099/2158] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:09.343196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2e97fe7-3984-4478-89d7-6855849b04a6 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.403545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2e97fe7-3984-4478-89d7-6855849b04a6 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.071561 Jul 14 14:48:09.405813 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1100/2159] 10.222.0.98 () {58 vars in 1164 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.426835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc86c274-a01c-4fd3-9494-ae9ae4b4ad67 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.447640 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc86c274-a01c-4fd3-9494-ae9ae4b4ad67 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029174 Jul 14 14:48:09.456891 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1101/2160] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:09.468183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5296bff-9dfa-4faf-b53e-9ef4f418c309 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.508012 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5296bff-9dfa-4faf-b53e-9ef4f418c309 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.048724 Jul 14 14:48:09.518463 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1102/2161] 10.222.0.98 () {58 vars in 1168 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.527108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-baebc128-94e7-4176-a727-94f858e291bd tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.532539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:09.546093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-baebc128-94e7-4176-a727-94f858e291bd tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.026032 Jul 14 14:48:09.555359 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1103/2162] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:09.562984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86ac8662-8d4e-4e70-aa1c-4b054c779bae tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.587074 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86ac8662-8d4e-4e70-aa1c-4b054c779bae tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029321 Jul 14 14:48:09.594032 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1104/2163] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:09.616910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.618472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:09.631458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.632883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.634308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.636336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.662606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:09.678244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d4526a12-3932-4aeb-9b7b-a899f757b40b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1313 microversion: 2.1 time: 0.493545 Jul 14 14:48:09.679582 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1060/2164] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1313 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:09.692013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e8495d46-8a64-4210-ac30-8592cd440be0 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.772390 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e8495d46-8a64-4210-ac30-8592cd440be0 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.091114 Jul 14 14:48:09.784479 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1061/2165] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.795783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7d70762-1b3d-4397-80eb-b2c6bb098aa6 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.810228 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7d70762-1b3d-4397-80eb-b2c6bb098aa6 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020152 Jul 14 14:48:09.811316 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1062/2166] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:09.837875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5661d050-d57c-426d-8874-92dddded9c54 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.848235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:09.872917 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2db7ee8-4edd-4f1c-a0e4-0ffaaef1c10f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1260 microversion: 2.1 time: 0.275202 Jul 14 14:48:09.876951 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1105/2167] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.924286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:09.926180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:09.942823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.946122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.949061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:09.951731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5661d050-d57c-426d-8874-92dddded9c54 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.130266 Jul 14 14:48:09.952784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:09.954391 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1063/2168] 10.222.0.98 () {58 vars in 1143 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:09.973787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9760a5af-0861-4b7e-a4e0-628ab5edde89 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.013230 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9760a5af-0861-4b7e-a4e0-628ab5edde89 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.047792 Jul 14 14:48:10.018059 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1064/2169] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:10.038683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff3005cc-c77f-4cf7-b0a0-295d727d85f5 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.139676 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff3005cc-c77f-4cf7-b0a0-295d727d85f5 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.113439 Jul 14 14:48:10.142192 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1065/2170] 10.222.0.98 () {58 vars in 1147 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:10.159921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.167833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:10.200903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.201705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.203177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.209536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.224521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:10.292952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:10.301349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:10.310229 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7eb5868-d3f3-42fd-b3b4-c765e574a5dc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1357 microversion: 2.54 time: 0.385627 Jul 14 14:48:10.323302 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1106/2171] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:09 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1357 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:10.345019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35fd9e2b-ca7d-4fa7-8d42-c6c26289e33b tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.419043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35fd9e2b-ca7d-4fa7-8d42-c6c26289e33b tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.101979 Jul 14 14:48:10.433389 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1107/2172] 10.222.0.98 () {58 vars in 1139 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:10.448002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b78acf29-1375-4b8f-845d-53297059c105 req-e4de68fd-9f12-4e7d-813b-da7403e2c5ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3490c3-371d-4033-afe2-e2bf1b7bb517", "name": "network-vif-plugged", "status": "completed", "tag": "a95d4384-b690-4cd0-8f4e-719098d1cf4e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:10.473220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b78acf29-1375-4b8f-845d-53297059c105 req-e4de68fd-9f12-4e7d-813b-da7403e2c5ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.473761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b78acf29-1375-4b8f-845d-53297059c105 req-e4de68fd-9f12-4e7d-813b-da7403e2c5ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.498544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b78acf29-1375-4b8f-845d-53297059c105 req-e4de68fd-9f12-4e7d-813b-da7403e2c5ab service nova] Creating event network-vif-plugged:a95d4384-b690-4cd0-8f4e-719098d1cf4e for instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 on n-h2-768852-23 Jul 14 14:48:10.515321 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b78acf29-1375-4b8f-845d-53297059c105 req-e4de68fd-9f12-4e7d-813b-da7403e2c5ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076930 Jul 14 14:48:10.516163 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1108/2173] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:10.533735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea52442a-425d-423f-880f-46563a54551a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Action: 'create', calling method: .version_select at 0x7fdbf29f4ca0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1393516702", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1Ekuco3+uDb7+eiO3tnPl9FPFQ3SX68axKVKSRgJE1tKcpsSnJMx/Ngk06OuDBwSc2XuUjfQ3BJFHK5qzQm2r+Eglg11b5DEKxUMb8B4b9AahaO8kSUdmNqpdL3NXLuA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:10.582388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ea52442a-425d-423f-880f-46563a54551a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Getting quotas for project a0ebe694f2e34ee1a34caa32aba4d755. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:10.594851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ea52442a-425d-423f-880f-46563a54551a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Getting quotas for user 9a5792393e3f4517a52b4e84d5790ec8 and project a0ebe694f2e34ee1a34caa32aba4d755. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:10.674066 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea52442a-425d-423f-880f-46563a54551a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.151817 Jul 14 14:48:10.675613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1109/2174] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:48:10 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:48:10.692814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-41f56043-4c35-4c64-a718-31100fa98f07 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:10.711854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-41f56043-4c35-4c64-a718-31100fa98f07 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033076 Jul 14 14:48:10.716150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1110/2175] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:10.733744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1393516702", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:10.742416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:10.767014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.768313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.772860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:10.774106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:10.963478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:10.963916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:10.964486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:10.964912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:10.965446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:11.109292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:11.186080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.202480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.208598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.210328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.216019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.275664 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7bd662c3-f5cd-486b-8100-290484a9f0cc tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "POST /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53/action" status: 202 len: 1140 microversion: 2.54 time: 0.557397 Jul 14 14:48:11.282767 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1111/2176] 10.222.0.98 () {62 vars in 1319 bytes} [Thu Jul 14 14:48:10 2022] POST /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53/action => generated 1140 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 14:48:11.294316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.295510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.312589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.313238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.314310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.315981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.736830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:11.743848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:11.757058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b727bd4-1ce8-4733-8830-e0d9114125cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1462 microversion: 2.1 time: 0.472605 Jul 14 14:48:11.768903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1112/2177] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1462 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:11.798824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-659333f6-f969-4af4-80d6-3407591a408b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 1.653183 Jul 14 14:48:11.800562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f249a500-f91b-44f4-aad3-ca904e6b74c2 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.805324 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1066/2178] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:10 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:11.835038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-700c46f0-d24f-4583-8a5b-2426ab532789 req-e8adf038-116f-42b4-836a-d9392d86939a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "225f3940-0dbc-41c1-bf0b-9043e402e6ca", "name": "network-vif-deleted", "tag": "b85248f6-5ba1-442f-92e6-c64ef45c05fe"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:11.853423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-700c46f0-d24f-4583-8a5b-2426ab532789 req-e8adf038-116f-42b4-836a-d9392d86939a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.854552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-700c46f0-d24f-4583-8a5b-2426ab532789 req-e8adf038-116f-42b4-836a-d9392d86939a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.883231 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-700c46f0-d24f-4583-8a5b-2426ab532789 req-e8adf038-116f-42b4-836a-d9392d86939a service nova] Creating event network-vif-deleted:b85248f6-5ba1-442f-92e6-c64ef45c05fe for instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca on n-h1-768852-23 Jul 14 14:48:11.893707 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-700c46f0-d24f-4583-8a5b-2426ab532789 req-e8adf038-116f-42b4-836a-d9392d86939a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078720 Jul 14 14:48:11.895888 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1067/2179] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:11.907188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.908926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.925315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.927326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.928150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f249a500-f91b-44f4-aad3-ca904e6b74c2 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.156535 Jul 14 14:48:11.929309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.930418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.939812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1113/2180] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:11.953063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:11.954390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:11.981180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.981940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:11.983307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:11.996396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.125724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:12.136275 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bab9af42-7f20-4c82-9059-cbfcbdd52c88 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1266 microversion: 2.1 time: 0.237829 Jul 14 14:48:12.141196 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1068/2181] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:12.174439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:12.191822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:12.201374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:12.205783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b49c63d-f6aa-4ad1-a1e1-fb8b61a27da2 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.263402 Jul 14 14:48:12.207432 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1114/2182] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:11 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:12.220340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26b68cd4-5039-4e25-8fae-458e5fc33270 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.264876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26b68cd4-5039-4e25-8fae-458e5fc33270 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054590 Jul 14 14:48:12.272942 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1115/2183] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:12.294645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-048e1099-06e3-42fd-b414-21fe3fe89d25 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.317669 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-048e1099-06e3-42fd-b414-21fe3fe89d25 tempest-FlavorsV2TestJSON-1382288873 tempest-FlavorsV2TestJSON-1382288873-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030146 Jul 14 14:48:12.324950 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1116/2184] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:12.360003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.360780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:12.375173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.375854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.376773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.377329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.838010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:12.842611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:12.897775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.901581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:12.910122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:12.911849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.508287 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0bf14ba9-dcc7-405b-acb5-be3c3c8e2b16 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1615 microversion: 2.1 time: 1.357930 Jul 14 14:48:13.509279 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1069/2185] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1615 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:13.525995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:13.526585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:13.534928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.537961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:13.542591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:13.543421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.029450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.042024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-168258ad-17f2-4e24-ac0c-b448f059430d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 0.531506 Jul 14 14:48:14.042542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.052977 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1070/2186] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:13 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:14.056576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:14.057222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:14.067217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.069496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.069496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.069496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.076155 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-51605480-4564-4dea-b3bc-c9970c852916 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1318 microversion: 2.1 time: 1.240709 Jul 14 14:48:14.086434 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1117/2187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:12 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:14.091293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:14.097051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:14.111761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.116174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.117676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:14.118381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:14.384632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.395203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.413199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.417794 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd8ce20e-b623-4fd0-9334-98b28ff618a5 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.366943 Jul 14 14:48:14.420201 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1071/2188] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:14 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:14.853128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f2cdc02847a74ce6adf37f360f247ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c954b5add82d484393972d3762652312', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:14.854366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] flavor_id is None. Assuming migration. {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 14:48:14.854366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:48:15.062182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:15.063500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:15.080209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.080920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:15.083439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.084090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:15.620912 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99aa7f63-884b-43c2-b1c8-d599b450f3c7 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d/action" status: 202 len: 0 microversion: 2.1 time: 1.539957 Jul 14 14:48:15.623483 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1118/2189] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:14 2022] POST /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d/action => generated 0 bytes in 1543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:15.633092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:15.635518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:15.647079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.647861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:15.650005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:15.651037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.124185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.141650 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e87b0de8-57cc-461c-9dd6-3319704bf87a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1467 microversion: 2.1 time: 0.516343 Jul 14 14:48:16.145645 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1119/2190] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:15 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1467 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:16.153929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:16.154563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:16.177326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.177839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.178919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.187528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.513991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.580140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.590433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.600157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-569bdc4c-2d56-4a9e-a479-fdfa7b59a69a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.453103 Jul 14 14:48:16.604748 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1120/2191] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:16 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:16.616506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:16.642263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:16.663893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:16.675172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:16.680578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.684527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.694254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.694926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.699322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-30b0cca8-e419-4729-8519-de2052bd3f9f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 1.642172 Jul 14 14:48:16.700628 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1072/2192] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:15 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:16.753223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:16.757557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:16.791134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.800006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:16.803177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:16.804606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.635128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:17.646874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d79931ae-1502-40e8-883d-4904193962c5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 1466 microversion: 2.1 time: 0.941722 Jul 14 14:48:17.648904 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1073/2193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:16 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 1466 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:17.675634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:17.680476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:17.693918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.695146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:17.696951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:17.698071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.032529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.073004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:18.075049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.079027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.091362 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-321cc4ae-650d-49f9-a479-f51751294c6f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.440349 Jul 14 14:48:18.107439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1074/2194] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:17 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:18.117278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-686958835"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:18.124072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.150774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.155960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.157823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.158822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.402464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:18.422945 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44ab64af-57a6-4b96-8be1-b7989c5006aa tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1471 microversion: 2.1 time: 1.816415 Jul 14 14:48:18.429120 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1121/2195] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:16 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1471 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:18.457531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:18.458727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:18.484687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.485515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.514987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:18.524068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:18.588504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:19.346381 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf3e72c3-3a0a-4304-989a-4f1338d38fca tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "POST /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb/action" status: 202 len: 0 microversion: 2.1 time: 1.246768 Jul 14 14:48:19.370736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1075/2196] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:18 2022] POST /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb/action => generated 0 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:48:19.386944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-70050db1-ab13-41d9-995d-43421b23037e req-db60fef7-eaff-46fd-b669-7e34702ae9e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cfb9636-0d3e-44b4-be23-c29a77a2a8ad", "tag": "ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:19.403382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-70050db1-ab13-41d9-995d-43421b23037e req-db60fef7-eaff-46fd-b669-7e34702ae9e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.404213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-70050db1-ab13-41d9-995d-43421b23037e req-db60fef7-eaff-46fd-b669-7e34702ae9e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.443182 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-70050db1-ab13-41d9-995d-43421b23037e req-db60fef7-eaff-46fd-b669-7e34702ae9e0 service nova] Creating event network-changed:ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b for instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad on n-h2-768852-23 Jul 14 14:48:19.454100 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-70050db1-ab13-41d9-995d-43421b23037e req-db60fef7-eaff-46fd-b669-7e34702ae9e0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078516 Jul 14 14:48:19.455334 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1076/2197] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:19.474619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:19.475569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:19.486305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.487096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.488228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:19.489723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:19.920548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:19.933256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:19.936008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:19.938946 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62416dcc-ca41-41bb-bb8b-46d203d2a449 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.480690 Jul 14 14:48:19.958551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1077/2198] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:19 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:19.965516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93ee5977-16a8-4b89-b24e-b9e14e25e6b2 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf29e7ee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:20.036559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:20.044937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f59fba09-b4a6-49b3-b90f-f4b26bea4f08 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 1.614115 Jul 14 14:48:20.046222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1122/2199] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:18 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:20.051837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:20.052784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:20.060662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.061116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.061910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.062346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.064965 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93ee5977-16a8-4b89-b24e-b9e14e25e6b2 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.104818 Jul 14 14:48:20.065558 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1078/2200] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:19 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:20.461439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:20.472820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7df3430d-2e74-4c73-8854-e08f2525b7a1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1471 microversion: 2.1 time: 0.425098 Jul 14 14:48:20.477496 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1123/2201] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:20 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1471 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:20.963586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:20.964165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:20.966379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=18 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:20.976148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.976598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:20.977390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:20.977867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.083739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1673996446", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "5136dd81-d0c1-40cb-9071-91acb102375b"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:21.202042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] validate_networks() for [('5136dd81-d0c1-40cb-9071-91acb102375b', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:48:21.319953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.346158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.349790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.352342 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3dcc170d-b131-4144-b16a-a13a94bd258a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.393149 Jul 14 14:48:21.375015 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1124/2202] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:20 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:21.391994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:21.396026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:21.417902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.427140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.445415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:21.447396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:21.917634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:21.925934 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b41c3b7e-3211-4e01-88c6-bba31ef247df tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 0.549153 Jul 14 14:48:21.927149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1125/2203] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:21 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:21.938139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ca4259b-c3e2-4e76-89a8-f591146dd92b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf33f8160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:22.008799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9ca4259b-c3e2-4e76-89a8-f591146dd92b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.074374 Jul 14 14:48:22.009646 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1126/2204] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:21 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:22.022280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:22.023110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:22.047768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.048585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.049649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.050242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.764714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:22.768075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:22.769035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:22.771937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:22.773859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:22.811722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.815456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.818507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:22.819743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:22.865956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Getting quotas for project 178a39e9442c477f854e36b742e7c359. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:22.878371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Getting quotas for user 897290f2f03d4ac7ad58d50c44a17fb3 and project 178a39e9442c477f854e36b742e7c359. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:22.904965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:48:22.911818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:23.084431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.099598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ae0f4de1-ca04-4417-b38d-da7be1b09534 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1471 microversion: 2.1 time: 1.087355 Jul 14 14:48:23.101006 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1127/2205] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:22 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1471 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:23.110682 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7297eb85-3f53-404b-b2b8-794a3aa95eb8 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.377337 Jul 14 14:48:23.116087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1079/2206] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:48:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 2384 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:48:23.118483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.119538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:23.142925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.146454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.156930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.158007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.172017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.173573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:23.233797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.238940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.247302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:23.248614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:23.538535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.583983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.589563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.593335 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-251e911b-2a2f-4ff9-9729-68fdb6efa123 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.486440 Jul 14 14:48:23.595012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1128/2207] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:23.607569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c852ccf-1028-4967-abe1-8b47ac526bdb tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2bc1160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.697694 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c852ccf-1028-4967-abe1-8b47ac526bdb tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.101236 Jul 14 14:48:23.707497 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1129/2208] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:23.708507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23f5c0d0-60a6-4cae-8002-2dc4943f7617 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:23.708839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23f5c0d0-60a6-4cae-8002-2dc4943f7617 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:23.847175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:23.859006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-48104c82-0d16-4ce5-b8ac-6573b2dd2b97 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 0.728227 Jul 14 14:48:23.859945 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1080/2209] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:24.022682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23f5c0d0-60a6-4cae-8002-2dc4943f7617 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:24.045238 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23f5c0d0-60a6-4cae-8002-2dc4943f7617 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1216 microversion: 2.1 time: 0.344323 Jul 14 14:48:24.057976 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1130/2210] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:23 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1216 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:24.137268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:24.141260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:24.166491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.168783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.176769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:24.180342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:24.360040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1439680860", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "c32a2b4d-251f-4236-84b3-2037dcb2c951"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:24.609977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] validate_networks() for [('c32a2b4d-251f-4236-84b3-2037dcb2c951', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:48:25.198799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:25.203752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:25.217962 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-409d5824-1212-4058-bca5-3b8b10ca4d41 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 1.091537 Jul 14 14:48:25.233171 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1131/2211] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:24 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:25.257997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.258646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:25.280913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.281371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.282477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.285303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.631187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:25.646711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:25.655793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:25.657068 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a91fdf5c-f075-4f62-869f-0e423f1ffaba tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.422614 Jul 14 14:48:25.667306 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1132/2212] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:25.673443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2b7bccbf-5b19-4580-9406-11fb1df9e46a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf36200d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.806771 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2b7bccbf-5b19-4580-9406-11fb1df9e46a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.139533 Jul 14 14:48:25.807408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1133/2213] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:25.826561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:25.833573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:48:25.834727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:48:25.835572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:48:25.836380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:48:25.837068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:48:25.840528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:25.857223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.857996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.859460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.860120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.866186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.872982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.882486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:25.883472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:25.940378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Getting quotas for project 993c6d6a2aa347838950e9b67df54008. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:48:25.963483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Getting quotas for user 029da70c73ee487db039f4dafc0d2948 and project 993c6d6a2aa347838950e9b67df54008. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:48:26.032086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Going to run 3 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:48:26.040423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:26.180944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=58cd90a1-71fa-4b0d-9423-11f1842416bc,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:26.423213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:48:26.686748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a581266-6ace-4b91-819c-23101dd6e6ac tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.825327 Jul 14 14:48:26.689932 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1081/2214] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:48:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:48:26.720024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:26.720659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:26.736850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.737675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.738942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.740547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.859629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:26.868900 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07ec6241-4d28-44ed-a835-aee37cf2a057 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1274 microversion: 2.1 time: 0.170834 Jul 14 14:48:26.870520 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1082/2215] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:26 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1274 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:26.881737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:26.882801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:26.887525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:26.893231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.896496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:26.898307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:26.899903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.321443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.337113 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b12d859c-cea6-4304-8a77-9e465d7cfa8b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 0.465574 Jul 14 14:48:27.338045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1083/2216] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:26 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:27.348515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.351215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:27.372626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.375459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.376521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.381087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.642153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.655344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.671133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.674056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e944f375-839f-4fc2-b350-1167ddf0362e tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.333486 Jul 14 14:48:27.675311 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1084/2217] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:27.680368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.696322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.699122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:48:27.784372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.784882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.785771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.786218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.813008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:27.843719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66a6c610-7711-4347-92a2-0caec8e12738 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 2.032861 Jul 14 14:48:27.848895 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1134/2218] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:25 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 2041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:27.883694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a35733d5-7718-40d3-a25e-4018d6300b83 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf29fc8b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.887670 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3001e718-7307-4b18-adf0-ba0920bb411b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.210805 Jul 14 14:48:27.891555 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1085/2219] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/servers => generated 1018 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:27.906641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:27.916241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:27.942244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.958313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:27.959542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:27.965276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.112242 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a35733d5-7718-40d3-a25e-4018d6300b83 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.259749 Jul 14 14:48:28.116349 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1135/2220] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:28.140783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31fd3670-c9e6-4908-aabf-75ad5bf9efdc tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:28.145494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31fd3670-c9e6-4908-aabf-75ad5bf9efdc tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:28.333783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:28.355905 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ebb94e0b-8eb8-4535-be9a-235b2debde8c tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1274 microversion: 2.1 time: 0.460760 Jul 14 14:48:28.371596 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1086/2221] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:27 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1274 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:28.398658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:28.416417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:28.447821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.453907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.456845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:28.458196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:28.955745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31fd3670-c9e6-4908-aabf-75ad5bf9efdc tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:28.973808 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31fd3670-c9e6-4908-aabf-75ad5bf9efdc tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1223 microversion: 2.1 time: 0.852635 Jul 14 14:48:28.974446 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1136/2222] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1223 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:29.004885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.012954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.046760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.051494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.057717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.064112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.227884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:29.245082 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f404d6c8-dabd-4a78-8ace-4fd591a44468 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 0.872032 Jul 14 14:48:29.251215 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1087/2223] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:29.271019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:29.276221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:29.303670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.323692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:29.327018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:29.329792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.083233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.105518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.115546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.118382 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-76ede92a-09eb-4db3-94fe-220fa96b3ea8 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 1.137086 Jul 14 14:48:30.133502 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1137/2224] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:28 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:30.137436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-104bfbd8-3bfe-484b-a95a-9663ca35cdff tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf3143790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.255525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-104bfbd8-3bfe-484b-a95a-9663ca35cdff tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.129355 Jul 14 14:48:30.256835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1138/2225] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:30.273486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.276533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:30.294616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.297213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.299153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.300313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.536988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.577459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a2ee39c-38fc-4de3-8c4d-ea81c7028923 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1274 microversion: 2.1 time: 0.314438 Jul 14 14:48:30.579560 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1139/2226] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1274 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:30.601592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.606885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:30.631973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.632835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.636192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.640723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.818773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.819629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:30.858600 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5b662d50-46e2-4f53-9ff4-1f4f52fe5166 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1219 microversion: 2.1 time: 0.270188 Jul 14 14:48:30.859049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f967647-c681-4f25-b52c-70ad7dd571af tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 1.604698 Jul 14 14:48:30.859731 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1088/2227] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:29 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:30.861390 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1140/2228] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1219 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:30.874151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:30.875987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:30.895211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.898319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:30.902579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:30.903960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.141328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:31.142222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:31.160098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.162996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.164285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:31.166307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:31.926413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:31.954479 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-400e192a-179c-410c-bbd5-d9c39067b3de tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 1.087702 Jul 14 14:48:31.956530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1141/2229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:30 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:31.975977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cefbc3d-c114-46e2-9a65-f14cd6d5921d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf31afee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:32.062637 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cefbc3d-c114-46e2-9a65-f14cd6d5921d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.104444 Jul 14 14:48:32.068213 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1142/2230] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:31 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:32.083460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:32.085177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:32.098632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.104168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.106481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.107336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.620443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:32.648312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:32.654804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:32.664166 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3093e50f-d3c4-4d03-8a1b-bc5ce183950a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 1.526891 Jul 14 14:48:32.671049 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1089/2231] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:31 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:48:32.696317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:32.706162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:32.736082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.736914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:32.748472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:32.749544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.418186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:33.428244 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be3e522e-51fb-433a-bddd-5fc6a0a2ee42 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 1.352925 Jul 14 14:48:33.450123 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1143/2232] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:32 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:33.462494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:33.465281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:33.487767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.488269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.489313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.489875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.490475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:33.502397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f4046eb-f858-4f10-b163-6fcf5a15c9a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 0.819019 Jul 14 14:48:33.507024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1090/2233] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:32 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:33.522526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:33.523728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:33.551029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.552314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:33.553358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:33.558051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.329437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:34.341840 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad8fdbf5-a402-4353-bd13-9fc769e4303f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1281 microversion: 2.1 time: 0.890321 Jul 14 14:48:34.342487 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1144/2234] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:33 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1281 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:34.360381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7b08b64-c011-426f-ac3a-755ae6365875 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf33f8790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:34.465128 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7b08b64-c011-426f-ac3a-755ae6365875 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.108494 Jul 14 14:48:34.465781 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1145/2235] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:34 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:34.493164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:34.493808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:34.517064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.517440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.518496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.518951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.602565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:34.608376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:34.629859 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ac0c706-2ffd-43ec-bafb-e8fbd0b40c28 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 1.120705 Jul 14 14:48:34.635051 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1091/2236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:33 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:34.651073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7726bb03-a2a5-4d77-afee-dd993d4e9b22 req-d6261510-e498-41e4-a04e-c34b526f14a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfb9636-0d3e-44b4-be23-c29a77a2a8ad", "name": "network-vif-plugged", "status": "completed", "tag": "ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:34.686522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7726bb03-a2a5-4d77-afee-dd993d4e9b22 req-d6261510-e498-41e4-a04e-c34b526f14a4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.687609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7726bb03-a2a5-4d77-afee-dd993d4e9b22 req-d6261510-e498-41e4-a04e-c34b526f14a4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.732257 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7726bb03-a2a5-4d77-afee-dd993d4e9b22 req-d6261510-e498-41e4-a04e-c34b526f14a4 service nova] Creating event network-vif-plugged:ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b for instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad on n-h2-768852-23 Jul 14 14:48:34.745343 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7726bb03-a2a5-4d77-afee-dd993d4e9b22 req-d6261510-e498-41e4-a04e-c34b526f14a4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107382 Jul 14 14:48:34.749125 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1092/2237] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:34.781231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:34.782419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:34.814895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.818494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:34.819710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:34.821906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.003459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.015421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.019372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.021434 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f33ea5a2-40b7-41d5-833b-d25266d1b65b tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.542536 Jul 14 14:48:35.023644 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1146/2238] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:34 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:35.033410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:35.034531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:35.067355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.068381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.069654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.070432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.749759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.759780 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4058f58b-fa87-40b6-b45e-06d5fa3f5151 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 0.734455 Jul 14 14:48:35.772035 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1147/2239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:35 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:35.777407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:35.778287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:35.792474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:35.798598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.800314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.801745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:35.804197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:35.955467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:35.975052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0dc19ec2-082e-4a41-874f-a4ab8b147298 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1281 microversion: 2.1 time: 0.201647 Jul 14 14:48:35.987299 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1148/2240] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:35 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1281 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:36.001826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e2071937-9813-4466-8d32-aea3c7b680f1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2d659d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.007786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:36.089871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.102896 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62520920-a4af-41f1-9de3-ef9a54dac58e tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 1.346774 Jul 14 14:48:36.107927 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1093/2241] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:34 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:36.118134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.123787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:36.137630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.138355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.140905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.141531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.171029 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e2071937-9813-4466-8d32-aea3c7b680f1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.182017 Jul 14 14:48:36.171825 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1149/2242] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:35 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:36.188157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.201486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:36.218636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.223902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.232355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.232889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.591573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.605287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.606950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.625070 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53fd8cf3-5b2f-4f8d-af42-9f62fef55fde tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.451446 Jul 14 14:48:36.625856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1150/2243] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:36 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:36.651120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ef66cb1a-35b2-451a-97f6-0c2b3cb161a7 req-cc5f6b8b-d506-460b-916c-42ea167afac3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe", "tag": "577ada7a-b5fe-436b-a55b-df451b78cef0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:36.673778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ef66cb1a-35b2-451a-97f6-0c2b3cb161a7 req-cc5f6b8b-d506-460b-916c-42ea167afac3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.676498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ef66cb1a-35b2-451a-97f6-0c2b3cb161a7 req-cc5f6b8b-d506-460b-916c-42ea167afac3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.712979 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ef66cb1a-35b2-451a-97f6-0c2b3cb161a7 req-cc5f6b8b-d506-460b-916c-42ea167afac3 service nova] Creating event network-changed:577ada7a-b5fe-436b-a55b-df451b78cef0 for instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe on n-h1-768852-23 Jul 14 14:48:36.722333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ef66cb1a-35b2-451a-97f6-0c2b3cb161a7 req-cc5f6b8b-d506-460b-916c-42ea167afac3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094924 Jul 14 14:48:36.723476 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1151/2244] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:36.790750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:36.791765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:36.797036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:36.809680 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed4ef752-cae9-4047-be50-a3c24ed64326 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 0.700130 Jul 14 14:48:36.823339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.823339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.823339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:36.823339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:36.824014 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1094/2245] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:36 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:37.005635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.006605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.023212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.024615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.025649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.026326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.521003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:37.538300 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5ac5e885-849f-43b9-b64c-4d7aafc541df tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1281 microversion: 2.1 time: 0.533161 Jul 14 14:48:37.544813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1095/2246] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:36 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1281 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:48:37.550562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:37.552644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:37.581145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.581650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.590534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:37.591288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:37.833227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:38.750445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:38.769225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2dd3a7a2-2f6a-4204-834e-f3ee1333b472 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1308 microversion: 2.1 time: 1.983949 Jul 14 14:48:38.770533 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1152/2247] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:36 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1308 bytes in 1987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.787195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-194959cd-74f0-4b03-9875-42f0779d7b06 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2bf21f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.930301 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-194959cd-74f0-4b03-9875-42f0779d7b06 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.148058 Jul 14 14:48:38.932243 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1153/2248] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.935602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:38.944861 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b2b6890-4397-4d6d-9d12-83629151a2f0 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 1.398460 Jul 14 14:48:38.946619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-84b2145b-746f-404f-8839-c053200844b8 req-42cc8891-2c16-47ec-b5c9-41e2f3aacc39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "name": "network-vif-plugged", "status": "completed", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:38.950939 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1096/2249] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:37 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:38.961437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:38.966033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:38.981660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:38.987149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-84b2145b-746f-404f-8839-c053200844b8 req-42cc8891-2c16-47ec-b5c9-41e2f3aacc39 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.989151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-84b2145b-746f-404f-8839-c053200844b8 req-42cc8891-2c16-47ec-b5c9-41e2f3aacc39 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.990348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.990868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:38.991724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:38.992171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.028515 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-84b2145b-746f-404f-8839-c053200844b8 req-42cc8891-2c16-47ec-b5c9-41e2f3aacc39 service nova] Creating event network-vif-plugged:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:48:39.067343 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-84b2145b-746f-404f-8839-c053200844b8 req-42cc8891-2c16-47ec-b5c9-41e2f3aacc39 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132203 Jul 14 14:48:39.078438 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1154/2250] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:39.099237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:39.118642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:39.137759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.146986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.158857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:39.161071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7e88b1fb-cb51-44ff-8fbb-ee4b97d61b4a tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.208878 Jul 14 14:48:39.163408 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1097/2251] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:38 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:39.181948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:39.183598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:39.191954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.195239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.196489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.199139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.200474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.206317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:39.207834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.217641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:39.996512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:40.010676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f65caab3-a6ab-479f-b004-849b048c3d4a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 0.926622 Jul 14 14:48:40.012163 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1155/2252] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:39 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:40.021721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.022746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:40.058407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.058991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.059888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.060337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.134963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:40.143437 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77597a8c-f934-438d-9f43-f66b9b25c9e0 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1281 microversion: 2.1 time: 0.978606 Jul 14 14:48:40.159394 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1098/2253] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:39 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1281 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:40.165202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46705b13-ec5a-48b6-a8f3-330f6408e992 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2910a60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.367076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-46705b13-ec5a-48b6-a8f3-330f6408e992 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.206072 Jul 14 14:48:40.371121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1099/2254] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:40 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:40.382348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:40.384265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:40.401536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.402317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:40.404174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:40.409877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.015894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.027372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ae0b7f1-3e33-48a6-806f-347ce94db06a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1488 microversion: 2.1 time: 1.013752 Jul 14 14:48:41.031231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1156/2255] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:40 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1488 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:41.048530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:41.049418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:41.070133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.071367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.072599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.073220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.828817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.837948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f81b988-82c1-4195-8845-c9cfd03db9f1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 1.465148 Jul 14 14:48:41.858087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1100/2256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:40 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:41.868095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-fc205e63-62db-46c5-b05f-f732aef0f24f req-a3347f41-42d5-412d-bffd-a7af2e821745 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58cd90a1-71fa-4b0d-9423-11f1842416bc", "tag": "174d8192-dab3-48c4-8a6a-d793e6466d31"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:41.883429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.889241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fc205e63-62db-46c5-b05f-f732aef0f24f req-a3347f41-42d5-412d-bffd-a7af2e821745 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:41.889891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fc205e63-62db-46c5-b05f-f732aef0f24f req-a3347f41-42d5-412d-bffd-a7af2e821745 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:41.898991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:41.936411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.940063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:41.942696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f868265-d4ef-4fa6-9344-9b4c2de54343 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1409 microversion: 2.54 time: 0.909881 Jul 14 14:48:41.947401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1157/2257] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:41 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1409 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:41.954144 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fc205e63-62db-46c5-b05f-f732aef0f24f req-a3347f41-42d5-412d-bffd-a7af2e821745 service nova] Creating event network-changed:174d8192-dab3-48c4-8a6a-d793e6466d31 for instance 58cd90a1-71fa-4b0d-9423-11f1842416bc on n-h1-768852-23 Jul 14 14:48:41.972327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:41.980655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:41.981695 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-fc205e63-62db-46c5-b05f-f732aef0f24f req-a3347f41-42d5-412d-bffd-a7af2e821745 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121330 Jul 14 14:48:41.982892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1101/2258] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:42.004571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.010043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.012712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.023821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.027668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:42.034972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:42.073551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.080892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.084728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.094528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.229629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lazy-loading 'flavor' on Instance uuid 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:48:42.638515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6bbc7de-c843-4398-bcca-9ad72f645ade tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad/action" status: 202 len: 0 microversion: 2.1 time: 0.627302 Jul 14 14:48:42.648135 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1102/2259] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:42 2022] POST /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad/action => generated 0 bytes in 647 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:42.678029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:42.685054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:42.721593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.722783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:42.723797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:42.735701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:43.667127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:43.678555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13883f47-c016-47f7-a1d5-3b752bc2d7b5 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 1.028102 Jul 14 14:48:43.696333 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1103/2260] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:42 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:43.718996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c505f2d-0da1-474c-afdb-4cdb62cc8a20 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf298c3a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:43.894595 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c505f2d-0da1-474c-afdb-4cdb62cc8a20 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.196911 Jul 14 14:48:43.895193 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1104/2261] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:43 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:43.905358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:43.922690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:43.955057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:43.956593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:43.960335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:43.969889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.065491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:44.123189 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-828ee77e-f995-4c23-9151-99d57993596b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 2.173321 Jul 14 14:48:44.133517 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1158/2262] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:41 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:44.181042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:44.201585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:44.275724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.276618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.281772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.282643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.833221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:44.849702 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cfee3fec-2e17-4e62-a8cd-0a541f42a266 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 0.708902 Jul 14 14:48:44.859777 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1159/2263] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:44 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:44.866111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:44.870122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:44.889092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.889556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:44.890599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:44.891332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:45.072834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:45.107147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:45.111250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:45.113730 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c81fe979-bd13-49e2-be8a-8c40cd0ca03f tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1415 microversion: 2.54 time: 0.257414 Jul 14 14:48:45.127557 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1160/2264] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:44 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1415 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:45.146675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-49df6dc9-ed9b-4407-bcf0-34362550a417 req-776ab8c7-2c4b-4219-9afb-8936b33c4fa2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b", "tag": "c450fd35-4bd9-4b9f-9daa-fe609722e7f0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:45.159753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:45.210575 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70dca458-ad08-4c6f-a97f-7a720876fe93 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 200 len: 1479 microversion: 2.1 time: 1.312735 Jul 14 14:48:45.212380 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1105/2265] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:43 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 1479 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:45.221904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-49df6dc9-ed9b-4407-bcf0-34362550a417 req-776ab8c7-2c4b-4219-9afb-8936b33c4fa2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:45.235972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-49df6dc9-ed9b-4407-bcf0-34362550a417 req-776ab8c7-2c4b-4219-9afb-8936b33c4fa2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:45.246039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:45.247589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:45.280687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:45.281840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:45.289137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:45.291988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:45.346382 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-49df6dc9-ed9b-4407-bcf0-34362550a417 req-776ab8c7-2c4b-4219-9afb-8936b33c4fa2 service nova] Creating event network-changed:c450fd35-4bd9-4b9f-9daa-fe609722e7f0 for instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b on n-h2-768852-23 Jul 14 14:48:45.362539 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-49df6dc9-ed9b-4407-bcf0-34362550a417 req-776ab8c7-2c4b-4219-9afb-8936b33c4fa2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232557 Jul 14 14:48:45.364581 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1161/2266] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:45.371952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eccbf8a7-9de6-4937-92b8-be31cde423ee tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf29715e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:45.466967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eccbf8a7-9de6-4937-92b8-be31cde423ee tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.100698 Jul 14 14:48:45.473687 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1162/2267] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:45 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:45.489688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:45.496252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:45.529448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:45.533103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:45.541332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:45.542087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.016953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:46.034439 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ae7dc25-2559-47d4-8da2-df9a8853e3e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1476 microversion: 2.1 time: 0.556931 Jul 14 14:48:46.036132 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1163/2268] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:45 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1476 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:46.384129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a06913a-bfdc-4b47-957c-3245f4102b56 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2bf2a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1008410504", "description": "tempest-description-771955102"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:46.865436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a06913a-bfdc-4b47-957c-3245f4102b56 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.820800 Jul 14 14:48:46.866150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1164/2269] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:48:46 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:46.874771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-208608088"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:46.881597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:46.904382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.907633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:46.927568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:46.928349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.451718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:47.473639 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2eb3c641-393c-424f-9ab6-61d8a43963a1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 2.245427 Jul 14 14:48:47.474350 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1106/2270] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:45 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 2258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:47.494529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d46df590-2893-495c-b43a-e3c13e749c52 req-2b75dc4d-aa45-4c3d-89d0-c80d962b1e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d43f293-fc15-4707-8454-98e7974bbd54", "tag": "01ed3089-f608-4923-9e76-14d7be483cea"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:47.523723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d46df590-2893-495c-b43a-e3c13e749c52 req-2b75dc4d-aa45-4c3d-89d0-c80d962b1e49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.527488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d46df590-2893-495c-b43a-e3c13e749c52 req-2b75dc4d-aa45-4c3d-89d0-c80d962b1e49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.570166 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d46df590-2893-495c-b43a-e3c13e749c52 req-2b75dc4d-aa45-4c3d-89d0-c80d962b1e49 service nova] Creating event network-changed:01ed3089-f608-4923-9e76-14d7be483cea for instance 2d43f293-fc15-4707-8454-98e7974bbd54 on n-h1-768852-23 Jul 14 14:48:47.586062 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d46df590-2893-495c-b43a-e3c13e749c52 req-2b75dc4d-aa45-4c3d-89d0-c80d962b1e49 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110374 Jul 14 14:48:47.588400 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1107/2271] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:47.598277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:47.608996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:47.630921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.631843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:47.633024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:47.637097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.062612 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-afd6f13b-6ebd-41c2-a36c-a7bfe659ae13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad/action" status: 202 len: 0 microversion: 2.1 time: 1.194012 Jul 14 14:48:48.065735 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1165/2272] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:48:46 2022] POST /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad/action => generated 0 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:48:48.079239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:48.080305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:48.092984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:48.093622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.094887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:48.095531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.318171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.327389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.346844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.352753 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-439b829b-3401-41ad-beea-29b19bba10c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 0.762718 Jul 14 14:48:48.355595 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1108/2273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:47 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:48.359336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.364309 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22bddb35-0ab4-4aec-af95-23044d74a997 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1415 microversion: 2.54 time: 0.295909 Jul 14 14:48:48.369960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5fc0750-d3ef-4553-bddb-41bb16b4772a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2986820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:48.371299 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1166/2274] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:48 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1415 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:48.397096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b1d3a04-8273-4722-afac-f9fea7d4d2d4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2bf2820>, body: {"security_group_rule": {"parent_group_id": "daded0bf-202b-45f1-a652-9b8a683faf1e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:48.507327 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5fc0750-d3ef-4553-bddb-41bb16b4772a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.149251 Jul 14 14:48:48.514626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1109/2275] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:48 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:48.534644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:48.535562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:48.553298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:48.558874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.560136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:48.562741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:48.957744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:48.974101 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9d00080-30c9-4275-acb3-34021f5e7d15 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1475 microversion: 2.1 time: 0.455971 Jul 14 14:48:48.976422 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1110/2276] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:48 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1475 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:48.994047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de89bd98-d53e-4182-adb9-80c2c08f0ddd tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2986e50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:49.097917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de89bd98-d53e-4182-adb9-80c2c08f0ddd tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.108923 Jul 14 14:48:49.098725 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1111/2277] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:48 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:49.110315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:49.112605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:49.133257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:49.133624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:49.137084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:49.137699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:49.950003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:49.986832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:48:50.010581 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c61d111-34e3-4310-b933-37c0917ee12e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 0.909930 Jul 14 14:48:50.037600 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1112/2278] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:49 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:50.046983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:50.048949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:50.061911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.063599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.065691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.066975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.227634 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b1d3a04-8273-4722-afac-f9fea7d4d2d4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.854769 Jul 14 14:48:50.234474 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1167/2279] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:48:48 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:50.249550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:50.250604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:50.271093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.271554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.272421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.272877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.557794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:50.569251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:50.571020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9a5792393e3f4517a52b4e84d5790ec8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0ebe694f2e34ee1a34caa32aba4d755', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:50.599537 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5efeea23-24c4-4861-8542-343a7978df73 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 200 len: 1400 microversion: 2.54 time: 0.356715 Jul 14 14:48:50.616633 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1168/2280] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:48:50 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 1400 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:48:50.624971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-846f04ed-7395-47b9-a924-92b201be94cc tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b1b310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:50.711589 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-846f04ed-7395-47b9-a924-92b201be94cc tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.093648 Jul 14 14:48:50.712486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1169/2281] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:50 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:50.718221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:50.719298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:50.729642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.730353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:50.731414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:50.732031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:51.429762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:51.488838 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99b9afd8-73db-444c-b1eb-b14b19339fe5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1475 microversion: 2.1 time: 0.771555 Jul 14 14:48:51.495317 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1170/2282] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:50 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1475 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:51.522282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f1617447-d2d0-4c05-bf33-8f9d8287a181 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdc0427dee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:51.663391 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f1617447-d2d0-4c05-bf33-8f9d8287a181 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.163231 Jul 14 14:48:51.664173 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1171/2283] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:51 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:51.684720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a677e616-7eb3-4482-aad2-22744da8ec92 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf3143d30>, body: {"security_group_rule": {"parent_group_id": "daded0bf-202b-45f1-a652-9b8a683faf1e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:51.764424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:51.790252 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fef15478-aeb7-4dda-a880-a4958975dd23 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 1.750370 Jul 14 14:48:51.819426 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1113/2284] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:50 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 1768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:51.841778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-1251be5a-0301-4c12-92ba-dc2aab04976a req-c850c38e-e3da-4698-afa6-40b3161d471e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe", "name": "network-vif-plugged", "status": "completed", "tag": "577ada7a-b5fe-436b-a55b-df451b78cef0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:51.889395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1251be5a-0301-4c12-92ba-dc2aab04976a req-c850c38e-e3da-4698-afa6-40b3161d471e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:51.889955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1251be5a-0301-4c12-92ba-dc2aab04976a req-c850c38e-e3da-4698-afa6-40b3161d471e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:51.976087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-1251be5a-0301-4c12-92ba-dc2aab04976a req-c850c38e-e3da-4698-afa6-40b3161d471e service nova] Creating event network-vif-plugged:577ada7a-b5fe-436b-a55b-df451b78cef0 for instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe on n-h1-768852-23 Jul 14 14:48:52.021924 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-1251be5a-0301-4c12-92ba-dc2aab04976a req-c850c38e-e3da-4698-afa6-40b3161d471e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.212558 Jul 14 14:48:52.027110 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1114/2285] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:52.068318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9322defa-9e5a-4e18-b1fd-169c058fd60c tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '.version_select at 0x7fdbf2a65670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:52.144068 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a677e616-7eb3-4482-aad2-22744da8ec92 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: This rule already exists in group daded0bf-202b-45f1-a652-9b8a683faf1e Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a677e616-7eb3-4482-aad2-22744da8ec92 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 138 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: {"security_group_rule": {"parent_group_id": "daded0bf-202b-45f1-a652-9b8a683faf1e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: exception: This rule already exists in group daded0bf-202b-45f1-a652-9b8a683faf1e Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'daded0bf-202b-45f1-a652-9b8a683faf1e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group daded0bf-202b-45f1-a652-9b8a683faf1e Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group daded0bf-202b-45f1-a652-9b8a683faf1e Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:48:52.146137 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:48:52.150671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:48:52.150671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:48:52.150671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group daded0bf-202b-45f1-a652-9b8a683faf1e Jul 14 14:48:52.150671 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:48:52.151225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a677e616-7eb3-4482-aad2-22744da8ec92 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 400 to user: This rule already exists in group daded0bf-202b-45f1-a652-9b8a683faf1e {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:48:52.152354 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a677e616-7eb3-4482-aad2-22744da8ec92 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.479800 Jul 14 14:48:52.153163 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1172/2286] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:48:51 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 481 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:48:52.166761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:52.172084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:52.196246 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9322defa-9e5a-4e18-b1fd-169c058fd60c tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1393516702" status: 204 len: 0 microversion: 2.54 time: 0.155704 Jul 14 14:48:52.197757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1115/2287] 10.222.0.98 () {60 vars in 1318 bytes} [Thu Jul 14 14:48:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1393516702 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:48:52.213319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:52.217709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:52.220934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:52.222422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:52.222902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-412d5109-3693-4ba9-930e-5423f7a3f03f req-92bbbb0a-03b7-40e2-9fbf-19e8663f3575 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570420f0-9812-4164-b136-02e3f8d2068d", "name": "network-vif-unplugged", "status": "completed", "tag": "f3325209-778c-4269-b0f6-c9756ff6ad15"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:48:52.295703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-412d5109-3693-4ba9-930e-5423f7a3f03f req-92bbbb0a-03b7-40e2-9fbf-19e8663f3575 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:52.297092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-412d5109-3693-4ba9-930e-5423f7a3f03f req-92bbbb0a-03b7-40e2-9fbf-19e8663f3575 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:52.354911 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-412d5109-3693-4ba9-930e-5423f7a3f03f req-92bbbb0a-03b7-40e2-9fbf-19e8663f3575 service nova] Creating event network-vif-unplugged:f3325209-778c-4269-b0f6-c9756ff6ad15 for instance 570420f0-9812-4164-b136-02e3f8d2068d on n-h2-768852-23 Jul 14 14:48:52.391696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-412d5109-3693-4ba9-930e-5423f7a3f03f req-92bbbb0a-03b7-40e2-9fbf-19e8663f3575 service nova] Instance 570420f0-9812-4164-b136-02e3f8d2068d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:48:52.440428 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-412d5109-3693-4ba9-930e-5423f7a3f03f req-92bbbb0a-03b7-40e2-9fbf-19e8663f3575 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.236055 Jul 14 14:48:52.442177 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1116/2288] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:48:52.459912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89f12e2b-5110-4640-bfb2-b8c541d16658 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a53310>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:52.604235 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89f12e2b-5110-4640-bfb2-b8c541d16658 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1452 microversion: 2.1 time: 0.159983 Jul 14 14:48:52.619559 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1117/2289] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:52 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:52.642473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37081c3c-7e53-40ca-9bcf-7f2a4873b912 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdbf29e74c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:53.361556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:53.413565 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d56087bd-44da-4916-b29d-c029261a291c tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 1.258656 Jul 14 14:48:53.415473 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1173/2290] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:52 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:53.445862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:53.447169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:53.483513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.490262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.494813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:53.498940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:53.669235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:48:54.053456 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ee82b7a-7aad-4100-ab61-6fa229e58c88 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 204 len: 0 microversion: 2.54 time: 0.626898 Jul 14 14:48:54.063045 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1174/2291] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:48:53 2022] DELETE /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:48:54.076177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.077497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:54.106818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.108066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.110192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.111370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.562831 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37081c3c-7e53-40ca-9bcf-7f2a4873b912 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-group-rules/426444e7-3de6-42af-acb7-6cffa7a4a492" status: 202 len: 0 microversion: 2.1 time: 1.941655 Jul 14 14:48:54.564150 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1118/2292] 10.222.0.98 () {58 vars in 1286 bytes} [Thu Jul 14 14:48:52 2022] DELETE /compute/v2.1/os-security-group-rules/426444e7-3de6-42af-acb7-6cffa7a4a492 => generated 0 bytes in 1944 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:48:54.569352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a2c40dd-d5ed-4ef1-a73e-c2162303832a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf298cc10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.592683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:54.609052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7dbc91c7-6670-45bb-9456-5b8aef75fea5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1475 microversion: 2.1 time: 0.543891 Jul 14 14:48:54.610230 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1175/2293] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:54 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1475 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:54.632137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:48:54.633105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:48:54.648135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.648840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:54.649855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:48:54.650460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:48:55.514871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:48:55.531095 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a5be9e0-2f61-4514-9a9b-efca4240c0be tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1316 microversion: 2.1 time: 0.918392 Jul 14 14:48:55.550876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1176/2294] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:48:54 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1316 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:48:55.556534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b49ce44-4e8f-45b8-bbb4-8e6248f5b572 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b1bc10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.168484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b49ce44-4e8f-45b8-bbb4-8e6248f5b572 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1461 microversion: 2.1 time: 5.616066 Jul 14 14:49:01.171666 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1177/2295] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:55 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1461 bytes in 5620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:01.174143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a2c40dd-d5ed-4ef1-a73e-c2162303832a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 6.607795 Jul 14 14:49:01.176237 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1119/2296] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:48:54 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 6611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:01.182063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.185034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] [instance: fd831d90-90f6-4a08-944e-b0f1be716a53] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.194838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.203772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.207634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:01.210332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.210760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.211624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.212043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.228303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.230270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.232987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.234233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.258435 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] HTTP exception thrown: Instance fd831d90-90f6-4a08-944e-b0f1be716a53 could not be found. Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Request method failure captured: Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 HTTP/1.1 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CyigzozkqsbUs975SX0vIKIvmWqRiF-e-S8jxS88O37IH6RVxxo8aQ2-t1N6CYgcjjwLQEb1qlTEbvkw2w9j6hnEpf7rzrvohO1avpa177n7i4RSyLs6sQPza3XAnFSSI1xybM1pN93iqyjxH7Frby3nxo_taCJeL63_c0oeHdpeA0 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.54 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a0ebe694f2e34ee1a34caa32aba4d755 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerShowV254Test-340777162 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a0ebe694f2e34ee1a34caa32aba4d755"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a0ebe694f2e34ee1a34caa32aba4d755"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a0ebe694f2e34ee1a34caa32aba4d755"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a0ebe694f2e34ee1a34caa32aba4d755"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerShowV254Test-340777162 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a0ebe694f2e34ee1a34caa32aba4d755 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerShowV254Test-340777162 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerShowV254Test-340777162-project Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 9a5792393e3f4517a52b4e84d5790ec8 Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerShowV254Test-340777162-project Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance fd831d90-90f6-4a08-944e-b0f1be716a53 could not be found. Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fd831d90-90f6-4a08-944e-b0f1be716a53'} Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd831d90-90f6-4a08-944e-b0f1be716a53 could not be found. Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd831d90-90f6-4a08-944e-b0f1be716a53 could not be found. Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:01.274712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd831d90-90f6-4a08-944e-b0f1be716a53 could not be found. Jul 14 14:49:01.279653 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:01.284337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] Returning 404 to user: Instance fd831d90-90f6-4a08-944e-b0f1be716a53 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:01.286774 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73089820-838b-4343-a119-b87a34c650e7 tempest-ServerShowV254Test-340777162 tempest-ServerShowV254Test-340777162-project] 10.222.0.98 "GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53" status: 404 len: 111 microversion: 2.54 time: 0.113811 Jul 14 14:49:01.340776 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1178/2297] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:49:01 2022] GET /compute/v2.1/servers/fd831d90-90f6-4a08-944e-b0f1be716a53 => generated 111 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:01.363854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b30d9791-f093-4ec0-9bcf-a02157a3cc7d tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2ce5c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-319930994", "description": "tempest-description-2040870828"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:01.706065 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b30d9791-f093-4ec0-9bcf-a02157a3cc7d tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.366879 Jul 14 14:49:01.712839 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1179/2298] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:49:01 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:01.712839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f8dbd4ad-986e-4322-98ec-78813b2a4354 req-29103fa1-9dd7-47e9-981a-8fd0f944898b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "570420f0-9812-4164-b136-02e3f8d2068d", "tag": "f3325209-778c-4269-b0f6-c9756ff6ad15"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:01.743858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f8dbd4ad-986e-4322-98ec-78813b2a4354 req-29103fa1-9dd7-47e9-981a-8fd0f944898b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.750251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f8dbd4ad-986e-4322-98ec-78813b2a4354 req-29103fa1-9dd7-47e9-981a-8fd0f944898b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.826850 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f8dbd4ad-986e-4322-98ec-78813b2a4354 req-29103fa1-9dd7-47e9-981a-8fd0f944898b service nova] Creating event network-changed:f3325209-778c-4269-b0f6-c9756ff6ad15 for instance 570420f0-9812-4164-b136-02e3f8d2068d on n-h2-768852-23 Jul 14 14:49:01.864954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-f8dbd4ad-986e-4322-98ec-78813b2a4354 req-29103fa1-9dd7-47e9-981a-8fd0f944898b service nova] Instance 570420f0-9812-4164-b136-02e3f8d2068d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:49:01.921562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:01.937254 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d82e4e6c-790c-4952-abe2-7d35ad4bc575 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 0.753683 Jul 14 14:49:01.948049 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1120/2299] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:01 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:01.948275 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f8dbd4ad-986e-4322-98ec-78813b2a4354 req-29103fa1-9dd7-47e9-981a-8fd0f944898b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224576 Jul 14 14:49:01.948275 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1180/2300] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:01.952504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:01.955451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:01.977442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.977902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.978709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:01.979149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:01.986437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-27892af6-e704-4e00-9100-daa2127027eb req-03ee88d3-651e-4755-9127-4e0e067e1e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cd90a1-71fa-4b0d-9423-11f1842416bc", "name": "network-vif-plugged", "status": "completed", "tag": "174d8192-dab3-48c4-8a6a-d793e6466d31"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:02.058044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-27892af6-e704-4e00-9100-daa2127027eb req-03ee88d3-651e-4755-9127-4e0e067e1e01 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.058498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-27892af6-e704-4e00-9100-daa2127027eb req-03ee88d3-651e-4755-9127-4e0e067e1e01 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:02.078106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:02.115006 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-27892af6-e704-4e00-9100-daa2127027eb req-03ee88d3-651e-4755-9127-4e0e067e1e01 service nova] Creating event network-vif-plugged:174d8192-dab3-48c4-8a6a-d793e6466d31 for instance 58cd90a1-71fa-4b0d-9423-11f1842416bc on n-h1-768852-23 Jul 14 14:49:02.132543 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-27892af6-e704-4e00-9100-daa2127027eb req-03ee88d3-651e-4755-9127-4e0e067e1e01 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177742 Jul 14 14:49:02.135561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1181/2301] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:02.152665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:02.155649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:02.179597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.187969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:02.190045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:02.191374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.131059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:03.144038 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dca6396b-b85b-425d-8684-67329d00d6c1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1505 microversion: 2.1 time: 1.006817 Jul 14 14:49:03.145268 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1182/2302] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:02 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1505 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:03.150230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b119ebee-babf-4511-ad38-05979ac0b7a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf31af940>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:03.248300 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b119ebee-babf-4511-ad38-05979ac0b7a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 200 len: 1461 microversion: 2.1 time: 0.101754 Jul 14 14:49:03.256339 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1183/2303] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:03 2022] GET /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 1461 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:03.267164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77d35a72-c313-467b-b7b6-a65b8a2d7fa5 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf3161820>, body: {"security_group_rule": {"parent_group_id": "e31ed877-08db-4389-8659-abb5cd1d3d2e", "ip_protocol": "tcp", "from_port": 872339122, "to_port": 22}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:03.371536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:03.398816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7aac6d85-49f1-4caf-87e3-997801efc325 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1470 microversion: 2.1 time: 1.457163 Jul 14 14:49:03.411709 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1121/2304] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:01 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1470 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:03.434631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95c9e7cc-8e19-4b5a-b495-20879cd80c29 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2b48820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:03.520448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95c9e7cc-8e19-4b5a-b495-20879cd80c29 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.104454 Jul 14 14:49:03.527666 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1122/2305] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:03 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:03.555483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:03.556352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:03.573274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.578333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.579424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.582475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.707387 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-77d35a72-c313-467b-b7b6-a65b8a2d7fa5 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Invalid port range 872339122:22. Former value cannot be greater than the later Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77d35a72-c313-467b-b7b6-a65b8a2d7fa5 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 145 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: {"security_group_rule": {"parent_group_id": "e31ed877-08db-4389-8659-abb5cd1d3d2e", "ip_protocol": "tcp", "from_port": 872339122, "to_port": 22}} Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid port range 872339122:22. Former value cannot be greater than the later Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e31ed877-08db-4389-8659-abb5cd1d3d2e', 'ip_protocol': 'tcp', 'from_port': 872339122, 'to_port': 22}}} Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 872339122:22. Former value cannot be greater than the later Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 872339122:22. Former value cannot be greater than the later Jul 14 14:49:03.709143 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 872339122:22. Former value cannot be greater than the later Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77d35a72-c313-467b-b7b6-a65b8a2d7fa5 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 400 to user: Invalid port range 872339122:22. Former value cannot be greater than the later {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:03.713577 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77d35a72-c313-467b-b7b6-a65b8a2d7fa5 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.453380 Jul 14 14:49:03.716083 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1184/2306] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:49:03 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 459 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:03.722873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:03.722873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:03.754001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.754486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.755329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:03.755934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:03.803532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:04.044693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d9f9a82-f4f2-4388-826e-84a150ec9c55 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 204 len: 0 microversion: 2.1 time: 0.326955 Jul 14 14:49:04.045640 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1185/2307] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:03 2022] DELETE /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:04.061909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:04.071935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.079396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.086069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.092465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.093715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.543699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.567207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:04.577705 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-525cf9c7-c2f9-42f3-8c7c-9a2525263c27 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 1466 microversion: 2.1 time: 0.526633 Jul 14 14:49:04.585143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d34ba421-909e-48ef-a67c-93d6ab89add1 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 1.050508 Jul 14 14:49:04.585769 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1186/2308] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:04 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 1466 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:04.586072 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1123/2309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:03 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:04.623107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-841e5fd6-4669-46aa-94a7-5d774973f6a0 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2b68af0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1217387363", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:04.625461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-841e5fd6-4669-46aa-94a7-5d774973f6a0 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Security group id should be uuid Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-841e5fd6-4669-46aa-94a7-5d774973f6a0 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 131 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1217387363", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group id should be uuid Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1217387363', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:04.631786 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:04.636529 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Jul 14 14:49:04.636529 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:04.637625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-841e5fd6-4669-46aa-94a7-5d774973f6a0 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 400 to user: Security group id should be uuid {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:04.638095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:04.639099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.652785 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-841e5fd6-4669-46aa-94a7-5d774973f6a0 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.037452 Jul 14 14:49:04.653856 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1124/2310] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:49:04 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:04.663967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:04.668367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:04.671429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.672074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.673225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.673830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.680511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.681228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.682899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.683655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:04.869018 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-582c6f14-e4e2-4b8b-ba4e-3e6f7a0da09d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d/action" status: 204 len: 0 microversion: 2.1 time: 0.252287 Jul 14 14:49:04.874085 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1187/2311] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:49:04 2022] POST /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d/action => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:04.889649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b", "name": "network-vif-plugged", "status": "completed", "tag": "c450fd35-4bd9-4b9f-9daa-fe609722e7f0"}, {"server_uuid": "2d43f293-fc15-4707-8454-98e7974bbd54", "name": "network-vif-plugged", "status": "completed", "tag": "01ed3089-f608-4923-9e76-14d7be483cea"}, {"server_uuid": "2cfb9636-0d3e-44b4-be23-c29a77a2a8ad", "name": "network-vif-plugged", "status": "completed", "tag": "ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:04.946633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:04.947114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.012450 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] Creating event network-vif-plugged:c450fd35-4bd9-4b9f-9daa-fe609722e7f0 for instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b on n-h2-768852-23 Jul 14 14:49:05.013750 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] Creating event network-vif-plugged:01ed3089-f608-4923-9e76-14d7be483cea for instance 2d43f293-fc15-4707-8454-98e7974bbd54 on n-h1-768852-23 Jul 14 14:49:05.018123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] Creating event network-vif-plugged:ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b for instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad on n-h2-768852-23 Jul 14 14:49:05.042321 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4fc21bfc-0341-419e-a763-7053458c1aee req-09a61864-c69e-455a-ab04-9e0ce08bbdad service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.166159 Jul 14 14:49:05.043246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1188/2312] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:05.070691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-51155e05-d477-4088-affb-26f4aa76616f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2c16160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:05.158694 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-51155e05-d477-4088-affb-26f4aa76616f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.113731 Jul 14 14:49:05.160390 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1189/2313] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:05 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:05.168403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-868056377"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:05.170728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:05.190211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.191949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.194263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.195646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.759751 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5edb5364-ce53-4006-9ca1-a10ba2620266 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "POST /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517/action" status: 202 len: 0 microversion: 2.1 time: 0.597148 Jul 14 14:49:05.762677 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1190/2314] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:49:05 2022] POST /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:49:05.772264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9f36d3d-c4f9-479e-8d78-8b9b2b00b344 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2d65790>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-600880752", "description": "tempest-description-1285092934"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:05.857085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:05.876501 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c992c8e-0de7-4f87-a7a9-4d40ad4c62ba tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1511 microversion: 2.1 time: 1.221155 Jul 14 14:49:05.877295 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1125/2315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:04 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1511 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:05.903632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:05.913100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:05.938438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.942874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:05.944269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:05.944733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.238783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9f36d3d-c4f9-479e-8d78-8b9b2b00b344 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.472761 Jul 14 14:49:06.243343 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1191/2316] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:49:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:06.257116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:06.258366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:06.263315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:06.322211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.323085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:06.337888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:06.338779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.185826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.222942 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bce00e53-a745-480e-bec7-d3918f267d43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1470 microversion: 2.1 time: 1.338669 Jul 14 14:49:07.224638 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1126/2317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:05 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1470 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.274110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5fab9ae-d832-4142-84de-8d90ce0734bd tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b68670>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:07.383591 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5fab9ae-d832-4142-84de-8d90ce0734bd tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.156629 Jul 14 14:49:07.385529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1127/2318] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:07 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.395329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95065a2f-7f39-4f49-9410-89e0cc564865 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2986820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:07.493728 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95065a2f-7f39-4f49-9410-89e0cc564865 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.105927 Jul 14 14:49:07.495695 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1128/2319] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:07 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.506791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eabfbd66-21ea-42af-bc71-d0694ef66504 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2b6f5e0>, body: {"security_group_rule": {"parent_group_id": "f1948f02-e81f-4acf-873b-b584a6a46f94", "ip_protocol": "tempest-999-263499294", "from_port": 22, "to_port": 22}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-eabfbd66-21ea-42af-bc71-d0694ef66504 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Invalid IP protocol tempest-999-263499294. Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eabfbd66-21ea-42af-bc71-d0694ef66504 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 156 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: {"security_group_rule": {"parent_group_id": "f1948f02-e81f-4acf-873b-b584a6a46f94", "ip_protocol": "tempest-999-263499294", "from_port": 22, "to_port": 22}} Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid IP protocol tempest-999-263499294. Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'f1948f02-e81f-4acf-873b-b584a6a46f94', 'ip_protocol': 'tempest-999-263499294', 'from_port': 22, 'to_port': 22}}} Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-263499294. Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:07.739710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-263499294. Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-263499294. Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eabfbd66-21ea-42af-bc71-d0694ef66504 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 400 to user: Invalid IP protocol tempest-999-263499294. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eabfbd66-21ea-42af-bc71-d0694ef66504 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.241771 Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1129/2320] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:49:07 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 244 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:49:07.763371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:07.769718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:07.773188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.773645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.774460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.774909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.826715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:07.850871 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-853f186a-32cb-4ad3-a72e-4e1db3ad12b9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1323 microversion: 2.1 time: 1.608858 Jul 14 14:49:07.859659 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1192/2321] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:06 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1323 bytes in 1619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:07.893695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570420f0-9812-4164-b136-02e3f8d2068d", "name": "network-vif-plugged", "status": "completed", "tag": "f3325209-778c-4269-b0f6-c9756ff6ad15"}, {"server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "name": "network-vif-unplugged", "status": "completed", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:07.934225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:07.943724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:07.980691 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] Creating event network-vif-plugged:f3325209-778c-4269-b0f6-c9756ff6ad15 for instance 570420f0-9812-4164-b136-02e3f8d2068d on n-h2-768852-23 Jul 14 14:49:07.983225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] Creating event network-vif-unplugged:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:49:07.996005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] Instance 570420f0-9812-4164-b136-02e3f8d2068d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:49:08.030603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ad1f9ddd-5a01-4418-8220-765fb49fdf27 req-aeff32bd-fb0b-4091-9abc-6e73ca81af28 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.168071 Jul 14 14:49:08.033830 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1193/2322] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:08.046451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fe9525d-49ed-4983-8b98-80aefd47de2e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf2c165e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-236138033", "description": "tempest-description-873721972"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:08.263139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '897290f2f03d4ac7ad58d50c44a17fb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178a39e9442c477f854e36b742e7c359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:08.277995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d25e2abd-85c3-4b6e-b42b-17e636bffdd1 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 200 len: 1469 microversion: 2.1 time: 0.536269 Jul 14 14:49:08.281155 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1130/2323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:07 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 1469 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:08.295139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:08.297901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:08.326395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.326395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:08.339856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:08.340964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.014323 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fe9525d-49ed-4983-8b98-80aefd47de2e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.976825 Jul 14 14:49:09.029708 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1194/2324] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:49:08 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:09.053814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6392ab8b-0a7d-4566-93b0-83b0dc65bb17 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf3161dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.242545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6392ab8b-0a7d-4566-93b0-83b0dc65bb17 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.210646 Jul 14 14:49:09.243467 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1195/2325] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:09.313197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a8a8ccf-11fc-4813-b758-95fdd268b67a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdc04293820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.474073 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a8a8ccf-11fc-4813-b758-95fdd268b67a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.192887 Jul 14 14:49:09.475010 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1196/2326] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:09.493897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b3ee7b24-db9e-448d-a197-0cda313c2969 req-625ee535-7bad-4f31-ac08-ce6c81b8b5ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe", "name": "network-vif-deleted", "tag": "577ada7a-b5fe-436b-a55b-df451b78cef0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:09.537996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b3ee7b24-db9e-448d-a197-0cda313c2969 req-625ee535-7bad-4f31-ac08-ce6c81b8b5ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.546955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b3ee7b24-db9e-448d-a197-0cda313c2969 req-625ee535-7bad-4f31-ac08-ce6c81b8b5ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.586294 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b3ee7b24-db9e-448d-a197-0cda313c2969 req-625ee535-7bad-4f31-ac08-ce6c81b8b5ee service nova] Creating event network-vif-deleted:577ada7a-b5fe-436b-a55b-df451b78cef0 for instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe on n-h1-768852-23 Jul 14 14:49:09.602268 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b3ee7b24-db9e-448d-a197-0cda313c2969 req-625ee535-7bad-4f31-ac08-ce6c81b8b5ee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119379 Jul 14 14:49:09.603431 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1197/2327] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:09.642297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:09.652345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:09.708838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:09.709404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.710485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.715006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:09.716695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:09.724037 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de58848f-c423-432d-8ad8-06a2f0c9739a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1470 microversion: 2.1 time: 1.441323 Jul 14 14:49:09.741552 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1131/2328] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:08 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1470 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:09.757642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b44046df-6cb6-4179-b660-ba7ad343e801 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf298c310>, body: {"security_group_rule": {"parent_group_id": "3344e425-8820-45c0-a2f9-e5cabec1c187", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:10.267529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:10.291928 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-251695b1-8130-4fc6-a57b-f2ff9ea0566e tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 200 len: 1515 microversion: 2.1 time: 0.686870 Jul 14 14:49:10.292530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1198/2329] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:09 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 1515 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:10.298853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:10.300610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:10.320859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.321475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.322411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.323255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.334561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b44046df-6cb6-4179-b660-ba7ad343e801 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b44046df-6cb6-4179-b660-ba7ad343e801 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 138 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: {"security_group_rule": {"parent_group_id": "3344e425-8820-45c0-a2f9-e5cabec1c187", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'security_group_rule': {'parent_group_id': '3344e425-8820-45c0-a2f9-e5cabec1c187', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:49:10.338342 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Jul 14 14:49:10.345738 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.346802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe HTTP/1.1 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe'} Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:10.351548 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc944ae0-0614-4596-b0ba-311f989e4022 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 404 len: 111 microversion: 2.1 time: 0.057325 Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1199/2330] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:10 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:10.368410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7a73ddc-8eab-4fb9-8e6f-19ff061f11f0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc0423c0d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:10.381993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b44046df-6cb6-4179-b660-ba7ad343e801 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:10.381993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b44046df-6cb6-4179-b660-ba7ad343e801 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.633608 Jul 14 14:49:10.381993 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1132/2331] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:49:09 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 636 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:10.416361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:10.417847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:10.432221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7a73ddc-8eab-4fb9-8e6f-19ff061f11f0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.072135 Jul 14 14:49:10.435009 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1200/2332] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:10 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:10.445090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.447137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.449131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.450310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.459246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2043728830", "metadata": {"image_type": "test"}}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:10.469891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:10.514434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.514972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.519808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:10.520162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:10.569648 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe/action HTTP/1.1 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 112 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-2043728830", "metadata": {"image_type": "test"}}} Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-2043728830', 'metadata': {'image_type': 'test'}}}} Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:49:10.573369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7026ab3e-2f7f-4c7b-ab85-576e5ecc0d41 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "POST /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe/action" status: 404 len: 111 microversion: 2.1 time: 0.143318 Jul 14 14:49:10.585850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1201/2333] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Jul 14 14:49:10 2022] POST /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe/action => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:10.599043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee963fab-c5ad-48b4-ac17-7b115267f909 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdc0423ca60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1697086805", "description": "tempest-description-1689636092"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:10.894985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:10.930041 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3b8fb80-6ac9-477a-9a77-7a038657a7ff tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b" status: 200 len: 1516 microversion: 2.1 time: 0.536469 Jul 14 14:49:10.949324 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1133/2334] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:10 2022] GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b => generated 1516 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:10.966946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7935d19-9c87-4b7a-868e-d6ffc6e017fe tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2986c10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:11.131240 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee963fab-c5ad-48b4-ac17-7b115267f909 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.546652 Jul 14 14:49:11.131876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1202/2335] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:49:10 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:11.137134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55d3fa21-ecbb-4261-a66a-73e2cb5ff9e6 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-875610006", "metadata": {"image_type": "test"}}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:11.140869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-55d3fa21-ecbb-4261-a66a-73e2cb5ff9e6 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Failed to fetch instance by id tempest-invalid-2094727518 {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:49:11.142416 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-55d3fa21-ecbb-4261-a66a-73e2cb5ff9e6 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance tempest-invalid-2094727518 could not be found. Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55d3fa21-ecbb-4261-a66a-73e2cb5ff9e6 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/tempest-invalid-2094727518/action HTTP/1.1 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 111 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-875610006", "metadata": {"image_type": "test"}}} Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance tempest-invalid-2094727518 could not be found. Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'tempest-invalid-2094727518', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-875610006', 'metadata': {'image_type': 'test'}}}} Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-2094727518 could not be found. Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-2094727518 could not be found. Jul 14 14:49:11.159690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-2094727518 could not be found. Jul 14 14:49:11.163493 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.165295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55d3fa21-ecbb-4261-a66a-73e2cb5ff9e6 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance tempest-invalid-2094727518 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:11.166422 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-55d3fa21-ecbb-4261-a66a-73e2cb5ff9e6 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "POST /compute/v2.1/servers/tempest-invalid-2094727518/action" status: 404 len: 101 microversion: 2.1 time: 0.033397 Jul 14 14:49:11.167258 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1203/2336] 10.222.0.98 () {60 vars in 1248 bytes} [Thu Jul 14 14:49:11 2022] POST /compute/v2.1/servers/tempest-invalid-2094727518/action => generated 101 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:11.182182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:11.193003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:11.214574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.215134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.220703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.221275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.311950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c7935d19-9c87-4b7a-868e-d6ffc6e017fe tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1437 microversion: 2.1 time: 0.360420 Jul 14 14:49:11.327568 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1134/2337] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:10 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1437 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:11.352539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:11.354414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:11.371775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.372213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.373327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:11.378513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:11.583233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:11.604959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-18025682-affc-49ca-9c74-eab6be132821 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1470 microversion: 2.1 time: 0.432700 Jul 14 14:49:11.615482 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1204/2338] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:11 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1470 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:11.621284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cf21967-9076-4ccb-bdea-34b19b4dd78e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf3143940>, body: {"security_group_rule": {"parent_group_id": "9af68bd0-09d2-4cd2-b17a-d1d23dfe37ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 694660559}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:11.753905 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2cf21967-9076-4ccb-bdea-34b19b4dd78e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Invalid port range 22:694660559. Valid TCP ports should be between 1-65535 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cf21967-9076-4ccb-bdea-34b19b4dd78e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 145 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: {"security_group_rule": {"parent_group_id": "9af68bd0-09d2-4cd2-b17a-d1d23dfe37ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 694660559}} Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid port range 22:694660559. Valid TCP ports should be between 1-65535 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'security_group_rule': {'parent_group_id': '9af68bd0-09d2-4cd2-b17a-d1d23dfe37ac', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 694660559}}} Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:694660559. Valid TCP ports should be between 1-65535 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:694660559. Valid TCP ports should be between 1-65535 Jul 14 14:49:11.755888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:694660559. Valid TCP ports should be between 1-65535 Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cf21967-9076-4ccb-bdea-34b19b4dd78e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 400 to user: Invalid port range 22:694660559. Valid TCP ports should be between 1-65535 {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2cf21967-9076-4ccb-bdea-34b19b4dd78e tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.140511 Jul 14 14:49:11.779804 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1205/2339] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:49:11 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:11.790308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b2a1ff2-d61b-4fd8-b306-2e0f581329cc tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1185660482"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:11.792155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b2a1ff2-d61b-4fd8-b306-2e0f581329cc tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:49:11.793107 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3b2a1ff2-d61b-4fd8-b306-2e0f581329cc tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b2a1ff2-d61b-4fd8-b306-2e0f581329cc tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 57 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: {"createImage": {"name": "tempest-test-snap-1185660482"}} Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-1185660482'}}} Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:11.796251 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b2a1ff2-d61b-4fd8-b306-2e0f581329cc tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:11.801798 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b2a1ff2-d61b-4fd8-b306-2e0f581329cc tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.028270 Jul 14 14:49:11.812552 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1206/2340] 10.222.0.98 () {60 vars in 1274 bytes} [Thu Jul 14 14:49:11 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:11.825638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63c21941-6b97-4fa2-8ec0-0b1407af05ff tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2bc1430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:11.998277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:12.029510 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37f23f14-8a05-48af-ab54-82e803503a87 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc" status: 200 len: 1515 microversion: 2.1 time: 0.697817 Jul 14 14:49:12.036873 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1135/2341] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:11 2022] GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc => generated 1515 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:12.077155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Action: 'create', calling method: .version_select at 0x7fdbf29e7550>, body: {"security_group_rule": {"parent_group_id": "fb6a69ea-cf1d-4ac9-8768-932e028c90f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:12.355163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:49:12.356422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Neutron security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:49:12.357219 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.357219 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 138 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: {"security_group_rule": {"parent_group_id": "fb6a69ea-cf1d-4ac9-8768-932e028c90f8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fb6a69ea-cf1d-4ac9-8768-932e028c90f8', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:49:12.359727 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] Jul 14 14:49:12.363981 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.368474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 404 to user: Security group fb6a69ea-cf1d-4ac9-8768-932e028c90f8 does not exist Jul 14 14:49:12.368474 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-2ae75f33-82e2-4c6c-a28b-855ca11ce42e'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:12.369816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a5f7281-d5d2-47e1-b5d8-4eb01c7eeeb4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.331106 Jul 14 14:49:12.370640 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1136/2342] 10.222.0.98 () {60 vars in 1194 bytes} [Thu Jul 14 14:49:12 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 333 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:12.388360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4eb65cb4-d93b-45e0-9a13-6ecb7eb84471 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2143272718"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:12.390583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4eb65cb4-d93b-45e0-9a13-6ecb7eb84471 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:49:12.401356 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4eb65cb4-d93b-45e0-9a13-6ecb7eb84471 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4eb65cb4-d93b-45e0-9a13-6ecb7eb84471 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 57 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: {"createImage": {"name": "tempest-test-snap-2143272718"}} Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2143272718'}}} Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1318, in _action_create_image Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:12.422315 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Jul 14 14:49:12.433533 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:12.440414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4eb65cb4-d93b-45e0-9a13-6ecb7eb84471 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:12.440414 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4eb65cb4-d93b-45e0-9a13-6ecb7eb84471 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.064565 Jul 14 14:49:12.451903 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1137/2343] 10.222.0.98 () {60 vars in 1280 bytes} [Thu Jul 14 14:49:12 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:12.478653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:12.479947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:12.509627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:12.513960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.518788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:12.525462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:12.688065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:13.168878 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4053f33c-5c43-4edd-8e51-e264dd97e063 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "DELETE /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc" status: 204 len: 0 microversion: 2.1 time: 0.706309 Jul 14 14:49:13.173185 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1138/2344] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:12 2022] DELETE /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc => generated 0 bytes in 720 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:13.191887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-928d4466-9993-4623-8cf5-b267461b1ad1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf29869d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:21.211668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=13 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:21.457448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-928d4466-9993-4623-8cf5-b267461b1ad1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1446 microversion: 2.1 time: 8.281224 Jul 14 14:49:21.459701 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1139/2345] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:13 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1446 bytes in 8285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:21.472597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdbf2b6dca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:21.481265 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63c21941-6b97-4fa2-8ec0-0b1407af05ff tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 9.666507 Jul 14 14:49:21.495503 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1207/2346] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:11 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 9682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:21.518178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:21.524480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:49:21.525160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:21.525698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Neutron security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 not found {{(pid=125966) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Jul 14 14:49:21.527324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] HTTP exception thrown: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.527324 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Request method failure captured: Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-group-rules/892b5d3f-73c7-4704-9118-12335c3e54b9 HTTP/1.1 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzMtHqpQHix07U45c62ZNku_M_60se5PMpeWxB-57Dd5OVvk9zcdaDh6SZNfgqKxtaPQHMlEEgAA9slgL9_DYbMUsDrSreuuVrz-TyyhkzFKmbm08-zrR4tQq7weV3QjGhheV__W1UxXERES26MK3COdkLzZTnC-KVlGxcGOFITbLs Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5ffc690dc81847199f7339b22ab61dea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5ffc690dc81847199f7339b22ab61dea Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0dc1c56423ac4676b94f4e086338a712 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '892b5d3f-73c7-4704-9118-12335c3e54b9'} Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:49:21.534445 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] Jul 14 14:49:21.538521 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.543611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Returning 404 to user: Security group rule 892b5d3f-73c7-4704-9118-12335c3e54b9 does not exist Jul 14 14:49:21.543611 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-81df9abe-afa4-4cc3-b4fe-69fe8e723dcd'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:21.544881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-86f01114-b323-422b-88b1-c72878c86071 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-group-rules/892b5d3f-73c7-4704-9118-12335c3e54b9" status: 404 len: 199 microversion: 2.1 time: 0.077281 Jul 14 14:49:21.545984 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1140/2347] 10.222.0.98 () {58 vars in 1286 bytes} [Thu Jul 14 14:49:21 2022] DELETE /compute/v2.1/os-security-group-rules/892b5d3f-73c7-4704-9118-12335c3e54b9 => generated 199 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:21.554782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:21.556072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:21.567214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.568139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.569206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.569815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.586646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.590904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.593816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.596206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.598917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:21.613257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:21.676943 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe HTTP/1.1 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe'} Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:21.682101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:21.685718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.705042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:21.707967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-12eaafa9-2795-4e03-884a-74dab1f25c30 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 404 len: 111 microversion: 2.1 time: 0.209965 Jul 14 14:49:21.709720 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1208/2348] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:21 2022] DELETE /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 111 bytes in 213 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:21.719544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:21.720902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:21.734126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.735095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.736790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.737786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.772615 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] HTTP exception thrown: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc HTTP/1.1 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '58cd90a1-71fa-4b0d-9423-11f1842416bc'} Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:21.782092 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:21.786069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:21.788634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 404 to user: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:21.792709 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65a87d5c-0287-49c9-8833-6afcbe4d790d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc" status: 404 len: 111 microversion: 2.1 time: 0.080676 Jul 14 14:49:21.801220 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1209/2349] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:21 2022] GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:21.829172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7c620534-965a-4fdc-8244-efea9d7e69c1 req-f9bbda05-4ae6-46e1-bbe8-6521ccb660da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3490c3-371d-4033-afe2-e2bf1b7bb517", "name": "network-vif-plugged", "status": "completed", "tag": "a95d4384-b690-4cd0-8f4e-719098d1cf4e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:21.848144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7c620534-965a-4fdc-8244-efea9d7e69c1 req-f9bbda05-4ae6-46e1-bbe8-6521ccb660da service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.850119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7c620534-965a-4fdc-8244-efea9d7e69c1 req-f9bbda05-4ae6-46e1-bbe8-6521ccb660da service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.884175 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7c620534-965a-4fdc-8244-efea9d7e69c1 req-f9bbda05-4ae6-46e1-bbe8-6521ccb660da service nova] Creating event network-vif-plugged:a95d4384-b690-4cd0-8f4e-719098d1cf4e for instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 on n-h2-768852-23 Jul 14 14:49:21.901370 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7c620534-965a-4fdc-8244-efea9d7e69c1 req-f9bbda05-4ae6-46e1-bbe8-6521ccb660da service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095712 Jul 14 14:49:21.903804 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1210/2350] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:21.929025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2c2611c9-89b6-4e58-8396-d070bda409e0 req-eafc18e5-34e1-4e46-990e-1adf5a2cf4ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58cd90a1-71fa-4b0d-9423-11f1842416bc", "name": "network-vif-deleted", "tag": "174d8192-dab3-48c4-8a6a-d793e6466d31"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:21.937523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:21.958422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2c2611c9-89b6-4e58-8396-d070bda409e0 req-eafc18e5-34e1-4e46-990e-1adf5a2cf4ba service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:21.960130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2c2611c9-89b6-4e58-8396-d070bda409e0 req-eafc18e5-34e1-4e46-990e-1adf5a2cf4ba service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:21.972200 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fb9a68bf-dabb-4804-affd-c3f60101883c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1462 microversion: 2.1 time: 0.419695 Jul 14 14:49:21.977803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1141/2351] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:21 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1462 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:22.042547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2c2611c9-89b6-4e58-8396-d070bda409e0 req-eafc18e5-34e1-4e46-990e-1adf5a2cf4ba service nova] Creating event network-vif-deleted:174d8192-dab3-48c4-8a6a-d793e6466d31 for instance 58cd90a1-71fa-4b0d-9423-11f1842416bc on n-h1-768852-23 Jul 14 14:49:22.072463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2c2611c9-89b6-4e58-8396-d070bda409e0 req-eafc18e5-34e1-4e46-990e-1adf5a2cf4ba service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162558 Jul 14 14:49:22.079064 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1211/2352] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:22.097943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-989697e7-32d5-4d7c-a328-7b72a64f157d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a618b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:22.302648 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-989697e7-32d5-4d7c-a328-7b72a64f157d tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 200 len: 1446 microversion: 2.1 time: 0.221100 Jul 14 14:49:22.334471 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1212/2353] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:22 2022] GET /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 1446 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:22.351949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16e4a0e7-d815-43f8-9963-50ad90535a12 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdbf3620280>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:22.481298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-819085249", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "7cbc0ed1-4efb-41d2-ba23-3be40e126f10"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:22.624202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] validate_networks() for [('7cbc0ed1-4efb-41d2-ba23-3be40e126f10', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:23.147795 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16e4a0e7-d815-43f8-9963-50ad90535a12 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/9af68bd0-09d2-4cd2-b17a-d1d23dfe37ac" status: 202 len: 0 microversion: 2.1 time: 0.816391 Jul 14 14:49:23.148746 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1213/2354] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:49:22 2022] DELETE /compute/v2.1/os-security-groups/9af68bd0-09d2-4cd2-b17a-d1d23dfe37ac => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:49:23.162815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:23.167766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] [instance: 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:23.199811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.201663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.203925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.206869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.255180 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] HTTP exception thrown: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Request method failure captured: Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe HTTP/1.1 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy0Yy4JV49wqkMIgv5QoGPCRm_H4FKMKnmyIzefuLvjxS0Ul10A7Fo7Vsq6a8xYayODujThcO0XqdW3YEYY3WlB2tO8uvQ1wZi9VReH6AuBny2-52m8Y83skn-LNWCUqAtZPxYAPBMYecxpUnA2xvxMirx6PvGnmUKfLKrEPlSEXno Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178a39e9442c477f854e36b742e7c359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178a39e9442c477f854e36b742e7c359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178a39e9442c477f854e36b742e7c359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178a39e9442c477f854e36b742e7c359 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-857969488 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 897290f2f03d4ac7ad58d50c44a17fb3 Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesNegativeTestJSON-857969488-project Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe'} Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:23.260749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. Jul 14 14:49:23.265180 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:23.268350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] Returning 404 to user: Instance 6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:23.269892 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9ee968e2-2c2e-48df-9b81-97d63a1c5a93 tempest-ImagesNegativeTestJSON-857969488 tempest-ImagesNegativeTestJSON-857969488-project] 10.222.0.98 "GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe" status: 404 len: 111 microversion: 2.1 time: 0.119907 Jul 14 14:49:23.271634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1214/2355] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:23 2022] GET /compute/v2.1/servers/6c2b98e4-d0dd-4333-a6a0-bbf92f2249fe => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:23.279371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:23.288799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:23.290657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:23.298182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.298807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.301250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.301839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.407048 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54c55e97-9d9f-4a1a-a3d8-e48f9cb4a920 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.133342 Jul 14 14:49:23.409181 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1215/2356] 10.222.0.98 () {58 vars in 1229 bytes} [Thu Jul 14 14:49:23 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:49:23.414478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:23.415587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:23.422947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.423910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.425028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.426226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.459256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:23.460169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:23.460676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:23.461091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:23.461516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:23.480299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.480785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.481826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:23.483232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:23.515918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Getting quotas for project e4a6f1fb6e554564b4ee3c6586646b17. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:23.523863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Getting quotas for user a05fac57c00245d8965ed40f144b27e9 and project e4a6f1fb6e554564b4ee3c6586646b17. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:23.543568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:23.546992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:23.643860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f2c5621-b967-4c21-80c6-04de954c9497 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.663771 Jul 14 14:49:23.651943 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1142/2357] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:23.660223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d34bf84-0e16-4824-be91-f80c6fcd2230 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2a53700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:24.414140 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e235cd35-cc44-49df-92cf-f8d8e4af7c70 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1615 microversion: 2.1 time: 1.003360 Jul 14 14:49:24.415032 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1216/2358] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:23 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1615 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:24.419621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe1c0ad7-2273-44e0-9a0d-3849bd60b544 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2bc3e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.341116 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d34bf84-0e16-4824-be91-f80c6fcd2230 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 204 len: 0 microversion: 2.1 time: 1.687584 Jul 14 14:49:25.342123 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1143/2359] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:23 2022] DELETE /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 0 bytes in 1689 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:25.352769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85b9c20c-89dd-4827-8386-a1bbeaa1261d tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdbf2ba13a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.433429 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe1c0ad7-2273-44e0-9a0d-3849bd60b544 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 1.017430 Jul 14 14:49:25.435422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1217/2360] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:24 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:25.440511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe1c0ad7-2273-44e0-9a0d-3849bd60b544 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.441790 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe1c0ad7-2273-44e0-9a0d-3849bd60b544 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001709 Jul 14 14:49:25.445649 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1218/2361] 10.222.0.98 () {56 vars in 885 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:49:25.477768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd08bd72-77cd-4648-9349-a55983617b13 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd08bd72-77cd-4648-9349-a55983617b13 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi '2011/01/01' Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 14 14:49:25.484580 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Jul 14 14:49:25.489488 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:25.508337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd08bd72-77cd-4648-9349-a55983617b13 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:25.513129 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd08bd72-77cd-4648-9349-a55983617b13 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.065433 Jul 14 14:49:25.517880 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1219/2362] 10.222.0.98 () {58 vars in 1181 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 71 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:25.539534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:25.546825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:25.586117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.586635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.594537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:25.596921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:25.942641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:25.978051 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4de3c81a-2ebe-417f-8430-b0e0942e2546 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1279 microversion: 2.1 time: 0.456873 Jul 14 14:49:25.981870 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1220/2363] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1279 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:26.005427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-027c2860-9ddc-4a97-95bd-78109514561c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '.version_select at 0x7fdbf3143430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:26.018667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-027c2860-9ddc-4a97-95bd-78109514561c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.020014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-027c2860-9ddc-4a97-95bd-78109514561c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.073206 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-027c2860-9ddc-4a97-95bd-78109514561c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 414 microversion: 2.1 time: 0.089259 Jul 14 14:49:26.076207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1221/2364] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:49:25 2022] GET /compute/v2.1/os-migrations => generated 414 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:26.101693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:26.108059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:26.128349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.136211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.140094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.142705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.306955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:26.752554 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d74dc2da-cb33-43e9-996a-8ecb7a633ff4 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 204 len: 0 microversion: 2.1 time: 0.671996 Jul 14 14:49:26.754816 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1222/2365] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:26 2022] DELETE /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:26.764946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:26.769296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:26.770777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:26.814274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.824753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.826233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:26.835225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:26.998014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:49:27.108075 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cf1565a-e3c6-4226-a0e4-a1e2ef545305 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.351348 Jul 14 14:49:27.113548 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1223/2366] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:49:26 2022] GET /compute/v2.1/servers => generated 683 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:27.126442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-855ea560-7bfc-4bf0-a951-6403f1f40e1c req-36fda15b-eb04-4ad1-9c38-646c797abe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfb9636-0d3e-44b4-be23-c29a77a2a8ad", "name": "network-vif-unplugged", "status": "completed", "tag": "ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:27.164814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-855ea560-7bfc-4bf0-a951-6403f1f40e1c req-36fda15b-eb04-4ad1-9c38-646c797abe22 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:27.164814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-855ea560-7bfc-4bf0-a951-6403f1f40e1c req-36fda15b-eb04-4ad1-9c38-646c797abe22 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:27.208746 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-855ea560-7bfc-4bf0-a951-6403f1f40e1c req-36fda15b-eb04-4ad1-9c38-646c797abe22 service nova] Creating event network-vif-unplugged:ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b for instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad on n-h2-768852-23 Jul 14 14:49:27.258257 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-855ea560-7bfc-4bf0-a951-6403f1f40e1c req-36fda15b-eb04-4ad1-9c38-646c797abe22 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142759 Jul 14 14:49:27.273959 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1224/2367] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:27.310798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4e4a286f-ccbb-4aa8-82da-ec2ff19fe0bb tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf3161940>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:27.534484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4e4a286f-ccbb-4aa8-82da-ec2ff19fe0bb tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.258579 Jul 14 14:49:27.551558 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1225/2368] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:27 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:27.574217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1718346647", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:27.808280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:28.153127 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-85b9c20c-89dd-4827-8386-a1bbeaa1261d tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/3344e425-8820-45c0-a2f9-e5cabec1c187" status: 202 len: 0 microversion: 2.1 time: 2.809580 Jul 14 14:49:28.153890 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1144/2369] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:49:25 2022] DELETE /compute/v2.1/os-security-groups/3344e425-8820-45c0-a2f9-e5cabec1c187 => generated 0 bytes in 2811 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:49:28.159513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:28.160154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:28.203344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.210199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.211247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.211934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.540708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:28.589856 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6cb476f7-264c-459c-b20d-9c443fb2e33d tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1285 microversion: 2.1 time: 0.434182 Jul 14 14:49:28.606589 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1145/2370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:28 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1285 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:28.626190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:28.632061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:28.650749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.servers [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Removing options 'limit' from query {{(pid=125966) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:49:28.651858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:28.664941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.665394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.666254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:28.666695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:28.747481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:49:28.849678 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98f08fd9-ec33-4cc7-a54f-17e5d49bce51 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.241335 Jul 14 14:49:28.851218 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1146/2371] 10.222.0.98 () {58 vars in 1143 bytes} [Thu Jul 14 14:49:28 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:28.884020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-566233275", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:28.977226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] validate_networks() for [('e6e9f41c-de53-4ba2-8cc7-7f2e6ca08b47', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:49:29.223526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:29.224719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:29.225385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:29.225975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:29.226539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:29.253695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.255171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.256435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:29.257185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:29.328590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:29.343372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for user a185fa24374c417aa2bb9302a608cbcd and project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:29.382661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:29.386247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:29.509449 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67fa7b86-d693-43bc-81e0-c0edf9cfe396 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.955630 Jul 14 14:49:29.517220 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1226/2372] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:29.530636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31db0fec-d7b8-4d7c-a3a1-8ecb1faf4430 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdbf3161670>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:30.848663 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31db0fec-d7b8-4d7c-a3a1-8ecb1faf4430 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/f1948f02-e81f-4acf-873b-b584a6a46f94" status: 202 len: 0 microversion: 2.1 time: 1.329305 Jul 14 14:49:30.849293 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1227/2373] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:49:29 2022] DELETE /compute/v2.1/os-security-groups/f1948f02-e81f-4acf-873b-b584a6a46f94 => generated 0 bytes in 1331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:49:30.854950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-251921cb-e630-4c4c-a57d-613d261c9ef5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc04293f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.002513 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-251921cb-e630-4c4c-a57d-613d261c9ef5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.151922 Jul 14 14:49:31.009450 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1228/2374] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:30 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:31.022220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-993bbf43-0b22-47e1-8366-84da5b6db829 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-993bbf43-0b22-47e1-8366-84da5b6db829 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: action_args: {} Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi '-1' Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 14 14:49:31.030311 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-993bbf43-0b22-47e1-8366-84da5b6db829 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:31.040619 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-993bbf43-0b22-47e1-8366-84da5b6db829 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.020866 Jul 14 14:49:31.052700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1229/2375] 10.222.0.98 () {58 vars in 1141 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:31.058769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.059444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:31.069159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.069502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.071211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.071697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.434993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.450098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e55f8a9e-a3ac-4056-840d-64706846f6ae tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1209 microversion: 2.1 time: 0.396143 Jul 14 14:49:31.451296 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1230/2376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1209 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:31.475213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:31.476603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:31.512382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.513268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.524631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:31.524990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:31.749914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:31.794011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-704dac36-6cf0-4ab8-9839-97743d485012 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1285 microversion: 2.1 time: 0.333382 Jul 14 14:49:31.816070 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1231/2377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:31 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1285 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:31.840779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-660c4d8f-29e6-4a45-a41c-5363512edb9b tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdc0423c4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.182828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:49:32.183931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:49:32.184659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:49:32.185238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:49:32.186199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:49:32.193430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:32.260036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.260511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.267124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.267900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.325790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:49:32.338557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Getting quotas for user 331a222a893c4f84a08abf11333c7449 and project 52b2ada3fd2842f0a04fdedaf4bd908e. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:49:32.388423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:49:32.391618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:49:32.535686 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-745bfc45-c9c0-4590-ba3e-55dc0a4af225 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.677536 Jul 14 14:49:32.547033 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1147/2378] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:49:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:49:32.552484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1cbe9a4f-83e9-4d1f-ac7f-4be847503278 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1cbe9a4f-83e9-4d1f-ac7f-4be847503278 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: action_args: {} Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'minimum': 0, Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance[0]: Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'testing' Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 2 more times] Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Jul 14 14:49:32.555373 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1cbe9a4f-83e9-4d1f-ac7f-4be847503278 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1cbe9a4f-83e9-4d1f-ac7f-4be847503278 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.008742 Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1148/2379] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:49:32 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:49:32.565856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4b92bd5-f4dd-4f3a-882f-37509e1d3b26 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b6d700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.654151 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4b92bd5-f4dd-4f3a-882f-37509e1d3b26 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.094899 Jul 14 14:49:32.655692 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1149/2380] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:32 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:32.666462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:32.667815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:32.694910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.694910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:32.695633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:32.696107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.058397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.091643 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93d870a4-62c7-4539-88fe-489e57415854 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1271 microversion: 2.1 time: 0.432195 Jul 14 14:49:33.097258 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1150/2381] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:32 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1271 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:33.124656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94fbb283-0fdb-466f-a40f-60e33581eaf7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:33.126589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94fbb283-0fdb-466f-a40f-60e33581eaf7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:33.596832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94fbb283-0fdb-466f-a40f-60e33581eaf7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.605774 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94fbb283-0fdb-466f-a40f-60e33581eaf7 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1207 microversion: 2.1 time: 0.491625 Jul 14 14:49:33.609804 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1151/2382] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:33 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1207 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:33.642813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-48ca972b-cae3-48b3-a29f-2de3e716ff15 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:33.665693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-48ca972b-cae3-48b3-a29f-2de3e716ff15 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:33.668667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-48ca972b-cae3-48b3-a29f-2de3e716ff15 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:33.690732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.servers [None req-48ca972b-cae3-48b3-a29f-2de3e716ff15 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Flavor 'non_existing_flavor' could not be found {{(pid=125966) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:338}} Jul 14 14:49:33.692250 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-48ca972b-cae3-48b3-a29f-2de3e716ff15 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.081120 Jul 14 14:49:33.697112 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1152/2383] 10.222.0.98 () {58 vars in 1177 bytes} [Thu Jul 14 14:49:33 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:49:33.718992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:33.723532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:33.753790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:33.754607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:33.759080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:33.763484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.419982 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-660c4d8f-29e6-4a45-a41c-5363512edb9b tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/e31ed877-08db-4389-8659-abb5cd1d3d2e" status: 202 len: 0 microversion: 2.1 time: 2.601390 Jul 14 14:49:34.421780 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1232/2384] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:49:31 2022] DELETE /compute/v2.1/os-security-groups/e31ed877-08db-4389-8659-abb5cd1d3d2e => generated 0 bytes in 2604 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:49:34.429801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2434249-96c4-4f0e-94d5-178489a5360b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc041f9a60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:34.599104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2434249-96c4-4f0e-94d5-178489a5360b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.175331 Jul 14 14:49:34.600894 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1233/2385] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:34 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:34.612338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:34.621583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:34.625067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:34.652204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.654096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.658749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:34.660430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:34.996855 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2035e13-74f1-4b4b-abcc-94952aebcf59 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.393586 Jul 14 14:49:34.998513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1234/2386] 10.222.0.98 () {58 vars in 1173 bytes} [Thu Jul 14 14:49:34 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:49:35.016738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.018905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.049797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.051568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.056236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.057067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.157908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.199878 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-102743b5-0c7c-4762-b972-13ed60560952 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 1.501637 Jul 14 14:49:35.219339 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1153/2387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:33 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:35.256901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-45cf8208-aff1-45b0-a3bf-33c686940063 req-dab376f4-bfdb-45e5-ab8f-0dfce4b9c489 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cfb9636-0d3e-44b4-be23-c29a77a2a8ad", "name": "network-vif-deleted", "tag": "ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:35.331974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-45cf8208-aff1-45b0-a3bf-33c686940063 req-dab376f4-bfdb-45e5-ab8f-0dfce4b9c489 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.336400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-45cf8208-aff1-45b0-a3bf-33c686940063 req-dab376f4-bfdb-45e5-ab8f-0dfce4b9c489 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.385909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-45cf8208-aff1-45b0-a3bf-33c686940063 req-dab376f4-bfdb-45e5-ab8f-0dfce4b9c489 service nova] Creating event network-vif-deleted:ea27b20d-f3da-4dc1-8e3c-9a1e85ea5f2b for instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad on n-h2-768852-23 Jul 14 14:49:35.421224 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-45cf8208-aff1-45b0-a3bf-33c686940063 req-dab376f4-bfdb-45e5-ab8f-0dfce4b9c489 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209500 Jul 14 14:49:35.423676 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1154/2388] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:35.445873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a5606ee-728d-4e30-bac4-658e9c4262b4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] Calling method '.version_select at 0x7fdbf2b8a280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.562880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.590759 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c36f42a9-1e64-4c06-9d37-8184e3dadc43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1271 microversion: 2.1 time: 0.589797 Jul 14 14:49:35.591963 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1235/2389] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:34 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1271 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:35.600749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.601944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:35.614147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.615036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.616545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.617628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.838686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.864312 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d39d35c5-01eb-4870-ae95-41defedcb732 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1265 microversion: 2.1 time: 0.269469 Jul 14 14:49:35.867046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1236/2390] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:35 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:35.877526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:35.893924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:35.895188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:35.951742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.953078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:35.957724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:35.966109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.231231 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1e242f0-edbf-4976-9ccd-55cd04c4b33d tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.361812 Jul 14 14:49:36.259357 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1237/2391] 10.222.0.98 () {58 vars in 1183 bytes} [Thu Jul 14 14:49:35 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:49:36.290791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a537bf06-918e-4044-b3f3-b0d5fc34fbec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf33f89d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.385205 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a537bf06-918e-4044-b3f3-b0d5fc34fbec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.101942 Jul 14 14:49:36.387217 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1238/2392] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:36.395566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.396352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:36.404524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.404982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.405789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.406579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.713891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.725391 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00c0cc30-7498-45b2-a058-ee59e95fd741 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 0.336889 Jul 14 14:49:36.727931 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1239/2393] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:36.737563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.741320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.742584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:36.755168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.761129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.763430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.764402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.814034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a5606ee-728d-4e30-bac4-658e9c4262b4 tempest-SecurityGroupRulesNegativeTestJSON-1456776655 tempest-SecurityGroupRulesNegativeTestJSON-1456776655-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/daded0bf-202b-45f1-a652-9b8a683faf1e" status: 202 len: 0 microversion: 2.1 time: 1.388037 Jul 14 14:49:36.815864 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1155/2394] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:49:35 2022] DELETE /compute/v2.1/os-security-groups/daded0bf-202b-45f1-a652-9b8a683faf1e => generated 0 bytes in 1391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:49:36.821089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:36.822153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:36.841917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.842415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.842777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:49:36.843236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.843728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:36.938322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:36.952392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:36.953113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.257509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.276068 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-402a862d-44f8-4bde-9903-c49325fe6693 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1271 microversion: 2.1 time: 0.458927 Jul 14 14:49:37.277419 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1156/2395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1271 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.292691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.293702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:37.314034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.314855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.315925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.316552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.478017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.494784 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-970162e5-941b-4144-852e-b8734cc0daf1 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1265 microversion: 2.1 time: 0.214369 Jul 14 14:49:37.495447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1157/2396] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1265 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.501808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bd69be9e-dc72-468c-8976-3bf98d800bdd tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2ba1ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.537429 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-599a4d80-9d14-479b-9300-cf61f337c60f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.807960 Jul 14 14:49:37.538349 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1240/2397] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:49:36 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.575401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89298652-a28b-4fb0-9194-0d495b94d3e3 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.584901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-89298652-a28b-4fb0-9194-0d495b94d3e3 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.590612 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-89298652-a28b-4fb0-9194-0d495b94d3e3 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.015676 Jul 14 14:49:37.591133 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1241/2398] 10.222.0.98 () {58 vars in 1177 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:49:37.617940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bd69be9e-dc72-468c-8976-3bf98d800bdd tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.121340 Jul 14 14:49:37.618564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1158/2399] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:37.622827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.631833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:37.632553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Searching by: {'deleted': False, 'project_id': '993c6d6a2aa347838950e9b67df54008'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:49:37.656080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.656669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.657422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.657969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.749491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.750533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:37.788814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:37.799451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:49:37.809827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.810630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.811851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.812425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.885293 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80945aab-e24e-4e87-bb64-27ac50e0a4bb tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.275328 Jul 14 14:49:37.888812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1242/2400] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers => generated 683 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:37.924569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:37.925830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:37.951710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.955147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:37.961618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:37.965148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.014937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] HTTP exception thrown: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc HTTP/1.1 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '58cd90a1-71fa-4b0d-9423-11f1842416bc'} Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:38.019718 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:38.030926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:38.035758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 404 to user: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:38.045655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6ccdbed-bf97-41fc-aa7c-87862af556c6 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "DELETE /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc" status: 404 len: 111 microversion: 2.1 time: 0.136217 Jul 14 14:49:38.061541 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1243/2401] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:37 2022] DELETE /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc => generated 111 bytes in 159 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:38.076479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.080928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:38.097513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.097874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.100402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.104997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.215303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:38.479615 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca6b4c38-8d20-4a9a-8fe5-005dbb88a613 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "DELETE /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b" status: 204 len: 0 microversion: 2.1 time: 0.401613 Jul 14 14:49:38.489666 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1244/2402] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:38 2022] DELETE /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:38.505690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:38.507762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:38.523389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.524405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:38.527956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:38.531747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.168728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:39.186233 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31789eac-e35f-4a4a-b4c4-109b42d51434 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.694248 Jul 14 14:49:39.187118 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1245/2403] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:38 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:39.220506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:39.220967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:39.245321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.248967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.249994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.253683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.386404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:49:39.396476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:39.407102 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-76baf40c-f598-471b-a8f4-3676f533ebf5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 1.662637 Jul 14 14:49:39.427784 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1159/2404] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:37 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:39.459203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:39.460299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:39.538877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.544693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.553705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:39.554503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:39.818779 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd4a9bd7-c702-48ee-88c8-eb8d4afe5c1b tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 204 len: 0 microversion: 2.1 time: 0.625282 Jul 14 14:49:39.819765 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1246/2405] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:49:39 2022] DELETE /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:49:39.829402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2a1ecbd-f9b4-4c12-8a33-e4198399f5c1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc04216310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.056668 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2a1ecbd-f9b4-4c12-8a33-e4198399f5c1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1452 microversion: 2.1 time: 0.235047 Jul 14 14:49:40.065866 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1247/2406] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:39 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1452 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:40.091768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-31063ccf-e0af-4413-9f39-4d8e888863f5 req-00ea7751-3c21-4244-a43a-0cccdb2236a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bc98e3c-1a42-4d76-9ee4-8fcab7c28249", "tag": "63a6b850-49a5-4849-9453-a0dd3b31740f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:40.148854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31063ccf-e0af-4413-9f39-4d8e888863f5 req-00ea7751-3c21-4244-a43a-0cccdb2236a3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.149529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31063ccf-e0af-4413-9f39-4d8e888863f5 req-00ea7751-3c21-4244-a43a-0cccdb2236a3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.187467 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-31063ccf-e0af-4413-9f39-4d8e888863f5 req-00ea7751-3c21-4244-a43a-0cccdb2236a3 service nova] Creating event network-changed:63a6b850-49a5-4849-9453-a0dd3b31740f for instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 on n-h1-768852-23 Jul 14 14:49:40.204174 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-31063ccf-e0af-4413-9f39-4d8e888863f5 req-00ea7751-3c21-4244-a43a-0cccdb2236a3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129109 Jul 14 14:49:40.204848 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1248/2407] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:40.222401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.224118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 58cd90a1-71fa-4b0d-9423-11f1842416bc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:40.274877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.279761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.280627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.286557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.336333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] HTTP exception thrown: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc HTTP/1.1 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '58cd90a1-71fa-4b0d-9423-11f1842416bc'} Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:40.338105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. Jul 14 14:49:40.341965 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:40.349197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 404 to user: Instance 58cd90a1-71fa-4b0d-9423-11f1842416bc could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:40.350395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ad6de87-6cd7-4752-a8a0-789ce62f67f7 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc" status: 404 len: 111 microversion: 2.1 time: 0.141834 Jul 14 14:49:40.353077 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1249/2408] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:40 2022] GET /compute/v2.1/servers/58cd90a1-71fa-4b0d-9423-11f1842416bc => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:40.372890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.373545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:40.396218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.396679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.397516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.397969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.524839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:40.545945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a552e38e-45e1-4c78-92af-3623491873bc tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 1.115689 Jul 14 14:49:40.559748 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1160/2409] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:39 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:40.565016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:40.565607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:40.592573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.593225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:40.594152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:40.594595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.044177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.056790 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a55c9ab8-b543-4cf8-95e3-86109a9bcc1f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.698053 Jul 14 14:49:41.057399 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1250/2410] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:40 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.062257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.062885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.084950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.085398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.086200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.086636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.519798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.539786 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2b238030-94f5-40d9-9c1d-c8fffc93b929 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 0.481178 Jul 14 14:49:41.540730 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1251/2411] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.546969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e0b5369-502d-4826-b1fe-2d088155fabd tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf23578b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.602815 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e0b5369-502d-4826-b1fe-2d088155fabd tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1461 microversion: 2.1 time: 0.060414 Jul 14 14:49:41.604020 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1252/2412] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1461 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.612380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.613270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:41.620496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.621227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.622244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.622872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:41.690327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:41.732245 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e8c6bbc7-566b-4be4-82d4-ffd5d4a5b9c2 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b" status: 200 len: 1522 microversion: 2.1 time: 1.158046 Jul 14 14:49:41.734620 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1161/2413] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:40 2022] GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b => generated 1522 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.778810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e75e4023-504f-4dd8-82aa-52a1574e7203 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf291b940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:41.890443 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e75e4023-504f-4dd8-82aa-52a1574e7203 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 200 len: 1461 microversion: 2.1 time: 0.146008 Jul 14 14:49:41.891551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1162/2414] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 1461 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:41.906168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bdcf77b5-52c2-4baa-bd7f-5c7cfbe4b355 req-c82e26e4-2589-40fa-8dda-2b844ba0de11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "30d72422-22aa-416d-891f-82117e2108f7", "tag": "b12379d4-5bbc-4f1c-bee8-25041259ca74"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:41.953751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bdcf77b5-52c2-4baa-bd7f-5c7cfbe4b355 req-c82e26e4-2589-40fa-8dda-2b844ba0de11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:41.960601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bdcf77b5-52c2-4baa-bd7f-5c7cfbe4b355 req-c82e26e4-2589-40fa-8dda-2b844ba0de11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.003014 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bdcf77b5-52c2-4baa-bd7f-5c7cfbe4b355 req-c82e26e4-2589-40fa-8dda-2b844ba0de11 service nova] Creating event network-changed:b12379d4-5bbc-4f1c-bee8-25041259ca74 for instance 30d72422-22aa-416d-891f-82117e2108f7 on n-h1-768852-23 Jul 14 14:49:42.020747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bdcf77b5-52c2-4baa-bd7f-5c7cfbe4b355 req-c82e26e4-2589-40fa-8dda-2b844ba0de11 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126397 Jul 14 14:49:42.022548 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1163/2415] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:42.045874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:42.052412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:42.064466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:42.065693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.066936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:42.067628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.305154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:42.354030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:42.370004 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bf58624c-3737-4f2b-ac37-fe49635e5714 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 0.764289 Jul 14 14:49:42.371154 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1253/2416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:41 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:42.385268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:42.386408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:42.398495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:42.399322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.400719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:42.401522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.898066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:42.920476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8534541-5da1-4865-862a-6f7557420b9a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1467 microversion: 2.1 time: 0.894439 Jul 14 14:49:42.923469 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1164/2417] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:42 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1467 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:42.940864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:42.945183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:42.966155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:42.968277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:42.973993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:42.974850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.207562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.229955 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28e519c3-92cf-402f-a9f6-fb14adc656eb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.854675 Jul 14 14:49:43.232261 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1254/2418] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:42 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:43.246793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:43.248367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:43.260815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.262021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.264946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.266718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.463339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '029da70c73ee487db039f4dafc0d2948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '993c6d6a2aa347838950e9b67df54008', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:43.475783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f6b3fea5-c9e9-4a88-a4c6-2baa178997a9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b" status: 200 len: 1480 microversion: 2.1 time: 0.240718 Jul 14 14:49:43.476403 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1255/2419] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:43 2022] GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b => generated 1480 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:43.494102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1769714541"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:43.495626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:43.501157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:43.521443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.521894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.524299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:43.528805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:43.605789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=14 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:44.183773 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b64b52b-4782-481a-be82-3d2a7e13276a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "POST /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb/action" status: 202 len: 0 microversion: 2.1 time: 0.705470 Jul 14 14:49:44.185124 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1256/2420] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:49:43 2022] POST /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:49:44.216128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:44.217288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:44.230461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.230698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.232309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.234524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.382775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:44.392119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5f39493-dabe-4251-bffb-879b359b9f6b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 1.465107 Jul 14 14:49:44.400463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1165/2421] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:42 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:44.411785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ff5249ba-5813-47b2-9bed-5f9f25ff7b3a req-357ffea4-186f-461a-bf81-9eda45d18f6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b", "name": "network-vif-deleted", "tag": "c450fd35-4bd9-4b9f-9daa-fe609722e7f0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:44.431021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ff5249ba-5813-47b2-9bed-5f9f25ff7b3a req-357ffea4-186f-461a-bf81-9eda45d18f6e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.435812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ff5249ba-5813-47b2-9bed-5f9f25ff7b3a req-357ffea4-186f-461a-bf81-9eda45d18f6e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.468499 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ff5249ba-5813-47b2-9bed-5f9f25ff7b3a req-357ffea4-186f-461a-bf81-9eda45d18f6e service nova] Creating event network-vif-deleted:c450fd35-4bd9-4b9f-9daa-fe609722e7f0 for instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b on n-h2-768852-23 Jul 14 14:49:44.487289 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ff5249ba-5813-47b2-9bed-5f9f25ff7b3a req-357ffea4-186f-461a-bf81-9eda45d18f6e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084183 Jul 14 14:49:44.488652 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1166/2422] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:44.495350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-476f479c-cfa3-45b0-bbcb-1737bb109c1c req-30706694-518e-4202-a6b9-c1d6db62ff9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d43f293-fc15-4707-8454-98e7974bbd54", "name": "network-vif-deleted", "tag": "01ed3089-f608-4923-9e76-14d7be483cea"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:44.523710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-476f479c-cfa3-45b0-bbcb-1737bb109c1c req-30706694-518e-4202-a6b9-c1d6db62ff9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.533035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-476f479c-cfa3-45b0-bbcb-1737bb109c1c req-30706694-518e-4202-a6b9-c1d6db62ff9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.557731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-476f479c-cfa3-45b0-bbcb-1737bb109c1c req-30706694-518e-4202-a6b9-c1d6db62ff9c service nova] Creating event network-vif-deleted:01ed3089-f608-4923-9e76-14d7be483cea for instance 2d43f293-fc15-4707-8454-98e7974bbd54 on n-h1-768852-23 Jul 14 14:49:44.569580 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-476f479c-cfa3-45b0-bbcb-1737bb109c1c req-30706694-518e-4202-a6b9-c1d6db62ff9c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079234 Jul 14 14:49:44.571663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1167/2423] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:44.578947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3fe63e0e-56d4-4b72-8eea-b503fe82be6a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b6faf0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:44.653533 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3fe63e0e-56d4-4b72-8eea-b503fe82be6a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.079532 Jul 14 14:49:44.656216 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1168/2424] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:44 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:44.667547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:44.669474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:44.714075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.720532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:44.722931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:44.725861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.522075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.552690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:45.557507 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2db609ef-58fb-4f87-9043-e57ad7938b5e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 1.362722 Jul 14 14:49:45.558970 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1257/2425] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:44 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:45.576790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.578214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.598475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.602211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.603356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.604072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.625190 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] HTTP exception thrown: Instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b could not be found. Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b HTTP/1.1 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b could not be found. Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b'} Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b could not be found. Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b could not be found. Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:45.628630 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b could not be found. Jul 14 14:49:45.633080 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.636470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 404 to user: Instance 25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:45.644525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1571863-f65f-4140-afcc-8b63d7b8ada9 tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b" status: 404 len: 111 microversion: 2.1 time: 0.077106 Jul 14 14:49:45.645544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:45.647913 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1258/2426] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:45 2022] GET /compute/v2.1/servers/25a6ce5e-f48b-4c9d-b1e3-646dfe47d82b => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:45.662018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.666762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d21023a1-727d-4a21-abbd-6b4e88a0a307 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 1.006266 Jul 14 14:49:45.668607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.668942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1169/2427] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:44 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:45.675949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.676988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] [instance: 2d43f293-fc15-4707-8454-98e7974bbd54] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:45.684638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.685484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.686558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.691001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.691236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.691904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.692885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:45.693484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:45.713528 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] HTTP exception thrown: Instance 2d43f293-fc15-4707-8454-98e7974bbd54 could not be found. Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Request method failure captured: Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 HTTP/1.1 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cy20l1Xqz9gxJ97nA8NzrM1Fu8xPMCod5Mqp8u7Ol06vEk2TE478aDWBMEBbGAubSpUGxTbOJqMXmjGO2Iu-C0M6bZLmC9dq12KC4wbeTLlqpG9ci9jea6gLQvd5kcHBh0BGau2udWRn3ch9E-jwbcBMvicTqdpF7qR1Loha9oPP8I Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_993c6d6a2aa347838950e9b67df54008"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/993c6d6a2aa347838950e9b67df54008"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 993c6d6a2aa347838950e9b67df54008 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-2135247518 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 029da70c73ee487db039f4dafc0d2948 Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ListServersNegativeTestJSON-2135247518-project Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2d43f293-fc15-4707-8454-98e7974bbd54 could not be found. Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2d43f293-fc15-4707-8454-98e7974bbd54'} Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d43f293-fc15-4707-8454-98e7974bbd54 could not be found. Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d43f293-fc15-4707-8454-98e7974bbd54 could not be found. Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:49:45.715770 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d43f293-fc15-4707-8454-98e7974bbd54 could not be found. Jul 14 14:49:45.721601 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:49:45.724294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] Returning 404 to user: Instance 2d43f293-fc15-4707-8454-98e7974bbd54 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:49:45.725558 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-193674ef-3d21-412b-b63d-2482421a777f tempest-ListServersNegativeTestJSON-2135247518 tempest-ListServersNegativeTestJSON-2135247518-project] 10.222.0.98 "GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54" status: 404 len: 111 microversion: 2.1 time: 0.054444 Jul 14 14:49:45.727370 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1170/2428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:45 2022] GET /compute/v2.1/servers/2d43f293-fc15-4707-8454-98e7974bbd54 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:49:45.733817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08004947-7071-4027-85ec-9377769a173e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf29869d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:45.803261 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08004947-7071-4027-85ec-9377769a173e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.074430 Jul 14 14:49:45.804685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1171/2429] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:45 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:46.357986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:46.377210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0583233d-eb6b-4aa1-b1ed-5afdec54d2d5 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 0.727914 Jul 14 14:49:46.380873 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1259/2430] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:45 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:46.566309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8c0dc16c-1bfa-454a-ae50-fdb2a9d05cdc req-ea953840-b44b-4905-b0e0-30928c458204 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a29ece-d239-4899-aa1b-85f8151eb874", "tag": "2094fac7-8553-4153-abaa-974a33ab82cf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:46.591630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.597593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.608511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8c0dc16c-1bfa-454a-ae50-fdb2a9d05cdc req-ea953840-b44b-4905-b0e0-30928c458204 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.614990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.616482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8c0dc16c-1bfa-454a-ae50-fdb2a9d05cdc req-ea953840-b44b-4905-b0e0-30928c458204 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.625669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.628057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.638195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.657617 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8c0dc16c-1bfa-454a-ae50-fdb2a9d05cdc req-ea953840-b44b-4905-b0e0-30928c458204 service nova] Creating event network-changed:2094fac7-8553-4153-abaa-974a33ab82cf for instance 81a29ece-d239-4899-aa1b-85f8151eb874 on n-h2-768852-23 Jul 14 14:49:46.735211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8c0dc16c-1bfa-454a-ae50-fdb2a9d05cdc req-ea953840-b44b-4905-b0e0-30928c458204 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164772 Jul 14 14:49:46.738736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1172/2431] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:49:46.786595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:46.790531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:46.816252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.817650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.821055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:46.822547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:46.927728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:47.439027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:47.462390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:47.477940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00335131-b057-43ae-9971-ba50a256f5a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.732759 Jul 14 14:49:47.484214 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1173/2432] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:46 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:47.490466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-368b7577-ba7e-4218-b739-4d4588c3dd9c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf29860d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:47.558869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-368b7577-ba7e-4218-b739-4d4588c3dd9c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.070221 Jul 14 14:49:47.559624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1174/2433] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:47 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:47.577938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-57184210-e15b-4767-8ebf-66b5d35f77af req-ba95c07a-9099-418e-b070-f97c079f1dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3490c3-371d-4033-afe2-e2bf1b7bb517", "name": "network-vif-unplugged", "status": "completed", "tag": "a95d4384-b690-4cd0-8f4e-719098d1cf4e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:47.595314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57184210-e15b-4767-8ebf-66b5d35f77af req-ba95c07a-9099-418e-b070-f97c079f1dcc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:47.596432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57184210-e15b-4767-8ebf-66b5d35f77af req-ba95c07a-9099-418e-b070-f97c079f1dcc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:47.613651 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-57184210-e15b-4767-8ebf-66b5d35f77af req-ba95c07a-9099-418e-b070-f97c079f1dcc service nova] Creating event network-vif-unplugged:a95d4384-b690-4cd0-8f4e-719098d1cf4e for instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 on n-h2-768852-23 Jul 14 14:49:47.622607 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-57184210-e15b-4767-8ebf-66b5d35f77af req-ba95c07a-9099-418e-b070-f97c079f1dcc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054963 Jul 14 14:49:47.624320 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1175/2434] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:47.631574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:47.632589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:47.640726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:47.643642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:47.645093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:47.645791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:47.678148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=14 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:49:48.126369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:48.166211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-82c7ab69-4d00-411a-a23f-cef5b6030508 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 0.539389 Jul 14 14:49:48.168217 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1176/2435] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:47 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:48.247381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:48.270173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-76544c5b-8de3-4ba2-849b-569226aaaea3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 1.686080 Jul 14 14:49:48.271174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1260/2436] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:46 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:48.500611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:48.501635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:48.520213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:48.521103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:48.522199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:48.522887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:48.572317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-13a4fe87-60e7-40e1-86fa-6c88fea61192 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc041f9310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:48.725812 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-13a4fe87-60e7-40e1-86fa-6c88fea61192 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.155049 Jul 14 14:49:48.732315 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1261/2437] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:48 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:49.202532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:49.205939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:49.241860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.248608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.256621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.282322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.401827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.418731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf992baa-3746-4eb3-8107-c6827b798d05 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.921846 Jul 14 14:49:49.422848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1177/2438] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:48 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:49.448534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:49.449269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:49.460102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.460948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.462005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:49.462675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:49.914268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:49.930318 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1102d766-83f5-491c-a7a5-a189c7060935 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 0.484972 Jul 14 14:49:49.948528 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1178/2439] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:49 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:49.962226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2790b370-6f1c-4700-a2db-b551d49dbc0a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b48820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:50.070159 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2790b370-6f1c-4700-a2db-b551d49dbc0a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.119120 Jul 14 14:49:50.080176 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1179/2440] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:49 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:50.440637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:50.441632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:50.448786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.449480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.450641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.451263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.796968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:50.811425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-783b89b3-20cc-4fa6-ba14-fd35c5da0772 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.375640 Jul 14 14:49:50.827179 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1180/2441] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:50 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:50.956773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:50.957315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:50.964626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.965092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:50.965918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:50.966530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.152383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:51.161790 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6bb42ad7-9fa7-4388-bddc-538dd1696f56 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 0.210826 Jul 14 14:49:51.163069 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1181/2442] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:50 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:51.168503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e433f120-8920-4bc8-ad9f-b20820a60841 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf35950d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.238047 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e433f120-8920-4bc8-ad9f-b20820a60841 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.073509 Jul 14 14:49:51.249009 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1182/2443] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:51 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:51.424840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:51.434197 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-96b41b3d-fc59-4d28-8c8b-6573998b488b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 2.242534 Jul 14 14:49:51.435296 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1262/2444] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:49 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 2244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:51.831033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:51.832623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:51.849730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.852923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:51.854245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:51.856446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.093760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:52.104781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6acd454d-f051-4700-a877-fd862edac296 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.279405 Jul 14 14:49:52.115299 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1183/2445] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:51 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:52.180084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:52.181310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:52.199700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.201569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.208456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.209464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.281188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80442693-d20e-4535-b6b3-217e2e7c9ccf tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf29cedc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:52.360373 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80442693-d20e-4535-b6b3-217e2e7c9ccf tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.094680 Jul 14 14:49:52.372600 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1184/2446] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:52 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:52.454038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:52.454682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:52.479347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.480134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.481533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:52.482306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:52.904187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:52.941945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9cbc4810-9e8c-474d-b3c4-c94ea1e32fb7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 0.490483 Jul 14 14:49:52.947040 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1185/2447] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:52 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:53.132092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:53.149286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:53.188791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:53.195443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:53.200861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:53.201829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:53.685282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:53.714534 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be917dfd-49bc-4d1a-bfb7-463e434b4ccd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.595260 Jul 14 14:49:53.715996 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1186/2448] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:53 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:49:53.740270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95c271a3-83fc-4a22-8c2e-c784d9acee3e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a6fb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:53.910573 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95c271a3-83fc-4a22-8c2e-c784d9acee3e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.187090 Jul 14 14:49:53.913114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1187/2449] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:53 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:53.939159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ab5b0db6-7c4c-4310-9670-ffc34b24e7fc req-f3bee04f-5ad2-4fb9-b3b1-3729ae6f0435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc98e3c-1a42-4d76-9ee4-8fcab7c28249", "name": "network-vif-plugged", "status": "completed", "tag": "63a6b850-49a5-4849-9453-a0dd3b31740f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:53.981646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ab5b0db6-7c4c-4310-9670-ffc34b24e7fc req-f3bee04f-5ad2-4fb9-b3b1-3729ae6f0435 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:53.983133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ab5b0db6-7c4c-4310-9670-ffc34b24e7fc req-f3bee04f-5ad2-4fb9-b3b1-3729ae6f0435 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:54.057395 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ab5b0db6-7c4c-4310-9670-ffc34b24e7fc req-f3bee04f-5ad2-4fb9-b3b1-3729ae6f0435 service nova] Creating event network-vif-plugged:63a6b850-49a5-4849-9453-a0dd3b31740f for instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 on n-h1-768852-23 Jul 14 14:49:54.065141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:54.084261 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20433035-1f1a-4c6b-8ac6-0fe449787c04 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 1.907270 Jul 14 14:49:54.088073 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ab5b0db6-7c4c-4310-9670-ffc34b24e7fc req-f3bee04f-5ad2-4fb9-b3b1-3729ae6f0435 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172566 Jul 14 14:49:54.089102 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1263/2450] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:52 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 1915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:54.096424 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1188/2451] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:54.098152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:54.102298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:54.121721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:54.124312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:54.125972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:54.127584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:54.734493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:54.735228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:54.755034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:54.755549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:54.756387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:54.756835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:54.836198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:54.854011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-96206204-e641-4a77-83b3-72796cdec7ac tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 0.762644 Jul 14 14:49:54.855376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1264/2452] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:54 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:54.926257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46d273f2-9adc-48a9-a3dc-576658fd74a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf230ad30>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:55.079203 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46d273f2-9adc-48a9-a3dc-576658fd74a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.157064 Jul 14 14:49:55.085855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1265/2453] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:54 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:55.089132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46d273f2-9adc-48a9-a3dc-576658fd74a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:55.091541 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46d273f2-9adc-48a9-a3dc-576658fd74a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002779 Jul 14 14:49:55.093294 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1266/2454] 10.222.0.98 () {56 vars in 885 bytes} [Thu Jul 14 14:49:55 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:49:55.122218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:55.128242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:55.148970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.160128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:55.162458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.165471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:55.254762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:55.271470 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-84e6e485-6cad-40ec-8b89-f7fdfbc16fa0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.542506 Jul 14 14:49:55.288846 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1189/2455] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:54 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:55.706271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:55.729814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30cbc28c-bc32-46d5-89ce-59ac39a2943f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 0.619162 Jul 14 14:49:55.737538 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1267/2456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:55 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:55.886680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:55.887801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:55.905796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.921895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:55.923191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:55.925430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:56.094133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05fe45ef-060a-4bbd-a734-2b5ac606ca59 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2357430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:56.194167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05fe45ef-060a-4bbd-a734-2b5ac606ca59 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.104595 Jul 14 14:49:56.203378 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1268/2457] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:56 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:56.291750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:56.292488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:56.318945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:56.319835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:56.327607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:56.328633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:56.676769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:56.690149 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-730439ce-7bb3-44ab-b27a-5d75fb2a82d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.406413 Jul 14 14:49:56.691864 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1269/2458] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:56 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:56.707631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ac099932-83c7-4cf7-8e24-ceb4c763b2ab req-f712b248-ce4a-41c9-ba13-20d9192c0b67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "name": "network-vif-plugged", "status": "completed", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}, {"server_uuid": "30d72422-22aa-416d-891f-82117e2108f7", "name": "network-vif-plugged", "status": "completed", "tag": "b12379d4-5bbc-4f1c-bee8-25041259ca74"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:56.719650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ac099932-83c7-4cf7-8e24-ceb4c763b2ab req-f712b248-ce4a-41c9-ba13-20d9192c0b67 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:56.720911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ac099932-83c7-4cf7-8e24-ceb4c763b2ab req-f712b248-ce4a-41c9-ba13-20d9192c0b67 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:56.767518 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ac099932-83c7-4cf7-8e24-ceb4c763b2ab req-f712b248-ce4a-41c9-ba13-20d9192c0b67 service nova] Creating event network-vif-plugged:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:49:56.768223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ac099932-83c7-4cf7-8e24-ceb4c763b2ab req-f712b248-ce4a-41c9-ba13-20d9192c0b67 service nova] Creating event network-vif-plugged:b12379d4-5bbc-4f1c-bee8-25041259ca74 for instance 30d72422-22aa-416d-891f-82117e2108f7 on n-h1-768852-23 Jul 14 14:49:56.792176 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ac099932-83c7-4cf7-8e24-ceb4c763b2ab req-f712b248-ce4a-41c9-ba13-20d9192c0b67 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.088514 Jul 14 14:49:56.792847 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1270/2459] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:56.815312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:56.816632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:56.834509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:56.834982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:56.838591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:56.839051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.583527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:57.608673 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce784561-3a62-48a4-950c-0d36f5275e3f tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1307 microversion: 2.1 time: 0.814014 Jul 14 14:49:57.609782 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1271/2460] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:56 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1307 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:57.629938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-755c3828-07ae-4695-9b82-58b0ffdf4e63 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf33f89d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:57.676557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:57.739732 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99e24dd5-8c74-4a3e-945d-5549c9e54dbf tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1327 microversion: 2.1 time: 1.855383 Jul 14 14:49:57.742736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1190/2461] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:55 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1327 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:57.769027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:57.770170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:57.819664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.825634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.827462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:57.828279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:57.832409 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-755c3828-07ae-4695-9b82-58b0ffdf4e63 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.213858 Jul 14 14:49:57.833490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1272/2462] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:57 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:58.522188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:58.550723 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-669bf59a-753a-44d7-9a41-fbcbbbf418ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 0.801285 Jul 14 14:49:58.566526 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1191/2463] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:57 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:58.630061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:58.652068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:58.677139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:58.677657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:58.678701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:58.679776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:58.765699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:58.767025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:58.781958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:58.783734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:58.787945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:58.789396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.323140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:59.340978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0bf555c-a00d-485e-a60f-13557eb455f7 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1527 microversion: 2.1 time: 0.584296 Jul 14 14:49:59.342185 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1192/2464] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:58 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1527 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:59.374048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b5c64ff9-212d-4c47-9365-1c75c1590253 req-73b72331-481f-461d-aca1-64a8f5de39a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a29ece-d239-4899-aa1b-85f8151eb874", "name": "network-vif-plugged", "status": "completed", "tag": "2094fac7-8553-4153-abaa-974a33ab82cf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:59.408743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b5c64ff9-212d-4c47-9365-1c75c1590253 req-73b72331-481f-461d-aca1-64a8f5de39a9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.409887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b5c64ff9-212d-4c47-9365-1c75c1590253 req-73b72331-481f-461d-aca1-64a8f5de39a9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.454188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:49:59.476991 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b5c64ff9-212d-4c47-9365-1c75c1590253 req-73b72331-481f-461d-aca1-64a8f5de39a9 service nova] Creating event network-vif-plugged:2094fac7-8553-4153-abaa-974a33ab82cf for instance 81a29ece-d239-4899-aa1b-85f8151eb874 on n-h2-768852-23 Jul 14 14:49:59.487114 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38e2b89c-9de5-4451-9860-26d49e6f8575 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1488 microversion: 2.1 time: 0.862882 Jul 14 14:49:59.488540 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1273/2465] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:58 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1488 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:59.493035 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b5c64ff9-212d-4c47-9365-1c75c1590253 req-73b72331-481f-461d-aca1-64a8f5de39a9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136214 Jul 14 14:49:59.498036 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1193/2466] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:49:59.521486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:59.522352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e35cbc91-c9ff-4a49-90bc-f0d925b608c3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc0428ee50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:49:59.525527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:59.546138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.547955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.551084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.560730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.669447 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e35cbc91-c9ff-4a49-90bc-f0d925b608c3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.179159 Jul 14 14:49:59.671984 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1274/2467] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:49:59 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:49:59.687185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1093027666"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:49:59.693317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:49:59.725528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.727747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:49:59.730948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:49:59.734992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:00.872523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:00.905236 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7db6cfe-77ce-4bf1-a03c-b5830a4cba5a tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "POST /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7/action" status: 202 len: 0 microversion: 2.1 time: 1.229878 Jul 14 14:50:00.907563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1275/2468] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:49:59 2022] POST /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7/action => generated 0 bytes in 1234 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:50:00.915671 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8a7ba59-b9c2-4336-b458-e1dc626b2d05 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1527 microversion: 2.1 time: 1.414489 Jul 14 14:50:00.919169 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1194/2469] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:49:59 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1527 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:00.958518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:00.960244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:00.972272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f0ba3261-7fb5-448e-a660-80b79c9e2465 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a53dc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:00.978735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:00.980759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:00.984054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:00.986735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:01.164310 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f0ba3261-7fb5-448e-a660-80b79c9e2465 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.235511 Jul 14 14:50:01.173138 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1195/2470] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:00 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:01.224407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf4a752a-3323-4b5c-960c-41df80bada4c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf3825d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:01.393740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf4a752a-3323-4b5c-960c-41df80bada4c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1" status: 200 len: 1412 microversion: 2.1 time: 0.215321 Jul 14 14:50:01.395361 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1196/2471] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:01 2022] GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 => generated 1412 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:02.140278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:02.141040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:02.156362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.158451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.161595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.162684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.216267 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] HTTP exception thrown: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Request method failure captured: Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 HTTP/1.1 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzuNBWckimQQtIRbrNtaN-dxBWFMcT7Q5l0ZD_LSiDtJUHTBnXkaOJ5AKxV9I9FRhK8afsqpAbFXIG06png8kXmFzpHC2NaEbv7ESmWlBgmuF--BLwtcAvZcuG5uiufvM_Mxk4k_tS6jHZztjKpYRWHjo17IxrFgaMArxZb494q4MY Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 68dbc7aaa5704a53b305a1d1c2f406fd Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-729649219 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-729649219 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 68dbc7aaa5704a53b305a1d1c2f406fd Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-729649219 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestMultiTenantJSON-729649219-project Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 73d4f50dad7f4217806d7a9229dd5868 Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-729649219-project Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '8bc98e3c-1a42-4d76-9ee4-8fcab7c28249'} Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:02.224749 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:02.235254 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:02.241632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Returning 404 to user: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:02.246508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e94ee6d-4338-440d-ad68-cf886c6cd144 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 404 len: 111 microversion: 2.1 time: 0.847468 Jul 14 14:50:02.249070 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1197/2472] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:01 2022] DELETE /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 111 bytes in 853 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:02.271151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86e1b595-d1e7-4b85-aaec-6fdaffd1aaa3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf31b6ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:02.401523 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-86e1b595-d1e7-4b85-aaec-6fdaffd1aaa3 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1" status: 200 len: 1412 microversion: 2.1 time: 0.146830 Jul 14 14:50:02.402294 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1198/2473] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:02 2022] GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 => generated 1412 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:02.422772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05cbb98f-fd0c-4b32-b2b3-4d5f979f1e82 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf31e1ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:02.576093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:02.592329 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7a75cd1-5bc1-45ab-bb1d-8b50d8e98825 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1313 microversion: 2.1 time: 1.678465 Jul 14 14:50:02.594478 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1276/2474] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:00 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1313 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:02.606425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:02.613504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:02.635738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.635990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05cbb98f-fd0c-4b32-b2b3-4d5f979f1e82 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.231901 Jul 14 14:50:02.636747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.637741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:02.638370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:02.653681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1199/2475] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:02 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:02.656224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05cbb98f-fd0c-4b32-b2b3-4d5f979f1e82 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:02.667777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05cbb98f-fd0c-4b32-b2b3-4d5f979f1e82 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute//" status: 200 len: 377 microversion: - time: 0.010454 Jul 14 14:50:02.670247 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1200/2476] 10.222.0.98 () {56 vars in 885 bytes} [Thu Jul 14 14:50:02 2022] GET /compute/ => generated 377 bytes in 15 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:50:02.695146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45240b33-d23e-4bec-9e8d-66b57c6025a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf31b69d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:03.253009 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45240b33-d23e-4bec-9e8d-66b57c6025a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1" status: 204 len: 0 microversion: 2.1 time: 0.580310 Jul 14 14:50:03.255191 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1201/2477] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:02 2022] DELETE /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:03.257034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45240b33-d23e-4bec-9e8d-66b57c6025a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:03.258566 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45240b33-d23e-4bec-9e8d-66b57c6025a0 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002210 Jul 14 14:50:03.259942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1202/2478] 10.222.0.98 () {54 vars in 1034 bytes} [Thu Jul 14 14:50:03 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Jul 14 14:50:03.392464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:03.415699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1527 microversion: 2.1 time: 0.816400 Jul 14 14:50:03.438540 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1277/2479] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:02 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1527 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:03.440554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:03.442954 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6836f88-924a-4ff2-a26e-71aba4ba63e8 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002704 Jul 14 14:50:03.451432 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1278/2480] 10.222.0.98 () {54 vars in 1040 bytes} [Thu Jul 14 14:50:03 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:03.451432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Action: 'update', calling method: >, body: {"server": {"name": "8bc98e3c-1a42-4d76-9ee4-8fcab7c28249_new"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:03.451432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:03.463224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:03.463713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:03.465885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:03.466081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:03.495774 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] HTTP exception thrown: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Request method failure captured: Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: request: PUT /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 HTTP/1.1 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 64 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CzuNBWckimQQtIRbrNtaN-dxBWFMcT7Q5l0ZD_LSiDtJUHTBnXkaOJ5AKxV9I9FRhK8afsqpAbFXIG06png8kXmFzpHC2NaEbv7ESmWlBgmuF--BLwtcAvZcuG5uiufvM_Mxk4k_tS6jHZztjKpYRWHjo17IxrFgaMArxZb494q4MY Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 68dbc7aaa5704a53b305a1d1c2f406fd Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-729649219 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/68dbc7aaa5704a53b305a1d1c2f406fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-729649219 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 68dbc7aaa5704a53b305a1d1c2f406fd Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-729649219 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestMultiTenantJSON-729649219-project Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 73d4f50dad7f4217806d7a9229dd5868 Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-729649219-project Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "8bc98e3c-1a42-4d76-9ee4-8fcab7c28249_new"}} Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '8bc98e3c-1a42-4d76-9ee4-8fcab7c28249', 'body': {'server': {'name': '8bc98e3c-1a42-4d76-9ee4-8fcab7c28249_new'}}} Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 14:50:03.497920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 917, in update Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:03.502737 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:03.505589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Returning 404 to user: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:03.506731 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] 10.222.0.98 "PUT /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 404 len: 111 microversion: 2.1 time: 0.061752 Jul 14 14:50:03.507567 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1279/2481] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 14:50:03 2022] PUT /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:03.516146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:03.518402 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b9ab28b-4481-4cc6-9eb1-32681f995c23 tempest-ServersNegativeTestMultiTenantJSON-729649219 tempest-ServersNegativeTestMultiTenantJSON-729649219-project] 10.222.0.98 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001839 Jul 14 14:50:03.519305 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1280/2482] 10.222.0.98 () {56 vars in 885 bytes} [Thu Jul 14 14:50:03 2022] GET /compute/ => generated 377 bytes in 5 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Jul 14 14:50:03.526213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:03.528469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:03.563181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:03.564677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:03.566423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:03.567216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:03.708374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:03.950679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:04.138948 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-17a186c8-7efc-4d45-a6ec-4c418871cd0b tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "DELETE /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 204 len: 0 microversion: 2.1 time: 0.616190 Jul 14 14:50:04.142545 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1281/2483] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:03 2022] DELETE /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:04.161377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:04.166249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:04.201786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.207408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.214395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.218434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.387124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cb3bae76-2741-4c1c-a788-5ad3a1a29ece tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2ad0160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:04.510872 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-cb3bae76-2741-4c1c-a788-5ad3a1a29ece tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Image not found. Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cb3bae76-2741-4c1c-a788-5ad3a1a29ece tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 HTTP/1.1 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9011aab4-094b-426f-8bda-0bc62592f0a1'} Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 9011aab4-094b-426f-8bda-0bc62592f0a1 Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:50:04.514954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9011aab4-094b-426f-8bda-0bc62592f0a1 could not be found. Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cb3bae76-2741-4c1c-a788-5ad3a1a29ece tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cb3bae76-2741-4c1c-a788-5ad3a1a29ece tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1" status: 404 len: 62 microversion: 2.1 time: 1.255967 Jul 14 14:50:04.530304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1203/2484] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:03 2022] GET /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 => generated 62 bytes in 1265 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:50:04.563714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85c2c71b-aa06-43ba-8d8f-28007cb73645 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2ad03a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:04.701283 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-85c2c71b-aa06-43ba-8d8f-28007cb73645 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.166251 Jul 14 14:50:04.703085 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1204/2485] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:04 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:04.717388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:04.718053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:04.738080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:04.739722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.740202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.740987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.741431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.874563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:04.911297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d058f8f8-9daf-4f3c-b19b-d542d1f64dfb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1463 microversion: 2.1 time: 0.766298 Jul 14 14:50:04.913325 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1282/2486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:04 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1463 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:04.937413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:04.943457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:04.974027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.974470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:04.977483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:04.978772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:05.568073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:05.594468 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0d994b42-d8fc-4b10-a418-2f5313e93373 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1506 microversion: 2.1 time: 0.672176 Jul 14 14:50:05.598904 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1283/2487] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:04 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:05.618449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:05.624235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:05.651454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:05.655255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:05.661920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:05.663332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:06.093127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:06.122358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:50:06.165922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:06.166141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:06.167735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:06.168519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:06.169287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:06.714459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-527f8ce2-1479-4f37-a123-f3af8c845a79 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874/action" status: 202 len: 0 microversion: 2.1 time: 1.107567 Jul 14 14:50:06.729263 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1284/2488] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:50:05 2022] POST /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874/action => generated 0 bytes in 1126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:50:06.767370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b4fdfb51-2011-49f2-9c23-c157b249792e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf3161dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:06.933984 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b4fdfb51-2011-49f2-9c23-c157b249792e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.199030 Jul 14 14:50:06.945097 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1285/2489] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:06 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:06.946475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:06.947128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:06.969098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:06.971250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:06.972130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:06.972640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.312564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:07.355731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c124639c-d709-4b37-9d5a-ca88cc69f200 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1533 microversion: 2.1 time: 2.650274 Jul 14 14:50:07.357525 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1205/2490] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:04 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1533 bytes in 2653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:07.378935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:07.385255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:07.416605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.417399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:07.419726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:07.420856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:08.088567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:08.116916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f75a689-0191-455d-bc8f-ea02314eb44c tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1488 microversion: 2.1 time: 1.177611 Jul 14 14:50:08.127576 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1286/2491] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:06 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1488 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:08.173627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3a40cfe-8a8b-46bb-8fd1-e5778d0c5aeb tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf233f4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:08.321962 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3a40cfe-8a8b-46bb-8fd1-e5778d0c5aeb tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.192312 Jul 14 14:50:08.323859 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1287/2492] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:08 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:08.370621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:08.376071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:08.428391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:08.432265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:08.440711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:08.442853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:08.559356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:08.907547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:09.007195 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44434be4-f2da-41d7-ad9d-8f7ab91262b5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1472 microversion: 2.1 time: 1.646621 Jul 14 14:50:09.007860 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1206/2493] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:07 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1472 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:09.072411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:09.095465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:09.130534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.131199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.132210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.137999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.148022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:09.192633 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-72a6d34f-2d56-4011-b161-956f7ef8158b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 204 len: 0 microversion: 2.1 time: 0.853041 Jul 14 14:50:09.205899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1288/2494] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:08 2022] DELETE /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:09.220007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60aa7551-220b-405e-b339-ced5d34e19b6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf2378280>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:09.296885 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-60aa7551-220b-405e-b339-ced5d34e19b6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Image not found. Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60aa7551-220b-405e-b339-ced5d34e19b6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 HTTP/1.1 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9011aab4-094b-426f-8bda-0bc62592f0a1'} Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9011aab4-094b-426f-8bda-0bc62592f0a1 to delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9011aab4-094b-426f-8bda-0bc62592f0a1 could not be found. Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.299836 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:50:09.305008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:09.309695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60aa7551-220b-405e-b339-ced5d34e19b6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:09.310832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60aa7551-220b-405e-b339-ced5d34e19b6 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1" status: 404 len: 62 microversion: 2.1 time: 0.097918 Jul 14 14:50:09.316274 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1289/2495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:09 2022] DELETE /compute/v2.1/images/9011aab4-094b-426f-8bda-0bc62592f0a1 => generated 62 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:50:09.327922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:09.329328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:09.341104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.342228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.344217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.345380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.420738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:09.559052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.compute.api [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Instance is already in deleting state, ignoring this request Jul 14 14:50:09.561297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0769531b-7b6b-4239-adfe-8546fde9eb5b tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 204 len: 0 microversion: 2.1 time: 0.243525 Jul 14 14:50:09.570529 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1290/2496] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:09 2022] DELETE /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:09.580354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d1a9443-c00f-4915-a849-c31c84219e4c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf22c5af0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:09.673129 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d1a9443-c00f-4915-a849-c31c84219e4c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.101119 Jul 14 14:50:09.675134 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1291/2497] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:09 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:09.685196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:09.685839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:09.704967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.705446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.706292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:09.706740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:09.801259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:09.810180 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4d7ea11-fd0f-4313-aeb9-63cf328ef072 tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1533 microversion: 2.1 time: 0.766580 Jul 14 14:50:09.819626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1207/2498] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:09 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1533 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:10.025900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:10.026590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:10.048872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.059031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:10.067859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.072668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:10.410214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:10.459690 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df4293b7-fc44-4e55-b8b3-ffc06d95029e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1494 microversion: 2.1 time: 0.776209 Jul 14 14:50:10.476096 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1292/2499] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:09 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1494 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:10.594122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5f05a337-5396-4507-915e-263f0e06b0f0 req-d7567fc3-23bc-485b-9267-d91e6663ad6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bc98e3c-1a42-4d76-9ee4-8fcab7c28249", "name": "network-vif-deleted", "tag": "63a6b850-49a5-4849-9453-a0dd3b31740f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:10.638186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5f05a337-5396-4507-915e-263f0e06b0f0 req-d7567fc3-23bc-485b-9267-d91e6663ad6e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:10.640099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5f05a337-5396-4507-915e-263f0e06b0f0 req-d7567fc3-23bc-485b-9267-d91e6663ad6e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:10.688432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5f05a337-5396-4507-915e-263f0e06b0f0 req-d7567fc3-23bc-485b-9267-d91e6663ad6e service nova] Creating event network-vif-deleted:63a6b850-49a5-4849-9453-a0dd3b31740f for instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 on n-h1-768852-23 Jul 14 14:50:10.706809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5f05a337-5396-4507-915e-263f0e06b0f0 req-d7567fc3-23bc-485b-9267-d91e6663ad6e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116405 Jul 14 14:50:10.710323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1293/2500] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:10.730150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-97af6413-6695-47ab-bfd0-b12d8b99c516 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf22c5700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:10.990578 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-97af6413-6695-47ab-bfd0-b12d8b99c516 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.269602 Jul 14 14:50:11.005128 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1294/2501] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:10 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:11.018016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b989f0c2-f8fd-496c-b6fc-b2b883552eaa req-463ba402-b56f-42f1-999d-c3ef54db2cb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d72422-22aa-416d-891f-82117e2108f7", "name": "network-vif-plugged", "status": "completed", "tag": "b12379d4-5bbc-4f1c-bee8-25041259ca74"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:11.062695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b989f0c2-f8fd-496c-b6fc-b2b883552eaa req-463ba402-b56f-42f1-999d-c3ef54db2cb2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.075359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b989f0c2-f8fd-496c-b6fc-b2b883552eaa req-463ba402-b56f-42f1-999d-c3ef54db2cb2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.102811 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b989f0c2-f8fd-496c-b6fc-b2b883552eaa req-463ba402-b56f-42f1-999d-c3ef54db2cb2 service nova] Creating event network-vif-plugged:b12379d4-5bbc-4f1c-bee8-25041259ca74 for instance 30d72422-22aa-416d-891f-82117e2108f7 on n-h1-768852-23 Jul 14 14:50:11.153953 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b989f0c2-f8fd-496c-b6fc-b2b883552eaa req-463ba402-b56f-42f1-999d-c3ef54db2cb2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148535 Jul 14 14:50:11.156539 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1295/2502] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:11.182080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:11.192945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:11.212527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.217413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.223071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.227795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.377753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.381493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.385333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lazy-loading 'fault' on Instance uuid 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:50:11.777901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a05fac57c00245d8965ed40f144b27e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4a6f1fb6e554564b4ee3c6586646b17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:11.788360 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-192296ab-3513-43ab-af45-c8ade4f3b75f tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 200 len: 1317 microversion: 2.1 time: 0.629471 Jul 14 14:50:11.797822 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1296/2503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:11 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:11.813356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:11.814575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:11.870351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.870793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:11.885348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:11.892607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:12.128924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:12.143552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e168162-5a80-44c6-b18d-04db53813e89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1472 microversion: 2.1 time: 2.122237 Jul 14 14:50:12.149255 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1208/2504] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:10 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1472 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:12.155070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc256180-9f86-41c1-b8bd-039b2ee28193 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf38831f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:12.412771 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc256180-9f86-41c1-b8bd-039b2ee28193 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.261641 Jul 14 14:50:12.413400 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1209/2505] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:12 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:12.604707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:12.618804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5274065-047b-4ac5-a32a-0d8ea90c785e tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1494 microversion: 2.1 time: 0.819668 Jul 14 14:50:12.620634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1297/2506] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:11 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1494 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:12.816858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:12.817810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] [instance: 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:12.841803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:12.842268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:12.843188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:12.843669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:12.946028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] HTTP exception thrown: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Request method failure captured: Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 HTTP/1.1 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CzW10yMKb230CAJNrTDnDq7nxIvcqMDgmTlwOBGYYoxIGbgaiY37w4__IWcZC6MVk4iSUvgdnbsO46gDOYba4Uf6LZvDki_5wsDI_iRo7LxrswZ17TLTBhYpFLtQHqvJN91A1p-LU8irmhhOtgbJp_7A0iIxMSpsA58YvmocDGyPHE Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e4a6f1fb6e554564b4ee3c6586646b17 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-471315059 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4a6f1fb6e554564b4ee3c6586646b17"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e4a6f1fb6e554564b4ee3c6586646b17"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4a6f1fb6e554564b4ee3c6586646b17"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e4a6f1fb6e554564b4ee3c6586646b17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-471315059 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e4a6f1fb6e554564b4ee3c6586646b17 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-471315059 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestMultiTenantJSON-471315059-project Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a05fac57c00245d8965ed40f144b27e9 Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-471315059-project Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '8bc98e3c-1a42-4d76-9ee4-8fcab7c28249'} Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:12.947773 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] Returning 404 to user: Instance 8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8c7aa315-6ee6-4198-98ee-e1bc50dc788e tempest-ServersNegativeTestMultiTenantJSON-471315059 tempest-ServersNegativeTestMultiTenantJSON-471315059-project] 10.222.0.98 "GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249" status: 404 len: 111 microversion: 2.1 time: 0.138142 Jul 14 14:50:12.952586 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1210/2507] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:12 2022] GET /compute/v2.1/servers/8bc98e3c-1a42-4d76-9ee4-8fcab7c28249 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:50:13.172713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:13.174786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:13.194217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.196026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.201957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:13.206557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:13.427470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-59111bed-1ccd-499c-9040-6551a316f55f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2ba15e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:13.564634 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-59111bed-1ccd-499c-9040-6551a316f55f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.140728 Jul 14 14:50:13.565905 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1211/2508] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:13 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:13.949934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:13.983830 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8282f6a3-18b5-49c9-b4e8-9c3b373c9b7f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1472 microversion: 2.1 time: 0.814077 Jul 14 14:50:13.990280 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1298/2509] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:13 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1472 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:14.217111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-892489225", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e7e64f1b-6e91-453d-83c0-e77e70b58838"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:14.249353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c3d6afd-d782-460b-9be5-78f21fcade08 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2081981909", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:14.255460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:14.257909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0c3d6afd-d782-460b-9be5-78f21fcade08 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] HTTP exception thrown: min_count must be <= max_count Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c3d6afd-d782-460b-9be5-78f21fcade08 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Request method failure captured: Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 184 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C0kXdtIXN6kWBtllgKw0uZYFMEuDA06wQfLrANQhg1ceQqnyZfSEDxjzLc11NYo5JNxNL1ruKGydSta0n2N8KTXd2a3gwhcjgcnyTOA1vUwMSrdEAWgro_NdYyDbwoWUk06jRyrZcT1XECJHKNMosjK-pNjCGOVxN_6-eiWwun8g8E Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f520518ffcc94715b63f06b2711cab51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 4fb9f90ead624da1bbed75cd6215183e Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2081981909", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 3, "max_count": 2}} Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: exception: min_count must be <= max_count Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2081981909', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 728, in create Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Jul 14 14:50:14.265029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:14.280549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c3d6afd-d782-460b-9be5-78f21fcade08 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Returning 400 to user: min_count must be <= max_count {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:14.286345 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c3d6afd-d782-460b-9be5-78f21fcade08 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.710722 Jul 14 14:50:14.316338 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1212/2510] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:13 2022] POST /compute/v2.1/servers => generated 74 bytes in 724 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 14:50:14.341001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:14.342149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:14.377467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:14.378281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:14.384700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:14.385492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:14.420119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] validate_networks() for [('e7e64f1b-6e91-453d-83c0-e77e70b58838', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:15.629233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '331a222a893c4f84a08abf11333c7449', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52b2ada3fd2842f0a04fdedaf4bd908e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:15.639867 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b47a3302-b08d-4f95-b725-32221c4a7569 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 200 len: 1452 microversion: 2.1 time: 1.320888 Jul 14 14:50:15.641234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1213/2511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:14 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 1452 bytes in 1324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:15.669841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9e044e3-5ffd-470f-9e64-a0edf34d9317 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1469033519", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "max_count": 0}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9e044e3-5ffd-470f-9e64-a0edf34d9317 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Request method failure captured: Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 168 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C0kXdtIXN6kWBtllgKw0uZYFMEuDA06wQfLrANQhg1ceQqnyZfSEDxjzLc11NYo5JNxNL1ruKGydSta0n2N8KTXd2a3gwhcjgcnyTOA1vUwMSrdEAWgro_NdYyDbwoWUk06jRyrZcT1XECJHKNMosjK-pNjCGOVxN_6-eiWwun8g8E Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f520518ffcc94715b63f06b2711cab51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 4fb9f90ead624da1bbed75cd6215183e Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1469033519", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "max_count": 0}} Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1469033519', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'max_count': 0}}} Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 0 Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:50:15.674266 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:50:15.678561 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:15.681672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9e044e3-5ffd-470f-9e64-a0edf34d9317 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:15.682847 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b9e044e3-5ffd-470f-9e64-a0edf34d9317 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.039724 Jul 14 14:50:15.684045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1214/2512] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:15 2022] POST /compute/v2.1/servers => generated 130 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:15.690996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-02bf4526-3495-4e7b-a478-c9b1347fb0b5 req-2c4ca595-2758-4a97-a9ab-36b21a51704c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "30d72422-22aa-416d-891f-82117e2108f7", "name": "network-vif-deleted", "tag": "b12379d4-5bbc-4f1c-bee8-25041259ca74"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:15.717531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-02bf4526-3495-4e7b-a478-c9b1347fb0b5 req-2c4ca595-2758-4a97-a9ab-36b21a51704c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:15.722643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-02bf4526-3495-4e7b-a478-c9b1347fb0b5 req-2c4ca595-2758-4a97-a9ab-36b21a51704c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:15.753677 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-02bf4526-3495-4e7b-a478-c9b1347fb0b5 req-2c4ca595-2758-4a97-a9ab-36b21a51704c service nova] Creating event network-vif-deleted:b12379d4-5bbc-4f1c-bee8-25041259ca74 for instance 30d72422-22aa-416d-891f-82117e2108f7 on n-h1-768852-23 Jul 14 14:50:15.768147 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-02bf4526-3495-4e7b-a478-c9b1347fb0b5 req-2c4ca595-2758-4a97-a9ab-36b21a51704c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080251 Jul 14 14:50:15.771808 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1215/2513] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:15.781997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc5f0100-599b-429b-b1a7-b7729ea3ab36 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2ba18b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:15.949801 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc5f0100-599b-429b-b1a7-b7729ea3ab36 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.176278 Jul 14 14:50:15.950560 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1216/2514] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:15 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:15.960932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:15.961861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:15.978699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:15.979440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:15.980377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:15.981027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.048876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:16.050829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:16.051627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:16.052277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:16.052989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:16.080298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:16.083862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.085955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:16.089417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.140659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for project f30b8cc1b9254cca90487359e0872a93. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:16.154794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for user a7edefb2896948e39ac7aed5a3884233 and project f30b8cc1b9254cca90487359e0872a93. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:16.181381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:16.185313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:16.311882 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ceb58bab-3b8c-4d69-b644-1a767586a4e8 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.312099 Jul 14 14:50:16.321426 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1299/2515] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:50:16.334157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b0f6c4e-fbb7-43f5-93ce-327060894f4a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1611767297", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "max_count": 2.5}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b0f6c4e-fbb7-43f5-93ce-327060894f4a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Request method failure captured: Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 170 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kXdtIXN6kWBtllgKw0uZYFMEuDA06wQfLrANQhg1ceQqnyZfSEDxjzLc11NYo5JNxNL1ruKGydSta0n2N8KTXd2a3gwhcjgcnyTOA1vUwMSrdEAWgro_NdYyDbwoWUk06jRyrZcT1XECJHKNMosjK-pNjCGOVxN_6-eiWwun8g8E Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f520518ffcc94715b63f06b2711cab51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4fb9f90ead624da1bbed75cd6215183e Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1611767297", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "max_count": 2.5}} Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1611767297', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'max_count': 2.5}}} Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 2.5 Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:50:16.349730 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b0f6c4e-fbb7-43f5-93ce-327060894f4a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:16.358088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b0f6c4e-fbb7-43f5-93ce-327060894f4a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.033942 Jul 14 14:50:16.369914 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1300/2516] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:16 2022] POST /compute/v2.1/servers => generated 139 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:16.382026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e058d86-9fb2-47e1-9ea9-306fbdfa18e9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:16.401030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e058d86-9fb2-47e1-9ea9-306fbdfa18e9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:16.560737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e058d86-9fb2-47e1-9ea9-306fbdfa18e9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:16.573426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e058d86-9fb2-47e1-9ea9-306fbdfa18e9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1224 microversion: 2.1 time: 0.202267 Jul 14 14:50:16.582371 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1301/2517] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:16 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1224 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:16.603704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a2d35b3-77ec-4cab-b818-c9e98dd8e42a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2141114023", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 0}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a2d35b3-77ec-4cab-b818-c9e98dd8e42a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Request method failure captured: Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 168 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kXdtIXN6kWBtllgKw0uZYFMEuDA06wQfLrANQhg1ceQqnyZfSEDxjzLc11NYo5JNxNL1ruKGydSta0n2N8KTXd2a3gwhcjgcnyTOA1vUwMSrdEAWgro_NdYyDbwoWUk06jRyrZcT1XECJHKNMosjK-pNjCGOVxN_6-eiWwun8g8E Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f520518ffcc94715b63f06b2711cab51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4fb9f90ead624da1bbed75cd6215183e Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-2141114023", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 0}} Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-2141114023', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'min_count': 0}}} Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 0 Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:50:16.609559 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a2d35b3-77ec-4cab-b818-c9e98dd8e42a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:16.615649 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a2d35b3-77ec-4cab-b818-c9e98dd8e42a tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.022444 Jul 14 14:50:16.627493 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1302/2518] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:16 2022] POST /compute/v2.1/servers => generated 130 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:16.659565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:16.660934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 30d72422-22aa-416d-891f-82117e2108f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:16.695069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:16.701925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.703063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:16.703550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:16.740043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 30d72422-22aa-416d-891f-82117e2108f7 could not be found. Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 HTTP/1.1 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 30d72422-22aa-416d-891f-82117e2108f7 could not be found. Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '30d72422-22aa-416d-891f-82117e2108f7'} Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 30d72422-22aa-416d-891f-82117e2108f7 could not be found. Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 30d72422-22aa-416d-891f-82117e2108f7 could not be found. Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.746571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.752980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.752980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.752980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:16.752980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:16.752980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 30d72422-22aa-416d-891f-82117e2108f7 could not be found. Jul 14 14:50:16.752980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.763622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 30d72422-22aa-416d-891f-82117e2108f7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:16.772512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4bae28dc-2916-4efe-9670-4ca022879a05 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7" status: 404 len: 111 microversion: 2.1 time: 0.114408 Jul 14 14:50:16.779085 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1303/2519] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:16 2022] GET /compute/v2.1/servers/30d72422-22aa-416d-891f-82117e2108f7 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:50:16.795547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cd79f83-b6e5-4697-9dd5-8d9d97e58123 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-193201682", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 2.5}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cd79f83-b6e5-4697-9dd5-8d9d97e58123 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Request method failure captured: Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 169 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kXdtIXN6kWBtllgKw0uZYFMEuDA06wQfLrANQhg1ceQqnyZfSEDxjzLc11NYo5JNxNL1ruKGydSta0n2N8KTXd2a3gwhcjgcnyTOA1vUwMSrdEAWgro_NdYyDbwoWUk06jRyrZcT1XECJHKNMosjK-pNjCGOVxN_6-eiWwun8g8E Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f520518ffcc94715b63f06b2711cab51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f520518ffcc94715b63f06b2711cab51"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f520518ffcc94715b63f06b2711cab51 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1957773434 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4fb9f90ead624da1bbed75cd6215183e Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1957773434-project Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-193201682", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "min_count": 2.5}} Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-193201682', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'min_count': 2.5}}} Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'minLength': 1, Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'minimum': 1, Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 2.5 Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:50:16.814358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Jul 14 14:50:16.818257 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.837441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cd79f83-b6e5-4697-9dd5-8d9d97e58123 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:16.840152 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2cd79f83-b6e5-4697-9dd5-8d9d97e58123 tempest-MultipleCreateNegativeTestJSON-1957773434 tempest-MultipleCreateNegativeTestJSON-1957773434-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.059475 Jul 14 14:50:16.841632 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1304/2520] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:16 2022] POST /compute/v2.1/servers => generated 139 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:16.864207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-021f4318-29e7-48e4-88e6-93ebfaeb0a13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf23781f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:16.957429 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-021f4318-29e7-48e4-88e6-93ebfaeb0a13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Image not found. Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-021f4318-29e7-48e4-88e6-93ebfaeb0a13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae HTTP/1.1 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2ef0c651-8f20-41cc-adbf-60e8d9fc16ae'} Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2ef0c651-8f20-41cc-adbf-60e8d9fc16ae to delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2ef0c651-8f20-41cc-adbf-60e8d9fc16ae could not be found. Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.962115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:50:16.967014 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:16.971260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-021f4318-29e7-48e4-88e6-93ebfaeb0a13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:16.972870 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-021f4318-29e7-48e4-88e6-93ebfaeb0a13 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae" status: 404 len: 62 microversion: 2.1 time: 0.120541 Jul 14 14:50:16.973647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1305/2521] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:16 2022] DELETE /compute/v2.1/images/2ef0c651-8f20-41cc-adbf-60e8d9fc16ae => generated 62 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:50:16.995880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d31da9bf-679b-4620-8e0f-b50512fcc2a2 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2209d30>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.209364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d31da9bf-679b-4620-8e0f-b50512fcc2a2 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.234182 Jul 14 14:50:17.213878 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1306/2522] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:16 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:17.235344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.236449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.272382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.272860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.273821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.274233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.359549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:17.381197 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad HTTP/1.1 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2cfb9636-0d3e-44b4-be23-c29a77a2a8ad'} Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:17.388278 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.393356 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.398069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:17.401475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2946818-d4b4-45fc-8659-7068bc7a17a5 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 404 len: 111 microversion: 2.1 time: 0.186342 Jul 14 14:50:17.407448 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1307/2523] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:17 2022] DELETE /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:17.422493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.428664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.453657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.454509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.455713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.456379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.514774 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad HTTP/1.1 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2cfb9636-0d3e-44b4-be23-c29a77a2a8ad'} Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.525601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.530527 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.530527 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.530527 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:17.530527 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:17.530527 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. Jul 14 14:50:17.530527 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.532115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 2cfb9636-0d3e-44b4-be23-c29a77a2a8ad could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:17.533570 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd775030-e5c4-4011-8c75-e986aa294063 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad" status: 404 len: 111 microversion: 2.1 time: 0.122455 Jul 14 14:50:17.551582 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1308/2524] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:17 2022] GET /compute/v2.1/servers/2cfb9636-0d3e-44b4-be23-c29a77a2a8ad => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:17.563569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-773d0e26-efda-47f2-9cc0-eb9b5582fc40 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdc04216c10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.584994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:17.597241 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c690a9a-842e-4475-847a-010d3efdd1f3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1472 microversion: 2.1 time: 1.645493 Jul 14 14:50:17.617754 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1217/2525] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:15 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1472 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:17.617754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.617754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.631325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.632424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.633857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.636369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.665364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-773d0e26-efda-47f2-9cc0-eb9b5582fc40 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Image not found. Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-773d0e26-efda-47f2-9cc0-eb9b5582fc40 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 HTTP/1.1 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'eb1854bf-0db4-4564-bf74-57f4d4fccca9'} Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image eb1854bf-0db4-4564-bf74-57f4d4fccca9 to delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image eb1854bf-0db4-4564-bf74-57f4d4fccca9 could not be found. Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.667169 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-773d0e26-efda-47f2-9cc0-eb9b5582fc40 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-773d0e26-efda-47f2-9cc0-eb9b5582fc40 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9" status: 404 len: 62 microversion: 2.1 time: 0.115215 Jul 14 14:50:17.680957 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1309/2526] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:17 2022] DELETE /compute/v2.1/images/eb1854bf-0db4-4564-bf74-57f4d4fccca9 => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:50:17.688259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.688259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.739991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.750066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.750980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.752009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.822697 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca HTTP/1.1 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '225f3940-0dbc-41c1-bf0b-9043e402e6ca'} Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:17.825336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:17.833451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:17.842106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:17.842106 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52ff8903-f2f2-4715-b557-69a43def3219 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 404 len: 111 microversion: 2.1 time: 0.159439 Jul 14 14:50:17.842106 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1310/2527] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:17 2022] DELETE /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:50:17.871005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:17.876491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 225f3940-0dbc-41c1-bf0b-9043e402e6ca] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:17.931903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.934621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.939263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:17.941368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:17.988124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:18.019565 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-110d37a5-efec-4b50-9a55-1224789b11a9 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1228 microversion: 2.1 time: 0.399802 Jul 14 14:50:18.035313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1218/2528] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:17 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1228 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:18.035784 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca HTTP/1.1 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '225f3940-0dbc-41c1-bf0b-9043e402e6ca'} Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.043812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 225f3940-0dbc-41c1-bf0b-9043e402e6ca could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61e1d163-6ffb-459d-a375-3efc48bbcdaa tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca" status: 404 len: 111 microversion: 2.1 time: 0.206590 Jul 14 14:50:18.057308 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1311/2529] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:17 2022] GET /compute/v2.1/servers/225f3940-0dbc-41c1-bf0b-9043e402e6ca => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:18.062566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3886ace5-18e0-4e4d-bd26-24be18a97284 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '.version_select at 0x7fdbf3365280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:18.139731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3886ace5-18e0-4e4d-bd26-24be18a97284 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Image not found. Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3886ace5-18e0-4e4d-bd26-24be18a97284 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 HTTP/1.1 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '1757f724-c007-4c6f-80ab-b0f9b8b794c2'} Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1757f724-c007-4c6f-80ab-b0f9b8b794c2 to delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1757f724-c007-4c6f-80ab-b0f9b8b794c2 could not be found. Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.143684 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3886ace5-18e0-4e4d-bd26-24be18a97284 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3886ace5-18e0-4e4d-bd26-24be18a97284 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2" status: 404 len: 62 microversion: 2.1 time: 0.087259 Jul 14 14:50:18.147703 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1219/2530] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:18 2022] DELETE /compute/v2.1/images/1757f724-c007-4c6f-80ab-b0f9b8b794c2 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:50:18.156493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:18.157353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:18.180764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.203502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.204963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.205422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.224034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-257240b8-44a9-4532-a43e-63331ee613c2 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a49310>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:18.312156 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 HTTP/1.1 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '80f2e64a-ba04-4c1b-a5e0-695662b50049'} Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:18.316300 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.321048 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.331608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:18.335401 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21267c41-b4ae-48e9-aa82-896c7a866408 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "DELETE /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 404 len: 111 microversion: 2.1 time: 0.180379 Jul 14 14:50:18.336408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1312/2531] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:18 2022] DELETE /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:18.355796 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-257240b8-44a9-4532-a43e-63331ee613c2 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.136974 Jul 14 14:50:18.362231 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1220/2532] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:18 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:18.368277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:18.368917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] [instance: 80f2e64a-ba04-4c1b-a5e0-695662b50049] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:18.394346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.394813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.399445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.400831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.434959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] HTTP exception thrown: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Request method failure captured: Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 HTTP/1.1 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cvu-0eCYuulcLzbDP5e9MBWjoiUL7sNaguRRRqYtlc9wnicS71B-157d9LF9Af6ezKQFkAWS2Vzj-zY5WFALsS7472Ez_mpLtK6b54sb-IbbmTNQCK6KL0ynhF5Sf-QdJFlrPPv8bIr2sTMoWfHNcuphCOX51ToNYXxqeyZakbCeyk Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/52b2ada3fd2842f0a04fdedaf4bd908e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 52b2ada3fd2842f0a04fdedaf4bd908e Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesTestJSON-714228121 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 331a222a893c4f84a08abf11333c7449 Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesTestJSON-714228121-project Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '80f2e64a-ba04-4c1b-a5e0-695662b50049'} Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.436984 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:18.442495 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:18.442495 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:18.442495 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:18.442495 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:18.442495 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. Jul 14 14:50:18.442495 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:18.444729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] Returning 404 to user: Instance 80f2e64a-ba04-4c1b-a5e0-695662b50049 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:18.445956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d6c758b5-e49b-493a-8579-2c1bfc264437 tempest-ImagesTestJSON-714228121 tempest-ImagesTestJSON-714228121-project] 10.222.0.98 "GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049" status: 404 len: 111 microversion: 2.1 time: 0.102090 Jul 14 14:50:18.446785 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1313/2533] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:18 2022] GET /compute/v2.1/servers/80f2e64a-ba04-4c1b-a5e0-695662b50049 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:18.627155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:18.629235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:18.651844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.653314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:18.657130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:18.661026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.053803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:19.054989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:19.080168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.082558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.086665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:19.089447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:19.580285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:19.605351 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5a69121-035b-4532-a427-1542b5d4cd59 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1282 microversion: 2.1 time: 0.545408 Jul 14 14:50:19.606026 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1314/2534] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:19 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1282 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:19.635665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-defd7a81-e3aa-438b-b78c-0dab17abc930 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf230a940>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:19.779528 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-defd7a81-e3aa-438b-b78c-0dab17abc930 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.172197 Jul 14 14:50:19.789164 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1315/2535] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:19 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:20.419092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:20.451448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a294028-13cd-4d5b-9b48-fc19bb03dc95 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1472 microversion: 2.1 time: 1.829036 Jul 14 14:50:20.452803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1221/2536] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:18 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1472 bytes in 1832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:20.634148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:20.635645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:20.797665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b2408f0-8d2f-4f02-9a60-9db9ec52622d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a49790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:20.964816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b2408f0-8d2f-4f02-9a60-9db9ec52622d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.173952 Jul 14 14:50:20.976788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1222/2537] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:20 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:21.124659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.125440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.126599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.127395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.500374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:21.502007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:21.515147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.528320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.530139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:21.531079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:21.609372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:21.626960 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9e1c9f4f-58bc-4556-a14c-7a724cbffe8d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1282 microversion: 2.1 time: 0.996519 Jul 14 14:50:21.628285 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1316/2538] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:20 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1282 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:21.996705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6288495f-606e-4052-96b1-7862db686bad tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf227c8b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:22.134663 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6288495f-606e-4052-96b1-7862db686bad tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1453 microversion: 2.1 time: 0.148028 Jul 14 14:50:22.135857 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1317/2539] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:21 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:22.679053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:22.685927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:22.763162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.764576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:22.765739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:22.773879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:22.928871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:22.948216 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f629a54b-2c32-4172-9559-9bf49c1d55d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1477 microversion: 2.1 time: 1.463509 Jul 14 14:50:22.966481 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1223/2540] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:21 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1477 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:23.150916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-530f1863-93f3-47d3-a5b0-cf7dc36152a9 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b6fb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:23.349718 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-530f1863-93f3-47d3-a5b0-cf7dc36152a9 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1462 microversion: 2.1 time: 0.202026 Jul 14 14:50:23.354767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1224/2541] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:23 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1462 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:23.388533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-528ee30b-600f-4556-b815-dd4aba4f6c85 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf291b3a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:23.621146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-528ee30b-600f-4556-b815-dd4aba4f6c85 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 200 len: 1462 microversion: 2.1 time: 0.253516 Jul 14 14:50:23.622721 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1225/2542] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:23 2022] GET /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 1462 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:23.645079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:23.647321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:23.663820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.664379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.665203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:23.665949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:23.785961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:23.826667 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcbbdd54-f4fb-4ba8-bf40-56f8cd733923 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1282 microversion: 2.1 time: 1.174300 Jul 14 14:50:23.832200 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1318/2543] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:22 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1282 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:23.979227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:23.981377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:24.000758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.003981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.005861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:24.007456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:24.933663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:24.956065 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d860485-ff84-43d7-8613-b8d478f19c42 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1477 microversion: 2.1 time: 0.983276 Jul 14 14:50:24.968626 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1319/2544] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:23 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1477 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:24.977773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:24.989539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:25.009603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:25.010417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:25.011974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:25.012761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:25.146405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:25.176214 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7bfac7fa-da07-49bf-9e55-46f57bc12b1c tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 1466 microversion: 2.1 time: 1.537695 Jul 14 14:50:25.179214 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1226/2545] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:23 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 1466 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:25.235924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77dbff34-40a8-49be-8280-416c51f20664 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf319f9d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:25.258820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:25.310232 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f270d95-644f-4b8b-98d1-86e87e691712 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1282 microversion: 2.1 time: 0.339380 Jul 14 14:50:25.345915 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1320/2546] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:24 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1282 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:25.577781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77dbff34-40a8-49be-8280-416c51f20664 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?changes-since=2022-07-14T14%3A47%3A29Z" status: 200 len: 2374 microversion: 2.1 time: 0.364101 Jul 14 14:50:25.602542 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1227/2547] 10.222.0.98 () {58 vars in 1198 bytes} [Thu Jul 14 14:50:25 2022] GET /compute/v2.1/images?changes-since=2022-07-14T14%3A47%3A29Z => generated 2374 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:25.615679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-740ad31d-f5fc-4146-8796-68e77e5fa738 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf237e3a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:25.837010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-740ad31d-f5fc-4146-8796-68e77e5fa738 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1896467521" status: 200 len: 485 microversion: 2.1 time: 0.225939 Jul 14 14:50:25.851841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1321/2548] 10.222.0.98 () {58 vars in 1230 bytes} [Thu Jul 14 14:50:25 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1896467521 => generated 485 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:25.871645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-963666e9-5a69-4379-8d1d-13ef2d57df36 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf31e1af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:25.999487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:26.006153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:26.030945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:26.033049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:26.035033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:26.037263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:26.168145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:26.298425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-963666e9-5a69-4379-8d1d-13ef2d57df36 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?server=19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 957 microversion: 2.1 time: 0.430954 Jul 14 14:50:26.308226 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1228/2549] 10.222.0.98 () {58 vars in 1208 bytes} [Thu Jul 14 14:50:25 2022] GET /compute/v2.1/images?server=19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 957 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:26.333538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6f10c23a-71da-48ff-9b3d-4a76d51248fe tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf30ed9d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:26.560596 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6f10c23a-71da-48ff-9b3d-4a76d51248fe tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fv2.1%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 484 microversion: 2.1 time: 0.233879 Jul 14 14:50:26.565715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:26.569222 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1229/2550] 10.222.0.98 () {58 vars in 1316 bytes} [Thu Jul 14 14:50:26 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fv2.1%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 484 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:26.598346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:26.607303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:26.645519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:26.646986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:26.650907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:26.653271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:27.216871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:27.226463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-96ce41c7-d110-48e7-90b8-fe60a7d7fdd1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1477 microversion: 2.1 time: 1.237058 Jul 14 14:50:27.227128 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1322/2551] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:25 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1477 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:27.255384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-770a9c06-c73e-42c9-bb57-099afd2919c6 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc04216a60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.342633 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-770a9c06-c73e-42c9-bb57-099afd2919c6 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 484 microversion: 2.1 time: 0.100413 Jul 14 14:50:27.343331 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1323/2552] 10.222.0.98 () {58 vars in 1302 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 484 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:27.362958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f90325e-8772-47e1-bb50-d3e3bd604569 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc0428ef70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.507461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:27.531067 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94f82e56-567d-4072-8675-5edd7f846955 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 0.945098 Jul 14 14:50:27.532608 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1230/2553] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:26 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:27.604986 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f90325e-8772-47e1-bb50-d3e3bd604569 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3280 microversion: 2.1 time: 0.249523 Jul 14 14:50:27.606413 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1324/2554] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:27.641245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-735fff8f-d553-4d39-b662-c513c3ba81d3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf327b5e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.758473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-19b1b597-2688-440a-9631-715f3aa3ae07 req-244f67a2-5af3-4d86-b751-e17ea3ae4304 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "name": "network-vif-unplugged", "status": "completed", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:27.825896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-19b1b597-2688-440a-9631-715f3aa3ae07 req-244f67a2-5af3-4d86-b751-e17ea3ae4304 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:27.827307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-19b1b597-2688-440a-9631-715f3aa3ae07 req-244f67a2-5af3-4d86-b751-e17ea3ae4304 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:27.834216 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-735fff8f-d553-4d39-b662-c513c3ba81d3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.200802 Jul 14 14:50:27.844952 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1231/2555] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:27.865976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d525521-7337-44c4-88b4-5a073a0e1bef tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b6dca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.889044 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-19b1b597-2688-440a-9631-715f3aa3ae07 req-244f67a2-5af3-4d86-b751-e17ea3ae4304 service nova] Creating event network-vif-unplugged:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:50:27.910480 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-19b1b597-2688-440a-9631-715f3aa3ae07 req-244f67a2-5af3-4d86-b751-e17ea3ae4304 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.160428 Jul 14 14:50:27.913365 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1325/2556] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:27.976695 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d525521-7337-44c4-88b4-5a073a0e1bef tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.129030 Jul 14 14:50:27.992071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ebcb3236-c48f-40a8-b8a0-79d47b4b7edc tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc04216790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:27.995659 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1232/2557] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:28.168715 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ebcb3236-c48f-40a8-b8a0-79d47b4b7edc tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?changes-since=2022-07-14T14%3A47%3A24Z" status: 200 len: 6327 microversion: 2.1 time: 0.180076 Jul 14 14:50:28.189482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b1f79e5-b47c-4fe0-9781-e39e8afbd587 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2b683a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:28.195465 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1326/2558] 10.222.0.98 () {58 vars in 1219 bytes} [Thu Jul 14 14:50:27 2022] GET /compute/v2.1/images/detail?changes-since=2022-07-14T14%3A47%3A24Z => generated 6327 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:28.248349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:28.249397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:28.288096 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b1f79e5-b47c-4fe0-9781-e39e8afbd587 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1896467521" status: 200 len: 665 microversion: 2.1 time: 0.103008 Jul 14 14:50:28.332963 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1233/2559] 10.222.0.98 () {58 vars in 1251 bytes} [Thu Jul 14 14:50:28 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1896467521 => generated 665 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:28.332963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e67881e3-7fac-435c-812e-aef33a3f4dc5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf31d9d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:28.333369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:28.333369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:28.333369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:28.333369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:28.481053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e67881e3-7fac-435c-812e-aef33a3f4dc5 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fv2.1%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1464 microversion: 2.1 time: 0.164697 Jul 14 14:50:28.495377 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1234/2560] 10.222.0.98 () {58 vars in 1337 bytes} [Thu Jul 14 14:50:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fv2.1%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1464 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:28.509500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b828cce9-a775-4e86-b56b-4bd0d83b2167 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf327b940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:28.706846 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b828cce9-a775-4e86-b56b-4bd0d83b2167 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1464 microversion: 2.1 time: 0.207449 Jul 14 14:50:28.708719 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1235/2561] 10.222.0.98 () {58 vars in 1323 bytes} [Thu Jul 14 14:50:28 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.98%2Fcompute%2Fservers%2F2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1464 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:28.738562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:28.741026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:28.755477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:28.756979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:28.758783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:28.759958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:29.546367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:29.563198 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d002431-5e87-4987-af7f-49e57bbd71b3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1477 microversion: 2.1 time: 1.322490 Jul 14 14:50:29.564466 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1327/2562] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:28 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1477 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:29.569857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd892daa-186c-4e37-8f80-792118d45e35 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf227c430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:29.836569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd892daa-186c-4e37-8f80-792118d45e35 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7102 microversion: 2.1 time: 0.270576 Jul 14 14:50:29.837442 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1328/2563] 10.222.0.98 () {58 vars in 1169 bytes} [Thu Jul 14 14:50:29 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7102 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:29.839646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:29.864299 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca311151-c942-4709-8456-9556fd5786ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 1.142160 Jul 14 14:50:29.865344 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1236/2564] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:28 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:29.875308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c0c2abc4-cf10-4235-a7b0-83f82c29762b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf227c4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:30.118834 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c0c2abc4-cf10-4235-a7b0-83f82c29762b tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.253265 Jul 14 14:50:30.133568 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1329/2565] 10.222.0.98 () {58 vars in 1169 bytes} [Thu Jul 14 14:50:29 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:30.142942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a877fcf1-eff1-4f89-9c7f-ac5a9fb1c068 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2986940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:30.252769 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a877fcf1-eff1-4f89-9c7f-ac5a9fb1c068 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/882b5d60-a014-41cb-b7f7-f80f1fdee9e4" status: 200 len: 784 microversion: 2.1 time: 0.114043 Jul 14 14:50:30.253096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1237/2566] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:50:30 2022] GET /compute/v2.1/images/882b5d60-a014-41cb-b7f7-f80f1fdee9e4 => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:30.275000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-78f5eab9-1fc0-412e-b0ae-ef30ca1e4549 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf227c430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:30.431156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0ef3ef41-ccca-4dce-aa62-ff400d1aa88e req-c0bcd8b2-a3ac-4eb9-89f2-241d583f2fb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c613e631-44c4-4528-b21f-6919a2785219", "tag": "f93fe03d-21fa-42db-b0fc-79511a897b52"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:30.458754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0ef3ef41-ccca-4dce-aa62-ff400d1aa88e req-c0bcd8b2-a3ac-4eb9-89f2-241d583f2fb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:30.459214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0ef3ef41-ccca-4dce-aa62-ff400d1aa88e req-c0bcd8b2-a3ac-4eb9-89f2-241d583f2fb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:30.496687 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-78f5eab9-1fc0-412e-b0ae-ef30ca1e4549 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.226411 Jul 14 14:50:30.497497 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1330/2567] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:50:30 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:30.520960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e6fe068-3d61-4fbf-9dbe-888fb6e693d7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf230ac10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:30.558615 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0ef3ef41-ccca-4dce-aa62-ff400d1aa88e req-c0bcd8b2-a3ac-4eb9-89f2-241d583f2fb9 service nova] Creating event network-changed:f93fe03d-21fa-42db-b0fc-79511a897b52 for instance c613e631-44c4-4528-b21f-6919a2785219 on n-h1-768852-23 Jul 14 14:50:30.576113 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0ef3ef41-ccca-4dce-aa62-ff400d1aa88e req-c0bcd8b2-a3ac-4eb9-89f2-241d583f2fb9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145720 Jul 14 14:50:30.577529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1238/2568] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:30.591627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:30.614772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:30.636991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:30.638061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:30.642424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:30.643039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:31.869212 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e6fe068-3d61-4fbf-9dbe-888fb6e693d7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3" status: 204 len: 0 microversion: 2.1 time: 1.356460 Jul 14 14:50:31.870420 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1331/2569] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:30 2022] DELETE /compute/v2.1/images/5115c7c1-db5d-4807-9c9f-4952c20e24d3 => generated 0 bytes in 1358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:50:31.876718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:31.877447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:31.885487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:31.886524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:31.887641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:31.888347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:32.078089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:32.092714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f6897a4-842b-4a6d-852f-dc9eba699c4b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1477 microversion: 2.1 time: 1.513277 Jul 14 14:50:32.096206 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1239/2570] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:30 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1477 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:32.105879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-391cb5b7-33f8-4c46-a3f6-6534b2788fd7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf31e3ee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:32.929270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:32.942854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3dce4f4b-435a-4303-81be-96e64f3a496c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 1.070951 Jul 14 14:50:32.943516 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1332/2571] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:31 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:32.979884 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-391cb5b7-33f8-4c46-a3f6-6534b2788fd7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92" status: 204 len: 0 microversion: 2.1 time: 0.845370 Jul 14 14:50:32.981078 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1240/2572] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:32 2022] DELETE /compute/v2.1/images/428c9b8e-00e2-433d-8e08-95c438491c92 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:32.990704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5031ef9d-ac38-4638-b360-a0994fee73c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc0423c310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:33.119009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:33.129499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:33.182280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:33.188102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:33.192707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:33.193938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:33.827307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:33.853748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60c0af1e-1955-463b-a5f0-c22c175c3d9d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1477 microversion: 2.1 time: 0.744287 Jul 14 14:50:33.854381 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1241/2573] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:33 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1477 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:33.882243 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5031ef9d-ac38-4638-b360-a0994fee73c7 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d" status: 204 len: 0 microversion: 2.1 time: 0.895936 Jul 14 14:50:33.890438 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1333/2574] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:32 2022] DELETE /compute/v2.1/images/f7ca3ae9-8525-4da8-a6bb-964703b9246d => generated 0 bytes in 901 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:33.896677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:33.898108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:33.905727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:33.906684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:33.907955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:33.908909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:33.954359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:33.982256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:33.982891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:34.004069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.004855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.007299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.008969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.071793 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f721a8d2-4231-4fa2-9cc0-92481afc99d0 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 204 len: 0 microversion: 2.1 time: 0.180720 Jul 14 14:50:34.073022 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1242/2575] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:33 2022] DELETE /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:50:34.093008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:34.093765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:34.106415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.107709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.126444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:34.131297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:34.640457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:34.655531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20dba4a6-5c70-400c-bafc-3f11284e7528 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 0.685617 Jul 14 14:50:34.656672 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1334/2576] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:33 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:34.899713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:34.941039 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b82047eb-498e-4a93-a704-17e0cd811f9e tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1473 microversion: 2.1 time: 0.857194 Jul 14 14:50:34.956012 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1243/2577] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:34 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1473 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:34.971033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-298945fd-ad91-428d-8841-f39a25888a66 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'create', calling method: .version_select at 0x7fdbf227c310>, body: {"keypair": {"name": "tempest-keypair-1279313034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHh7T2gvCWcSuCd7HZvC6mxc5htMbaqfq9I4FipkNM/ot5yw3HzxrJqM29XSeG5a/Sy1rYRsEUBPk+JR+ldOuJtmqFcXBS5hM8WbWwrZWn0Pms1F0QMUdyizzhskZ1EiA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:35.035369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-298945fd-ad91-428d-8841-f39a25888a66 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:35.054160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-298945fd-ad91-428d-8841-f39a25888a66 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for user 2625ce3aa5034d048494fca0dc403c51 and project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:35.108296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cb415245-d456-4c23-99aa-87f4571c2761 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Action: 'create', calling method: .version_select at 0x7fdbf3065e50>, body: {"keypair": {"name": "tempest-keypair-1038982271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLgMUPlnd/bm7nhiQnf6EB/Bj9g02O88vOtsQpOnRy+oQEPCHSjoIPdMYRMgAj6mVILp1SzwxOIm3+bI9INg51pnu+PWcrr3AZ+pmvqAqu/5OABWkHAsLuu4HffmI7keEQ=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:35.136550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:35.148561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-298945fd-ad91-428d-8841-f39a25888a66 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.490111 Jul 14 14:50:35.158476 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1335/2578] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:50:34 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 492 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:50:35.169671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:35.171250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:35.182551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cb415245-d456-4c23-99aa-87f4571c2761 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Getting quotas for project 4da9bfba7a6e411fa22206a70417ae73. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:35.183869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.184977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.186825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.188064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.212580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cb415245-d456-4c23-99aa-87f4571c2761 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Getting quotas for user 1db067ac2fdc491e866b8dcfdfe8d606 and project 4da9bfba7a6e411fa22206a70417ae73. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:35.306258 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cb415245-d456-4c23-99aa-87f4571c2761 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.348125 Jul 14 14:50:35.307552 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1244/2579] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:50:34 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:35.691956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:35.698675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:35.743258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.748011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.752077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:35.753396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:35.841957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:36.018069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:36.034560 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-095653c4-d8d3-4466-97e4-ba9c35592a52 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1476 microversion: 2.1 time: 0.872831 Jul 14 14:50:36.035196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1336/2580] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:35 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1476 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:36.044847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:36.048996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:36.064611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:36.068025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:36.069301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:36.070561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:36.368712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:36.380185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2998b88c-5e36-45c6-9287-fe4ec6d536de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 0.708934 Jul 14 14:50:36.384487 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1245/2581] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:35 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:37.052242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:37.052878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:37.064275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.064744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:37.065569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.066036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:37.211255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:37.242357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfb0e7c2-0414-4093-b896-da3ae6a92f04 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1473 microversion: 2.1 time: 1.205304 Jul 14 14:50:37.260650 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1337/2582] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:36 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1473 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:37.407842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:37.412074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:37.447148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:37.455403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.457374 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d2e5f301-c232-4e9b-b10b-392293797de5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1476 microversion: 2.1 time: 0.409144 Jul 14 14:50:37.458686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:37.460455 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1246/2583] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:37 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:37.466854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.468153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:37.889086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ca4b7d1c-a786-4ecd-8543-a5ef0c9c3253 req-375beb91-0247-414e-83e6-ac90d6cbe118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a29ece-d239-4899-aa1b-85f8151eb874", "name": "network-vif-unplugged", "status": "completed", "tag": "2094fac7-8553-4153-abaa-974a33ab82cf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:37.899180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ca4b7d1c-a786-4ecd-8543-a5ef0c9c3253 req-375beb91-0247-414e-83e6-ac90d6cbe118 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:37.903522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ca4b7d1c-a786-4ecd-8543-a5ef0c9c3253 req-375beb91-0247-414e-83e6-ac90d6cbe118 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:37.944397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ca4b7d1c-a786-4ecd-8543-a5ef0c9c3253 req-375beb91-0247-414e-83e6-ac90d6cbe118 service nova] Creating event network-vif-unplugged:2094fac7-8553-4153-abaa-974a33ab82cf for instance 81a29ece-d239-4899-aa1b-85f8151eb874 on n-h1-768852-23 Jul 14 14:50:37.998091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-ca4b7d1c-a786-4ecd-8543-a5ef0c9c3253 req-375beb91-0247-414e-83e6-ac90d6cbe118 service nova] Instance 81a29ece-d239-4899-aa1b-85f8151eb874 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:50:38.019183 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ca4b7d1c-a786-4ecd-8543-a5ef0c9c3253 req-375beb91-0247-414e-83e6-ac90d6cbe118 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134299 Jul 14 14:50:38.028823 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1247/2584] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:38.275778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:38.276916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:38.291994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:38.296067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:38.297342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:38.302631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:38.737260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:38.746397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cbe5ed88-2a1b-4efd-9370-35e438bcd1fc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 1.347995 Jul 14 14:50:38.764696 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1338/2585] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:37 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:38.783130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:38.784311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:38.800644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:38.801108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:38.801929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:38.806274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.148572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:39.163853 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df133aae-2066-4cf8-958c-856d45853bbe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1476 microversion: 2.1 time: 0.397318 Jul 14 14:50:39.164735 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1339/2586] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:38 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:39.767654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:39.769641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:39.791442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:39.794104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:39.798287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:39.799048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:40.134187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:40.152044 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b81cf6d6-a60e-4372-a10d-339c1403deae tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 0.389742 Jul 14 14:50:40.152709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1340/2587] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:39 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:40.171233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:40.182981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:40.184307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:40.197865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:40.198335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:40.199188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:40.203520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:40.204702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02fd0bee-383a-42ce-8f7d-eb3c2c77ffa3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1473 microversion: 2.1 time: 1.935107 Jul 14 14:50:40.205779 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1248/2588] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:38 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1473 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:40.243552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:40.554805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:40.569595 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de7cd10c-044b-4b26-8372-d3a4040fe327 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1476 microversion: 2.1 time: 0.391137 Jul 14 14:50:40.573381 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1341/2589] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:40 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1476 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:41.053895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-784e4252-20ca-4328-ba60-91ab1671c35c req-776502df-3ff8-45fe-9fc8-04bc33c7a01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81a29ece-d239-4899-aa1b-85f8151eb874", "tag": "2094fac7-8553-4153-abaa-974a33ab82cf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:41.096921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-784e4252-20ca-4328-ba60-91ab1671c35c req-776502df-3ff8-45fe-9fc8-04bc33c7a01a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.098132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-784e4252-20ca-4328-ba60-91ab1671c35c req-776502df-3ff8-45fe-9fc8-04bc33c7a01a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.115871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d02059c4-3cb7-4875-9a24-2b1436f189a7 req-1c707882-1207-4612-abc8-4a379027b72f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f3490c3-371d-4033-afe2-e2bf1b7bb517", "name": "network-vif-deleted", "tag": "a95d4384-b690-4cd0-8f4e-719098d1cf4e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:41.135313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d02059c4-3cb7-4875-9a24-2b1436f189a7 req-1c707882-1207-4612-abc8-4a379027b72f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.135651 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-784e4252-20ca-4328-ba60-91ab1671c35c req-776502df-3ff8-45fe-9fc8-04bc33c7a01a service nova] Creating event network-changed:2094fac7-8553-4153-abaa-974a33ab82cf for instance 81a29ece-d239-4899-aa1b-85f8151eb874 on n-h1-768852-23 Jul 14 14:50:41.135833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d02059c4-3cb7-4875-9a24-2b1436f189a7 req-1c707882-1207-4612-abc8-4a379027b72f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.164485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-784e4252-20ca-4328-ba60-91ab1671c35c req-776502df-3ff8-45fe-9fc8-04bc33c7a01a service nova] Instance 81a29ece-d239-4899-aa1b-85f8151eb874 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:50:41.173789 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d02059c4-3cb7-4875-9a24-2b1436f189a7 req-1c707882-1207-4612-abc8-4a379027b72f service nova] Creating event network-vif-deleted:a95d4384-b690-4cd0-8f4e-719098d1cf4e for instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 on n-h2-768852-23 Jul 14 14:50:41.192831 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d02059c4-3cb7-4875-9a24-2b1436f189a7 req-1c707882-1207-4612-abc8-4a379027b72f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081689 Jul 14 14:50:41.205662 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1342/2590] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:50:41.215794 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-784e4252-20ca-4328-ba60-91ab1671c35c req-776502df-3ff8-45fe-9fc8-04bc33c7a01a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162066 Jul 14 14:50:41.218346 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1249/2591] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:41.220600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:41.221518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:41.243331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:41.243795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.249061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:41.252826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.253689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.254143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.274230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.281499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.285194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.296456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.448541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.464622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.466019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lazy-loading 'fault' on Instance uuid 2f3490c3-371d-4033-afe2-e2bf1b7bb517 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:50:41.698379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:41.729320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d27cf307-c4d0-4c50-bc62-7c79a7b5864d tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 200 len: 1308 microversion: 2.1 time: 0.494391 Jul 14 14:50:41.758652 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1250/2592] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:41 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 1308 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:41.798557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:41.800535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:41.821842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.823121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.824962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:41.826107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:41.953569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:41.965907 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d650e893-c99f-4e81-b3df-0c5075c3fdfd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 0.758792 Jul 14 14:50:41.978332 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1343/2593] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:41 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:42.223345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c31d5443-3ce9-4218-9a83-390278347cd8 req-07c9dd1e-9cb7-4762-a74a-c030cf0a9e90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c613e631-44c4-4528-b21f-6919a2785219", "name": "network-vif-plugged", "status": "completed", "tag": "f93fe03d-21fa-42db-b0fc-79511a897b52"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:42.249732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c31d5443-3ce9-4218-9a83-390278347cd8 req-07c9dd1e-9cb7-4762-a74a-c030cf0a9e90 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:42.250191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c31d5443-3ce9-4218-9a83-390278347cd8 req-07c9dd1e-9cb7-4762-a74a-c030cf0a9e90 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:42.295545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c31d5443-3ce9-4218-9a83-390278347cd8 req-07c9dd1e-9cb7-4762-a74a-c030cf0a9e90 service nova] Creating event network-vif-plugged:f93fe03d-21fa-42db-b0fc-79511a897b52 for instance c613e631-44c4-4528-b21f-6919a2785219 on n-h1-768852-23 Jul 14 14:50:42.303291 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c31d5443-3ce9-4218-9a83-390278347cd8 req-07c9dd1e-9cb7-4762-a74a-c030cf0a9e90 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083772 Jul 14 14:50:42.306024 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1344/2594] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:42.762848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:42.764080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 2f3490c3-371d-4033-afe2-e2bf1b7bb517] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:42.778088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:42.778601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:42.779480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:42.779930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:42.829809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] HTTP exception thrown: Instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 could not be found. Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Request method failure captured: Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 HTTP/1.1 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cx7evodVcm4SjYp_uFQ7tbQHVcociGi-Byxja1DDwlIwRgvzl8HsRjDiN_Tt1B1fp4KHYjtlTh6C4RkU9IGdY5p6drhvGheTJK0GyAB6cmhm1BUIVwyV-ylMLAujPvWhmOL1tLnYHUDND0qkheb1D2rJuhp9cIhnpbxNYhKWCk_IVQ Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: accf60fb4fd44f6fa6f8cf9302662d68 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListImageFiltersTestJSON-317075709 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListImageFiltersTestJSON-317075709 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: accf60fb4fd44f6fa6f8cf9302662d68 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-317075709 Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListImageFiltersTestJSON-317075709-project Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 9ac47e12cd544be0bb7a6c7616e1aaed Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListImageFiltersTestJSON-317075709-project Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 could not be found. Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2f3490c3-371d-4033-afe2-e2bf1b7bb517'} Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 could not be found. Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 could not be found. Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:42.831917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 could not be found. Jul 14 14:50:42.836322 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:42.838953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Returning 404 to user: Instance 2f3490c3-371d-4033-afe2-e2bf1b7bb517 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:42.840162 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-45f6dbc4-5f31-46bf-8384-cf9804835c90 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517" status: 404 len: 111 microversion: 2.1 time: 0.082505 Jul 14 14:50:42.841334 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1345/2595] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:42 2022] GET /compute/v2.1/servers/2f3490c3-371d-4033-afe2-e2bf1b7bb517 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:50:42.851923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:42.852762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:42.869894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:42.875040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:42.876111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:42.876575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:42.929152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:50:43.195963 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c8466707-3aaa-4cbc-acfd-d2691362b1ec tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 204 len: 0 microversion: 2.1 time: 0.346958 Jul 14 14:50:43.207636 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1346/2596] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:50:42 2022] DELETE /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:50:43.244397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:43.252414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:43.290423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:43.299570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:43.301302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:43.302213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:43.796337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:43.852324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:43.866057 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1f81974-f898-4d0c-b345-9dfa26141c51 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1324 microversion: 2.1 time: 0.648785 Jul 14 14:50:43.869674 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1347/2597] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:43 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1324 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:43.887422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:43.889814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:43.892497 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c77bf81-c10e-4931-95c6-6492948ff233 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1476 microversion: 2.1 time: 2.129632 Jul 14 14:50:43.901551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1251/2598] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:41 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1476 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:43.921796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:43.922669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:43.924239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:43.925506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.623637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:44.640124 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-591ec4cf-e30e-4059-b3bd-616012384741 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 1472 microversion: 2.1 time: 0.767196 Jul 14 14:50:44.641790 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1348/2599] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:43 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 1472 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:44.926395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:44.940008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:44.940587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:44.941407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:44.963499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:44.970640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:44.970940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.971783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:44.975927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.979698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:44.983046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:44.985158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:44.991848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:45.109203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:45.244439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:45.953595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:45.988777 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d5b91f5-d579-4e0b-965f-906a246ac5a3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1474 microversion: 2.1 time: 1.070146 Jul 14 14:50:45.990951 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1349/2600] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:44 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1474 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:46.027780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-850065686", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "38ce255a-17ac-43fc-a038-31291283adea"}], "security_groups": [{"name": "tempest-securitygroup--727107973"}], "key_name": "tempest-keypair-1038982271", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:46.208227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:46.287857 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54b4c5f7-b308-4937-8aea-8e6cb2cea96a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 1.391479 Jul 14 14:50:46.300814 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1252/2601] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:44 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:50:46.318379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:46.323950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:46.348033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:46.349551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:46.351365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:46.352452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:46.822875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] validate_networks() for [('38ce255a-17ac-43fc-a038-31291283adea', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:47.512099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:47.532871 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2322c69-0e0c-406a-b2ac-af701d12816a tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 1472 microversion: 2.1 time: 1.227500 Jul 14 14:50:47.534805 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1253/2602] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:46 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 1472 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:47.556161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:47.558550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:47.580600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:47.581663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:47.583309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:47.584399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:48.935461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:48.950788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-787deac7-749f-4f4b-9a83-3cc1ad5e2a47 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 1.414100 Jul 14 14:50:48.954843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1254/2603] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:47 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:48.995061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:48.998628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:49.015702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.017285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.020882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.022214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.203000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Getting quotas for project 4da9bfba7a6e411fa22206a70417ae73. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:49.218653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Getting quotas for user 1db067ac2fdc491e866b8dcfdfe8d606 and project 4da9bfba7a6e411fa22206a70417ae73. Resources: dict_keys(['metadata_items']) {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:49.254427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:49.256872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:49.260904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:49.261825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:49.262614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:49.291375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.294880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.296438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.304266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.343482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Getting quotas for project 4da9bfba7a6e411fa22206a70417ae73. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:49.349422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Getting quotas for user 1db067ac2fdc491e866b8dcfdfe8d606 and project 4da9bfba7a6e411fa22206a70417ae73. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:49.393619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:49.401883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:49.574617 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7858b0c8-62ae-4fa0-bea5-2a4f47290c3c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.581687 Jul 14 14:50:49.575324 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1350/2604] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 3584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:50:49.589149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:49.593133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:49.614566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.616074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.617198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.618115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.784198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:49.787622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:49.790197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lazy-loading 'fault' on Instance uuid 19aeffd0-2dc4-4423-825c-3fb183bcfbdb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:50:49.980118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ac47e12cd544be0bb7a6c7616e1aaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'accf60fb4fd44f6fa6f8cf9302662d68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:49.995074 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25001a47-a084-4096-9bb1-6784e007e79f tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 200 len: 1307 microversion: 2.1 time: 0.415572 Jul 14 14:50:49.999409 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1351/2605] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:49 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 1307 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:50.014676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-295b042a-6139-4e6a-a08f-3b9a93e243e5 req-aefcf49c-10a9-4641-b00c-461e5f7a5fe3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19aeffd0-2dc4-4423-825c-3fb183bcfbdb", "name": "network-vif-deleted", "tag": "3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:50.028841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:50.045266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-295b042a-6139-4e6a-a08f-3b9a93e243e5 req-aefcf49c-10a9-4641-b00c-461e5f7a5fe3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.045756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-295b042a-6139-4e6a-a08f-3b9a93e243e5 req-aefcf49c-10a9-4641-b00c-461e5f7a5fe3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.059298 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1331092c-e7d5-464c-999f-2134f56e3d84 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1471 microversion: 2.1 time: 1.102877 Jul 14 14:50:50.069584 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1255/2606] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:48 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1471 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:50.083663 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-295b042a-6139-4e6a-a08f-3b9a93e243e5 req-aefcf49c-10a9-4641-b00c-461e5f7a5fe3 service nova] Creating event network-vif-deleted:3195a2a3-2c8e-46b7-8bd6-3d6d1c05edb1 for instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb on n-h2-768852-23 Jul 14 14:50:50.097693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-295b042a-6139-4e6a-a08f-3b9a93e243e5 req-aefcf49c-10a9-4641-b00c-461e5f7a5fe3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094277 Jul 14 14:50:50.098337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1352/2607] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:50.105288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5160a3af-3712-440a-abd1-b464d62f9c71 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2111273449", "metadata": {"": ""}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:50.126844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66873db0-c8b7-4fbb-8a8a-4308fd26cd62 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:50.129158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66873db0-c8b7-4fbb-8a8a-4308fd26cd62 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5160a3af-3712-440a-abd1-b464d62f9c71 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action HTTP/1.1 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 107 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-2111273449", "metadata": {"": ""}}} Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-2111273449', 'metadata': {'': ''}}}} Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'': ''} Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:50.135485 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5160a3af-3712-440a-abd1-b464d62f9c71 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:50.145836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5160a3af-3712-440a-abd1-b464d62f9c71 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action" status: 400 len: 170 microversion: 2.1 time: 0.064099 Jul 14 14:50:50.152125 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1256/2608] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Jul 14 14:50:50 2022] POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action => generated 170 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:50.186901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-422701841", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5159ddda-95bd-4e7f-87d5-260eea5ce87f"}], "security_groups": [{"name": "tempest-securitygroup--1816263707"}], "key_name": "tempest-keypair-1279313034", "user_data": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:50.300585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-66873db0-c8b7-4fbb-8a8a-4308fd26cd62 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:50.312106 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66873db0-c8b7-4fbb-8a8a-4308fd26cd62 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1269 microversion: 2.1 time: 0.195797 Jul 14 14:50:50.318662 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1353/2609] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:50 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1269 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:50.337996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:50.340810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:50.360850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.363203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.367739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.369612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.550537 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-478feff7-9993-41c5-a963-9927519eb364 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874/action" status: 204 len: 0 microversion: 2.1 time: 0.228586 Jul 14 14:50:50.561001 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1354/2610] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:50:50 2022] POST /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874/action => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:50.591346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:50.592775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:50.618588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.619051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.619906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:50.620360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:50.622289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] validate_networks() for [('5159ddda-95bd-4e7f-87d5-260eea5ce87f', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:51.081263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:51.117610 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eeadbae4-fba0-43a8-8b7d-987a240c048d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 0.546958 Jul 14 14:50:51.118716 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1355/2611] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:50 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:51.155322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:51.159353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:51.188655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.189435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.190845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.195948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.719451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:51.732946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70f91e68-c38d-4235-b5fa-f5fc815ae638 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1471 microversion: 2.1 time: 0.601335 Jul 14 14:50:51.746521 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1356/2612] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:51 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:51.765608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:51.768945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] [instance: 19aeffd0-2dc4-4423-825c-3fb183bcfbdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:51.793887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.796190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.798874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.800326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.845906 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] HTTP exception thrown: Instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb could not be found. Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Request method failure captured: Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb HTTP/1.1 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Cx7evodVcm4SjYp_uFQ7tbQHVcociGi-Byxja1DDwlIwRgvzl8HsRjDiN_Tt1B1fp4KHYjtlTh6C4RkU9IGdY5p6drhvGheTJK0GyAB6cmhm1BUIVwyV-ylMLAujPvWhmOL1tLnYHUDND0qkheb1D2rJuhp9cIhnpbxNYhKWCk_IVQ Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: accf60fb4fd44f6fa6f8cf9302662d68 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListImageFiltersTestJSON-317075709 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/accf60fb4fd44f6fa6f8cf9302662d68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListImageFiltersTestJSON-317075709 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: accf60fb4fd44f6fa6f8cf9302662d68 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-317075709 Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListImageFiltersTestJSON-317075709-project Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 9ac47e12cd544be0bb7a6c7616e1aaed Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListImageFiltersTestJSON-317075709-project Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb could not be found. Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '19aeffd0-2dc4-4423-825c-3fb183bcfbdb'} Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb could not be found. Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb could not be found. Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:51.851468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb could not be found. Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Returning 404 to user: Instance 19aeffd0-2dc4-4423-825c-3fb183bcfbdb could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:51.861211 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5453540f-9635-4c0b-817a-4ae782a987a4 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb" status: 404 len: 111 microversion: 2.1 time: 0.106147 Jul 14 14:50:51.862448 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1357/2613] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:51 2022] GET /compute/v2.1/servers/19aeffd0-2dc4-4423-825c-3fb183bcfbdb => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:50:51.873937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:51.876070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:51.894499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.896332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:51.897250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:51.897710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:52.684646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:52.739441 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-678697a3-1681-4c0f-b0c9-9f9c55e2e8ca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 0.876323 Jul 14 14:50:52.740530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1358/2614] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:51 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:52.775406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:52.776737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:52.805856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:52.809785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:52.813994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:52.815710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.127887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:53.151413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c54b2648-3d55-49a2-a04f-e9f8ac515a77 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1339 microversion: 2.1 time: 0.408968 Jul 14 14:50:53.152529 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1359/2615] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:52 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1339 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:53.167145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ba90fbf4-8aaa-4654-b708-f5ad3f8f9418 req-1db64332-bdc4-47d8-ac1a-6c6b63f4a302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a29ece-d239-4899-aa1b-85f8151eb874", "name": "network-vif-plugged", "status": "completed", "tag": "2094fac7-8553-4153-abaa-974a33ab82cf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:53.205489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ba90fbf4-8aaa-4654-b708-f5ad3f8f9418 req-1db64332-bdc4-47d8-ac1a-6c6b63f4a302 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:53.206313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ba90fbf4-8aaa-4654-b708-f5ad3f8f9418 req-1db64332-bdc4-47d8-ac1a-6c6b63f4a302 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:53.214501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:50:53.232223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ba90fbf4-8aaa-4654-b708-f5ad3f8f9418 req-1db64332-bdc4-47d8-ac1a-6c6b63f4a302 service nova] Creating event network-vif-plugged:2094fac7-8553-4153-abaa-974a33ab82cf for instance 81a29ece-d239-4899-aa1b-85f8151eb874 on n-h1-768852-23 Jul 14 14:50:53.271681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-ba90fbf4-8aaa-4654-b708-f5ad3f8f9418 req-1db64332-bdc4-47d8-ac1a-6c6b63f4a302 service nova] Instance 81a29ece-d239-4899-aa1b-85f8151eb874 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:50:53.303451 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ba90fbf4-8aaa-4654-b708-f5ad3f8f9418 req-1db64332-bdc4-47d8-ac1a-6c6b63f4a302 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148188 Jul 14 14:50:53.304636 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1360/2616] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:50:53.316698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55bf81d0-b129-4462-9abc-68e471afe9b3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf227cdc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:54.264041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-55bf81d0-b129-4462-9abc-68e471afe9b3 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/images/919de8d2-88b5-4e84-bf29-9bff4d602b01" status: 204 len: 0 microversion: 2.1 time: 0.957349 Jul 14 14:50:54.270472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1361/2617] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:53 2022] DELETE /compute/v2.1/images/919de8d2-88b5-4e84-bf29-9bff4d602b01 => generated 0 bytes in 960 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:54.281261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05c4c2c2-e53a-4409-84b4-05b252d9afa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1296322832", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05c4c2c2-e53a-4409-84b4-05b252d9afa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action HTTP/1.1 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 619 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1296322832", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1296322832', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:50:54.289558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 14:50:54.298082 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:50:54.311078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05c4c2c2-e53a-4409-84b4-05b252d9afa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:50:54.311078 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05c4c2c2-e53a-4409-84b4-05b252d9afa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action" status: 400 len: 938 microversion: 2.1 time: 0.034348 Jul 14 14:50:54.311078 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1362/2618] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Jul 14 14:50:54 2022] POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action => generated 938 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:50:54.324434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:54.325681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:54.361542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.362815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.364610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.365662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.392711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:54.393773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:54.395059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:54.397326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:54.397685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:54.426728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.427811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.433478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.436887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.514166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:54.533416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for user 2625ce3aa5034d048494fca0dc403c51 and project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:54.602756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:54.612249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:54.773020 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a1c1f37-bfba-4ef3-b6db-c8e38dca0904 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.614417 Jul 14 14:50:54.782592 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1257/2619] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:50:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 4622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:50:54.800733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:54.802427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:54.819704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.821055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.823054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:54.823835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:54.824437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:54.862633 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0eb825c8-48bf-4775-9513-05e23c3b39b1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1471 microversion: 2.1 time: 0.553315 Jul 14 14:50:54.864493 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1363/2620] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:54 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1471 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:54.876137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec3088fb-9359-4de9-8dcd-d5a68eefcdb1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdc04293040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:55.039244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:55.069920 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55d04b32-8657-43a9-83ca-c880c864ab0d tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1327 microversion: 2.1 time: 0.269059 Jul 14 14:50:55.072916 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1258/2621] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:54 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1327 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:55.089136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:55.094298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:55.117194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:55.127601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:55.128994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:55.129700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:55.482536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec3088fb-9359-4de9-8dcd-d5a68eefcdb1 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/images/a6e5a31a-5dca-465f-ae05-cff77a71dcdd" status: 204 len: 0 microversion: 2.1 time: 0.614300 Jul 14 14:50:55.483397 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1364/2622] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:54 2022] DELETE /compute/v2.1/images/a6e5a31a-5dca-465f-ae05-cff77a71dcdd => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:55.901441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-81565994", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:50:55.947201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:55.988517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c904a066-5e8f-43da-9437-aa3d28781b1b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 0.907528 Jul 14 14:50:55.995614 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1259/2623] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:55 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:56.013948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62f02529-81d7-49b9-83d1-4d222e02def8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:56.030391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62f02529-81d7-49b9-83d1-4d222e02def8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:56.051568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] validate_networks() for [('ec21279c-faed-4ec6-8a6e-8500739ef80a', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:50:56.273220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62f02529-81d7-49b9-83d1-4d222e02def8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:56.304910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62f02529-81d7-49b9-83d1-4d222e02def8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:56.332716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62f02529-81d7-49b9-83d1-4d222e02def8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:56.336776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62f02529-81d7-49b9-83d1-4d222e02def8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1281 microversion: 2.20 time: 0.337325 Jul 14 14:50:56.342064 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1260/2624] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:55 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1281 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:50:56.372689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8bba5a2-2a91-4b46-9c13-80b9771af417 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] Calling method '.version_select at 0x7fdbf2a49790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:57.036065 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8bba5a2-2a91-4b46-9c13-80b9771af417 tempest-ListImageFiltersTestJSON-317075709 tempest-ListImageFiltersTestJSON-317075709-project] 10.222.0.98 "DELETE /compute/v2.1/images/101b136a-1636-4deb-9d97-b8f095a0b71c" status: 204 len: 0 microversion: 2.1 time: 0.688315 Jul 14 14:50:57.037218 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1261/2625] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:56 2022] DELETE /compute/v2.1/images/101b136a-1636-4deb-9d97-b8f095a0b71c => generated 0 bytes in 694 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:50:57.049850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:57.050544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:57.068267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.069102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:57.071792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:57.084075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.056396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:58.070114 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad478a9c-5b45-4361-8be5-12d965811a03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1463 microversion: 2.1 time: 1.027692 Jul 14 14:50:58.073022 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1262/2626] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:57 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1463 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:58.091239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:58.092548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:58.121655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.124786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:58.128310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:58.129307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.075011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:50:59.075844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:50:59.077382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:50:59.078205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:50:59.079256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:50:59.122851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.123480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.125073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.125681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.152114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Getting quotas for project 633d43bf7c6c48e5ba244d103fbd2fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:50:59.158890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Getting quotas for user 24ffcc115d374182b9039ddfe987042d and project 633d43bf7c6c48e5ba244d103fbd2fe6. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:50:59.174080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:50:59.177225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:50:59.284794 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29aa19db-2cff-453d-bbf0-6878bfb43b49 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.800289 Jul 14 14:50:59.287944 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1365/2627] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:50:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:50:59.307490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:59.311375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:59.339752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:50:59.353169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.353984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.356057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.357147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.362811 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1860eadf-6852-41ff-9bd3-26fe5e9b0d8e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 1.279164 Jul 14 14:50:59.379688 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1263/2628] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:58 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:50:59.379688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:50:59.379688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:50:59.416737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.419085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:50:59.420116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:50:59.424410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.069920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.139886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.147734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.152112 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b98f0304-f18d-4cf2-ae43-60a32d3e88e8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1339 microversion: 2.20 time: 0.783203 Jul 14 14:51:00.171570 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1264/2629] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:50:59 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1339 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:00.183305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:00.187035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:00.205145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.206438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.208116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.209027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.542998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.575471 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4595866d-26fb-440a-97e3-86223e7ce968 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1394 microversion: 2.1 time: 1.285623 Jul 14 14:51:00.584594 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1366/2630] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:50:59 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1394 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:00.597044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:00.608301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:00.633940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.635028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.640020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:00.643594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:00.855669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:00.886099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7c85fdd-2a96-43a1-b04c-0eaafe586db7 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1225 microversion: 2.1 time: 0.296176 Jul 14 14:51:00.889381 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1367/2631] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:00 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1225 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:00.906336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ba7d8ef-c737-4321-a19c-f19d522f7276 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ba7d8ef-c737-4321-a19c-f19d522f7276 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action HTTP/1.1 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 285 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['createImage']: Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.913976 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 14:51:00.917917 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:00.923193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ba7d8ef-c737-4321-a19c-f19d522f7276 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:00.925577 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ba7d8ef-c737-4321-a19c-f19d522f7276 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action" status: 400 len: 619 microversion: 2.1 time: 0.034333 Jul 14 14:51:00.931145 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1368/2632] 10.222.0.98 () {60 vars in 1278 bytes} [Thu Jul 14 14:51:00 2022] POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action => generated 619 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:51:01.560028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:01.592351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:01.596260 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6104942f-f9ce-41ba-9342-2559c35a1e1d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1463 microversion: 2.1 time: 1.422297 Jul 14 14:51:01.607457 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1265/2633] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:00 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1463 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:01.618575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:01.624073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:01.636306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:01.636766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.637558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:01.638186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:01.769337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb69b0c1-c971-4889-b42a-43f4c188ad94 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdc0428eb80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-651777368", "description": "tempest-description-1253435734"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:02.726252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:02.754961 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da9df1d5-b34a-4f0f-93e6-554f5dd13105 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 1.145630 Jul 14 14:51:02.762743 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1266/2634] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:01 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:03.480406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb69b0c1-c971-4889-b42a-43f4c188ad94 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.547601 Jul 14 14:51:03.481548 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1369/2635] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:00 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:03.498059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:03.498689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:03.507166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.508042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.511864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.512630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.550941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ecdae69b-378f-4c4a-ac53-b4394299a34a req-2414c011-12ff-45be-8f5e-3e3644fb51f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9561de-a262-42aa-9970-e747af3e88a8", "tag": "e4f71160-74ef-4672-a27e-ee986e72f3b7"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:03.569143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ecdae69b-378f-4c4a-ac53-b4394299a34a req-2414c011-12ff-45be-8f5e-3e3644fb51f7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.570944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ecdae69b-378f-4c4a-ac53-b4394299a34a req-2414c011-12ff-45be-8f5e-3e3644fb51f7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.594202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ecdae69b-378f-4c4a-ac53-b4394299a34a req-2414c011-12ff-45be-8f5e-3e3644fb51f7 service nova] Creating event network-changed:e4f71160-74ef-4672-a27e-ee986e72f3b7 for instance 9f9561de-a262-42aa-9970-e747af3e88a8 on n-h1-768852-23 Jul 14 14:51:03.602532 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ecdae69b-378f-4c4a-ac53-b4394299a34a req-2414c011-12ff-45be-8f5e-3e3644fb51f7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.837382 Jul 14 14:51:03.604742 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1267/2636] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:03.612163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:03.613287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:03.633300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.634102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.635228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.635982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.775937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:03.789213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:03.791703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:03.793651 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7030418-162e-43d0-aeeb-d9a19762a901 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.310862 Jul 14 14:51:03.794652 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1370/2637] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:03 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:03.800860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60be24ca-0462-4f25-b6ad-8cff9a7995cb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'create', calling method: .version_select at 0x7fdbf33f80d0>, body: {"keypair": {"name": "tempest-keypair-1789208874", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBiLVkC0lHo29PHApmTlTGCpFs9mKKpVy9GZ7JDK3RtF3wmWeSCXQxef9nRvJWmXZeZCOmeij7Ot5iSMVPrdWGEKHwHax+YX4eC8xjWlxHUTRniWOUdKCQN45YnHrEivPg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:03.828758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-60be24ca-0462-4f25-b6ad-8cff9a7995cb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:03.838796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-60be24ca-0462-4f25-b6ad-8cff9a7995cb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for user a185fa24374c417aa2bb9302a608cbcd and project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:03.870219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60be24ca-0462-4f25-b6ad-8cff9a7995cb tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073660 Jul 14 14:51:03.870850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1371/2638] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:03.877114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:03.878736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:03.894654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.895871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:03.899082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:03.900265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:04.052665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:04.092254 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ee25fa3-0f10-4f51-af3e-c1601d38b196 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1279 microversion: 2.1 time: 0.217402 Jul 14 14:51:04.093130 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1372/2639] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:03 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:04.153828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:04.159174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:04.179964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:04.181499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:04.182748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:04.183445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:04.480439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:04.746330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:04.761854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6bcb196d-00a0-4fc7-90f8-81ed05102b44 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 0.664594 Jul 14 14:51:04.763026 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1373/2640] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:04 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:04.803228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:04.858710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ab1ec8b-4b5d-40a1-9221-eceec460be75 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1394 microversion: 2.1 time: 1.245332 Jul 14 14:51:04.862456 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1268/2641] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:03 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1394 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:04.881485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c8ea4413-de21-462c-9436-446f1b1aef25 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf2b6d5e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1266277100", "description": "tempest-description-1620344756"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:05.153517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5fda17d5-9fe9-4309-b014-e30b5b561f84 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Action: 'create', calling method: .version_select at 0x7fdc042f14c0>, body: {"keypair": {"name": "tempest-keypair-430201010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLA4wwevNzv3E7Yc1bEDncNYpNTmTPTB/IDhvA6n7oFywtb/OtLK0A1pfw6NFwO0b+CuC5HNmuOSbyUMSiYZatBKixXDbK65lSx1RBjhywHaPk9B5bZ8f1v+HTMrhYJG3w=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:05.181543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5fda17d5-9fe9-4309-b014-e30b5b561f84 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:05.194055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5fda17d5-9fe9-4309-b014-e30b5b561f84 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for user 5f3aa69fa13247cdb6cb55057b6bba13 and project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:05.219546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:05.303852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5fda17d5-9fe9-4309-b014-e30b5b561f84 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.539078 Jul 14 14:51:05.305138 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1374/2642] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:05.316251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1372406742"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:05.317432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:05.339193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:05.339988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:05.341790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:05.344666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:05.863647 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c8ea4413-de21-462c-9436-446f1b1aef25 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.998528 Jul 14 14:51:05.876703 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1269/2643] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:04 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:05.876703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:05.876703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:05.892586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:05.900159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:05.900620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:05.901427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:05.901871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.216783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a26c16b-0bf4-4ae4-be3c-3452d642441c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action" status: 202 len: 0 microversion: 2.1 time: 0.909564 Jul 14 14:51:06.227125 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1375/2644] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:05 2022] POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action => generated 0 bytes in 912 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:51:06.227125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:06.227125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:06.294456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:06.299399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.303042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.306282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.307747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.612605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:06.637332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:06.645663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:06.649870 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c861fa4-3985-45e2-8178-f7801d50cf43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.779516 Jul 14 14:51:06.653777 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1270/2645] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:05 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:06.664998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-840d072f-5ede-4393-98a6-468cf07b731c tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdbf35a34c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:06.682831 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-840d072f-5ede-4393-98a6-468cf07b731c tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs/tempest-keypair-430201010" status: 200 len: 497 microversion: 2.1 time: 0.026470 Jul 14 14:51:06.695506 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1271/2646] 10.222.0.98 () {58 vars in 1214 bytes} [Thu Jul 14 14:51:06 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-430201010 => generated 497 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:06.709392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:06.710928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:06.740159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.747157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.752092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.753450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.863514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:06.883032 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3497d1ad-43bd-4326-af94-aeace9777e3c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.662402 Jul 14 14:51:06.884360 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1376/2647] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:06 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:06.895326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-246908751"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:06.896503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:06.908695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.909158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.909979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.910426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.952264 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Cannot 'createImage' instance c613e631-44c4-4528-b21f-6919a2785219 while it is in task_state image_snapshot Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action HTTP/1.1 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 84 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-246908751"}} Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'createImage' instance c613e631-44c4-4528-b21f-6919a2785219 while it is in task_state image_snapshot Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-246908751'}}} Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1348, in _action_create_image Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c613e631-44c4-4528-b21f-6919a2785219 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1353, in _action_create_image Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 14:51:06.954764 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c613e631-44c4-4528-b21f-6919a2785219 while it is in task_state image_snapshot Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c613e631-44c4-4528-b21f-6919a2785219 while it is in task_state image_snapshot Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 409 to user: Cannot 'createImage' instance c613e631-44c4-4528-b21f-6919a2785219 while it is in task_state image_snapshot {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b24d778a-876b-4f33-8607-fe533a363541 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action" status: 409 len: 159 microversion: 2.1 time: 0.071162 Jul 14 14:51:06.959087 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1377/2648] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:06 2022] POST /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219/action => generated 159 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:51:06.962878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-243b5b7f-b5f3-4e70-b3df-16456f8a8e9e req-ad35a779-8eb5-40d8-b11e-f5f74f261dc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:06.972786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-243b5b7f-b5f3-4e70-b3df-16456f8a8e9e req-ad35a779-8eb5-40d8-b11e-f5f74f261dc4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:06.973229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-243b5b7f-b5f3-4e70-b3df-16456f8a8e9e req-ad35a779-8eb5-40d8-b11e-f5f74f261dc4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:06.988050 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-243b5b7f-b5f3-4e70-b3df-16456f8a8e9e req-ad35a779-8eb5-40d8-b11e-f5f74f261dc4 service nova] Creating event network-changed:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:51:06.995051 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-243b5b7f-b5f3-4e70-b3df-16456f8a8e9e req-ad35a779-8eb5-40d8-b11e-f5f74f261dc4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036500 Jul 14 14:51:06.996340 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1378/2649] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:07.003314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1089655614", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "3e4d676b-43a6-40f9-be48-f1f10ab7d1ab"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:07.072180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] validate_networks() for [('3e4d676b-43a6-40f9-be48-f1f10ab7d1ab', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:07.329153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:07.358469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b229f131-493a-49ed-9f17-f7515ad37a86 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1394 microversion: 2.1 time: 0.656298 Jul 14 14:51:07.368859 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1272/2650] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:06 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1394 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:07.380303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-48399d7d-b008-49ce-875c-097290dc3f49 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdbf314bd30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:07.435577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-48399d7d-b008-49ce-875c-097290dc3f49 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-430201010" status: 202 len: 0 microversion: 2.1 time: 0.057318 Jul 14 14:51:07.436790 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1273/2651] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:51:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-430201010 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:07.449263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02020f7a-8481-4a06-ba13-a333c1a163de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '.version_select at 0x7fdbf31e1af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:07.738717 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02020f7a-8481-4a06-ba13-a333c1a163de tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/images/a28b9235-9a66-4063-b616-9cf1ca53ad22" status: 204 len: 0 microversion: 2.1 time: 0.299954 Jul 14 14:51:07.739573 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1274/2652] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:07 2022] DELETE /compute/v2.1/images/a28b9235-9a66-4063-b616-9cf1ca53ad22 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:07.746941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d42e8fe-280d-45e4-8b4b-3be882701021 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Action: 'create', calling method: .version_select at 0x7fdbf2ad0e50>, body: {"keypair": {"name": "tempest-keypair-491891085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDGAULGAku4XFfopxIdQdL5JIawJnEBAXbxCICgTMo9w1nWyxm0pNYu5l36ZWuIq0O4SLcgVB7X5w0tLcpQBS6FBct5YJaiEd72fa2ISeTxvS5JWTeGfXgzkJlSa855zrw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:07.771655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5d42e8fe-280d-45e4-8b4b-3be882701021 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:07.779444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5d42e8fe-280d-45e4-8b4b-3be882701021 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for user 5f3aa69fa13247cdb6cb55057b6bba13 and project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:07.822486 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d42e8fe-280d-45e4-8b4b-3be882701021 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.081426 Jul 14 14:51:07.831666 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1275/2653] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:07.866648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:07.868568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:07.886908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.889033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.891203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.894885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.923581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:07.924627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:07.925635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:07.926332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:07.926918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:07.942393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.942865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.944608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:07.945255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:07.967011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Getting quotas for project 1a307dcb18fe4909bc0421fb1fb18892. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:07.979574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Getting quotas for user 7ef211f562144656a4a95f4e0df02341 and project 1a307dcb18fe4909bc0421fb1fb18892. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:08.000819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:08.004424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:08.073374 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f6701896-a727-4ec7-a313-b0aa3dd97db5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.075534 Jul 14 14:51:08.074298 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1379/2654] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:08.084781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:08.085769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:08.103752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.104612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.105652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.106094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.334842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.345869 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1a081592-876f-4a5c-95b1-6498845d83ff tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1540 microversion: 2.1 time: 0.270685 Jul 14 14:51:08.346902 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1380/2655] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:08 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1540 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:08.353299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ccf41114-5df8-45dc-8710-47298168e3f3 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdc042930d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:08.357015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.371397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.378144 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ccf41114-5df8-45dc-8710-47298168e3f3 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491891085" status: 202 len: 0 microversion: 2.1 time: 0.029638 Jul 14 14:51:08.379372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1381/2656] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491891085 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:08.385696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.388048 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98c829ca-8a5f-4de0-a11f-e0e9a385e82d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.537250 Jul 14 14:51:08.393886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:08.396039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:08.407498 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1276/2657] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:07 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:08.409748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.410572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.412065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.412721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.424239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e879ba1b-07b0-4b4b-a664-668fc939ffff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:08.424905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e879ba1b-07b0-4b4b-a664-668fc939ffff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:08.609046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e879ba1b-07b0-4b4b-a664-668fc939ffff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.635645 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e879ba1b-07b0-4b4b-a664-668fc939ffff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1216 microversion: 2.1 time: 0.226528 Jul 14 14:51:08.642222 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1277/2658] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:08 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1216 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:08.662074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:08.666478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:08.700860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.701373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.705386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.705879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.772778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:08.799111 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b26a0b46-c23b-4d9f-a20e-b6badb5bd398 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.415306 Jul 14 14:51:08.800228 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1382/2659] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:08 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:08.815149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ef8586a-9bdf-4c64-884c-6c1a7d572895 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Action: 'create', calling method: .version_select at 0x7fdbf2333670>, body: {"keypair": {"name": "tempest-keypair-815481100", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:08.852164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7ef8586a-9bdf-4c64-884c-6c1a7d572895 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:08.861069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7ef8586a-9bdf-4c64-884c-6c1a7d572895 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for user 5f3aa69fa13247cdb6cb55057b6bba13 and project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:08.919063 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ef8586a-9bdf-4c64-884c-6c1a7d572895 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.111749 Jul 14 14:51:08.926159 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1383/2660] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:08 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:08.931306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6300dff6-f3e7-4bfa-aa6a-d59becbbd720 req-3edaedf7-a11e-4fea-8fb2-e2f0f41880c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9561de-a262-42aa-9970-e747af3e88a8", "name": "network-vif-plugged", "status": "completed", "tag": "e4f71160-74ef-4672-a27e-ee986e72f3b7"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:08.945077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6300dff6-f3e7-4bfa-aa6a-d59becbbd720 req-3edaedf7-a11e-4fea-8fb2-e2f0f41880c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:08.945542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6300dff6-f3e7-4bfa-aa6a-d59becbbd720 req-3edaedf7-a11e-4fea-8fb2-e2f0f41880c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:08.960203 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6300dff6-f3e7-4bfa-aa6a-d59becbbd720 req-3edaedf7-a11e-4fea-8fb2-e2f0f41880c9 service nova] Creating event network-vif-plugged:e4f71160-74ef-4672-a27e-ee986e72f3b7 for instance 9f9561de-a262-42aa-9970-e747af3e88a8 on n-h1-768852-23 Jul 14 14:51:08.966631 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6300dff6-f3e7-4bfa-aa6a-d59becbbd720 req-3edaedf7-a11e-4fea-8fb2-e2f0f41880c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041795 Jul 14 14:51:08.971951 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1384/2661] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:08.978491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0eb02d70-da4b-431f-a241-302d22302d3e tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdc0427d0d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.024828 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0eb02d70-da4b-431f-a241-302d22302d3e tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815481100" status: 202 len: 0 microversion: 2.1 time: 0.049722 Jul 14 14:51:09.027106 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1385/2662] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 14:51:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815481100 => generated 0 bytes in 54 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:09.053817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d46e33d9-c5e2-4de4-b2f7-4a7e0aad46e1 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Action: 'create', calling method: .version_select at 0x7fdbf2378e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1726972351", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2ZZAiQbzsLVv/lHFFW2bHW/F5vuRjmODwt3lNWQ6qSR6cAClk6Bz7Slsv4Y2yXsLIYw4WDJW3oKDMAdzGPa9Kf3+vDbJzi4CwlxmHzt2YxW71kNj07f5mBsFggkBbsbQ=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:09.087419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-d46e33d9-c5e2-4de4-b2f7-4a7e0aad46e1 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:09.093314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-d46e33d9-c5e2-4de4-b2f7-4a7e0aad46e1 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for user 5f3aa69fa13247cdb6cb55057b6bba13 and project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:09.135219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d46e33d9-c5e2-4de4-b2f7-4a7e0aad46e1 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.093525 Jul 14 14:51:09.136026 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1386/2663] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:09.154558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87678c2f-4d89-4429-a907-738b2c67163d tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Action: 'create', calling method: .version_select at 0x7fdc04256e50>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1060958059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHum+nkK6bmNZZ1N/dgXhv7foxGj7yu6HLkHyPhzx0N5XgdLKmF+IdpHLlpNqKdbKszwmHoVhBDkyhQ9EKxmTF9eqyKabvW6J0SlY2i66y91z4g0n3QNN34TxgJlqcZcWA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:09.178772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-87678c2f-4d89-4429-a907-738b2c67163d tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:09.186657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-87678c2f-4d89-4429-a907-738b2c67163d tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for user 5f3aa69fa13247cdb6cb55057b6bba13 and project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:09.224842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87678c2f-4d89-4429-a907-738b2c67163d tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.074404 Jul 14 14:51:09.237383 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1387/2664] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:09.248243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edb9a97f-ee49-405d-9c31-f4fa83eb6f37 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Action: 'create', calling method: .version_select at 0x7fdbf31618b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1087284422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDXgc/c3LKaFWOJmTv+/tTTZ7aDKnZVFLLLGBFw12v01S5jAkCIOC+21/gqB9EWL9SI+wGWsR15e4W0BH/5paHInfANTnU5rTNdcufWJrP8r3DaYXZiHA77FGCt0RTFv6w=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:09.271018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-edb9a97f-ee49-405d-9c31-f4fa83eb6f37 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:09.281997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-edb9a97f-ee49-405d-9c31-f4fa83eb6f37 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Getting quotas for user 5f3aa69fa13247cdb6cb55057b6bba13 and project 6411d2a129c34c4080f7097ff8e2a566. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:09.317649 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edb9a97f-ee49-405d-9c31-f4fa83eb6f37 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.076288 Jul 14 14:51:09.317649 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1388/2665] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:09 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:09.330547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f728d507-fccc-41a1-b2c5-62431a421a83 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdbf230a280>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.335181 n-d-768852-23 devstack@n-api.service[125965]: WARNING oslo_db.sqlalchemy.utils [None req-f728d507-fccc-41a1-b2c5-62431a421a83 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:51:09.346682 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f728d507-fccc-41a1-b2c5-62431a421a83 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.021435 Jul 14 14:51:09.354202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1389/2666] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:51:09 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:09.361622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c2e2fd5-e46f-455c-a91a-7180368493d9 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdc042f15e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.386837 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c2e2fd5-e46f-455c-a91a-7180368493d9 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1087284422" status: 202 len: 0 microversion: 2.1 time: 0.029141 Jul 14 14:51:09.387853 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1390/2667] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 14:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1087284422 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:09.398260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.399146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:09.411978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.412756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.413583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.414042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.427851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:09.452990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ee2a013-d0fe-448a-aaef-e17bdd6fa757 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1394 microversion: 2.1 time: 0.807658 Jul 14 14:51:09.457927 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1278/2668] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:08 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1394 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:09.469102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6e75067-b88c-4dce-bea6-8c01034c6987 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdbf34bd820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.522365 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6e75067-b88c-4dce-bea6-8c01034c6987 tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1060958059" status: 202 len: 0 microversion: 2.1 time: 0.060338 Jul 14 14:51:09.524840 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1279/2669] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 14:51:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1060958059 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:09.539676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:09.541429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:09.555891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.557069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.558893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.560186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.844141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:09.858490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:09.862190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:09.864749 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c534a0d-55e4-4854-bb82-bdc0fc7b437a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.336919 Jul 14 14:51:09.880866 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1280/2670] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:09 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:09.891094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0b7b795a-ce96-4a45-b1b8-0ceeb72fb7dc req-53c5e734-0cb5-48c7-976b-4efdcd02cc83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:09.911304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0b7b795a-ce96-4a45-b1b8-0ceeb72fb7dc req-53c5e734-0cb5-48c7-976b-4efdcd02cc83 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:09.925486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0b7b795a-ce96-4a45-b1b8-0ceeb72fb7dc req-53c5e734-0cb5-48c7-976b-4efdcd02cc83 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:09.981302 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0b7b795a-ce96-4a45-b1b8-0ceeb72fb7dc req-53c5e734-0cb5-48c7-976b-4efdcd02cc83 service nova] Creating event network-changed:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:51:09.999301 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0b7b795a-ce96-4a45-b1b8-0ceeb72fb7dc req-53c5e734-0cb5-48c7-976b-4efdcd02cc83 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113138 Jul 14 14:51:10.002683 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1281/2671] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:10.023723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7b3947c-7e12-40ff-a7c6-62b37a3dc34a tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] Calling method '.version_select at 0x7fdbf34bd430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.056279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:10.089714 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43e0ee77-0278-47d6-bc56-41c7344d2fb6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1540 microversion: 2.1 time: 0.696712 Jul 14 14:51:10.108658 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1391/2672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:09 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1540 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:10.121401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.126923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:10.144003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.144890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.146394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.147291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.163903 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7b3947c-7e12-40ff-a7c6-62b37a3dc34a tempest-KeyPairsV2TestJSON-1109714823 tempest-KeyPairsV2TestJSON-1109714823-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1726972351" status: 202 len: 0 microversion: 2.1 time: 0.154247 Jul 14 14:51:10.169840 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1282/2673] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 14:51:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1726972351 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:10.222982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.224667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:10.240329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.241336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.244013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.245225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.348391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:10.426864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7120a52e-6ad6-493e-9766-c23ea3cb6805 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1276 microversion: 2.1 time: 0.313509 Jul 14 14:51:10.439068 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1392/2674] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:10.485653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:10.489944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:10.497524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:10.522201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.523002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.531590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:10.532975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:10.612109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:11.058302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:11.095718 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-252ce497-8d23-4bf0-a579-26ff33d83e0a tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1394 microversion: 2.1 time: 0.616992 Jul 14 14:51:11.096914 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1393/2675] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1394 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:11.120296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e5c160f-06e3-4444-a7d9-64b17efa0d87 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '.version_select at 0x7fdbf230a790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.150478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e5c160f-06e3-4444-a7d9-64b17efa0d87 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.153277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e5c160f-06e3-4444-a7d9-64b17efa0d87 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.206973 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e5c160f-06e3-4444-a7d9-64b17efa0d87 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/os-migrations" status: 200 len: 813 microversion: 2.1 time: 0.107840 Jul 14 14:51:11.214299 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1394/2676] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/os-migrations => generated 813 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:11.257309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.271893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:11.298011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.298306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.306963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.308574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.496620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:11.512990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dbf91c26-c9b2-4f41-817e-621916a431ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 1.332746 Jul 14 14:51:11.523316 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1283/2677] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:10 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:11.531320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:11.531320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:11.549455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.551157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:11.553727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:11.557253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.137126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:12.146547 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-84ca4537-386f-46fc-a571-49eaddcfbd42 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1535 microversion: 2.1 time: 0.627177 Jul 14 14:51:12.147842 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1284/2678] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1535 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:12.150632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:12.162613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4d6a3e8-dbef-4e79-a239-492a6c9187a1 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.182494 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4d6a3e8-dbef-4e79-a239-492a6c9187a1 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031856 Jul 14 14:51:12.183479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:12.193228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:12.195959 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1285/2679] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:12.196334 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b345858e-1214-448f-b131-d57a74122fac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.973955 Jul 14 14:51:12.197976 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1395/2680] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:11 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:12.214904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.215737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.216077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:12.218249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:12.240290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.240514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.241611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.241747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.243447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.245095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.247570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.248704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.434380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:12.452171 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18568ecb-2bec-45be-805d-1a07601f9225 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1274 microversion: 2.1 time: 0.254259 Jul 14 14:51:12.467524 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1286/2681] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1274 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:12.467524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37be8cb2-719d-4313-8705-274fc8d7603f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2051604960", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:12.467524 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:51:12.467524 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:51:12.503193 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37be8cb2-719d-4313-8705-274fc8d7603f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.048630 Jul 14 14:51:12.506996 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1287/2682] 10.222.0.98 () {60 vars in 1145 bytes} [Thu Jul 14 14:51:12 2022] POST /compute/v2.1/flavors => generated 499 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:12.537182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0c494fd-0132-442b-a5e0-a5d420b240d2 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.570818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0c494fd-0132-442b-a5e0-a5d420b240d2 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.045363 Jul 14 14:51:12.576252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1288/2683] 10.222.0.98 () {58 vars in 1181 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:12.590318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.590940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:12.616605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.617162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.619291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.619756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.842760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:12.854857 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef86121c-1db2-491d-9b64-a04df4568523 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1574 microversion: 2.1 time: 0.650199 Jul 14 14:51:12.859983 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1396/2684] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1574 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:12.876109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:12.878086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:12.889304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.890166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:12.892131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:12.892799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.100024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:13.111339 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-33989abc-269e-477b-ae4d-6cd6dd245426 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.532839 Jul 14 14:51:13.112462 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1289/2685] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:13.127814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-598740703", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "8040955d-8451-476c-ab33-3111d2da02a4"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:13.148526 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fa21982-2175-4a24-ba11-54da6f2210fc tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.276140 Jul 14 14:51:13.149770 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1397/2686] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:51:12 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:13.169422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:13.170733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:13.188209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.199979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.205429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.206766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.233207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:13.705782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:13.720929 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad3f3bf0-d125-474c-abdd-65e6a0ad10f5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1522 microversion: 2.1 time: 0.558156 Jul 14 14:51:13.731314 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1398/2687] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:13 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1522 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:13.735484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:13.735959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:13.758988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.759827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:13.761570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:13.762603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.520323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:14.537450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:14.555589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:14.558489 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-265d7d47-fd0a-433b-a197-65e2ca54bea3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.835031 Jul 14 14:51:14.560569 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1399/2688] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:13 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:14.746063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:14.746861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:14.747010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:14.748764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:14.749247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:14.762907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.763495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.764808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.765393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.802533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:14.810443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for user a185fa24374c417aa2bb9302a608cbcd and project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:14.828164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:14.831794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:14.881347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b7dff9ea-3050-4c36-9d15-621ed2636425 req-747f28b1-298a-4699-86c1-82ee5f618828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c613e631-44c4-4528-b21f-6919a2785219", "name": "network-vif-plugged", "status": "completed", "tag": "f93fe03d-21fa-42db-b0fc-79511a897b52"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:14.911157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b7dff9ea-3050-4c36-9d15-621ed2636425 req-747f28b1-298a-4699-86c1-82ee5f618828 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.912011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b7dff9ea-3050-4c36-9d15-621ed2636425 req-747f28b1-298a-4699-86c1-82ee5f618828 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.920239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c278cf6-cd7c-439b-a300-5f27bbe90cdf tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803514 Jul 14 14:51:14.921203 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1290/2689] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:14.926580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:14.927502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:14.934839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.935481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.936359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:14.937603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:14.994607 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b7dff9ea-3050-4c36-9d15-621ed2636425 req-747f28b1-298a-4699-86c1-82ee5f618828 service nova] Creating event network-vif-plugged:f93fe03d-21fa-42db-b0fc-79511a897b52 for instance c613e631-44c4-4528-b21f-6919a2785219 on n-h1-768852-23 Jul 14 14:51:15.006223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b7dff9ea-3050-4c36-9d15-621ed2636425 req-747f28b1-298a-4699-86c1-82ee5f618828 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.442739 Jul 14 14:51:15.007839 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1400/2690] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:15.038487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.039603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.088140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.088989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.090693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.091576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.214771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:15.445082 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3793683-d419-4710-8a0f-1e45bce00fbd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 204 len: 0 microversion: 2.1 time: 0.435158 Jul 14 14:51:15.448332 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1401/2691] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:15 2022] DELETE /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:15.462768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.463883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:15.481581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.482038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.482875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:15.483376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:15.620302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:15.629022 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed45c2c9-7b15-45c0-8c56-0ccf98a8e7c1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 0.706601 Jul 14 14:51:15.634886 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1291/2692] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:14 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:15.745999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4d359b5-d267-4f93-8773-31801365bced tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf314b4c0>, body: {"keypair": {"name": "tempest-keypair-1647255390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDniuRsM7Tmg6XPh3s6MQG2PhSLOl6trDyrzGHotDCZQJ54RDx64tfwhr3eAJ+dTF3V6+oCODQ5pOaQandba3Dh36yb72zAA26b3Wd5Hz3BDRro6jow7n+g/L4Eit+hbdg=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:15.769475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c4d359b5-d267-4f93-8773-31801365bced tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:15.778057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c4d359b5-d267-4f93-8773-31801365bced tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:15.832745 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4d359b5-d267-4f93-8773-31801365bced tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.196144 Jul 14 14:51:15.833595 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1292/2693] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 198 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:51:15.842578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99a3eaf1-20f6-41e7-8c56-5d8a02d24ee7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:15.846661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-99a3eaf1-20f6-41e7-8c56-5d8a02d24ee7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.094281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99a3eaf1-20f6-41e7-8c56-5d8a02d24ee7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:16.141030 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99a3eaf1-20f6-41e7-8c56-5d8a02d24ee7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1278 microversion: 2.1 time: 0.303948 Jul 14 14:51:16.163754 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1293/2694] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:15 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1278 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:16.177480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.181454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.197817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.199371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.202343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.205503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.590603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:16.604315 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1bc3ec84-8133-428c-b058-b87b7b377233 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 1.154636 Jul 14 14:51:16.608249 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1402/2695] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:15 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:16.620776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.622296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.637890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.639511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.644736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.646146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.763941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:16.780429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22b599c1-e420-430d-b460-397adf766ce4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1528 microversion: 2.1 time: 0.611541 Jul 14 14:51:16.786587 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1294/2696] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1528 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:16.799235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54cffcda-bba8-4f20-8ca1-46ed11f31b52 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf31b6ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.813211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54cffcda-bba8-4f20-8ca1-46ed11f31b52 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs/tempest-keypair-1647255390" status: 200 len: 513 microversion: 2.2 time: 0.025397 Jul 14 14:51:16.814204 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1295/2697] 10.222.0.98 () {60 vars in 1257 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1647255390 => generated 513 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:16.820574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:16.821538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:16.831597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.832690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:16.834097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:16.834897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.227692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.239227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2fab91b6-ac8b-4dad-9db8-da526a9caf50 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 0.423605 Jul 14 14:51:17.240476 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1296/2698] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:17.389654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.408784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-1b037c8d-d317-410d-9d5b-a6e702ee76ac req-f4e28a10-0d87-40a5-a038-3e33e914ec8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f502d653-a001-463d-822c-62943de2ff18", "tag": "36ea74e1-0e36-43ef-9f27-c1220f9a55ad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:17.420488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.427485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.428927 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-48f25085-a101-4cc6-8d2d-8453dc7f80b7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.816536 Jul 14 14:51:17.429639 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1403/2699] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:16 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:17.439318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-64130922-0596-4f68-b5de-d1f2550958fd tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdc0427dca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.442998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1b037c8d-d317-410d-9d5b-a6e702ee76ac req-f4e28a10-0d87-40a5-a038-3e33e914ec8f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.443496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1b037c8d-d317-410d-9d5b-a6e702ee76ac req-f4e28a10-0d87-40a5-a038-3e33e914ec8f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.464332 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-1b037c8d-d317-410d-9d5b-a6e702ee76ac req-f4e28a10-0d87-40a5-a038-3e33e914ec8f service nova] Creating event network-changed:36ea74e1-0e36-43ef-9f27-c1220f9a55ad for instance f502d653-a001-463d-822c-62943de2ff18 on n-h2-768852-23 Jul 14 14:51:17.465784 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-64130922-0596-4f68-b5de-d1f2550958fd tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647255390" status: 204 len: 0 microversion: 2.2 time: 0.030465 Jul 14 14:51:17.467311 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1404/2700] 10.222.0.98 () {60 vars in 1260 bytes} [Thu Jul 14 14:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1647255390 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:17.480135 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-1b037c8d-d317-410d-9d5b-a6e702ee76ac req-f4e28a10-0d87-40a5-a038-3e33e914ec8f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.237201 Jul 14 14:51:17.481225 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1297/2701] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:17.485588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f174e627-fb55-48e5-91b1-ecbfb21052a8 req-f9a3a225-41ae-44c4-b30b-09fc912b25e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "name": "network-vif-plugged", "status": "completed", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:17.493000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.496286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:17.497823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f174e627-fb55-48e5-91b1-ecbfb21052a8 req-f9a3a225-41ae-44c4-b30b-09fc912b25e9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.498440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f174e627-fb55-48e5-91b1-ecbfb21052a8 req-f9a3a225-41ae-44c4-b30b-09fc912b25e9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.503737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:17.518475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f174e627-fb55-48e5-91b1-ecbfb21052a8 req-f9a3a225-41ae-44c4-b30b-09fc912b25e9 service nova] Creating event network-vif-plugged:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:51:17.520309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.521998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.523118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.523995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.525157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f174e627-fb55-48e5-91b1-ecbfb21052a8 req-f9a3a225-41ae-44c4-b30b-09fc912b25e9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055875 Jul 14 14:51:17.526185 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1405/2702] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:17.548124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb7fb6e8-8149-4b23-b6c2-febd94bdefd4 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdc04293f70>, body: {"keypair": {"name": "tempest-keypair-1882949820", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcF9xu/SBe7uywNlt4HQSI+bsD53c3OzaYqK8l/sNBUOPEwLFAl9ERrfGUuPoNrgVZrcCCqnwytAZu+yqFvuB/lSWcICK855s93PyvGdZy5dhRoSB3l+sLEyD5ZyBOMTw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:17.574795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=49 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:17.603691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-fb7fb6e8-8149-4b23-b6c2-febd94bdefd4 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:17.617546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-fb7fb6e8-8149-4b23-b6c2-febd94bdefd4 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:17.698472 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb7fb6e8-8149-4b23-b6c2-febd94bdefd4 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.170797 Jul 14 14:51:17.699530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1406/2703] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 172 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:51:17.735399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.736196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:17.745159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.752823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.753697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.754214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.858428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:17.870174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-163cc35f-902d-4aac-b04e-56ac9118bb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1336 microversion: 2.1 time: 0.387375 Jul 14 14:51:17.872840 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1298/2704] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:17 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1336 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:17.889387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c3e1c2d-b231-43d8-8ea3-55ae835954eb tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf3192a60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.929725 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c3e1c2d-b231-43d8-8ea3-55ae835954eb tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882949820" status: 204 len: 0 microversion: 2.2 time: 0.055575 Jul 14 14:51:17.930875 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1299/2705] 10.222.0.98 () {60 vars in 1260 bytes} [Thu Jul 14 14:51:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1882949820 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:17.939690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:17.940406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:17.957078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:17.967589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.968827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.969847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:17.970466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:17.976615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:18.128744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:18.137794 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cb082758-6396-4631-b3a1-d6fcbd2fac85 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.425474 Jul 14 14:51:18.143085 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1407/2706] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:17 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:18.150562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-acd97e5b-6408-45b8-9708-e859c3c5c059 req-12f1c6b7-c77e-4b7c-8d58-e34ac3514105 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f9561de-a262-42aa-9970-e747af3e88a8", "tag": "e4f71160-74ef-4672-a27e-ee986e72f3b7"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:18.174237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-acd97e5b-6408-45b8-9708-e859c3c5c059 req-12f1c6b7-c77e-4b7c-8d58-e34ac3514105 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:18.177404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-acd97e5b-6408-45b8-9708-e859c3c5c059 req-12f1c6b7-c77e-4b7c-8d58-e34ac3514105 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:18.208716 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-acd97e5b-6408-45b8-9708-e859c3c5c059 req-12f1c6b7-c77e-4b7c-8d58-e34ac3514105 service nova] Creating event network-changed:e4f71160-74ef-4672-a27e-ee986e72f3b7 for instance 9f9561de-a262-42aa-9970-e747af3e88a8 on n-h1-768852-23 Jul 14 14:51:18.231418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-acd97e5b-6408-45b8-9708-e859c3c5c059 req-12f1c6b7-c77e-4b7c-8d58-e34ac3514105 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086410 Jul 14 14:51:18.232500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1408/2707] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:18.240299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:18.253845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:18.262545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:18.263476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:18.264487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:18.265738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:18.907522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:18.921272 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f3ce55d-b4e3-4efb-8c1e-23a759aa9224 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1574 microversion: 2.1 time: 0.989036 Jul 14 14:51:18.923741 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1300/2708] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:17 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1574 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:18.933657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1559444-9548-4b55-9449-bf32b19f7717 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf31e30d0>, body: {"keypair": {"name": "tempest-keypair-1322680368", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:18.987668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a1559444-9548-4b55-9449-bf32b19f7717 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:18.996563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a1559444-9548-4b55-9449-bf32b19f7717 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:19.003104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:19.019961 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a05f7c5b-51c2-4f3a-8ecc-9d892d717ca2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1528 microversion: 2.1 time: 0.785165 Jul 14 14:51:19.020616 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1409/2709] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:18 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1528 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:19.039413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.040388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:19.053642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.058145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.060902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.060902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.068568 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1559444-9548-4b55-9449-bf32b19f7717 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.143326 Jul 14 14:51:19.069264 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1301/2710] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:18 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 145 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:51:19.074869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.077601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:19.094534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.096689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.100018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.108034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.595414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:19.612120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:19.613709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:19.614919 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e19dd7f-3c83-4096-87e4-007b7ddb8b4f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 0.544375 Jul 14 14:51:19.615552 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1302/2711] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:19 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:19.635580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.636238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:19.655067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.655568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.656966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.657421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.668322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:19.677929 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b5cc6423-86f2-494d-a642-e0e68ce5cd4d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 0.656134 Jul 14 14:51:19.685118 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1410/2712] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:19 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:19.695597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4243c517-a0ba-492e-839b-561a97868047 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdc04293ee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.744109 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4243c517-a0ba-492e-839b-561a97868047 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322680368" status: 204 len: 0 microversion: 2.2 time: 0.057405 Jul 14 14:51:19.745643 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1411/2713] 10.222.0.98 () {60 vars in 1260 bytes} [Thu Jul 14 14:51:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1322680368 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:19.753002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:19.754053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:19.764081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.765679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:19.766826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:19.772773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.006282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:20.039560 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-034cddee-1ad6-49c6-8400-38e0b89ebd36 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1336 microversion: 2.1 time: 0.410620 Jul 14 14:51:20.043801 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1303/2714] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:19 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1336 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:20.063332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7c702f3c-23cc-485d-a485-7b0579f2342a req-b5b0b0e4-a1a8-492b-95ad-9eb61d73bc73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c613e631-44c4-4528-b21f-6919a2785219", "name": "network-vif-unplugged", "status": "completed", "tag": "f93fe03d-21fa-42db-b0fc-79511a897b52"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:20.105024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7c702f3c-23cc-485d-a485-7b0579f2342a req-b5b0b0e4-a1a8-492b-95ad-9eb61d73bc73 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.113197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7c702f3c-23cc-485d-a485-7b0579f2342a req-b5b0b0e4-a1a8-492b-95ad-9eb61d73bc73 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.168147 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7c702f3c-23cc-485d-a485-7b0579f2342a req-b5b0b0e4-a1a8-492b-95ad-9eb61d73bc73 service nova] Creating event network-vif-unplugged:f93fe03d-21fa-42db-b0fc-79511a897b52 for instance c613e631-44c4-4528-b21f-6919a2785219 on n-h1-768852-23 Jul 14 14:51:20.184401 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7c702f3c-23cc-485d-a485-7b0579f2342a req-b5b0b0e4-a1a8-492b-95ad-9eb61d73bc73 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130523 Jul 14 14:51:20.186433 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1304/2715] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:20.205036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ee1f00e-c4b1-4cc4-bb57-18dd20a49e7c tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf314baf0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1260155010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/yn+QjXbIGZB11gfx2rfmQ+gMPRe6bY73PAzIP7kpSvJyiLmNCcOec54I57UHjkZ5jz7mAXTX6YJ9RVCCRWnJ2xqmcW4XtFnfd9pAcfAU60/vE5rceP56cuP1Qb317kA=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:20.251597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6ee1f00e-c4b1-4cc4-bb57-18dd20a49e7c tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:20.276615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6ee1f00e-c4b1-4cc4-bb57-18dd20a49e7c tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:20.310364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:20.333586 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc6eea2c-cf0f-4b11-afaa-acdb7e64d9c2 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.583918 Jul 14 14:51:20.337218 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1412/2716] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:19 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:20.354218 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ee1f00e-c4b1-4cc4-bb57-18dd20a49e7c tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.164220 Jul 14 14:51:20.354761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:20.356598 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1305/2717] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 169 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:51:20.358396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:20.369696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5b4c00ab-8cda-4f5f-8128-2a5aa007c417 req-bcf12dd1-748e-43f1-9f4f-00dc88e05743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c613e631-44c4-4528-b21f-6919a2785219", "name": "network-vif-deleted", "tag": "f93fe03d-21fa-42db-b0fc-79511a897b52"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:20.382409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.383643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.384698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.386757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.387836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5b4c00ab-8cda-4f5f-8128-2a5aa007c417 req-bcf12dd1-748e-43f1-9f4f-00dc88e05743 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.388637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5b4c00ab-8cda-4f5f-8128-2a5aa007c417 req-bcf12dd1-748e-43f1-9f4f-00dc88e05743 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.417561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5b4c00ab-8cda-4f5f-8128-2a5aa007c417 req-bcf12dd1-748e-43f1-9f4f-00dc88e05743 service nova] Creating event network-vif-deleted:f93fe03d-21fa-42db-b0fc-79511a897b52 for instance c613e631-44c4-4528-b21f-6919a2785219 on n-h1-768852-23 Jul 14 14:51:20.430923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5b4c00ab-8cda-4f5f-8128-2a5aa007c417 req-bcf12dd1-748e-43f1-9f4f-00dc88e05743 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071803 Jul 14 14:51:20.433012 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1306/2718] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:20.448618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b59d4343-17d9-4923-92cf-435895c6a009 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf3192af0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2132018016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNvNe5NXIE0krJJw7283AsD66IZeVElvel3+F/RktwGGNrLg2SnPkgp0ZXHkWL/ZnNxtDRJENcBGXe1A0QV6gvcMN6cfT2UyR9fVF+YDnKUuermFpNhvdDN+LiX3uhj2aQ=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:20.483361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b59d4343-17d9-4923-92cf-435895c6a009 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:20.495630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b59d4343-17d9-4923-92cf-435895c6a009 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:20.542700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:20.553900 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f7c87223-9eac-451a-918f-1d2c6bc65d0d tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 200 len: 1309 microversion: 2.1 time: 0.214393 Jul 14 14:51:20.559379 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1413/2719] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:20 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 1309 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:20.589651 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b59d4343-17d9-4923-92cf-435895c6a009 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.152307 Jul 14 14:51:20.600925 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1307/2720] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:20 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 167 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:51:20.618371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fe9bb93-d3cd-4349-a434-f3c8bc33886a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf3161dc0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-851031523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3Neiz3E6zfT0Wu3J0YwNtvY/bX/Ta1d3NllJ57LHdnwNq8Qw0/KEquNWxJjS/KrIFU4z70TIp9iacLsQhvAzTQIBG23OJVdvaUCd7t4ofYkEEwvX/ILCekTlDEL09ANQ=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:20.661028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6fe9bb93-d3cd-4349-a434-f3c8bc33886a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:20.662009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:20.663628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:20.680472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6fe9bb93-d3cd-4349-a434-f3c8bc33886a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:20.685507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.686834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.692872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.694111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.756126 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6fe9bb93-d3cd-4349-a434-f3c8bc33886a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.146109 Jul 14 14:51:20.757014 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1414/2721] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:20 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 149 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Jul 14 14:51:20.772137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:20.774234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:20.812181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.813004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.814063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:20.815976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:20.841153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:21.232436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:21.248225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b74916d5-7d3c-4f71-be36-a57af285e4e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 0.482927 Jul 14 14:51:21.250341 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1415/2722] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:20 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:21.256136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-458dfd73-d617-459f-a934-2b5cb65a2546 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf349b700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.264377 n-d-768852-23 devstack@n-api.service[125965]: WARNING oslo_db.sqlalchemy.utils [None req-458dfd73-d617-459f-a934-2b5cb65a2546 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:51:21.279262 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-458dfd73-d617-459f-a934-2b5cb65a2546 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.027581 Jul 14 14:51:21.280571 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1416/2723] 10.222.0.98 () {60 vars in 1176 bytes} [Thu Jul 14 14:51:21 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:21.291102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.292833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:21.304163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.305272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.306341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.306951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.602156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:21.615887 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a8f60510-30b1-46ec-b87c-907aab71d1d3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 0.333751 Jul 14 14:51:21.619744 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1417/2724] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:21 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:21.624933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15071efa-768d-49a0-836c-e98b8ab9a9ac tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf2333670>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.632171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:21.671445 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15071efa-768d-49a0-836c-e98b8ab9a9ac tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-851031523" status: 204 len: 0 microversion: 2.2 time: 0.050132 Jul 14 14:51:21.672754 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1418/2725] 10.222.0.98 () {60 vars in 1317 bytes} [Thu Jul 14 14:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-851031523 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:21.675973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:21.682865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.683543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:21.703740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.707531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.710094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:21.711919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.712558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.720203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-42bc5af3-e5ac-4d62-b0cd-93591fa7503d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1407 microversion: 2.20 time: 1.072643 Jul 14 14:51:21.731064 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1308/2726] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:20 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1407 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:51:21.736582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.737867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:21.746266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.747181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.748764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:21.750032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:21.778076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 HTTP/1.1 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219'} Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:21.780268 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f313ca68-3589-41ca-aba8-b24d662ee0bf tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 404 len: 111 microversion: 2.1 time: 0.049595 Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1309/2727] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:21 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:21.793433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-998f62ab-fcce-4bd1-88bb-6f6c97076ab9 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf306eca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.818476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-998f62ab-fcce-4bd1-88bb-6f6c97076ab9 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2132018016" status: 204 len: 0 microversion: 2.2 time: 0.032991 Jul 14 14:51:21.823073 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1310/2728] 10.222.0.98 () {60 vars in 1320 bytes} [Thu Jul 14 14:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2132018016 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:21.831459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2cad5797-faa4-43bc-aaee-a24274ba2d43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'create', calling method: .version_select at 0x7fdbf309e550>, body: {"keypair": {"name": "tempest-keypair-1018033859", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAhBKRDEUl/+TAz8T5cjLh7ZvtAKsUI1c7BUDIk91ANWwxMNSooWpst24e+SRPHBJXtFC55NxeJ59pm56uOYNMH0V7AwIx9+hNEIF2uqViCeX0rdD63PmvBGIPvoHeKDA=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:21.853428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2cad5797-faa4-43bc-aaee-a24274ba2d43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for project f30b8cc1b9254cca90487359e0872a93. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:21.884521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2cad5797-faa4-43bc-aaee-a24274ba2d43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for user a7edefb2896948e39ac7aed5a3884233 and project f30b8cc1b9254cca90487359e0872a93. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:21.924338 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2cad5797-faa4-43bc-aaee-a24274ba2d43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.099418 Jul 14 14:51:21.925555 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1311/2729] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:21.935315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c0aefb69-41e7-46b8-a43a-7b738f41eb24 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf309e040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:21.973045 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c0aefb69-41e7-46b8-a43a-7b738f41eb24 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1260155010" status: 204 len: 0 microversion: 2.2 time: 0.045582 Jul 14 14:51:21.973872 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1312/2730] 10.222.0.98 () {60 vars in 1320 bytes} [Thu Jul 14 14:51:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1260155010 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:21.995441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-87b71b4c-777b-45e7-8868-3923b5e8b23a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf306e1f0>, body: {"keypair": {"name": "tempest-keypair-2003837394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtptLn0EMBUgXp6Osr325v0i9D8xb5eAoQ2xmqPuRXZiDPqP8CmKpay5LRz/telqpOBaOI4Yas18ZlTbI4ikcUv8Vnz/ubmYcEoYwQfJc3M96+73ac8ZpGB+SRryiA79g=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:22.053184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-87b71b4c-777b-45e7-8868-3923b5e8b23a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:22.058839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-87b71b4c-777b-45e7-8868-3923b5e8b23a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:22.098880 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-87b71b4c-777b-45e7-8868-3923b5e8b23a tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.114873 Jul 14 14:51:22.102688 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1313/2731] 10.222.0.98 () {62 vars in 1198 bytes} [Thu Jul 14 14:51:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Jul 14 14:51:22.128646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8dd51807-6d18-4789-84a8-02bed627ca92 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf327bd30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.156470 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8dd51807-6d18-4789-84a8-02bed627ca92 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs/tempest-keypair-2003837394" status: 200 len: 513 microversion: 2.2 time: 0.044970 Jul 14 14:51:22.191095 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1314/2732] 10.222.0.98 () {60 vars in 1257 bytes} [Thu Jul 14 14:51:22 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2003837394 => generated 513 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:22.208023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-420ec750-67b4-45a6-b8e4-76993339a314 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf312cd30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.210780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:22.218867 n-d-768852-23 devstack@n-api.service[125966]: WARNING oslo_db.sqlalchemy.utils [None req-420ec750-67b4-45a6-b8e4-76993339a314 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:51:22.238033 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-420ec750-67b4-45a6-b8e4-76993339a314 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.045566 Jul 14 14:51:22.246691 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1315/2733] 10.222.0.98 () {60 vars in 1176 bytes} [Thu Jul 14 14:51:22 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:22.255081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-527bf45d-ec92-4015-bbda-3a27fdd2890f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.580046 Jul 14 14:51:22.257135 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1419/2734] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:21 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:22.271631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57367bea-dc3f-4c08-9180-ef398264952d tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf312cca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.299892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:22.303492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:22.333146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57367bea-dc3f-4c08-9180-ef398264952d tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003837394" status: 204 len: 0 microversion: 2.2 time: 0.085034 Jul 14 14:51:22.333917 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1316/2735] 10.222.0.98 () {60 vars in 1260 bytes} [Thu Jul 14 14:51:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003837394 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:22.341698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:22.345152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Action: 'create', calling method: .version_select at 0x7fdbf327b940>, body: {"keypair": {"name": "tempest-keypair-1090985717", "type": "x509"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:22.349234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:22.351774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:22.352982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:22.395357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:22.397634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:INSERT=5 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:22.408218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:22.518488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.processutils [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpw8vosy44/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpw8vosy44/temp.key -subj /CN=86449d2ab5474b80bd4a05cc4c233da2 -extensions v3_req_client {{(pid=125966) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 14 14:51:22.714920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.processutils [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpw8vosy44/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpw8vosy44/temp.key -subj /CN=86449d2ab5474b80bd4a05cc4c233da2 -extensions v3_req_client" returned: 0 in 0.195s {{(pid=125966) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 14 14:51:22.719722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.processutils [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpw8vosy44/temp.key -password pass: {{(pid=125966) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Jul 14 14:51:22.816784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.processutils [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpw8vosy44/temp.key -password pass:" returned: 0 in 0.098s {{(pid=125966) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Jul 14 14:51:22.937140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:22.943263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Getting quotas for user 86449d2ab5474b80bd4a05cc4c233da2 and project 1ea96ec22cc6498da49173cf1f6bb455. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:23.009452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d73d7679-557c-4028-ab01-51468e778f2f tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.667327 Jul 14 14:51:23.011162 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1317/2736] 10.222.0.98 () {62 vars in 1197 bytes} [Thu Jul 14 14:51:22 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 672 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:23.024540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-57ea91fa-51bb-42ad-8b3f-737b0cfc971f req-61ff9cb4-0de5-490c-909e-01c925bc8ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "name": "network-vif-plugged", "status": "completed", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:23.035736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57ea91fa-51bb-42ad-8b3f-737b0cfc971f req-61ff9cb4-0de5-490c-909e-01c925bc8ad9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.036203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57ea91fa-51bb-42ad-8b3f-737b0cfc971f req-61ff9cb4-0de5-490c-909e-01c925bc8ad9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.055820 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-57ea91fa-51bb-42ad-8b3f-737b0cfc971f req-61ff9cb4-0de5-490c-909e-01c925bc8ad9 service nova] Creating event network-vif-plugged:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:51:23.065334 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-57ea91fa-51bb-42ad-8b3f-737b0cfc971f req-61ff9cb4-0de5-490c-909e-01c925bc8ad9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049901 Jul 14 14:51:23.068835 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1318/2737] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:23.078122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.078805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:23.086476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.087036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.089352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.090025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.262284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:23.286886 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b308a417-77b8-4974-a38e-651e531cf5dd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 1.006308 Jul 14 14:51:23.305849 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1420/2738] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:22 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:23.321492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.322906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:23.348417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.349506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.351300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.352360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.721556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:23.747343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:23.751547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:23.754779 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-82e6d155-dd10-4dbd-84db-0ac16dd31343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1598 microversion: 2.20 time: 0.443225 Jul 14 14:51:23.756375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:23.757731 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1421/2739] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1598 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:51:23.770402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22ed99e6-da1e-487c-88e5-87951c130fa7 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdc0427df70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.784722 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64f4ab98-936c-42a5-9829-416c550cc41a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 0.714436 Jul 14 14:51:23.791626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1319/2740] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:23.800548 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22ed99e6-da1e-487c-88e5-87951c130fa7 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs/tempest-keypair-1090985717" status: 200 len: 1534 microversion: 2.2 time: 0.041928 Jul 14 14:51:23.801751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.802411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:23.809017 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1422/2741] 10.222.0.98 () {60 vars in 1257 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1090985717 => generated 1534 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:23.819820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.820276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.827856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:23.828177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.828684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.829841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:23.842416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.844167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:23.845916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:23.846846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.072186 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c00cf457-290f-4229-9b49-0996a2487d96 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.259860 Jul 14 14:51:24.074255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1423/2742] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-interface => generated 284 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:51:24.100154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-251204dd-af1d-4654-8a59-5209cc34deb5 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf39071f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.104891 n-d-768852-23 devstack@n-api.service[125965]: WARNING oslo_db.sqlalchemy.utils [None req-251204dd-af1d-4654-8a59-5209cc34deb5 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 14:51:24.118944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-251204dd-af1d-4654-8a59-5209cc34deb5 tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.042102 Jul 14 14:51:24.120847 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1424/2743] 10.222.0.98 () {60 vars in 1176 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:24.268780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6131f116-6753-461c-a656-9988d4971554 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: .version_select at 0x7fdbf2333af0>, body: {"keypair": {"name": "tempest-keypair-1543036864", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPiT68BtkprnFCF/n7cW07guYD/bEq3xWDoMQtteZlgmWf7ZvGGI95FaWBu2aa3Aou4JfQHGbtqFh7b96EKH+obfiVH+vCdvIkbaSP2oW3h1B8w8fncU1Hs8lQZI4fTTGw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:24.286409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:24.313076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd20fae0-9a52-4163-ae81-2e41922b1604 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1321 microversion: 2.1 time: 0.517414 Jul 14 14:51:24.320356 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1320/2744] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:23 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:24.347729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-667cfc99-73e7-401c-b0b5-a30cf177940b tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] Calling method '.version_select at 0x7fdbf31e3af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.351240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6131f116-6753-461c-a656-9988d4971554 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for project 27951e61632946f58c199f09723d6fdd. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:24.372280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6131f116-6753-461c-a656-9988d4971554 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for user b06a5d6f31ea4d4a9a7e69f759a3c7ce and project 27951e61632946f58c199f09723d6fdd. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:24.401076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:24.429435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-667cfc99-73e7-401c-b0b5-a30cf177940b tempest-KeyPairsV22TestJSON-552811892 tempest-KeyPairsV22TestJSON-552811892-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090985717" status: 204 len: 0 microversion: 2.2 time: 0.106921 Jul 14 14:51:24.435867 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1321/2745] 10.222.0.98 () {60 vars in 1260 bytes} [Thu Jul 14 14:51:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1090985717 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:24.459979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.460900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:24.520981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.520981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.520981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.520981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.521553 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6131f116-6753-461c-a656-9988d4971554 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.397102 Jul 14 14:51:24.521882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1425/2746] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:51:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:24.543883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-702ecd06-5325-4764-87a3-3581234329e3 req-b8eeb80d-a18d-44fa-83a5-2ac2c6bf16ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:24.604980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-702ecd06-5325-4764-87a3-3581234329e3 req-b8eeb80d-a18d-44fa-83a5-2ac2c6bf16ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.606360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-702ecd06-5325-4764-87a3-3581234329e3 req-b8eeb80d-a18d-44fa-83a5-2ac2c6bf16ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.632516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-702ecd06-5325-4764-87a3-3581234329e3 req-b8eeb80d-a18d-44fa-83a5-2ac2c6bf16ee service nova] Creating event network-changed:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h2-768852-23 Jul 14 14:51:24.638782 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-702ecd06-5325-4764-87a3-3581234329e3 req-b8eeb80d-a18d-44fa-83a5-2ac2c6bf16ee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115065 Jul 14 14:51:24.639588 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1426/2747] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:24.788086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:24.819892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:24.825864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:24.884898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.888546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:24.891553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:24.894108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.112171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:25.134514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a967922c-d996-435e-aff5-d3c546a8c0de tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 0.699841 Jul 14 14:51:25.142825 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1322/2748] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:25.351559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:25.356191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:25.377108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.379807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.383837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.384966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.849498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:25.870062 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e70c9230-d353-42e4-9bf0-9308de79575e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 1.066429 Jul 14 14:51:25.875782 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1427/2749] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:24 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:25.908495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-338f4a24-a5b6-4366-a749-1f8f2ef3a7af req-32401796-b780-42d0-ba05-d4c4f860752a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f502d653-a001-463d-822c-62943de2ff18", "name": "network-vif-plugged", "status": "completed", "tag": "36ea74e1-0e36-43ef-9f27-c1220f9a55ad"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:25.927000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-338f4a24-a5b6-4366-a749-1f8f2ef3a7af req-32401796-b780-42d0-ba05-d4c4f860752a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:25.928241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-338f4a24-a5b6-4366-a749-1f8f2ef3a7af req-32401796-b780-42d0-ba05-d4c4f860752a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:25.955594 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-338f4a24-a5b6-4366-a749-1f8f2ef3a7af req-32401796-b780-42d0-ba05-d4c4f860752a service nova] Creating event network-vif-plugged:36ea74e1-0e36-43ef-9f27-c1220f9a55ad for instance f502d653-a001-463d-822c-62943de2ff18 on n-h2-768852-23 Jul 14 14:51:25.965597 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-338f4a24-a5b6-4366-a749-1f8f2ef3a7af req-32401796-b780-42d0-ba05-d4c4f860752a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065018 Jul 14 14:51:25.967622 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1428/2750] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:26.018869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:26.043588 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-72f57075-cb16-4728-9afe-5cb4cfded845 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1516 microversion: 2.1 time: 0.707818 Jul 14 14:51:26.050796 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1323/2751] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:25 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1516 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:26.073405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:26.077193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:26.086393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.088171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.089865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.090604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.143609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lazy-loading 'flavor' on Instance uuid 7ec99603-4678-45c6-a10f-2f7312a2d20e {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:51:26.172992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:26.174687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:26.214712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.216181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.219863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.223347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.402153 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c6a19395-e57e-4d2e-9d84-21a3f9504bc5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action" status: 200 len: 32 microversion: 2.1 time: 0.339460 Jul 14 14:51:26.403790 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1429/2752] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:26 2022] POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action => generated 32 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:51:26.429395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:26.430937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:26.446069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.447120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.448347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.448998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.676788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:26.709916 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-53e767ad-6e54-4279-9d2a-fe860ad4e02e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 0.543833 Jul 14 14:51:26.710654 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1324/2753] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:26 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:26.879197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:26.892228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:26.893184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:26.908782 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce340103-9912-4cc9-a10f-c9d6e666d75c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.484477 Jul 14 14:51:26.911580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.914400 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1430/2754] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:26 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:26.914646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:26.916464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:26.918647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.750082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:27.751229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:27.782047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.783251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.785017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.786091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.832179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:27.846527 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-440e1a09-cf67-4ac7-a7f4-ac4c60bcb769 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 0.960246 Jul 14 14:51:27.847154 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1325/2755] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:26 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:27.930369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:27.931538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:27.941479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.945096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:27.946260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:27.948360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:28.361935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:28.377957 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78ac62c8-158d-49d5-ba4a-55811ac03abc tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.451364 Jul 14 14:51:28.378521 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1326/2756] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:27 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:28.880902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:28.881738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:28.904534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:28.905145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:28.908546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:28.908971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.419100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:29.466699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f33ccb51-e78e-4f07-b4f3-590413161102 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1316 microversion: 2.1 time: 1.724217 Jul 14 14:51:29.470805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:29.471312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1431/2757] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:27 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1316 bytes in 1730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:29.486611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c08c4802-a833-48e5-9937-e07624d64410 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 0.614526 Jul 14 14:51:29.498950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1327/2758] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:28 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:29.506780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:29.512445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6a095c43-7946-4e50-bd9c-8933980aed90 req-e0eb4c3a-4237-4260-aaf7-98a5ad98fbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:29.512677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:29.537684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.538441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.539789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.540682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.542741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a095c43-7946-4e50-bd9c-8933980aed90 req-e0eb4c3a-4237-4260-aaf7-98a5ad98fbd3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:29.546437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a095c43-7946-4e50-bd9c-8933980aed90 req-e0eb4c3a-4237-4260-aaf7-98a5ad98fbd3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:29.573911 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6a095c43-7946-4e50-bd9c-8933980aed90 req-e0eb4c3a-4237-4260-aaf7-98a5ad98fbd3 service nova] Creating event network-changed:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:51:29.585040 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6a095c43-7946-4e50-bd9c-8933980aed90 req-e0eb4c3a-4237-4260-aaf7-98a5ad98fbd3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079446 Jul 14 14:51:29.586535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1328/2759] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:29.704559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-538669031", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:29.841184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] validate_networks() for [('e7e64f1b-6e91-453d-83c0-e77e70b58838', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:29.946594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:29.959644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-79a08eb5-f537-4750-a886-b67c71f45a4d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.486425 Jul 14 14:51:29.960273 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1432/2760] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:29 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:30.486510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:30.487562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:30.505841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.508430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:30.514696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:30.516109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.196375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:31.207670 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-13a104de-bfb6-4f4c-8c77-9287a455181e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1504 microversion: 2.1 time: 0.726246 Jul 14 14:51:31.209601 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1433/2761] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:30 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1504 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:31.216136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:31.216892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:31.223937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.224424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.225446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.225890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.353971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:31.354769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:31.355027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:31.356877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:31.360594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:31.398579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.399045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.400123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.400652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.447104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for project f30b8cc1b9254cca90487359e0872a93. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:31.454677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for user a7edefb2896948e39ac7aed5a3884233 and project f30b8cc1b9254cca90487359e0872a93. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:31.494338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:31.501034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:31.582394 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-31f5997b-9bed-4eb9-aaa6-c9e66afc189f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.884459 Jul 14 14:51:31.583076 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1329/2762] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:31.605012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1130401708", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88d93d25-4776-49a9-88b4-3b0c6033bbe9"}], "security_groups": [{"name": "tempest-securitygroup--1267753546"}], "key_name": "tempest-keypair-1543036864", "user_data": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:31.634840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:31.645997 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3e0be98d-2f06-4688-93f5-780295d74c70 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 0.434737 Jul 14 14:51:31.646936 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1434/2763] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:31 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:31.662818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:31.665117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:31.674323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.675063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.676178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.676836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.913003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:31.929277 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ec4972f-9fd9-40b3-a90d-01a60d2777e9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.270528 Jul 14 14:51:31.941612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1435/2764] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:31 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:31.949473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-651777368"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:31.950377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:31.963013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.963506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.964726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:31.965699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:31.972671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] validate_networks() for [('88d93d25-4776-49a9-88b4-3b0c6033bbe9', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:32.208910 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.network.security_group_api [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Adding security group 94c03fa3-d69c-4823-94cb-562fcbc73843 to port 36ea74e1-0e36-43ef-9f27-c1220f9a55ad Jul 14 14:51:32.578059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:32.578866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:32.579859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:32.580470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:32.581109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:32.603203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.604233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.605923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.606669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.634088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for project 27951e61632946f58c199f09723d6fdd. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:32.642141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for user b06a5d6f31ea4d4a9a7e69f759a3c7ce and project 27951e61632946f58c199f09723d6fdd. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:32.663167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:32.666700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:32.751950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-880e8fe0-9a9b-43e9-89ba-38a860a1d5b5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.151254 Jul 14 14:51:32.753750 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1330/2765] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:32.763510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:32.765386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:32.778613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.779794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.782359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:32.782855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:32.900978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:32.917648 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc12296c-dfa4-4694-82d7-c14dee750696 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1276 microversion: 2.1 time: 0.160172 Jul 14 14:51:32.918745 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1331/2766] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:32 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:32.955930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75fa55b0-a8a7-4b45-b907-326b4da6186d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18/action" status: 202 len: 0 microversion: 2.1 time: 1.011760 Jul 14 14:51:32.957032 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1436/2767] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:31 2022] POST /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18/action => generated 0 bytes in 1014 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:32.979563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2ede8659-abdd-4dba-821d-5ca122474816 req-79e85507-8cc1-4d0f-a4dd-62887d1fba81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "name": "network-vif-plugged", "status": "completed", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:33.034412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2ede8659-abdd-4dba-821d-5ca122474816 req-79e85507-8cc1-4d0f-a4dd-62887d1fba81 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.035442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2ede8659-abdd-4dba-821d-5ca122474816 req-79e85507-8cc1-4d0f-a4dd-62887d1fba81 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.047541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:33.064407 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2ede8659-abdd-4dba-821d-5ca122474816 req-79e85507-8cc1-4d0f-a4dd-62887d1fba81 service nova] Creating event network-vif-plugged:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h2-768852-23 Jul 14 14:51:33.108144 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2ede8659-abdd-4dba-821d-5ca122474816 req-79e85507-8cc1-4d0f-a4dd-62887d1fba81 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141550 Jul 14 14:51:33.109999 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1437/2768] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:33.126742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:33.133364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:33.178371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.179059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.180828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.181799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.449068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-157705253", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "d5020456-e8ca-4b7c-b5e2-2df731f9790a"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:33.600020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:33.610454 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd13de0b-b0a6-4fe6-aba5-853d0779d3ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1378 microversion: 2.1 time: 0.498623 Jul 14 14:51:33.611840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1438/2769] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:33 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1378 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:33.616982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] validate_networks() for [('d5020456-e8ca-4b7c-b5e2-2df731f9790a', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:33.617568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ce6a5db-70ef-4d3e-8ebd-ab5a2657ebb4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:33.618428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ce6a5db-70ef-4d3e-8ebd-ab5a2657ebb4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:33.699140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7ce6a5db-70ef-4d3e-8ebd-ab5a2657ebb4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:33.720545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ce6a5db-70ef-4d3e-8ebd-ab5a2657ebb4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1238 microversion: 2.1 time: 0.107393 Jul 14 14:51:33.722884 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1439/2770] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:33 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1238 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:33.732235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:33.734158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:33.741818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.742710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:33.743860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:33.744630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.209478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:34.228129 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4f3b89dc-48c6-4d84-baf1-0e317f285540 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.503159 Jul 14 14:51:34.229259 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1440/2771] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:33 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:34.259995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1266277100"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:34.261103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:34.271715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:34.272219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:34.272942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:34.273526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:34.274873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:34.289217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.289932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.290992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.291792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.292746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.293534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.294905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.295697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.319519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Getting quotas for project adc60bcb471e44fb8787afd9f5b623ab. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:34.324282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Getting quotas for user 3323669591584736b1e19db6da8fa08f and project adc60bcb471e44fb8787afd9f5b623ab. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:34.339886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:34.342170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:34.425143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3f766196-35f6-4492-8f37-c9284694d9c1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.504788 Jul 14 14:51:34.425880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1332/2772] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:34.438236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-edd4d3a8-fb53-43c5-8ef8-7434dbdf3bda req-8f62c66b-bd64-45f3-84d0-45f1867c65f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f502d653-a001-463d-822c-62943de2ff18", "tag": "36ea74e1-0e36-43ef-9f27-c1220f9a55ad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:34.449308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edd4d3a8-fb53-43c5-8ef8-7434dbdf3bda req-8f62c66b-bd64-45f3-84d0-45f1867c65f3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.449751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edd4d3a8-fb53-43c5-8ef8-7434dbdf3bda req-8f62c66b-bd64-45f3-84d0-45f1867c65f3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.477469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-edd4d3a8-fb53-43c5-8ef8-7434dbdf3bda req-8f62c66b-bd64-45f3-84d0-45f1867c65f3 service nova] Creating event network-changed:36ea74e1-0e36-43ef-9f27-c1220f9a55ad for instance f502d653-a001-463d-822c-62943de2ff18 on n-h2-768852-23 Jul 14 14:51:34.488958 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-edd4d3a8-fb53-43c5-8ef8-7434dbdf3bda req-8f62c66b-bd64-45f3-84d0-45f1867c65f3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061760 Jul 14 14:51:34.490013 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1333/2773] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:34.496518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:34.497662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:34.507834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.508838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.510143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:34.510846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:34.684287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:34.713267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:34.718895 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9721458-13b3-4609-84a0-c03a19963cd4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1282 microversion: 2.1 time: 0.227009 Jul 14 14:51:34.728521 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1334/2774] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:34 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1282 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:34.749697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1062685806", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "d5020456-e8ca-4b7c-b5e2-2df731f9790a"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:34.847864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.network.security_group_api [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Adding security group 7bcae5f9-a718-470e-a862-f72c5a47521e to port 36ea74e1-0e36-43ef-9f27-c1220f9a55ad Jul 14 14:51:34.891653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] validate_networks() for [('d5020456-e8ca-4b7c-b5e2-2df731f9790a', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:35.910333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd51a5b6-904b-4219-b25a-d147bc88cd03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18/action" status: 202 len: 0 microversion: 2.1 time: 1.679542 Jul 14 14:51:35.911677 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1441/2775] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:34 2022] POST /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18/action => generated 0 bytes in 1682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:35.917731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:35.918754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:35.933384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:35.939087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:35.942525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:35.943449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.349120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:36.349689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:36.350071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:36.350620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:36.351249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:36.354936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=10,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:36.376643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=65 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:36.385153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.385636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.389846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.390752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.465161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Getting quotas for project adc60bcb471e44fb8787afd9f5b623ab. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:36.478686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Getting quotas for user 3323669591584736b1e19db6da8fa08f and project adc60bcb471e44fb8787afd9f5b623ab. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:36.520618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:36.524560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:36.658568 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc47b8d1-90c8-4fc5-b843-a20ec7137256 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.927979 Jul 14 14:51:36.660982 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1335/2776] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:36.663550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:36.678686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bdbe1c1a-964f-4650-915d-87071d1e6eb3 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1527 microversion: 2.1 time: 0.765648 Jul 14 14:51:36.679050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:36.681135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:36.683097 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1442/2777] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:35 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1527 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:36.698270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.699881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.703239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.704837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.720338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:36.722116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:36.750568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.751033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:36.751892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:36.752331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.337990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:37.355668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8eca0c1e-7dd6-48bf-9deb-460657903e1c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1296 microversion: 2.1 time: 0.692234 Jul 14 14:51:37.357798 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1336/2778] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:36 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1296 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:37.363672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:37.371742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:37.389184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.390531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.392273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.393196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.586237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:37.609495 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f8498014-2f99-49cd-87af-589159014c69 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.923722 Jul 14 14:51:37.625577 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1443/2779] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:36 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:37.629435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:37.629957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:37.651793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.652856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:37.656101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:37.656924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:38.040004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:38.054407 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d7e2f1d-a08a-412a-9df3-9d578d4a6531 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.695059 Jul 14 14:51:38.057035 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1337/2780] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:37 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:38.070109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2b4536be-6db7-40b2-92e8-3e5672efaf2e req-bb3f5fe9-0252-4115-861c-aa386e6ed716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f502d653-a001-463d-822c-62943de2ff18", "tag": "36ea74e1-0e36-43ef-9f27-c1220f9a55ad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:38.095660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2b4536be-6db7-40b2-92e8-3e5672efaf2e req-bb3f5fe9-0252-4115-861c-aa386e6ed716 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:38.096422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2b4536be-6db7-40b2-92e8-3e5672efaf2e req-bb3f5fe9-0252-4115-861c-aa386e6ed716 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:38.115687 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d2c1f3e-11ff-4122-b0a1-38ec14c6156a tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.500079 Jul 14 14:51:38.127383 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1444/2781] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 14:51:37 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18/os-security-groups => generated 1158 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:38.128737 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2b4536be-6db7-40b2-92e8-3e5672efaf2e req-bb3f5fe9-0252-4115-861c-aa386e6ed716 service nova] Creating event network-changed:36ea74e1-0e36-43ef-9f27-c1220f9a55ad for instance f502d653-a001-463d-822c-62943de2ff18 on n-h2-768852-23 Jul 14 14:51:38.144555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2b4536be-6db7-40b2-92e8-3e5672efaf2e req-bb3f5fe9-0252-4115-861c-aa386e6ed716 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083147 Jul 14 14:51:38.145252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1338/2782] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:38.150938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:38.152577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:38.169097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:38.172523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:38.174510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:38.177659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:38.182281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1663823062", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "451", "networks": [{"uuid": "d5020456-e8ca-4b7c-b5e2-2df731f9790a"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:38.317390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] validate_networks() for [('d5020456-e8ca-4b7c-b5e2-2df731f9790a', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:38.476065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:38.486015 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d580c3a-5397-46da-8123-99a6bc49c9ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1527 microversion: 2.1 time: 0.355047 Jul 14 14:51:38.487440 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1445/2783] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:38 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1527 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:38.506079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2efc0237-cc34-4262-a723-a274029699e7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf31afd30>, body: {"security_group": {"name": " tempest-securitygroup -1821078493 ", "description": "tempest-description-1316035823"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:39.267618 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2efc0237-cc34-4262-a723-a274029699e7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.766031 Jul 14 14:51:39.272680 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1446/2784] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:38 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:39.284017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:39.285716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:39.328307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:39.331155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:39.337234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:39.338626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:39.611795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:39.616318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:39.617904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:39.619097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:39.624742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:39.672817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:39.674131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:39.676084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:39.677675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:39.777557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Getting quotas for project adc60bcb471e44fb8787afd9f5b623ab. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:39.800783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Getting quotas for user 3323669591584736b1e19db6da8fa08f and project adc60bcb471e44fb8787afd9f5b623ab. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:39.862585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:39.869013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:39.935476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:39.951563 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1e92c65-f8d1-47e6-8c26-b45db23352a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.676017 Jul 14 14:51:39.953222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1447/2785] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:39 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:39.963135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f06dcf9-1cd3-4ec7-8631-3273cad55c9d tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:39.965516 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:51:39.965516 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:51:39.994137 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b498f57-30b2-40c1-9a5b-d6ab2955206b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.841974 Jul 14 14:51:39.996769 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1339/2786] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:51:40.009986 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f06dcf9-1cd3-4ec7-8631-3273cad55c9d tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/8040955d-8451-476c-ab33-3111d2da02a4" status: 202 len: 0 microversion: 2.1 time: 0.054328 Jul 14 14:51:40.012057 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1448/2787] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:39 2022] DELETE /compute/v2.1/flavors/8040955d-8451-476c-ab33-3111d2da02a4 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:40.021741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.023686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:40.030322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.032484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:40.036994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.038319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.040354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.041145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.049600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.050098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.050876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.051358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.451723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:40.473815 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1df74704-4c5a-43a5-915e-4ee049c55c18 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.459433 Jul 14 14:51:40.485260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1449/2788] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:40 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:40.498340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-552b7e99-b81f-475f-9c78-d0b4d8b7b0f8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdc01961a60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.726616 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-552b7e99-b81f-475f-9c78-d0b4d8b7b0f8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9" status: 200 len: 224 microversion: 2.1 time: 0.246212 Jul 14 14:51:40.734535 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1450/2789] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:51:40 2022] GET /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9 => generated 224 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:40.739936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f9b9365-dffa-4069-97dd-d7569259c7c8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.740672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6f9b9365-dffa-4069-97dd-d7569259c7c8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:40.758115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:40.788869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a07e3b51-9ae0-4155-b6ae-2a047e75c889 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.788902 Jul 14 14:51:40.790684 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1340/2790] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:39 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:40.802912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-96b3d8c7-e942-41d8-b654-93bf80968aa5 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.847749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f9b9365-dffa-4069-97dd-d7569259c7c8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:40.859594 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f9b9365-dffa-4069-97dd-d7569259c7c8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1221 microversion: 2.1 time: 0.123695 Jul 14 14:51:40.861408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1451/2791] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:40 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1221 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:40.868500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c00f3fbb-4145-44f8-84b3-ba6d2a8ba1b7 req-7629f166-a54c-489a-b4db-448108d9215b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47dc97db-700a-4df6-a377-eea717c9fa71", "tag": "8fe2dd17-ee99-49df-b398-70e16102b754"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:40.884575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c00f3fbb-4145-44f8-84b3-ba6d2a8ba1b7 req-7629f166-a54c-489a-b4db-448108d9215b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.885510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c00f3fbb-4145-44f8-84b3-ba6d2a8ba1b7 req-7629f166-a54c-489a-b4db-448108d9215b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.901635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c00f3fbb-4145-44f8-84b3-ba6d2a8ba1b7 req-7629f166-a54c-489a-b4db-448108d9215b service nova] Creating event network-changed:8fe2dd17-ee99-49df-b398-70e16102b754 for instance 47dc97db-700a-4df6-a377-eea717c9fa71 on n-h1-768852-23 Jul 14 14:51:40.915165 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c00f3fbb-4145-44f8-84b3-ba6d2a8ba1b7 req-7629f166-a54c-489a-b4db-448108d9215b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052600 Jul 14 14:51:40.916424 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1452/2792] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:40.919432 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-96b3d8c7-e942-41d8-b654-93bf80968aa5 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.126464 Jul 14 14:51:40.926078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-08598e86-fb83-45fa-b5ea-7938690073a6 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdc04293f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:40.939814 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1341/2793] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:51:40 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:40.962019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:40.964457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:40.981325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.982822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:40.985639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:40.986500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:41.229560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:41.242871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Old instance type tempest-test_resize_flavor_-2051604960, new instance type m1.heat {{(pid=125966) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:51:41.260717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:41.261453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:41.262360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:41.263093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:41.263929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:41.544819 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68a7e1fe-7319-46d9-9ccd-2b35358c7017 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46/action" status: 202 len: 0 microversion: 2.1 time: 0.597259 Jul 14 14:51:41.546776 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1342/2794] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:40 2022] POST /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:41.554274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:41.556515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:41.566654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:41.568056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:41.569319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:41.570282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.661771 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-08598e86-fb83-45fa-b5ea-7938690073a6 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9" status: 202 len: 0 microversion: 2.1 time: 1.743777 Jul 14 14:51:42.662631 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1453/2795] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:51:40 2022] DELETE /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9 => generated 0 bytes in 1745 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:42.672213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:42.673037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:42.690026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.694412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.699563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:42.701867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:42.976538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:42.990029 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-27346455-240e-4585-af80-5c8411ff2326 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 1.441682 Jul 14 14:51:42.999057 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1343/2796] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:41 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:43.016538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:43.017476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:43.029000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.029465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.030828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.031365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.330827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:43.347875 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aecceb0c-dd69-4f6b-90ab-41850699936f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.680543 Jul 14 14:51:43.348784 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1454/2797] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:42 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:43.365415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:43.366077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:43.384791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.387009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.389122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.394031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.622013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:43.636087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5154d7f0-6bd0-44f3-a9e3-38f7f594a0ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1536 microversion: 2.1 time: 0.635427 Jul 14 14:51:43.636772 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1344/2798] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:42 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1536 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:43.644685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:43.645519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:43.655926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.656394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.657284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:43.657738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:43.840380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:43.895527 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68c49dec-ae8e-412c-bee7-089100399eea tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1279 microversion: 2.1 time: 0.257110 Jul 14 14:51:43.909332 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1345/2799] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:43 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1279 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:43.957472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2b8ad30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:44.016875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:44.032724 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d02ea88-e47b-4859-a217-ee3e9d56d709 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.680312 Jul 14 14:51:44.035388 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1455/2800] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:43 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:44.058356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-467f4aa4-adfd-4a3d-822a-56089c5710a0 req-b2cd07ce-9106-40b1-b7e7-7bccce8035fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c479bb-f2bf-46bb-a256-cd2431bb117a", "tag": "2e5cda1c-624c-4920-96ff-61aae4a6717c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:44.090937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-467f4aa4-adfd-4a3d-822a-56089c5710a0 req-b2cd07ce-9106-40b1-b7e7-7bccce8035fe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.094499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-467f4aa4-adfd-4a3d-822a-56089c5710a0 req-b2cd07ce-9106-40b1-b7e7-7bccce8035fe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:44.119058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-467f4aa4-adfd-4a3d-822a-56089c5710a0 req-b2cd07ce-9106-40b1-b7e7-7bccce8035fe service nova] Creating event network-changed:2e5cda1c-624c-4920-96ff-61aae4a6717c for instance f6c479bb-f2bf-46bb-a256-cd2431bb117a on n-h1-768852-23 Jul 14 14:51:44.126365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:51:44.128573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:51:44.129870 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.129870 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9 HTTP/1.1 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'cfe6268b-a797-4f65-8cc5-8740f13df0d9'} Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:51:44.135494 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] Jul 14 14:51:44.145651 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:44.159354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:51:44.159354 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-84f9b89c-86cd-4cae-9403-6f09ce236987'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:44.161795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-103ba200-d9a7-45c9-8e49-9998e90bad5c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9" status: 404 len: 194 microversion: 2.1 time: 0.224443 Jul 14 14:51:44.162819 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1346/2801] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:51:43 2022] GET /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9 => generated 194 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:44.168055 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-467f4aa4-adfd-4a3d-822a-56089c5710a0 req-b2cd07ce-9106-40b1-b7e7-7bccce8035fe service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130523 Jul 14 14:51:44.169309 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1456/2802] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:44.176284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:44.176924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:44.185124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0eea25c1-f069-4923-aae4-bcf7f93092bd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf2c1a940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1778336213", "description": "tempest-description-2108070653"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:44.199980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.200491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:44.201680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.210349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:44.668741 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0eea25c1-f069-4923-aae4-bcf7f93092bd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.496837 Jul 14 14:51:44.677615 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1457/2803] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:44 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:44.684019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:44.687874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:44.708809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.712131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:44.713963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:44.716304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.027752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:45.037086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:45.043203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b4c5e0e-30ed-4b40-b411-2cc8f0c4b29b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.878420 Jul 14 14:51:45.058293 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1347/2804] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:44 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:45.059347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-fa4eaece-6152-4fd6-a527-a74de098c6ad req-131c5530-3a53-4125-ab23-082fd62c87d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e899757-5400-47c4-ba27-33091c4a7cdb", "tag": "11f06ce6-6bc0-4d29-9c5e-acfc5bfbe497"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:45.073614 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9d2f9db4-6521-48d0-9b2b-981723d68de0 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.394019 Jul 14 14:51:45.074915 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1458/2805] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:44 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:45.083953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fa4eaece-6152-4fd6-a527-a74de098c6ad req-131c5530-3a53-4125-ab23-082fd62c87d0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.085050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fa4eaece-6152-4fd6-a527-a74de098c6ad req-131c5530-3a53-4125-ab23-082fd62c87d0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.087735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:45.088917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:45.103887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.105010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.106783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.107889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.112758 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fa4eaece-6152-4fd6-a527-a74de098c6ad req-131c5530-3a53-4125-ab23-082fd62c87d0 service nova] Creating event network-changed:11f06ce6-6bc0-4d29-9c5e-acfc5bfbe497 for instance 2e899757-5400-47c4-ba27-33091c4a7cdb on n-h1-768852-23 Jul 14 14:51:45.126747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-fa4eaece-6152-4fd6-a527-a74de098c6ad req-131c5530-3a53-4125-ab23-082fd62c87d0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077508 Jul 14 14:51:45.127904 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1348/2806] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:45.139302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c52d201-fca6-4a53-8569-0f7eb0e00287 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf31e3e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1265429401", "description": "tempest-description-742575984"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:45.399475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:45.414239 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d205740-e67a-44b2-92fa-93f6e12e17a4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1536 microversion: 2.1 time: 0.337179 Jul 14 14:51:45.415347 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1459/2807] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:45 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1536 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:45.425792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-138c65d4-3eea-45c3-bd3a-9c9a599f4e47 req-bca357d0-8619-425e-9d20-bb947a0a9c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dc97db-700a-4df6-a377-eea717c9fa71", "name": "network-vif-plugged", "status": "completed", "tag": "8fe2dd17-ee99-49df-b398-70e16102b754"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:45.439462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-138c65d4-3eea-45c3-bd3a-9c9a599f4e47 req-bca357d0-8619-425e-9d20-bb947a0a9c3d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.440214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-138c65d4-3eea-45c3-bd3a-9c9a599f4e47 req-bca357d0-8619-425e-9d20-bb947a0a9c3d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.460031 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-138c65d4-3eea-45c3-bd3a-9c9a599f4e47 req-bca357d0-8619-425e-9d20-bb947a0a9c3d service nova] Creating event network-vif-plugged:8fe2dd17-ee99-49df-b398-70e16102b754 for instance 47dc97db-700a-4df6-a377-eea717c9fa71 on n-h1-768852-23 Jul 14 14:51:45.472183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-138c65d4-3eea-45c3-bd3a-9c9a599f4e47 req-bca357d0-8619-425e-9d20-bb947a0a9c3d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052886 Jul 14 14:51:45.473184 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1460/2808] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:45.484512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:45.486502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:45.494931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.495621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.496662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.497276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.581784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:45.592974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd778150-3973-42b6-89dd-2f6a8425ac9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1279 microversion: 2.1 time: 0.116847 Jul 14 14:51:45.593708 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1461/2809] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:45 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:45.600631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:45.601789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:45.611564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.612177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.613255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:45.613886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:45.872571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:45.911569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc260849-9b6e-4426-89a4-6d202008066e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.315597 Jul 14 14:51:45.913118 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1462/2810] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:45 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:46.076707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:46.078181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:46.086062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.086765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.088136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.088846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.105017 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c52d201-fca6-4a53-8569-0f7eb0e00287 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.974893 Jul 14 14:51:46.115300 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1349/2811] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:45 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:46.127155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:46.128930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:46.148868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.166080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.167770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.168646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.323006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:46.337220 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28904304-bdd8-4454-ab69-6011158d5eeb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.264565 Jul 14 14:51:46.338251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1463/2812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:46 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:46.345818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce231a6f-ef99-40e5-bf02-b47b57df8ed0 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf31613a0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-621514631", "description": "tempest-description-243514542"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:46.471684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:46.481521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a02ff82-4673-48f7-a0fa-ac52c4ffbf6e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.364406 Jul 14 14:51:46.482336 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1350/2813] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:46 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:46.491108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a740b49a-6df3-4e9c-8078-abf3d9a52860 req-86ec8ac3-b68b-4a33-befe-e2ed5a9485f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b0e25f9-4c23-4d7b-8c01-fdcaa641c256", "tag": "28679601-624d-40ec-b3d6-a96a019636d0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:46.511635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a740b49a-6df3-4e9c-8078-abf3d9a52860 req-86ec8ac3-b68b-4a33-befe-e2ed5a9485f8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.512360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a740b49a-6df3-4e9c-8078-abf3d9a52860 req-86ec8ac3-b68b-4a33-befe-e2ed5a9485f8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.527633 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a740b49a-6df3-4e9c-8078-abf3d9a52860 req-86ec8ac3-b68b-4a33-befe-e2ed5a9485f8 service nova] Creating event network-changed:28679601-624d-40ec-b3d6-a96a019636d0 for instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 on n-h2-768852-23 Jul 14 14:51:46.535117 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a740b49a-6df3-4e9c-8078-abf3d9a52860 req-86ec8ac3-b68b-4a33-befe-e2ed5a9485f8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050391 Jul 14 14:51:46.536336 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1351/2814] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:46.542913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:46.543771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:46.545448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce231a6f-ef99-40e5-bf02-b47b57df8ed0 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.205278 Jul 14 14:51:46.547462 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1464/2815] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:46 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:46.552294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.552755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.553545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.553991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.564193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f1beefa-f535-4858-b887-cfb588afa031 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2bd5ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:46.790629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:46.799707 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b932b74-854d-4e61-b12c-ec791c753519 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1536 microversion: 2.1 time: 0.261831 Jul 14 14:51:46.800574 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1352/2816] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:46 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1536 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:46.805739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:46.806648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:46.821992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.822715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:46.823820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:46.824437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.036444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:47.050310 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ccef82f3-ab9c-4325-9aa6-b93d8ba1cfe4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.248015 Jul 14 14:51:47.051187 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1353/2817] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:46 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:47.053010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f1beefa-f535-4858-b887-cfb588afa031 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.493441 Jul 14 14:51:47.054113 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1465/2818] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:51:46 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:47.059931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.061098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:47.068152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a6205d7-a74c-401b-a6cf-8445b1a46048 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2bc14c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.070377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.070915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.071874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.072410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.322943 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a6205d7-a74c-401b-a6cf-8445b1a46048 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890" status: 202 len: 0 microversion: 2.1 time: 0.259813 Jul 14 14:51:47.329930 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1466/2819] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:51:47 2022] DELETE /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:47.336937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdc042f14c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.387643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:51:47.388507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group bc2ff9d0-b579-4d28-bd99-652379e79890 not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:51:47.389175 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.389175 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890 HTTP/1.1 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'bc2ff9d0-b579-4d28-bd99-652379e79890'} Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:51:47.392504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-5343b404-bfe9-4742-9b00-85cd694e7972'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:47.400531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d8f3e55e-785b-4e02-91c8-53bde8177dbb tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890" status: 404 len: 194 microversion: 2.1 time: 0.063348 Jul 14 14:51:47.411996 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1467/2820] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:51:47 2022] GET /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890 => generated 194 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:47.413581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.414608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:47.423686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.424441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.425687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.426681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.430058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:47.463359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:47.477407 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6c56c7a-28bd-491e-a784-9b34d6d417ed tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.424434 Jul 14 14:51:47.478603 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1354/2821] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:47 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:47.488641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41a43647-3d1c-4724-8a5b-7b78b08bf606 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2e0b8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.687438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:47.703207 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef68589c-f086-4f48-a9b1-45aa41079b1f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.299455 Jul 14 14:51:47.704367 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1468/2822] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:47 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:47.723310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.724573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:47.738052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.738909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.740893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.741736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.894852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:47.904475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-03c18670-bf60-4635-b08c-b1d551f5f724 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.198464 Jul 14 14:51:47.914749 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1469/2823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:47 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:47.914749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:47.914749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:47.919033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.919528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:47.920321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:47.920762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.218264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:48.230081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-926dcff9-aa5c-4c42-9b63-4c0d4861af89 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.323002 Jul 14 14:51:48.230703 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1470/2824] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:47 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:48.241227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.243247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.256367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.257121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.258095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.258599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.416391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:48.429466 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32045126-702a-420e-9d64-731afe8139c0 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.197631 Jul 14 14:51:48.430440 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1471/2825] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:48.506931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.507787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.517873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.518318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.524485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.525230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.610328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41a43647-3d1c-4724-8a5b-7b78b08bf606 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec" status: 202 len: 0 microversion: 2.1 time: 1.129470 Jul 14 14:51:48.613952 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1355/2826] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:51:47 2022] DELETE /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:48.630756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2d008b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.736337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:51:48.737185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group eaac9313-bcb6-4016-ae16-79e789921dec not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:51:48.738051 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.738051 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec HTTP/1.1 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'eaac9313-bcb6-4016-ae16-79e789921dec'} Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:51:48.741605 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-7cfbe2a0-6393-4040-a1e6-c91dc35dfabb'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-992e7897-2adc-43ea-bd54-12a5a55219b3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec" status: 404 len: 194 microversion: 2.1 time: 0.123080 Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1356/2827] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec => generated 194 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:48.758167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:48.777792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:48.777792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.777792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.780017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:48.782331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:48.810249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:48.822668 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-590000fd-a77f-4a14-96c8-a22cc7f3d858 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.320290 Jul 14 14:51:48.831350 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1472/2828] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:48.831350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00a03c12-d3ec-4043-bb2e-8c2584a690dc tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf3142430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:49.232321 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00a03c12-d3ec-4043-bb2e-8c2584a690dc tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d" status: 202 len: 0 microversion: 2.1 time: 0.406608 Jul 14 14:51:49.249040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1473/2829] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:51:48 2022] DELETE /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:51:49.258814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:49.273236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:49.285735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.287194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.288929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.289960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.399671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:49.411792 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-27abb3ec-6836-44ea-8efb-0e3b1ebabef1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.665167 Jul 14 14:51:49.412623 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1357/2830] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:48 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:49.427746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2d001f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:49.488355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:51:49.489507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:51:49.490221 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.490221 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d HTTP/1.1 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c58b5212-9615-4e7b-a88c-7a0f28e2f53d'} Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:51:49.492452 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] Jul 14 14:51:49.496970 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:51:49.501394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:51:49.501394 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-e0f70ca7-2492-4bde-8dd0-f4fb0b8b841c'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:49.502541 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da99ed06-8b8b-481b-bf7b-d7966ebb113c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d" status: 404 len: 194 microversion: 2.1 time: 0.088020 Jul 14 14:51:49.503310 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1358/2831] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:51:49 2022] GET /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d => generated 194 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:51:49.508307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:49.513392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:49.534203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.534937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.535960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.536575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.555229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:49.570458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:49.594620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba230b47-7614-40fa-bd57-573140923527 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1324 microversion: 2.1 time: 0.343220 Jul 14 14:51:49.619056 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1474/2832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:49 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1324 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:49.647835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:49.660184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:49.674734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.681228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.683204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:49.683985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:49.731060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:49.840336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=11 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:50.025090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:50.045285 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3924a140-c869-4301-a0b4-23910ea9b24a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.540250 Jul 14 14:51:50.054725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:50.060861 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1359/2833] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:49 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:50.063532 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c8331b0a-30e8-4010-97b6-e443366300de tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.442390 Jul 14 14:51:50.067748 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1475/2834] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:49 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:50.074107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38df7db9-f75c-4aba-bd38-40a1926e5405 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2d00f70>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:50.083143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:50.083932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:50.098514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.100078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.103160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.104452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.445511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:50.476398 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cad5fb32-b16e-4d6d-b757-71b3201c63f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.404310 Jul 14 14:51:50.479419 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1476/2835] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:50 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:50.493437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f43a27e0-1a62-4b14-990b-143412eabc87 req-60303ec8-bbb3-4662-961e-30490b9385f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d55f15dc-73cc-4117-b88f-d92f33ec54ce", "tag": "a142398e-7667-4e97-a5f7-e65d6c80fb1d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:50.509970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:50.531803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f43a27e0-1a62-4b14-990b-143412eabc87 req-60303ec8-bbb3-4662-961e-30490b9385f9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.533594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f43a27e0-1a62-4b14-990b-143412eabc87 req-60303ec8-bbb3-4662-961e-30490b9385f9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.605405 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f43a27e0-1a62-4b14-990b-143412eabc87 req-60303ec8-bbb3-4662-961e-30490b9385f9 service nova] Creating event network-changed:a142398e-7667-4e97-a5f7-e65d6c80fb1d for instance d55f15dc-73cc-4117-b88f-d92f33ec54ce on n-h2-768852-23 Jul 14 14:51:50.624408 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f43a27e0-1a62-4b14-990b-143412eabc87 req-60303ec8-bbb3-4662-961e-30490b9385f9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141280 Jul 14 14:51:50.627100 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1477/2836] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:50.640524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:50.642346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:50.657267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.658334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.660610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.661749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.853879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=15 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:50.922474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:50.941214 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-697c6796-fdee-43a7-9631-a23337a2af4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.311216 Jul 14 14:51:50.943047 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1478/2837] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:50 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:50.960341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:50.962626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:50.979150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.980675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:50.982483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:50.984980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.253674 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38df7db9-f75c-4aba-bd38-40a1926e5405 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 1.189660 Jul 14 14:51:51.254721 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1360/2838] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 14:51:50 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:51.264372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:51.265076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:51.289568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.290045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.290871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.291333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.368007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:51.378305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99eb3d06-c9f5-410c-aded-ae0ea3a0e8d5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1521 microversion: 2.1 time: 0.432127 Jul 14 14:51:51.390710 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1479/2839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:50 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:51.400207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:51.400841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:51.408082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.408533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.409332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.409757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.643036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:51.663711 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca4a044b-65f4-48cd-9126-b478a689d992 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.270736 Jul 14 14:51:51.680716 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1480/2840] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:51 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:51.702199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b858500e-7206-4133-bac7-d4e08d11e565 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf336b0d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1748963053", "description": "tempest-description-982529880"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:51.742513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:51.752309 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e406d410-15d6-4fcf-8363-06d9cacbcb65 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.495999 Jul 14 14:51:51.753574 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1361/2841] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:51 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:51.759947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:51.760846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:51.768841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.769713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.770714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:51.771146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:51.977251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:51.978228 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b858500e-7206-4133-bac7-d4e08d11e565 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.294955 Jul 14 14:51:51.979748 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1481/2842] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:51 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:51.993094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9e96f642-f47e-4e3a-b8b5-b5281ded4bad req-7d053f2c-4d26-422c-b006-b64107e2d78e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e899757-5400-47c4-ba27-33091c4a7cdb", "name": "network-vif-plugged", "status": "completed", "tag": "11f06ce6-6bc0-4d29-9c5e-acfc5bfbe497"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:52.016232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e96f642-f47e-4e3a-b8b5-b5281ded4bad req-7d053f2c-4d26-422c-b006-b64107e2d78e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.016472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d621a166-1c68-49d9-819d-638dcac02c0f tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1521 microversion: 2.1 time: 0.260722 Jul 14 14:51:52.016851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e96f642-f47e-4e3a-b8b5-b5281ded4bad req-7d053f2c-4d26-422c-b006-b64107e2d78e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.019846 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1362/2843] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:51 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:52.033942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9e96f642-f47e-4e3a-b8b5-b5281ded4bad req-7d053f2c-4d26-422c-b006-b64107e2d78e service nova] Creating event network-vif-plugged:11f06ce6-6bc0-4d29-9c5e-acfc5bfbe497 for instance 2e899757-5400-47c4-ba27-33091c4a7cdb on n-h1-768852-23 Jul 14 14:51:52.035698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:52.036971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:52.040114 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9e96f642-f47e-4e3a-b8b5-b5281ded4bad req-7d053f2c-4d26-422c-b006-b64107e2d78e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057797 Jul 14 14:51:52.040784 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1482/2844] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:52.046294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:52.047104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:52.051200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.052463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.053916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.054370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.054519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.055158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.055436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.055624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.277033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:52.286193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-72a30d08-bf7c-4038-804e-35655b58bdfe tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.244130 Jul 14 14:51:52.290544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:52.296731 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1483/2845] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:52 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:52.301763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4dd4700-8ada-4cf1-a98c-9f883cff14a4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf3315b80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-792102349", "description": "tempest-description-804502157"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:52.303122 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5ed84d9-c6bf-46a6-ad8b-16711f6b0a48 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.280937 Jul 14 14:51:52.303984 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1363/2846] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:52 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:52.310546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-927201487"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:52.312172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:52.321953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.322747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.324235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.324993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.501998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4dd4700-8ada-4cf1-a98c-9f883cff14a4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.203328 Jul 14 14:51:52.512998 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1484/2847] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:51:52 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:52.622902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1782678457", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "3e4d676b-43a6-40f9-be48-f1f10ab7d1ab"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:52.650568 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be688a6e-281e-4144-b05d-a10cf04d0af7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71/action" status: 202 len: 0 microversion: 2.1 time: 0.344713 Jul 14 14:51:52.651754 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1364/2848] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:51:52 2022] POST /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 14:51:52.667864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8a98704-ebca-4c75-b6c3-f15fcaa02d87 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '.version_select at 0x7fdbf312cdc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:52.710703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] validate_networks() for [('3e4d676b-43a6-40f9-be48-f1f10ab7d1ab', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:51:52.881028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8a98704-ebca-4c75-b6c3-f15fcaa02d87 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654" status: 204 len: 0 microversion: 2.1 time: 0.220497 Jul 14 14:51:52.882087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1365/2849] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:52 2022] DELETE /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:51:52.892063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:52.893339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:52.906003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.906890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:52.908394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:52.909210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.124674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:53.141381 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-286c39fd-ff09-4dce-aaac-290eda6da98a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.257734 Jul 14 14:51:53.142011 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1366/2850] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:52 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:53.159534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.160779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:53.168561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.169340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.171368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.172085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.362530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:51:53.364346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:51:53.365215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:51:53.366813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:51:53.368177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:51:53.384626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.385745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.387382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.388194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.427113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Getting quotas for project 1a307dcb18fe4909bc0421fb1fb18892. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:51:53.435115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Getting quotas for user 7ef211f562144656a4a95f4e0df02341 and project 1a307dcb18fe4909bc0421fb1fb18892. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:51:53.460574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:51:53.465432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:51:53.553750 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66fe111f-7144-4328-b5d7-48e9d42e38e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934784 Jul 14 14:51:53.554898 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1485/2851] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:51:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:51:53.567695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05135f8b-c154-4efb-82bc-199c22dc68ab tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '.version_select at 0x7fdbf2bf2790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.593957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:53.603944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-05135f8b-c154-4efb-82bc-199c22dc68ab tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Image not found. Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05135f8b-c154-4efb-82bc-199c22dc68ab tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654 HTTP/1.1 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '5e025e96-9796-4515-b8c5-6f58ae7ef654'} Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 5e025e96-9796-4515-b8c5-6f58ae7ef654 Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Jul 14 14:51:53.606163 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get(image_id) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e025e96-9796-4515-b8c5-6f58ae7ef654 could not be found. Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05135f8b-c154-4efb-82bc-199c22dc68ab tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05135f8b-c154-4efb-82bc-199c22dc68ab tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654" status: 404 len: 62 microversion: 2.1 time: 0.045746 Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1486/2852] 10.222.0.98 () {58 vars in 1232 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.618468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:53.630516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.630516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.630516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.631252 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f846c7df-6a2f-43e5-bb42-5593e51beb54 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.480100 Jul 14 14:51:53.631545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.636241 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1367/2853] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:53.648974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.650122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:53.658943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.659776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.661142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.661923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.878769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:53.895484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4c8f0e5c-cd5d-4a59-8ae2-6579246dba4a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.284367 Jul 14 14:51:53.896562 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1487/2854] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:53.903674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:53.908745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:53.910930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Searching by: {'deleted': False, 'project_id': '4da9bfba7a6e411fa22206a70417ae73'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:53.921914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.922674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.924109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:53.925103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:53.983711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:51:53.988515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.021579 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a29c3168-97b5-406e-b1e9-4518fa55e4f1 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.376722 Jul 14 14:51:54.035227 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1368/2855] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:54.059173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d980c296-91dd-4ee5-ba0b-2f3dd5675b47 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.060763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d980c296-91dd-4ee5-ba0b-2f3dd5675b47 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:54.087056 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-89ffe895-e53b-4929-ad99-a27978285070 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.188252 Jul 14 14:51:54.089136 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1488/2856] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:51:53 2022] GET /compute/v2.1/servers => generated 333 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:54.100422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.101698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:54.116009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.116838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.119113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.119952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.204387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d980c296-91dd-4ee5-ba0b-2f3dd5675b47 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.214407 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d980c296-91dd-4ee5-ba0b-2f3dd5675b47 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1216 microversion: 2.1 time: 0.188406 Jul 14 14:51:54.215604 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1369/2857] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1216 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:54.223080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6e6484ee-4781-48fd-8f4a-a51ea16ed5b7 req-c0c515a6-fa38-4cc4-8467-c26f3bc1fc05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0e25f9-4c23-4d7b-8c01-fdcaa641c256", "name": "network-vif-plugged", "status": "completed", "tag": "28679601-624d-40ec-b3d6-a96a019636d0"}, {"server_uuid": "f6c479bb-f2bf-46bb-a256-cd2431bb117a", "name": "network-vif-plugged", "status": "completed", "tag": "2e5cda1c-624c-4920-96ff-61aae4a6717c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:54.259035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6e6484ee-4781-48fd-8f4a-a51ea16ed5b7 req-c0c515a6-fa38-4cc4-8467-c26f3bc1fc05 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.259786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6e6484ee-4781-48fd-8f4a-a51ea16ed5b7 req-c0c515a6-fa38-4cc4-8467-c26f3bc1fc05 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.304860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6e6484ee-4781-48fd-8f4a-a51ea16ed5b7 req-c0c515a6-fa38-4cc4-8467-c26f3bc1fc05 service nova] Creating event network-vif-plugged:28679601-624d-40ec-b3d6-a96a019636d0 for instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 on n-h2-768852-23 Jul 14 14:51:54.305426 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6e6484ee-4781-48fd-8f4a-a51ea16ed5b7 req-c0c515a6-fa38-4cc4-8467-c26f3bc1fc05 service nova] Creating event network-vif-plugged:2e5cda1c-624c-4920-96ff-61aae4a6717c for instance f6c479bb-f2bf-46bb-a256-cd2431bb117a on n-h1-768852-23 Jul 14 14:51:54.321400 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6e6484ee-4781-48fd-8f4a-a51ea16ed5b7 req-c0c515a6-fa38-4cc4-8467-c26f3bc1fc05 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.103437 Jul 14 14:51:54.323362 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1370/2858] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:54.337833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.345233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.345798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.346510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Searching by: {'deleted': False, 'project_id': '4da9bfba7a6e411fa22206a70417ae73'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:51:54.355858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4b28b09-4ccc-499e-9feb-07031eb72ade tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1533 microversion: 2.1 time: 0.265025 Jul 14 14:51:54.356084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.356647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.357746 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1489/2859] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1533 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:54.358191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.359070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.383944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.386990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:54.396668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.397887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.399153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.400025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.424443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:51:54.432315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:54.507300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.532231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.533065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.658305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.672791 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2ac7869-b165-429f-b5e3-fef9ceb0cd78 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.312531 Jul 14 14:51:54.673974 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1490/2860] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:54.681498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.682654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:54.693080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.693828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.695564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.696497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.839783 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f3a8815-0a2e-43e4-a68b-b953754d0b12 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 1696 microversion: 2.1 time: 0.513384 Jul 14 14:51:54.843430 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1371/2861] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/detail => generated 1696 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:54.866685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfda21ff-e87b-411a-be9e-dd1fd6ec63a4 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.876508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfda21ff-e87b-411a-be9e-dd1fd6ec63a4 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014471 Jul 14 14:51:54.877229 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1372/2862] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:51:54.922829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:54.923616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:54.927670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:54.931611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.932229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.933123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:54.933702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:54.942169 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb4b4691-ece8-4d6b-a20f-9526748ce806 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.266395 Jul 14 14:51:54.943504 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1491/2863] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:55.051598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.052650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.063565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.064325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.065480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.066263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.121149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.134080 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7b243b9-8930-45b8-bf4d-a553b2bbee20 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.216533 Jul 14 14:51:55.135390 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1373/2864] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:54 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:55.248237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.250047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.266625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.280575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.281421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.282915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.283733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.289643 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a8e2e367-2a4a-4db6-813c-2f2bceea265d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.245154 Jul 14 14:51:55.290937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1492/2865] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:55.304067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.305724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.317602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.318941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.320453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.321301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.374908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:51:55.403759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.421830 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe37dee8-8b4f-47f4-8b9a-8d9fdbc8f425 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1268 microversion: 2.1 time: 0.182295 Jul 14 14:51:55.422954 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1374/2866] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1268 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:55.431872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.432863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.436162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:55.447757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.448431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.449757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.450527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.502888 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e9cda63f-6f08-420a-83c9-82f54b3762d6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 204 len: 0 microversion: 2.1 time: 0.208056 Jul 14 14:51:55.507352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1493/2867] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:51:55 2022] DELETE /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:51:55.516749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.517925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.529135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.529608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.531027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.531528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.678921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.693821 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-23fef8a6-1095-4526-b066-b46408a340eb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1539 microversion: 2.1 time: 0.268821 Jul 14 14:51:55.695130 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1375/2868] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1539 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:55.708501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.709344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.720350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.721270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.722322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.723877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.785150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.804048 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e0c5d7e1-90c2-4de7-9d5e-f2d2ef528c96 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1699 microversion: 2.1 time: 0.292695 Jul 14 14:51:55.810770 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1494/2869] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1699 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:55.880521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:55.901248 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a317e7b-2ef3-472f-9a20-8682a72bcb4f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.204324 Jul 14 14:51:55.902261 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1376/2870] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:55.962931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:55.963876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:55.971576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.972061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:55.972831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:55.973310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.163175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.164051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.174015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.174904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.176016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.176749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.227096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:56.243511 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fba2f808-76f8-438e-9ab7-7708cd44ab7b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.284480 Jul 14 14:51:56.244712 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1495/2871] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:55 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:56.317920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.321175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.330667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.331694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.333053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.334962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.423964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:56.433402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dea33753-4b61-4df3-93ef-4bb8d8cb9e57 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1364 microversion: 2.1 time: 0.276002 Jul 14 14:51:56.434363 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1377/2872] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:56.456680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.457461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.465906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.466341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.467905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.468737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.560940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:56.562506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:56.567243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:56.581172 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a620b79-e41a-443f-a76b-8d72f3b543d9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.269685 Jul 14 14:51:56.582642 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a34bddb-2598-44f3-a488-4c3f8cd3d1b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1274 microversion: 2.1 time: 0.129090 Jul 14 14:51:56.583014 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1496/2873] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:56.583844 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1378/2874] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1274 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:56.720039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.721954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.736755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.738177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.739942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.740984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.827506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.828328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.845613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.847893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.849310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.850698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.970685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:56.980381 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d08041d-0829-4202-b748-4a1288549310 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1539 microversion: 2.1 time: 0.269304 Jul 14 14:51:56.983341 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1497/2875] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:56.986716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:56.987504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:56.994539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.995451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:56.996963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:56.997979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.091116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:57.100552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f274f87-9084-4ea0-a859-ac5321cc0d7b tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1699 microversion: 2.1 time: 0.279744 Jul 14 14:51:57.101643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1379/2876] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1699 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:57.212905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:57.222566 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ad5f91b-4b07-42fc-9f0a-f4202390278a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.240069 Jul 14 14:51:57.223943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1498/2877] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:56 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:57.274359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:57.276787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:57.292970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.294254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.296544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.297391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.327601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ebc058f1-1191-447b-87ce-8168399150cc req-8310f930-d08f-4c1d-89b2-8f48b434fb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dc97db-700a-4df6-a377-eea717c9fa71", "name": "network-vif-plugged", "status": "completed", "tag": "8fe2dd17-ee99-49df-b398-70e16102b754"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:57.342769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ebc058f1-1191-447b-87ce-8168399150cc req-8310f930-d08f-4c1d-89b2-8f48b434fb36 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.343659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ebc058f1-1191-447b-87ce-8168399150cc req-8310f930-d08f-4c1d-89b2-8f48b434fb36 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.364789 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ebc058f1-1191-447b-87ce-8168399150cc req-8310f930-d08f-4c1d-89b2-8f48b434fb36 service nova] Creating event network-vif-plugged:8fe2dd17-ee99-49df-b398-70e16102b754 for instance 47dc97db-700a-4df6-a377-eea717c9fa71 on n-h1-768852-23 Jul 14 14:51:57.375083 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ebc058f1-1191-447b-87ce-8168399150cc req-8310f930-d08f-4c1d-89b2-8f48b434fb36 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054308 Jul 14 14:51:57.377091 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1499/2878] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:57.454467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:57.456318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:57.464415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.465170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.465972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.466415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.612943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:57.631542 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf838b7e-3cfc-425d-ac3b-4f4958bda6fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.369822 Jul 14 14:51:57.643186 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1380/2879] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:57 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:57.651110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:57.652384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:57.664608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.665603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.666734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.667189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.735484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:57.745017 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f16cb39f-1399-47eb-a2cb-be9b836f083d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1550 microversion: 2.1 time: 0.296375 Jul 14 14:51:57.745913 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1500/2880] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:57 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1550 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:51:57.752291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:57.753185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:57.761150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.762045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.763418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.764705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.951446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:57.961712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e316098-68e1-4f1c-abca-2c69a709c2cf tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.214417 Jul 14 14:51:57.973278 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1501/2881] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:57 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:57.979333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:57.979959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:57.987903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.988468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:57.989396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:57.989960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.078161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:58.089369 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5307a631-d1d6-41c8-947e-b31ebc0f4858 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.443686 Jul 14 14:51:58.096158 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1381/2882] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:57 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:58.106449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:58.109705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:58.124585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.125059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.125271 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-58a97a22-4edf-43e0-9ea7-b8abe1cd66d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.149580 Jul 14 14:51:58.126094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.126790 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1502/2883] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:51:57 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:58.130277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.145902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:58.147458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:58.177642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.179013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.181605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.183447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.688696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:58.702893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80e3fd0c-7b83-4530-b8e7-b2f0e8594945 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1539 microversion: 2.1 time: 0.607984 Jul 14 14:51:58.703913 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1382/2884] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:58 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1539 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:58.715816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:58.718636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:58.730509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.731724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:58.734105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:58.734962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.026540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.042300 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e631586-82a0-4fa8-87f5-f82aaee2fcf7 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1699 microversion: 2.1 time: 0.913504 Jul 14 14:51:59.053627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1503/2885] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:58 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1699 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.054063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:59.056168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:59.067921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.068191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.069496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.070412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.468262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.484183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65a9d46f-4790-4a9a-a187-41bfe02a715c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.438080 Jul 14 14:51:59.485539 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1504/2886] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:59 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.494115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:59.496797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:59.510453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.511513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.513153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.515590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.639364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.666883 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5602e695-ce80-4015-a0c1-5f71bfcd26e3 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.960717 Jul 14 14:51:59.668806 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1383/2887] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:58 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.682671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:59.684200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:59.697382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.699862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.702787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.703506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.874897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:51:59.892344 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fd75322-d746-420b-b6b3-a3c19a602aa5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.404892 Jul 14 14:51:59.893627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1505/2888] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:59 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:51:59.900147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8f0abab7-83f4-4ff5-8ed3-4543731d7bef req-89877a35-a1ed-4cfb-bcd2-97c59fd6da95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f15dc-73cc-4117-b88f-d92f33ec54ce", "name": "network-vif-plugged", "status": "completed", "tag": "a142398e-7667-4e97-a5f7-e65d6c80fb1d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:51:59.911365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8f0abab7-83f4-4ff5-8ed3-4543731d7bef req-89877a35-a1ed-4cfb-bcd2-97c59fd6da95 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.912190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8f0abab7-83f4-4ff5-8ed3-4543731d7bef req-89877a35-a1ed-4cfb-bcd2-97c59fd6da95 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.928247 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8f0abab7-83f4-4ff5-8ed3-4543731d7bef req-89877a35-a1ed-4cfb-bcd2-97c59fd6da95 service nova] Creating event network-vif-plugged:a142398e-7667-4e97-a5f7-e65d6c80fb1d for instance d55f15dc-73cc-4117-b88f-d92f33ec54ce on n-h2-768852-23 Jul 14 14:51:59.933802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8f0abab7-83f4-4ff5-8ed3-4543731d7bef req-89877a35-a1ed-4cfb-bcd2-97c59fd6da95 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038556 Jul 14 14:51:59.934589 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1506/2889] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:51:59.941550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:51:59.942797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:51:59.953938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.953938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.954976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:51:59.955585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:51:59.960536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:51:59.990718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:00.023596 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16f8aa62-aeaf-4be9-82c9-f5144fa68881 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.351930 Jul 14 14:52:00.034834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1384/2890] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:59 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:00.063842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.064391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.078227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.078560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.079136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.079635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.250359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:00.259313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:00.273481 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3d751cc-99b5-48f7-8733-17aea637eb0a tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1521 microversion: 2.1 time: 0.337359 Jul 14 14:52:00.278647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1507/2891] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:51:59 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1521 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:00.288752 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab61e89b-774d-4c84-9497-9b5ae86471c6 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1632 microversion: 2.1 time: 0.225407 Jul 14 14:52:00.294779 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1385/2892] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:00 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1632 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:00.295118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.295898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.303419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.304104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.305173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.305789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.335032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5869b713-2db5-4afb-8d87-166109968b82 req-a72fd0aa-0ab5-4a91-a446-86795c25082e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440ce25a-de3f-4234-87b5-8ba763984008", "tag": "09c542b3-79a4-4a81-8516-1a310a59643e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:00.345093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:00.404013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5869b713-2db5-4afb-8d87-166109968b82 req-a72fd0aa-0ab5-4a91-a446-86795c25082e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.414977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5869b713-2db5-4afb-8d87-166109968b82 req-a72fd0aa-0ab5-4a91-a446-86795c25082e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.457121 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5869b713-2db5-4afb-8d87-166109968b82 req-a72fd0aa-0ab5-4a91-a446-86795c25082e service nova] Creating event network-changed:09c542b3-79a4-4a81-8516-1a310a59643e for instance 440ce25a-de3f-4234-87b5-8ba763984008 on n-h2-768852-23 Jul 14 14:52:00.473439 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5869b713-2db5-4afb-8d87-166109968b82 req-a72fd0aa-0ab5-4a91-a446-86795c25082e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172629 Jul 14 14:52:00.474938 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1386/2893] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:00.481474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-dfe95aaa-9188-4da9-8eab-122eb4339636 req-0faf1a47-8cae-4fbd-a0fb-dea886392c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6c479bb-f2bf-46bb-a256-cd2431bb117a", "tag": "2e5cda1c-624c-4920-96ff-61aae4a6717c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:00.508242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dfe95aaa-9188-4da9-8eab-122eb4339636 req-0faf1a47-8cae-4fbd-a0fb-dea886392c4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.509226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dfe95aaa-9188-4da9-8eab-122eb4339636 req-0faf1a47-8cae-4fbd-a0fb-dea886392c4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.533372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a3470f3-f9bc-4250-ad3e-f266e11946bd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 204 len: 0 microversion: 2.1 time: 0.228271 Jul 14 14:52:00.534552 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1508/2894] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:00 2022] DELETE /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:52:00.563332 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-dfe95aaa-9188-4da9-8eab-122eb4339636 req-0faf1a47-8cae-4fbd-a0fb-dea886392c4b service nova] Creating event network-changed:2e5cda1c-624c-4920-96ff-61aae4a6717c for instance f6c479bb-f2bf-46bb-a256-cd2431bb117a on n-h1-768852-23 Jul 14 14:52:00.564902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.569058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.579636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-dfe95aaa-9188-4da9-8eab-122eb4339636 req-0faf1a47-8cae-4fbd-a0fb-dea886392c4b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102043 Jul 14 14:52:00.580613 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1387/2895] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:52:00.590826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.592362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.593325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.594322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.594904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.597507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.615256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.617027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.624201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.625597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.840595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:00.851636 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d511c1c0-fe3a-49e0-8918-2e052316fd02 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.309123 Jul 14 14:52:00.854024 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1509/2896] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:00 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:00.863238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:00.864030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:00.890468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.890870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:00.891740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:00.892418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.122510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:01.133776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f8383e0-3fe7-4497-b375-0bc93b6c2362 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1527 microversion: 2.1 time: 0.551671 Jul 14 14:52:01.135204 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1388/2897] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:00 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1527 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:01.141139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:01.142328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:01.153890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.156217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.161144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.162473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.192562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:01.203719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e459a8c-d7a1-417f-b1f7-be3d842e8873 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1321 microversion: 2.1 time: 0.347804 Jul 14 14:52:01.210245 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1510/2898] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:00 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:01.221691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:01.223020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:01.236034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.236497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.237310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.237834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.380345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:01.393221 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e00eb4f2-6a30-4a57-884d-ed0fb8e0245c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.255571 Jul 14 14:52:01.394455 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1389/2899] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:01 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:01.400339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:01.401551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:01.409981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.410835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.412291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.413235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.469896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:01.470508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1dd10335-f28e-4013-bca1-daf5a6d6b10e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/ips" status: 200 len: 150 microversion: 2.20 time: 0.073963 Jul 14 14:52:01.481559 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1390/2900] 10.222.0.98 () {60 vars in 1288 bytes} [Thu Jul 14 14:52:01 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:52:01.490451 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a73820c-8579-4a1b-a511-e5c5cc5ebdf9 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.277814 Jul 14 14:52:01.506591 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1511/2901] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:01 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:01.515973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:01.517425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:01.527920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.529121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.530589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.531890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.682714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:01.695051 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3892bdcd-b869-4540-90ae-0413a3cfa208 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1632 microversion: 2.1 time: 0.208409 Jul 14 14:52:01.695715 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1391/2902] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:01 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1632 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:01.872252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:01.873175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:01.885465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.885910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:01.892288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:01.892742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.163180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.163804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.172017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:02.174327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.174796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.175627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.178476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.182504 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-17317331-aefd-469f-821c-01cba4e75202 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.314961 Jul 14 14:52:02.183130 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1512/2903] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:01 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:02.222479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.224856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.231704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.232485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.233564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.234251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.465708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:02.473629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:02.487444 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2be2ddbd-654a-42be-b6e8-a9456ca437ed tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1527 microversion: 2.1 time: 0.328616 Jul 14 14:52:02.487693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-470ce3b8-24a0-4958-8753-b706c2ee0cc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1513 microversion: 2.1 time: 0.269566 Jul 14 14:52:02.488056 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1392/2904] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1527 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:52:02.503554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.504513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1513/2905] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1513 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:02.504826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.509560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.510189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.518005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.518412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.518674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.518866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.519564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.519850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.520003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.520291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.780126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:02.792543 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-da96b853-85ef-4c49-83a8-caeb9b3a9e9d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1511 microversion: 2.1 time: 0.286087 Jul 14 14:52:02.793634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1514/2906] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1511 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:02.800450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.801360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.810322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.811851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.812884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.813483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.832824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:02.843513 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f48917fd-0105-4303-8789-654618c78fe5 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.349435 Jul 14 14:52:02.854700 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1393/2907] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:02.861730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0cfdb518-5ae5-452b-b843-863792468fa3 req-1ca22f07-cd03-4977-85ab-0bd8bcf79119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f9561de-a262-42aa-9970-e747af3e88a8", "name": "network-vif-deleted", "tag": "e4f71160-74ef-4672-a27e-ee986e72f3b7"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:02.886671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0cfdb518-5ae5-452b-b843-863792468fa3 req-1ca22f07-cd03-4977-85ab-0bd8bcf79119 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.887621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0cfdb518-5ae5-452b-b843-863792468fa3 req-1ca22f07-cd03-4977-85ab-0bd8bcf79119 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.917421 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0cfdb518-5ae5-452b-b843-863792468fa3 req-1ca22f07-cd03-4977-85ab-0bd8bcf79119 service nova] Creating event network-vif-deleted:e4f71160-74ef-4672-a27e-ee986e72f3b7 for instance 9f9561de-a262-42aa-9970-e747af3e88a8 on n-h1-768852-23 Jul 14 14:52:02.923662 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0cfdb518-5ae5-452b-b843-863792468fa3 req-1ca22f07-cd03-4977-85ab-0bd8bcf79119 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067175 Jul 14 14:52:02.924519 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1394/2908] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:02.931770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:02.932907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:02.952224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.952984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:02.953978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:02.954691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.144790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1db067ac2fdc491e866b8dcfdfe8d606', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4da9bfba7a6e411fa22206a70417ae73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.162498 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b22021c7-882a-4572-b45f-f4f18a77d3a3 tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 200 len: 1354 microversion: 2.1 time: 0.233234 Jul 14 14:52:03.168317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.174383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1395/2909] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 1354 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:03.179663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:03.181376 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15b461fa-90d6-4765-afb5-10102dd44702 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.385995 Jul 14 14:52:03.182085 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1515/2910] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:02 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:03.182816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:03.191872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.192672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.200080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:03.201686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:03.204324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.205099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.212330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.212867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.220104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.221553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.453904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:03.456531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.467337 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a47cbcf4-172f-45c1-a2f0-bc2c3aaf954e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1512 microversion: 2.1 time: 0.291602 Jul 14 14:52:03.479602 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1396/2911] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:03 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1512 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:03.485614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5e50bc5f-3cfc-4eb6-909a-ac164639b154 req-17618715-960b-4b13-aeb5-def13c61fbc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dc97db-700a-4df6-a377-eea717c9fa71", "name": "network-vif-unplugged", "status": "completed", "tag": "8fe2dd17-ee99-49df-b398-70e16102b754"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:03.494214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.503568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5e50bc5f-3cfc-4eb6-909a-ac164639b154 req-17618715-960b-4b13-aeb5-def13c61fbc1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.504315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5e50bc5f-3cfc-4eb6-909a-ac164639b154 req-17618715-960b-4b13-aeb5-def13c61fbc1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.506720 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3fb305b8-d8f8-48d5-935d-2fdba5e1d684 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.310470 Jul 14 14:52:03.517247 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1516/2912] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:03 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:03.522092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5e50bc5f-3cfc-4eb6-909a-ac164639b154 req-17618715-960b-4b13-aeb5-def13c61fbc1 service nova] Creating event network-vif-unplugged:8fe2dd17-ee99-49df-b398-70e16102b754 for instance 47dc97db-700a-4df6-a377-eea717c9fa71 on n-h1-768852-23 Jul 14 14:52:03.523723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:03.528591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.529567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:03.533822 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5e50bc5f-3cfc-4eb6-909a-ac164639b154 req-17618715-960b-4b13-aeb5-def13c61fbc1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051875 Jul 14 14:52:03.534126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:03.535914 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1397/2913] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:03.546727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:03.547460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.547614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:03.548725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.549936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.550848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.556649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.557151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.558023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.558785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.589224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:03.703041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:03.801426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.809191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.812142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.861508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:03.869908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e94b938c-6582-4317-8b4b-dd6c9b7daeca tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1527 microversion: 2.1 time: 0.330545 Jul 14 14:52:03.870804 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1398/2914] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:03 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1527 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:03.876890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:03.878736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:03.885892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.886654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:03.887871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:03.888559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.062614 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29bba19d-21ce-443b-8c18-9f25f8230c48 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1516 microversion: 2.1 time: 0.542126 Jul 14 14:52:04.074595 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1517/2915] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 14:52:03 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1516 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:04.096396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.110449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.113374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-157705253', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:04.128811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.130099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.131973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.133256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.376286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:04.384289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:04.409215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.426289 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36c61820-2317-448b-bfd6-5e271bc68556 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1522 microversion: 2.1 time: 0.553878 Jul 14 14:52:04.427012 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1399/2916] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:03 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1522 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:04.433151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.437482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] [instance: 9f9561de-a262-42aa-9970-e747af3e88a8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:04.455757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.456784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.459759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.462646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.501903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.509231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:04.510845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.511356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.512014 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] HTTP exception thrown: Instance 9f9561de-a262-42aa-9970-e747af3e88a8 could not be found. Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Request method failure captured: Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 HTTP/1.1 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C06yZ8QaPbZaeNS6u7RdMkuzoapTwF2aOMHOTNJo7eID_w5gD-1QnF2I4jKX_v1QXaBtt0o4X_D6U9Etlk9NOSfP1kIN_AdoyOQtGnFAI1QN4cp0luRh4R4rYrKPdrMD2fvSDcp9y7POrcLZBf9_xRaCllDTt0oTYwYHp_p9oAAblI Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4da9bfba7a6e411fa22206a70417ae73 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-668490 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4da9bfba7a6e411fa22206a70417ae73"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4da9bfba7a6e411fa22206a70417ae73"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4da9bfba7a6e411fa22206a70417ae73"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4da9bfba7a6e411fa22206a70417ae73"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-668490 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4da9bfba7a6e411fa22206a70417ae73 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-668490 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-668490-project Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 1db067ac2fdc491e866b8dcfdfe8d606 Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-668490-project Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 9f9561de-a262-42aa-9970-e747af3e88a8 could not be found. Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9f9561de-a262-42aa-9970-e747af3e88a8'} Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f9561de-a262-42aa-9970-e747af3e88a8 could not be found. Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f9561de-a262-42aa-9970-e747af3e88a8 could not be found. Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:04.518011 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:04.523160 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:04.523160 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:04.523160 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:04.523160 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:04.523160 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f9561de-a262-42aa-9970-e747af3e88a8 could not be found. Jul 14 14:52:04.523160 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:04.525746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Returning 404 to user: Instance 9f9561de-a262-42aa-9970-e747af3e88a8 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:04.527101 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3cc9b2e2-c217-4cda-88d5-257adc5c371c tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8" status: 404 len: 111 microversion: 2.1 time: 0.098848 Jul 14 14:52:04.528357 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1400/2917] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/9f9561de-a262-42aa-9970-e747af3e88a8 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:04.534891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.536597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:04.549250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.550141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.551379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.552287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.743337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21f5b5aa-5bf0-410f-a744-71f497ab72f1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-157705253" status: 200 len: 1514 microversion: 2.1 time: 0.651202 Jul 14 14:52:04.744364 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1518/2918] 10.222.0.98 () {58 vars in 1260 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-157705253 => generated 1514 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:04.751990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-990fab0a-010f-4d43-b31c-2225da43e593 req-fea005ab-e089-429b-8e3a-6e5f93a84e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47dc97db-700a-4df6-a377-eea717c9fa71", "name": "network-vif-deleted", "tag": "8fe2dd17-ee99-49df-b398-70e16102b754"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:04.771297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-990fab0a-010f-4d43-b31c-2225da43e593 req-fea005ab-e089-429b-8e3a-6e5f93a84e74 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.772017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-990fab0a-010f-4d43-b31c-2225da43e593 req-fea005ab-e089-429b-8e3a-6e5f93a84e74 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.784645 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-990fab0a-010f-4d43-b31c-2225da43e593 req-fea005ab-e089-429b-8e3a-6e5f93a84e74 service nova] Creating event network-vif-deleted:8fe2dd17-ee99-49df-b398-70e16102b754 for instance 47dc97db-700a-4df6-a377-eea717c9fa71 on n-h1-768852-23 Jul 14 14:52:04.790373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-990fab0a-010f-4d43-b31c-2225da43e593 req-fea005ab-e089-429b-8e3a-6e5f93a84e74 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044104 Jul 14 14:52:04.791681 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1519/2919] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:04.798888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.799893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:04.807997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.808491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.809287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:04.810035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:04.909457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.925378 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b479fb38-b202-4bf5-ab2f-98bbe3450008 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.395367 Jul 14 14:52:04.926285 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1401/2920] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:04.940470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-263ef2a9-ee4f-41aa-b171-f65d49fd2ccf tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] Calling method '.version_select at 0x7fdbf2e0baf0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.974883 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-263ef2a9-ee4f-41aa-b171-f65d49fd2ccf tempest-ServersTestJSON-668490 tempest-ServersTestJSON-668490-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038982271" status: 202 len: 0 microversion: 2.1 time: 0.046643 Jul 14 14:52:04.977108 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1402/2921] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:52:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1038982271 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:04.985919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:04.986562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.993126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:04.994829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:04.995911 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0d2d0480-5e65-4397-8bbf-8f5c2f54b65f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.202542 Jul 14 14:52:04.996713 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1520/2922] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:05.002903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:05.004248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:05.011201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.012594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.012746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.013352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.014866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.015347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.015735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.015917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.033332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:05.056811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.057528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.058212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lazy-loading 'fault' on Instance uuid 47dc97db-700a-4df6-a377-eea717c9fa71 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:05.148083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:05.156123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:05.160914 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f04f02f-66eb-45dc-84d1-ce76ba4ed56e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 200 len: 1314 microversion: 2.1 time: 0.162807 Jul 14 14:52:05.161893 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1521/2923] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:05.238455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:05.250558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.250829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.411248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:05.412584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:05.419844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.421018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.422128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.423973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.482608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lazy-loading 'flavor' on Instance uuid 805e64f7-049d-4034-97c5-bf65914f6396 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:05.519885 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3cff3188-75a5-4488-968b-074ec8b8eb02 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.540165 Jul 14 14:52:05.524494 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1403/2924] 10.222.0.98 () {58 vars in 1172 bytes} [Thu Jul 14 14:52:04 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:05.530323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:05.531783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:05.539065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.540835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.541858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.542463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.724431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:05.735509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-92f55cc2-e437-428c-85bb-5a3b1ad96f4e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1502 microversion: 2.1 time: 0.208935 Jul 14 14:52:05.736353 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1404/2925] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:05 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1502 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:05.752546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:05.761529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:05.765012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.servers [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Removing options 'limit' from query {{(pid=125966) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:52:05.767872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:05.776464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.777359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.778678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.779246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:05.830646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:05.839821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:05.840444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.020057 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02a65bb6-8acd-4881-ad85-f9c7f9520e67 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/action" status: 202 len: 0 microversion: 2.20 time: 0.622462 Jul 14 14:52:06.024627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1522/2926] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:52:05 2022] POST /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/action => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:52:06.031349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30d6c11e-134b-46bd-9c3b-357fc46ff2fb tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'create', calling method: .version_select at 0x7fdbf2bbe5e0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-750507779", "description": "tempest-description-43562690"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:06.077781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe785531-aeda-4daf-a839-5a4eab73489c tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1662 microversion: 2.1 time: 0.340118 Jul 14 14:52:06.078551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1405/2927] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 14:52:05 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1662 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:06.095513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:06.096625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:06.113475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.114648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.118771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.120545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.362472 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30d6c11e-134b-46bd-9c3b-357fc46ff2fb tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.335616 Jul 14 14:52:06.377378 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1523/2928] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:52:06 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:06.388168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:06.389922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:06.401736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.402548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.403975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.405290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.481225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.496210 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f140399c-1b39-4e94-9387-219aaeec4221 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.416078 Jul 14 14:52:06.499037 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1406/2929] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:06 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:06.510306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:06.511659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:06.524057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.524867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.526243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.526920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.626481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.636827 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b15e01b1-ae12-4c38-86c6-b8231acc8b93 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.257728 Jul 14 14:52:06.637459 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1524/2930] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:06 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:06.643051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:06.647159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.648060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:06.657471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.657916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.658963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.659465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.784243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:06.848404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b389d5a-3940-44bc-ab84-38179cfcd5e9 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.209694 Jul 14 14:52:06.859483 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1525/2931] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:52:06 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:06.859483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:06.859483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:06.864793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.865248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.866033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.866495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.882825 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 HTTP/1.1 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '47dc97db-700a-4df6-a377-eea717c9fa71'} Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:06.884608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:06.893448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7028208-9412-4365-8ba3-a2d4d3ab2a70 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 404 len: 111 microversion: 2.1 time: 0.036146 Jul 14 14:52:06.895402 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1526/2932] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:06 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:06.902912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-750507779"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:06.904000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:06.913163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.913858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.915226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.916166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.936187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.949945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.953669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.955746 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f118efa-fb2d-4325-85c8-03aec0f193c3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.453075 Jul 14 14:52:06.960048 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1407/2933] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:06 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:06.967735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:06.976823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:06.977659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.servers [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Removing options 'limit' from query {{(pid=125966) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:52:06.979219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:06.989040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.989846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:06.991376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:06.992410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.046420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:07.100838 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6f337957-19e9-4729-9f6b-f8411b41fc9f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.140452 Jul 14 14:52:07.103981 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1408/2934] 10.222.0.98 () {58 vars in 1149 bytes} [Thu Jul 14 14:52:06 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:07.116288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-441609549", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:07.148618 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.network.security_group_api [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Adding security group 545c6774-d82c-4764-9b56-35670f88fbae to port 3eecb2db-a0c5-427c-8a37-e0241e285b86 Jul 14 14:52:07.239776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] validate_networks() for [('e7e64f1b-6e91-453d-83c0-e77e70b58838', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:52:07.714304 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aef26cdd-bbec-4870-85c8-d16b6048005e tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action" status: 202 len: 0 microversion: 2.1 time: 0.817394 Jul 14 14:52:07.715245 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1527/2935] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:06 2022] POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action => generated 0 bytes in 819 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:07.720716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:07.732254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:07.733512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:07.744645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.745102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.746178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.746851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.786896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:07.831066 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6629b6c5-9528-4505-a0e5-333f8f9d1e81 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.114940 Jul 14 14:52:07.832588 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1528/2936] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:52:07 2022] GET /compute/v2.1/servers => generated 1011 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:07.838242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:07.839185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:07.848158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.848616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:07.849624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:07.850246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.097504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:08.106757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e1adff0-fd52-4fcb-9b28-15ed0d0a7aec tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.272705 Jul 14 14:52:08.107812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1529/2937] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:07 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:08.114404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:08.115426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:08.126701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.127408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.128313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.128834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.380016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:08.399048 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-01e7f7ad-f1b9-4c1d-92b9-9a5171bf8261 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.289751 Jul 14 14:52:08.401532 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1530/2938] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:08 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:08.406452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-750507779"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:08.407300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:08.415690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.416175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.417337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.418338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.630755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:52:08.632322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:52:08.633606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:52:08.635752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:52:08.636822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:52:08.648365 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.network.security_group_api [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Removing security group 545c6774-d82c-4764-9b56-35670f88fbae from port 3eecb2db-a0c5-427c-8a37-e0241e285b86 Jul 14 14:52:08.679054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.681422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.682688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.689402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.722713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for project f30b8cc1b9254cca90487359e0872a93. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:08.728514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Getting quotas for user a7edefb2896948e39ac7aed5a3884233 and project f30b8cc1b9254cca90487359e0872a93. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:08.761700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:52:08.767417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:52:08.851427 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98e95f6a-8d5b-4802-9361-2f8a9ae7aa16 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.744539 Jul 14 14:52:08.852708 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1409/2939] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:52:08.862246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-34d35c49-5b3a-48f4-bebb-8f1b29834760 req-aa3bea7d-142e-49c9-992b-2a9e8c820657 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:08.893100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-34d35c49-5b3a-48f4-bebb-8f1b29834760 req-aa3bea7d-142e-49c9-992b-2a9e8c820657 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.893552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-34d35c49-5b3a-48f4-bebb-8f1b29834760 req-aa3bea7d-142e-49c9-992b-2a9e8c820657 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.907868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-34d35c49-5b3a-48f4-bebb-8f1b29834760 req-aa3bea7d-142e-49c9-992b-2a9e8c820657 service nova] Creating event network-changed:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:52:08.915016 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-34d35c49-5b3a-48f4-bebb-8f1b29834760 req-aa3bea7d-142e-49c9-992b-2a9e8c820657 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060475 Jul 14 14:52:08.915878 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1410/2940] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:08.922945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:08.926521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:08.927605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:08.951974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.952637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:08.953243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:08.953697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.051638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:09.122042 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7acebeda-c0d7-44e0-a7ec-7e2b1ccc6b16 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.204842 Jul 14 14:52:09.123829 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1411/2941] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:52:08 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:09.129352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.130111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.138191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.138652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.139676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.140176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.348367 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7d342ad-c371-4f62-be19-216683ee135f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action" status: 202 len: 0 microversion: 2.1 time: 0.947283 Jul 14 14:52:09.353289 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1531/2942] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:08 2022] POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action => generated 0 bytes in 949 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:09.358046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a82d92c0-4783-4b09-b958-037984215b35 req-ec78a5d2-c01d-4e05-b639-e436df10d9cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440ce25a-de3f-4234-87b5-8ba763984008", "name": "network-vif-plugged", "status": "completed", "tag": "09c542b3-79a4-4a81-8516-1a310a59643e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:09.378621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a82d92c0-4783-4b09-b958-037984215b35 req-ec78a5d2-c01d-4e05-b639-e436df10d9cb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.378887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a82d92c0-4783-4b09-b958-037984215b35 req-ec78a5d2-c01d-4e05-b639-e436df10d9cb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.410673 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a82d92c0-4783-4b09-b958-037984215b35 req-ec78a5d2-c01d-4e05-b639-e436df10d9cb service nova] Creating event network-vif-plugged:09c542b3-79a4-4a81-8516-1a310a59643e for instance 440ce25a-de3f-4234-87b5-8ba763984008 on n-h2-768852-23 Jul 14 14:52:09.423415 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a82d92c0-4783-4b09-b958-037984215b35 req-ec78a5d2-c01d-4e05-b639-e436df10d9cb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072705 Jul 14 14:52:09.425943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1532/2943] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:09.438187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-212df125-38e2-4509-b0de-cf25e9a1dfc6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.438968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-212df125-38e2-4509-b0de-cf25e9a1dfc6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.512384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-212df125-38e2-4509-b0de-cf25e9a1dfc6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.521386 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-212df125-38e2-4509-b0de-cf25e9a1dfc6 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1224 microversion: 2.1 time: 0.093852 Jul 14 14:52:09.522386 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1533/2944] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:09.527745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.528373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.536023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.536489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.537421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.537979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.719644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.728827 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-367a428b-0244-4b37-b4f9-61bbc025df5f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.205294 Jul 14 14:52:09.729763 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1534/2945] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:09.735690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.739722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.740217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.compute.servers [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Removing options 'limit' from query {{(pid=125965) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:52:09.741183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:09.748318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.749467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.750480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.751251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.782893 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68e7a56d-4b29-4a53-aeaa-e85cd3ea2226 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.051989 Jul 14 14:52:09.783949 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1535/2946] 10.222.0.98 () {58 vars in 1139 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:09.789262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c467af2-eb18-4465-af23-661827654326 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'create', calling method: .version_select at 0x7fdbf31afd30>, body: {"pool": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:09.898944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.921656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.937663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:09.943923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d7e6a51-0885-45c9-b255-90b4e0124664 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.816375 Jul 14 14:52:09.950138 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1412/2947] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:09.960137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:09.961515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:09.973394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.975800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:09.977971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:09.979175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.594521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:10.606783 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c2e2930-d1b4-42c6-a415-74e67cf2807c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1541 microversion: 2.1 time: 0.653287 Jul 14 14:52:10.624228 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1413/2948] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:09 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1541 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:10.637050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:10.646683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:10.648369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-157705253', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:10.657936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:10.662689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:10.664507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.667007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:10.668223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:10.872724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:11.022949 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f83d607d-10a5-48f4-9d97-dbdda3c39394 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-157705253" status: 200 len: 345 microversion: 2.1 time: 0.395566 Jul 14 14:52:11.024060 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1414/2949] 10.222.0.98 () {58 vars in 1239 bytes} [Thu Jul 14 14:52:10 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-157705253 => generated 345 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:11.034526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:11.036659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:11.049591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.050738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.052269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.053824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.250848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:11.279100 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-280ea2ff-db0f-4076-a260-1796abae24c4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1284 microversion: 2.1 time: 0.253011 Jul 14 14:52:11.283234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1415/2950] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:11 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1284 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:11.296220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:11.297683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:11.309265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.310171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.311800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.312900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.355991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:11.741020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:11.755968 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6f7587a5-e870-4fa7-ad9b-16c696db2ef1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1316 microversion: 2.1 time: 0.470083 Jul 14 14:52:11.776575 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1416/2951] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:11 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:11.787137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:11.788422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:11.800594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.801412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:11.803679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:11.804209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.167743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.177595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.179195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.180743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9e5cb00-2e8e-4179-8ba1-b38d9c750baf tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.402231 Jul 14 14:52:12.193448 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1417/2952] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:11 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:12.199404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d738a00-49f6-42e5-b271-3939a088a44a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:12.208023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d738a00-49f6-42e5-b271-3939a088a44a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.208760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d738a00-49f6-42e5-b271-3939a088a44a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.289133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d738a00-49f6-42e5-b271-3939a088a44a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:52:12.406439 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d738a00-49f6-42e5-b271-3939a088a44a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "POST /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256/action" status: 202 len: 0 microversion: 2.1 time: 0.211223 Jul 14 14:52:12.409660 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1418/2953] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:12 2022] POST /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:12.418694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ce03ccfa-e507-44d5-a287-cb3639dd787c req-d2a29d43-6113-4f1a-b442-acbc0621778a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:12.440301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ce03ccfa-e507-44d5-a287-cb3639dd787c req-d2a29d43-6113-4f1a-b442-acbc0621778a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.441855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ce03ccfa-e507-44d5-a287-cb3639dd787c req-d2a29d43-6113-4f1a-b442-acbc0621778a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.465975 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ce03ccfa-e507-44d5-a287-cb3639dd787c req-d2a29d43-6113-4f1a-b442-acbc0621778a service nova] Creating event network-changed:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:52:12.474519 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ce03ccfa-e507-44d5-a287-cb3639dd787c req-d2a29d43-6113-4f1a-b442-acbc0621778a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062660 Jul 14 14:52:12.475760 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1419/2954] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:12.484571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:12.486883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:12.500084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.501160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.502598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:12.503070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:12.963748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:12.979576 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d824be6-c540-4752-ace8-a8a466c43a40 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1540 microversion: 2.1 time: 0.501984 Jul 14 14:52:12.996163 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1420/2955] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:12 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1540 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:13.008338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:13.009677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:13.033594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.033594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.035372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.036281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.580311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:13.597008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-58313dfd-3a94-4e79-ab2e-8322b800d2a2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1282 microversion: 2.1 time: 0.599054 Jul 14 14:52:13.598201 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1421/2956] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:12 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1282 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:13.603685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:13.616296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:13.624344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.625028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.626304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.627105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.797677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c467af2-eb18-4465-af23-661827654326 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.012473 Jul 14 14:52:13.800559 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1536/2957] 10.222.0.98 () {60 vars in 1169 bytes} [Thu Jul 14 14:52:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4015 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:13.808659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:13.809628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:13.820258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.832459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:13.834290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:13.835367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.220075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.235865 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ab0db37-cc4d-4b00-bd25-9e3b1cd35332 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.635747 Jul 14 14:52:14.237915 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1422/2958] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:13 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:14.257181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:14.258311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:14.284367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.285186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.286690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.287588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.377315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.392014 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23b09c4d-1d3d-4d0d-9a96-728704bfb516 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1504 microversion: 2.1 time: 0.588903 Jul 14 14:52:14.392618 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1537/2959] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:13 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1504 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:14.417764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.1.253"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:14.425686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:14.455334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.456541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.458296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.459374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.509818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Acquired lock "refresh_cache-7ec99603-4678-45c6-a10f-2f7312a2d20e" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:52:14.744237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.755334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.757609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:14.758927 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6837f116-8296-43a0-97c5-ef898dcf482b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.509984 Jul 14 14:52:14.760004 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1423/2960] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:14 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:14.766028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:14.767066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:14.774642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.775083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:14.776129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:14.776943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.014059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:15.023302 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64149c8b-cc40-4567-9d85-d46759f081e7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1540 microversion: 2.1 time: 0.261557 Jul 14 14:52:15.024121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1424/2961] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:14 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1540 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:15.029626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1748963053"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:15.030177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:15.037956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.038618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.039719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.040164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.212863 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.network.security_group_api [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Adding security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 to port 09c542b3-79a4-4a81-8516-1a310a59643e Jul 14 14:52:15.750823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97ff2bc5-7f94-4361-8dc9-f3ebf34e30c3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008/action" status: 202 len: 0 microversion: 2.1 time: 0.725384 Jul 14 14:52:15.754846 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1425/2962] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:15 2022] POST /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008/action => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:15.759924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "name": "network-vif-unplugged", "status": "completed", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}, {"name": "network-changed", "server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:15.781405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.781847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.800591 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] Creating event network-vif-unplugged:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h1-768852-23 Jul 14 14:52:15.800876 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] Creating event network-changed:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h1-768852-23 Jul 14 14:52:15.815416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:52:15.840056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-91e21cd6-5313-4432-9869-87b3896a3c78 req-84dd9bcc-c189-4439-a723-f03c2812b2a5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.083607 Jul 14 14:52:15.843035 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1426/2963] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:15.850371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:15.851783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:15.862491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.863254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:15.864325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:15.864956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:16.485192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:16.510320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da76b2ab-ac89-42b8-a5d2-04266d7fd84b tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.664882 Jul 14 14:52:16.512111 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1427/2964] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:15 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:16.523053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:16.524599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:16.544019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:16.545551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:16.547114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:16.548158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:16.973119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:16.991581 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71bed2d6-dcca-4363-8d0b-43779319b5a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.477637 Jul 14 14:52:16.992197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1428/2965] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:16 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:16.997361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05f50991-dd81-451b-a5ae-d8dbd56e91d7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdc041944c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:17.422048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-05f50991-dd81-451b-a5ae-d8dbd56e91d7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use.", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:17.424609 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-05f50991-dd81-451b-a5ae-d8dbd56e91d7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.424609 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05f50991-dd81-451b-a5ae-d8dbd56e91d7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 HTTP/1.1 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: exception: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8'} Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:17.429280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] Jul 14 14:52:17.440147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:17.458212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05f50991-dd81-451b-a5ae-d8dbd56e91d7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 400 to user: Security Group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 in use. Jul 14 14:52:17.458212 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-96d61c37-2622-4e88-a825-9df1afe233ac'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:17.460502 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05f50991-dd81-451b-a5ae-d8dbd56e91d7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8" status: 400 len: 185 microversion: 2.1 time: 0.467023 Jul 14 14:52:17.462014 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1429/2966] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:16 2022] DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 => generated 185 bytes in 469 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:52:17.473576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:17.475052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:17.484832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.485535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.487036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.487996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.698410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:17.712326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:17.714254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:17.715650 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-109235f4-c314-4a98-9e38-73bcca217662 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.249370 Jul 14 14:52:17.716232 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1430/2967] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:17 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:17.722550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-1b6bb8fb-d2d7-4737-97a1-5e377b977cf6 req-e9d36446-a12f-450c-bd75-3d442f060628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440ce25a-de3f-4234-87b5-8ba763984008", "tag": "09c542b3-79a4-4a81-8516-1a310a59643e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:17.731806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1b6bb8fb-d2d7-4737-97a1-5e377b977cf6 req-e9d36446-a12f-450c-bd75-3d442f060628 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.732497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1b6bb8fb-d2d7-4737-97a1-5e377b977cf6 req-e9d36446-a12f-450c-bd75-3d442f060628 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.749860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-1b6bb8fb-d2d7-4737-97a1-5e377b977cf6 req-e9d36446-a12f-450c-bd75-3d442f060628 service nova] Creating event network-changed:09c542b3-79a4-4a81-8516-1a310a59643e for instance 440ce25a-de3f-4234-87b5-8ba763984008 on n-h2-768852-23 Jul 14 14:52:17.755642 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-1b6bb8fb-d2d7-4737-97a1-5e377b977cf6 req-e9d36446-a12f-450c-bd75-3d442f060628 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037341 Jul 14 14:52:17.756709 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1431/2968] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:17.769871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:17.771000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:17.790391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.790872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:17.792102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:17.793018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.123696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:18.138890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6bb1faa8-cee4-4cce-9015-8c6953bdb749 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1472 microversion: 2.1 time: 0.379939 Jul 14 14:52:18.140453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1432/2969] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:17 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1472 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:18.151784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:18.154080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:18.166651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:18.168036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.177553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:18.179054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.232646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Building network info cache for instance {{(pid=125965) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:52:18.363228 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff02a6dc-647e-4507-ab41-466f97f3af1d tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008/action" status: 202 len: 0 microversion: 2.1 time: 0.219871 Jul 14 14:52:18.365592 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1433/2970] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:18 2022] POST /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:18.376824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:18.378381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:18.392119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:18.392632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.394325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:18.395120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.439863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:18.685474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:18.698132 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-031cd72e-f6f3-4be4-a7c7-30ac969f44c5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.330623 Jul 14 14:52:18.699035 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1434/2971] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:18 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:18.711788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:18.712421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:18.725290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:18.725736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.726545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:18.726985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:18.760805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:18.998689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.011541 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf73e857-d6e7-44c0-b34f-1ae0541b5792 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.308199 Jul 14 14:52:19.012358 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1435/2972] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:18 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:19.019072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8ae7d3ea-ef01-4519-91a6-b4bbf93c6801 req-9cbac6b3-102f-488f-93cb-0a10cc94cfc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70", "tag": "ee19a7b3-b658-4895-8c41-7627ca326bb8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:19.034854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8ae7d3ea-ef01-4519-91a6-b4bbf93c6801 req-9cbac6b3-102f-488f-93cb-0a10cc94cfc6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.036088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8ae7d3ea-ef01-4519-91a6-b4bbf93c6801 req-9cbac6b3-102f-488f-93cb-0a10cc94cfc6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.052093 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8ae7d3ea-ef01-4519-91a6-b4bbf93c6801 req-9cbac6b3-102f-488f-93cb-0a10cc94cfc6 service nova] Creating event network-changed:ee19a7b3-b658-4895-8c41-7627ca326bb8 for instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 on n-h1-768852-23 Jul 14 14:52:19.062792 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8ae7d3ea-ef01-4519-91a6-b4bbf93c6801 req-9cbac6b3-102f-488f-93cb-0a10cc94cfc6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048553 Jul 14 14:52:19.064211 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1436/2973] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:19.073626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:19.076959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:19.086154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.086988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.088106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.088936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.178010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Updating instance_info_cache with network_info: [{"id": "3eecb2db-a0c5-427c-8a37-e0241e285b86", "address": "fa:16:3e:0b:26:ec", "network": {"id": "ec21279c-faed-4ec6-8a6e-8500739ef80a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1885863905-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.1.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "633d43bf7c6c48e5ba244d103fbd2fe6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3eecb2db-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125965) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:52:19.202895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Releasing lock "refresh_cache-7ec99603-4678-45c6-a10f-2f7312a2d20e" {{(pid=125965) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:52:19.212414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a936646f-1fd3-4abe-881f-4f320b302803 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action" status: 202 len: 0 microversion: 2.1 time: 4.802928 Jul 14 14:52:19.214862 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1538/2974] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:14 2022] POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action => generated 0 bytes in 4819 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:52:19.231127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:19.233255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:19.254457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.257980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.263147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.264054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.518157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:19.526678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.530417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:19.556985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.559687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.561325 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-143b7d37-f3b1-40e8-8c78-5ff646327660 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.343403 Jul 14 14:52:19.563384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1539/2975] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:19 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:19.578847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:19.580147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:19.606577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.610074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.611256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:19.612599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:19.638199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:19.657948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70e4285f-621f-482a-89ab-2e3436e5c621 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1575 microversion: 2.1 time: 0.590658 Jul 14 14:52:19.658624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1437/2976] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:19 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1575 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:19.680473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.1.253"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:19.764573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=14 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:20.010051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:20.018023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:20.019582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:20.025184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:20.025954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:20.579254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Acquired lock "refresh_cache-7ec99603-4678-45c6-a10f-2f7312a2d20e" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 14:52:20.646588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:20.657455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29d09d35-bce6-49fa-919d-1f88365d0fb1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1472 microversion: 2.1 time: 1.092583 Jul 14 14:52:20.666904 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1540/2977] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:19 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1472 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:20.670053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:20.670739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:20.693088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:20.693554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:20.694389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:20.695103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:20.733520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:21.205607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:21.225749 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fdb1fb40-0ca7-4b9b-ac2f-75c2d3b27284 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.565798 Jul 14 14:52:21.227064 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1541/2978] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:20 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:21.244626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:21.245270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:21.256652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.257351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.271752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.276367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.585737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:21.597690 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b983ff8a-a992-4c66-9261-fef0568aae73 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.364658 Jul 14 14:52:21.598762 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1542/2979] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:21 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:21.605556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:21.606562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:21.614133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.614700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.615624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.616141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.880145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:21.906618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:21.922099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:21.924699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1a300e08-a812-493a-a742-17c68ee16a63 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.323396 Jul 14 14:52:21.933610 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1543/2980] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:21 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:21.954095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:21.955182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:21.970598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.971772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:21.974354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:21.975962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.284887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:22.300098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85f71979-c3a1-4cb7-a8d2-35e4de7fd578 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1573 microversion: 2.1 time: 0.363950 Jul 14 14:52:22.301231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1544/2981] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:21 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1573 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:22.307511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3b1f29b7-250b-4abb-af53-44463e502b3c req-dee51aef-71c2-4898-a0af-678b820dcb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:22.319342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3b1f29b7-250b-4abb-af53-44463e502b3c req-dee51aef-71c2-4898-a0af-678b820dcb7b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.320138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3b1f29b7-250b-4abb-af53-44463e502b3c req-dee51aef-71c2-4898-a0af-678b820dcb7b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.333428 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3b1f29b7-250b-4abb-af53-44463e502b3c req-dee51aef-71c2-4898-a0af-678b820dcb7b service nova] Creating event network-changed:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:52:22.338580 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3b1f29b7-250b-4abb-af53-44463e502b3c req-dee51aef-71c2-4898-a0af-678b820dcb7b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035089 Jul 14 14:52:22.339235 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1545/2982] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:22.344658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:22.345391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:22.352466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.352922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.353723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.354162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.460615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Building network info cache for instance {{(pid=125966) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Jul 14 14:52:22.543136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:22.553751 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c8ca3ef2-8814-4956-afe0-0ee36856d88b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1469 microversion: 2.1 time: 0.213159 Jul 14 14:52:22.554378 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1546/2983] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:22 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:22.559323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-09f0bf83-0411-45fb-a4f6-60211dbb9944 req-cef61c89-c9c6-403a-a7df-f125674907d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "name": "network-vif-plugged", "status": "completed", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:22.569337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-09f0bf83-0411-45fb-a4f6-60211dbb9944 req-cef61c89-c9c6-403a-a7df-f125674907d2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.569636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-09f0bf83-0411-45fb-a4f6-60211dbb9944 req-cef61c89-c9c6-403a-a7df-f125674907d2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.583723 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-09f0bf83-0411-45fb-a4f6-60211dbb9944 req-cef61c89-c9c6-403a-a7df-f125674907d2 service nova] Creating event network-vif-plugged:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h1-768852-23 Jul 14 14:52:22.590843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-09f0bf83-0411-45fb-a4f6-60211dbb9944 req-cef61c89-c9c6-403a-a7df-f125674907d2 service nova] Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:52:22.606516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-09f0bf83-0411-45fb-a4f6-60211dbb9944 req-cef61c89-c9c6-403a-a7df-f125674907d2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050701 Jul 14 14:52:22.608258 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1547/2984] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:22.614599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:22.615703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:22.628205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.628786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.629664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.630230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.852857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:22.862757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-922c2a4c-cd85-4cd7-85f1-9745da3e52f7 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.252894 Jul 14 14:52:22.863743 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1548/2985] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:22 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:22.870109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-792102349"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:22.871487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:22.880450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.882025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:22.883100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:22.883787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.115902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.network.security_group_api [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Adding security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c to port 09c542b3-79a4-4a81-8516-1a310a59643e Jul 14 14:52:23.628391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Updating instance_info_cache with network_info: [{"id": "3eecb2db-a0c5-427c-8a37-e0241e285b86", "address": "fa:16:3e:0b:26:ec", "network": {"id": "ec21279c-faed-4ec6-8a6e-8500739ef80a", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1885863905-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "633d43bf7c6c48e5ba244d103fbd2fe6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap3eecb2db-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=125966) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 14:52:23.656986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Releasing lock "refresh_cache-7ec99603-4678-45c6-a10f-2f7312a2d20e" {{(pid=125966) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 14:52:23.659522 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a580f9c-6d88-4225-b2ac-cd46aa42221c tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action" status: 202 len: 0 microversion: 2.1 time: 3.996909 Jul 14 14:52:23.661579 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1438/2986] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:19 2022] POST /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e/action => generated 0 bytes in 4002 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Jul 14 14:52:23.671980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d634f6b4-5dcb-49aa-81aa-81cb48969fbb req-f2d80fd3-eefb-4499-8d99-243df1984255 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:23.693972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d634f6b4-5dcb-49aa-81aa-81cb48969fbb req-f2d80fd3-eefb-4499-8d99-243df1984255 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.702466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d634f6b4-5dcb-49aa-81aa-81cb48969fbb req-f2d80fd3-eefb-4499-8d99-243df1984255 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.727799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d634f6b4-5dcb-49aa-81aa-81cb48969fbb req-f2d80fd3-eefb-4499-8d99-243df1984255 service nova] Creating event network-changed:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:52:23.740816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d634f6b4-5dcb-49aa-81aa-81cb48969fbb req-f2d80fd3-eefb-4499-8d99-243df1984255 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075937 Jul 14 14:52:23.741940 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1439/2987] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:23.752367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:23.753483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:23.766447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.767718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.770422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.771573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.792318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fc056595-9b62-44d0-a9bb-c39b3ca0d714 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008/action" status: 202 len: 0 microversion: 2.1 time: 0.926715 Jul 14 14:52:23.797289 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1549/2988] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:22 2022] POST /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008/action => generated 0 bytes in 929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:23.799159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:23.799827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:23.812598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.813092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.813901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.814344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.905112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.906405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.907774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:23.908971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:23.958419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:23.968148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for user a185fa24374c417aa2bb9302a608cbcd and project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:24.222197 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-34eb4b59-f188-4a75-893f-d320549318fd tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46/action" status: 202 len: 0 microversion: 2.1 time: 0.477268 Jul 14 14:52:24.222522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1440/2989] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:23 2022] POST /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:24.251487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.273544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:24.282772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:24.289418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c424d78-c2a3-437f-8805-d5ffdb0666dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.494497 Jul 14 14:52:24.293113 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1550/2990] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:23 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:24.319416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:24.321671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2822a02b-683c-42cf-9c4d-160700831fcb tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '.version_select at 0x7fdbf2af7e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:24.322375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:24.325113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:24.328300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:24.877589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.916524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.926795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:24.928380 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f0e34006-97c5-47db-9c94-c686784914d5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1743 microversion: 2.20 time: 0.704556 Jul 14 14:52:24.928999 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1441/2991] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:24 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1743 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:24.982214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ebec036b-7e6b-4efb-b80b-2aca27231d03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2b3d160>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:25.472513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-ebec036b-7e6b-4efb-b80b-2aca27231d03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use.", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:25.473441 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ebec036b-7e6b-4efb-b80b-2aca27231d03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.473441 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ebec036b-7e6b-4efb-b80b-2aca27231d03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c HTTP/1.1 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: exception: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'fa774309-c2bc-4e52-9fc7-42aab63a2a3c'} Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:25.476007 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] Jul 14 14:52:25.480198 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:25.484929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ebec036b-7e6b-4efb-b80b-2aca27231d03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 400 to user: Security Group fa774309-c2bc-4e52-9fc7-42aab63a2a3c in use. Jul 14 14:52:25.484929 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-3ca8312a-bb75-428b-89ce-b2d76cea7d6f'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:25.486163 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ebec036b-7e6b-4efb-b80b-2aca27231d03 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c" status: 400 len: 185 microversion: 2.1 time: 0.539454 Jul 14 14:52:25.486930 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1442/2992] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:24 2022] DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c => generated 185 bytes in 557 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:52:25.496790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:25.497644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:25.518588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:25.529259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:25.537179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:25.542903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.636620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:26.646084 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b85b42f-f4e5-44ae-b182-f6dea3faf1b2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 1.157812 Jul 14 14:52:26.650659 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1443/2993] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:25 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:26.664866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:26.667894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:26.683228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:26.688987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:26.690293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:26.694548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:27.019730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:27.032342 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-276301a5-6856-43a1-bf65-a8989d233957 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1468 microversion: 2.1 time: 0.379425 Jul 14 14:52:27.033391 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1444/2994] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:26 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1468 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:27.041771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9a27119f-0841-4a97-ba78-b133ce2e18bd req-83135d27-4c5e-4db1-bbfa-e7d9ec404f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440ce25a-de3f-4234-87b5-8ba763984008", "tag": "09c542b3-79a4-4a81-8516-1a310a59643e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:27.070362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9a27119f-0841-4a97-ba78-b133ce2e18bd req-83135d27-4c5e-4db1-bbfa-e7d9ec404f63 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:27.071239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9a27119f-0841-4a97-ba78-b133ce2e18bd req-83135d27-4c5e-4db1-bbfa-e7d9ec404f63 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:27.089304 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9a27119f-0841-4a97-ba78-b133ce2e18bd req-83135d27-4c5e-4db1-bbfa-e7d9ec404f63 service nova] Creating event network-changed:09c542b3-79a4-4a81-8516-1a310a59643e for instance 440ce25a-de3f-4234-87b5-8ba763984008 on n-h2-768852-23 Jul 14 14:52:27.096734 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9a27119f-0841-4a97-ba78-b133ce2e18bd req-83135d27-4c5e-4db1-bbfa-e7d9ec404f63 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061752 Jul 14 14:52:27.098094 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1445/2995] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:27.104947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:27.106155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:27.115887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:27.117144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:27.119122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:27.120077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.115822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.128606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-920beb9c-aef3-41ae-ab49-637b1b27096b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 1.028994 Jul 14 14:52:28.141930 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1446/2996] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:27 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:28.154488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:28.159368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:28.176563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.177817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.181051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.183172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.188819 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2822a02b-683c-42cf-9c4d-160700831fcb tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "DELETE /compute/v2.1/os-floating-ips/55f79023-901e-494a-881e-0c9e65f3d0a0" status: 202 len: 0 microversion: 2.1 time: 3.879611 Jul 14 14:52:28.190815 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1551/2997] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:52:24 2022] DELETE /compute/v2.1/os-floating-ips/55f79023-901e-494a-881e-0c9e65f3d0a0 => generated 0 bytes in 3896 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:28.196678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:28.197416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:28.228599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.229076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.229894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.234757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.244829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:28.501430 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6aa983bd-a1e1-48c2-8c50-67096269dec3 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 204 len: 0 microversion: 2.1 time: 0.356831 Jul 14 14:52:28.503590 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1447/2998] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:28 2022] DELETE /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:52:28.525213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:28.526989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:28.545408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.546220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.563783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.564762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.615114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=4,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:28.793806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.803894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.812315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:28.816217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e5ff666-189e-4581-9f2e-cd4b94b1bf1c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.624781 Jul 14 14:52:28.831264 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1552/2999] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:28 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:28.836590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:28.837527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:28.847984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.848772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:28.849794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:28.850407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.034351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:29.051190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a2728e9-8d11-4a7c-b523-83f53ea7daa5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.545646 Jul 14 14:52:29.051854 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1448/3000] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:28 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:29.056954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b604c5c7-0357-4304-bd33-cef14c5b8c43 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '.version_select at 0x7fdbf29aa8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:29.095293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:29.125124 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f6c0475-d641-48a6-a141-c3dc2ce79af0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1468 microversion: 2.1 time: 0.291886 Jul 14 14:52:29.139803 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1553/3001] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:28 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1468 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:29.153354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:29.155053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:29.167587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.168950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.171235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.172372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.654986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:29.664089 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-03cc3e75-4155-4025-bd34-002541bd30d5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1647 microversion: 2.1 time: 0.522321 Jul 14 14:52:29.668705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1554/3002] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:29 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1647 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:29.675584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:29.683403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:29.700216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.707603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.709638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.710327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.752707 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b604c5c7-0357-4304-bd33-cef14c5b8c43 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/545c6774-d82c-4764-9b56-35670f88fbae" status: 202 len: 0 microversion: 2.1 time: 0.699492 Jul 14 14:52:29.756985 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1449/3003] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:29 2022] DELETE /compute/v2.1/os-security-groups/545c6774-d82c-4764-9b56-35670f88fbae => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:29.762246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-624d4b08-0b70-4a29-9312-124280f3e3d0 req-d9175352-f6ed-4bad-b20a-ed0fe83a833e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "name": "network-vif-plugged", "status": "completed", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:29.784037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-624d4b08-0b70-4a29-9312-124280f3e3d0 req-d9175352-f6ed-4bad-b20a-ed0fe83a833e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.784830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-624d4b08-0b70-4a29-9312-124280f3e3d0 req-d9175352-f6ed-4bad-b20a-ed0fe83a833e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.810694 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-624d4b08-0b70-4a29-9312-124280f3e3d0 req-d9175352-f6ed-4bad-b20a-ed0fe83a833e service nova] Creating event network-vif-plugged:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:52:29.828037 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-624d4b08-0b70-4a29-9312-124280f3e3d0 req-d9175352-f6ed-4bad-b20a-ed0fe83a833e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069552 Jul 14 14:52:29.831625 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1450/3004] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:29.837825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:29.844527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:29.871912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.873349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.874390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:29.881432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:29.969431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:30.159691 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ada31282-e110-4dd6-bea6-74107bd05cfe tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "DELETE /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 204 len: 0 microversion: 2.1 time: 0.326188 Jul 14 14:52:30.161174 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1451/3005] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:29 2022] DELETE /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:52:30.167161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:30.172249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:30.176732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:30.189851 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3dbdb0c2-217a-45b8-af39-448315ec319f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.518900 Jul 14 14:52:30.191092 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1555/3006] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:29 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:30.196623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.197085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:30.197289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.198054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:30.198190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.198525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.216820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.217360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.218381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.219065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.601535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:30.618602 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7aea12dc-974e-46ed-bf4d-ef01efc5db43 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.425749 Jul 14 14:52:30.619553 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1556/3007] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:30 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:30.643759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:30.644410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:30.666177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.666771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.667314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:30.668107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:30.988486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:30.998854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-764939c8-42a6-4499-b347-5f70662b4283 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1468 microversion: 2.1 time: 0.368116 Jul 14 14:52:31.022514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1557/3008] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:30 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1468 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:31.028444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.029498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:31.037021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.037800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.038964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.039650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.328771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.351954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:31.383978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcf32f1e-1ac5-4372-b643-7395673ca49f tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1508 microversion: 2.1 time: 0.359171 Jul 14 14:52:31.384669 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1558/3009] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1508 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:31.398544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.399670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:31.407878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.409004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.410083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.410828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.632526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.643653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.660315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.661966 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-623074d3-b1a3-4ca6-85c7-9af56fbddcc7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 1.494795 Jul 14 14:52:31.663161 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1452/3010] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:30 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 1497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:31.669185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.684009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:31.691479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:31.694131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.699069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.707862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.717927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.762212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:31.774146 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b36ef84-c35c-42a2-90bf-fddff98acc04 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1647 microversion: 2.1 time: 0.388151 Jul 14 14:52:31.774776 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1559/3011] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1647 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:31.790715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:31.791384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:31.800219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.801860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:31.803055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:31.804162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.091095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:32.112553 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33adacaa-04d3-4afa-88e2-1d1a764d9eb1 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.325057 Jul 14 14:52:32.114820 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1560/3012] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:32.136742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1043cee0-581b-4536-84fe-f06ef0796a59 req-8ab367b1-f77f-4970-88c0-f441ec1196b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70", "name": "network-vif-plugged", "status": "completed", "tag": "ee19a7b3-b658-4895-8c41-7627ca326bb8"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:32.164393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1043cee0-581b-4536-84fe-f06ef0796a59 req-8ab367b1-f77f-4970-88c0-f441ec1196b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.165485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1043cee0-581b-4536-84fe-f06ef0796a59 req-8ab367b1-f77f-4970-88c0-f441ec1196b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.184889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1043cee0-581b-4536-84fe-f06ef0796a59 req-8ab367b1-f77f-4970-88c0-f441ec1196b1 service nova] Creating event network-vif-plugged:ee19a7b3-b658-4895-8c41-7627ca326bb8 for instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 on n-h1-768852-23 Jul 14 14:52:32.193761 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1043cee0-581b-4536-84fe-f06ef0796a59 req-8ab367b1-f77f-4970-88c0-f441ec1196b1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076611 Jul 14 14:52:32.195053 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1561/3013] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:32.206133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:32.208455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:32.218081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.218944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.220729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.221489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.546140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:32.559018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-20ecd527-dc94-4223-99ab-677236182de1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1521 microversion: 2.1 time: 0.894409 Jul 14 14:52:32.563297 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1453/3014] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:31 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1521 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:32.581545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:32.592262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:32.599076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:32.602119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.602859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.603974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.604636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.654307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca1be316-62f7-4ade-8685-efaa8903e697 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1468 microversion: 2.1 time: 0.445579 Jul 14 14:52:32.658975 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1562/3015] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:32 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1468 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:32.697897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d5581c3e-6a7d-4066-90ca-092406ce9760 req-09637a7d-2b96-4dec-a7cb-9331cdeb2643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440ce25a-de3f-4234-87b5-8ba763984008", "name": "network-vif-deleted", "tag": "09c542b3-79a4-4a81-8516-1a310a59643e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:32.740472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d5581c3e-6a7d-4066-90ca-092406ce9760 req-09637a7d-2b96-4dec-a7cb-9331cdeb2643 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.740777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d5581c3e-6a7d-4066-90ca-092406ce9760 req-09637a7d-2b96-4dec-a7cb-9331cdeb2643 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.783189 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d5581c3e-6a7d-4066-90ca-092406ce9760 req-09637a7d-2b96-4dec-a7cb-9331cdeb2643 service nova] Creating event network-vif-deleted:09c542b3-79a4-4a81-8516-1a310a59643e for instance 440ce25a-de3f-4234-87b5-8ba763984008 on n-h2-768852-23 Jul 14 14:52:32.821607 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d5581c3e-6a7d-4066-90ca-092406ce9760 req-09637a7d-2b96-4dec-a7cb-9331cdeb2643 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159531 Jul 14 14:52:32.822995 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1563/3016] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:32.852483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:32.853979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:32.893794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.904557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:32.911512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:32.912367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.447112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.457465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.463649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.472974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-34cc4a51-0873-41fb-be32-e44ab374532b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.647919 Jul 14 14:52:33.473835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1564/3017] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:32 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:33.491410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.492418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:33.498684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:33.511525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.514870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.517769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.525319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.663203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.664124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.665944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lazy-loading 'fault' on Instance uuid 440ce25a-de3f-4234-87b5-8ba763984008 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:52:33.754000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.795322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2cfe7193-e226-48ea-9dc7-8f6b4873b75d tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1508 microversion: 2.1 time: 1.227220 Jul 14 14:52:33.808473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1454/3018] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:32 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1508 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:33.814421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.815054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:33.862221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.880583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.882289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:33.883145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:33.943699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:33.956955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:33.969898 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1158c0e-0983-4080-ad96-598be93740e8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 200 len: 1306 microversion: 2.1 time: 0.494786 Jul 14 14:52:33.988942 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1565/3019] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:33 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 1306 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:33.990653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:33.993043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:34.016382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.016964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.036674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.037112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.562330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:34.562789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:34.595257 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-413974c0-59bf-4692-9515-9cfc62621dca tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1498 microversion: 2.1 time: 0.606685 Jul 14 14:52:34.598765 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1566/3020] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:33 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1498 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:34.601830 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed7666d4-a0b5-4b64-9a1e-2fd36cc74da2 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1324 microversion: 2.1 time: 0.791420 Jul 14 14:52:34.602920 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1455/3021] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:33 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1324 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:34.623042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:34.624139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:34.629775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-16ad7c3f-a100-4c7f-94dd-01ffd92c6c9a req-519269a9-51ba-4d82-b130-632dfe1d242b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "name": "network-vif-unplugged", "status": "completed", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:34.647658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.656309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.658214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.658952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.694169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-16ad7c3f-a100-4c7f-94dd-01ffd92c6c9a req-519269a9-51ba-4d82-b130-632dfe1d242b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.694965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-16ad7c3f-a100-4c7f-94dd-01ffd92c6c9a req-519269a9-51ba-4d82-b130-632dfe1d242b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.771794 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-16ad7c3f-a100-4c7f-94dd-01ffd92c6c9a req-519269a9-51ba-4d82-b130-632dfe1d242b service nova] Creating event network-vif-unplugged:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h2-768852-23 Jul 14 14:52:34.786590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-16ad7c3f-a100-4c7f-94dd-01ffd92c6c9a req-519269a9-51ba-4d82-b130-632dfe1d242b service nova] Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:52:34.819865 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-16ad7c3f-a100-4c7f-94dd-01ffd92c6c9a req-519269a9-51ba-4d82-b130-632dfe1d242b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.209911 Jul 14 14:52:34.827549 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1456/3022] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:34.838939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:34.843034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:34.866428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.869908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:34.870897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:34.876397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.152240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.164534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d893b21b-b9d5-4e64-80e9-65aabad7be50 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1534 microversion: 2.1 time: 0.559964 Jul 14 14:52:35.165461 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1567/3023] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:34 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1534 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:35.181370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:35.186511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.195357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:35.219171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.221617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.245619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.246386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.323466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:35.387564 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5759133c-6a79-404c-ba1a-4e4dd0a970d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.215970 Jul 14 14:52:35.389136 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1568/3024] 10.222.0.98 () {58 vars in 1153 bytes} [Thu Jul 14 14:52:35 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:35.395853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:35.396726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:35.418014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.423871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.424635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.428353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.542631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24ffcc115d374182b9039ddfe987042d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '633d43bf7c6c48e5ba244d103fbd2fe6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:35.551681 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-343cf963-82dd-4f5f-88ab-bdb5c05446f9 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 200 len: 1466 microversion: 2.1 time: 0.161159 Jul 14 14:52:35.553070 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1569/3025] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:35 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 1466 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:35.562566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:35.563720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:35.575042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.576691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.577815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.578510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.594181 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 HTTP/1.1 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '440ce25a-de3f-4234-87b5-8ba763984008'} Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:35.600972 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75420ed9-641c-49e0-991a-f7a5c0b36fb5 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 404 len: 111 microversion: 2.1 time: 0.048440 Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1570/3026] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:35 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:35.618406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02b7f523-5c3a-4479-aa18-553a56d92254 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:35.627117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02b7f523-5c3a-4479-aa18-553a56d92254 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.628326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02b7f523-5c3a-4479-aa18-553a56d92254 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.656854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02b7f523-5c3a-4479-aa18-553a56d92254 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Going to try to start instance {{(pid=125965) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:52:35.736753 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02b7f523-5c3a-4479-aa18-553a56d92254 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "POST /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256/action" status: 202 len: 0 microversion: 2.1 time: 0.123484 Jul 14 14:52:35.738217 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1571/3027] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:52:35 2022] POST /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:35.748714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5f072a3c-ca7b-4aad-9f01-6c4a2857bd61 req-0c1792f4-4c41-4f60-8115-72d344fc21ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec99603-4678-45c6-a10f-2f7312a2d20e", "name": "network-vif-deleted", "tag": "3eecb2db-a0c5-427c-8a37-e0241e285b86"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:35.759903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5f072a3c-ca7b-4aad-9f01-6c4a2857bd61 req-0c1792f4-4c41-4f60-8115-72d344fc21ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:35.762072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5f072a3c-ca7b-4aad-9f01-6c4a2857bd61 req-0c1792f4-4c41-4f60-8115-72d344fc21ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:35.792172 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5f072a3c-ca7b-4aad-9f01-6c4a2857bd61 req-0c1792f4-4c41-4f60-8115-72d344fc21ab service nova] Creating event network-vif-deleted:3eecb2db-a0c5-427c-8a37-e0241e285b86 for instance 7ec99603-4678-45c6-a10f-2f7312a2d20e on n-h1-768852-23 Jul 14 14:52:35.801305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5f072a3c-ca7b-4aad-9f01-6c4a2857bd61 req-0c1792f4-4c41-4f60-8115-72d344fc21ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060887 Jul 14 14:52:35.802791 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1572/3028] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:35.811149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-da0c0427-8b67-406b-a283-5999d0a9ebdc tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2a3b1f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:36.117303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-da0c0427-8b67-406b-a283-5999d0a9ebdc tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8" status: 202 len: 0 microversion: 2.1 time: 0.312820 Jul 14 14:52:36.118315 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1573/3029] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:35 2022] DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:36.125592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:36.129158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:36.160162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.167447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.168166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.168911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.462970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:36.506282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:36.515731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:36.524135 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f578c0d5-2013-45ef-b94a-eb8cfa3b6489 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 1.694335 Jul 14 14:52:36.535367 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1457/3030] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:34 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:36.566225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:36.567091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:36.575027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.580065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.581269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:36.581912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:36.583879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:36.618498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-368f362a-614f-4829-b8fa-962bf0e1e3cd tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1521 microversion: 2.1 time: 0.498517 Jul 14 14:52:36.623496 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1574/3031] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:36 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1521 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:36.644536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8698a184-3aa5-41bb-85ce-2c5741280258 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2bbe700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:37.206551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8698a184-3aa5-41bb-85ce-2c5741280258 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c" status: 202 len: 0 microversion: 2.1 time: 0.579688 Jul 14 14:52:37.208289 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1575/3032] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:36 2022] DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:37.228670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:37.232400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:37.292762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.295823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.300865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.304590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.346269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:37.369857 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e54e959-15dd-4be8-8773-94008e14e805 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1507 microversion: 2.1 time: 0.832659 Jul 14 14:52:37.384220 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1458/3033] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:36 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1507 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:37.636659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:37.661341 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-59e3fe33-a096-4b80-9b38-8e863d21f39b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1534 microversion: 2.1 time: 0.450428 Jul 14 14:52:37.676753 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1576/3034] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:37 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1534 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:37.687952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:37.689148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] [instance: 7ec99603-4678-45c6-a10f-2f7312a2d20e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:37.689968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1122041668", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "807f52a6-e1d9-417a-8d0d-4d23ac776995"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:37.699199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.701041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.702924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.703667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.734344 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] HTTP exception thrown: Instance 7ec99603-4678-45c6-a10f-2f7312a2d20e could not be found. Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Request method failure captured: Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e HTTP/1.1 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1Of6lG6rO0ZKmPl5BXFwv9SPm0tXviWA41Wd-XO54DU_jCiw9xG9lYolIiBBkzIxrErBjwNOBZQnp2lV8UzBgcwQHKmxYKdZcQj05YUIjxR1DEUibh_2M_WxhwaD85RG2gcsFLyI_ejCy-u98ovZN28tirDKtfWr-wVXwLJNWy048 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 633d43bf7c6c48e5ba244d103fbd2fe6 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1593963079 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/633d43bf7c6c48e5ba244d103fbd2fe6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_633d43bf7c6c48e5ba244d103fbd2fe6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/633d43bf7c6c48e5ba244d103fbd2fe6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/633d43bf7c6c48e5ba244d103fbd2fe6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1593963079 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 633d43bf7c6c48e5ba244d103fbd2fe6 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1593963079 Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerRescueTestJSONUnderV235-1593963079-project Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 24ffcc115d374182b9039ddfe987042d Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1593963079-project Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 7ec99603-4678-45c6-a10f-2f7312a2d20e could not be found. Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '7ec99603-4678-45c6-a10f-2f7312a2d20e'} Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec99603-4678-45c6-a10f-2f7312a2d20e could not be found. Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec99603-4678-45c6-a10f-2f7312a2d20e could not be found. Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:37.738567 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec99603-4678-45c6-a10f-2f7312a2d20e could not be found. Jul 14 14:52:37.744415 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:37.746786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] Returning 404 to user: Instance 7ec99603-4678-45c6-a10f-2f7312a2d20e could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:37.751169 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a92d4c02-8047-413a-a793-cfbbae29ace3 tempest-ServerRescueTestJSONUnderV235-1593963079 tempest-ServerRescueTestJSONUnderV235-1593963079-project] 10.222.0.98 "GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e" status: 404 len: 111 microversion: 2.1 time: 0.072592 Jul 14 14:52:37.756670 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1577/3035] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:37 2022] GET /compute/v2.1/servers/7ec99603-4678-45c6-a10f-2f7312a2d20e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:37.766175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:37.766788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:37.777293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.777947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.780658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:37.781218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:37.827222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:37.877872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] validate_networks() for [('807f52a6-e1d9-417a-8d0d-4d23ac776995', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:52:37.985704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:38.119037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fc6f1d7b-6e09-44e6-bf27-92d9a1033026 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 204 len: 0 microversion: 2.1 time: 0.360445 Jul 14 14:52:38.125695 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1578/3036] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:37 2022] DELETE /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:52:38.138758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4e1a25a-4aa9-4bdb-8601-dcfa1c288b42 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'create', calling method: .version_select at 0x7fdbf2a3b310>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-138382065", "description": "tempest-description-1662176490"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:38.844534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4e1a25a-4aa9-4bdb-8601-dcfa1c288b42 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.715947 Jul 14 14:52:38.851871 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1579/3037] 10.222.0.98 () {60 vars in 1179 bytes} [Thu Jul 14 14:52:38 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:38.858453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:38.859393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:38.889007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:38.893033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:38.897945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:38.898612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:39.408221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:39.420580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:39.423061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:39.425071 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ede75ea4-dfab-4e6a-8094-0abbb414dc1d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.571963 Jul 14 14:52:39.426279 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1580/3038] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:38 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:39.431768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e379af13-08d6-4c51-b2fc-7c753bad7888 req-47935bd6-1817-43de-be48-039d4d4d1ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:39.443534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e379af13-08d6-4c51-b2fc-7c753bad7888 req-47935bd6-1817-43de-be48-039d4d4d1ca0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:39.444782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e379af13-08d6-4c51-b2fc-7c753bad7888 req-47935bd6-1817-43de-be48-039d4d4d1ca0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:39.478067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e379af13-08d6-4c51-b2fc-7c753bad7888 req-47935bd6-1817-43de-be48-039d4d4d1ca0 service nova] Creating event network-changed:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h2-768852-23 Jul 14 14:52:39.485940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-e379af13-08d6-4c51-b2fc-7c753bad7888 req-47935bd6-1817-43de-be48-039d4d4d1ca0 service nova] Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:52:39.541075 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e379af13-08d6-4c51-b2fc-7c753bad7888 req-47935bd6-1817-43de-be48-039d4d4d1ca0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113230 Jul 14 14:52:39.543052 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1581/3039] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:39.554708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:39.556607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:39.577041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:39.578804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:39.580910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:39.582178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.051405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:52:40.051967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:52:40.052506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:52:40.053017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:52:40.053507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:52:40.073277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.078127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.079494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.080197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.121768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:40.132911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Getting quotas for project 4381d698f8624ab2b1e932305ea8b67a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:40.137204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fca148f9-d637-42ac-b05b-594d77b4f252 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1527 microversion: 2.1 time: 0.589431 Jul 14 14:52:40.140956 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1582/3040] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:39 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1527 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:40.149999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.152419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Getting quotas for user b72083f0df93495194118d6a12088c75 and project 4381d698f8624ab2b1e932305ea8b67a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:40.153075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:40.171904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.172922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.174233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.176289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.184984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:52:40.187529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:52:40.295705 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0c6a61a-b011-453e-8dab-f34137b7afbf tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.909264 Jul 14 14:52:40.301799 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1459/3041] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:52:40.307257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:40.308227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:40.317348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.318287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.319322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:40.319962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:40.775856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:40.785562 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37179766-71e3-469d-9d7a-d97bb3930e35 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1534 microversion: 2.1 time: 0.482259 Jul 14 14:52:40.795925 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1460/3042] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:40 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1534 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:40.807701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a2fc98e-2155-4158-8bbc-5a05b94ad03f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Action: 'update', calling method: .version_select at 0x7fdbf2acd1f0>, body: {"security_group": {"name": "tempest-sg-hth-1538303908", "description": "tempest-description-hth-10778454"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:41.125818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a2fc98e-2155-4158-8bbc-5a05b94ad03f tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "PUT /compute/v2.1/os-security-groups/55135b3f-0fc5-44f1-96ff-1c906f77b511" status: 200 len: 216 microversion: 2.1 time: 0.332413 Jul 14 14:52:41.127803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1461/3043] 10.222.0.98 () {60 vars in 1289 bytes} [Thu Jul 14 14:52:40 2022] PUT /compute/v2.1/os-security-groups/55135b3f-0fc5-44f1-96ff-1c906f77b511 => generated 216 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:41.134352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12c7bbbe-24aa-483d-90e6-ecd7af6ad97b tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:41.135951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12c7bbbe-24aa-483d-90e6-ecd7af6ad97b tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:41.287533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12c7bbbe-24aa-483d-90e6-ecd7af6ad97b tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:41.329090 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12c7bbbe-24aa-483d-90e6-ecd7af6ad97b tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1225 microversion: 2.1 time: 0.199745 Jul 14 14:52:41.330601 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1462/3044] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:41 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1225 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:41.335885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:41.336845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:41.351657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.353509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.354595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.355303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.619222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:41.675108 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2ddcd63-de95-4bd2-8a58-800b14a82fa1 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1511 microversion: 2.1 time: 1.532273 Jul 14 14:52:41.678168 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1583/3045] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:40 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1511 bytes in 1536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:41.694357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-104b9232-ec54-4bd0-b1dc-d024adc2c078 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf232b4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:41.853616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:41.880683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:41.882584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:41.884192 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-854898eb-1b8b-447a-8a57-8f12b6456a10 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.552340 Jul 14 14:52:41.904468 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1463/3046] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:41 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:41.904468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:41.904468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:41.910564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.911452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:41.912400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:41.912969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.145193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-104b9232-ec54-4bd0-b1dc-d024adc2c078 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/os-security-groups/55135b3f-0fc5-44f1-96ff-1c906f77b511" status: 200 len: 216 microversion: 2.1 time: 0.460778 Jul 14 14:52:42.146240 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1584/3047] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 14:52:41 2022] GET /compute/v2.1/os-security-groups/55135b3f-0fc5-44f1-96ff-1c906f77b511 => generated 216 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:42.155493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.165212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:42.165987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.compute.servers [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Removing options 'limit' from query {{(pid=125965) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1489}} Jul 14 14:52:42.167499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:42.170391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.171336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.172750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.173625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.175666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b75fce6-e4b7-4daa-b154-6c59d747dda8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.027786 Jul 14 14:52:42.176966 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1585/3048] 10.222.0.98 () {58 vars in 1139 bytes} [Thu Jul 14 14:52:42 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:52:42.183522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:42.184576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:42.195254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.196948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.198652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:42.199494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:42.459739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7edefb2896948e39ac7aed5a3884233', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f30b8cc1b9254cca90487359e0872a93', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:42.509123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-763eaccd-3b3a-4d4b-b69f-ccf42550f9f4 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 200 len: 1527 microversion: 2.1 time: 0.621013 Jul 14 14:52:42.527736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1464/3049] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:41 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 1527 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:42.536219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-76769871-edd8-4591-afb5-ff5d72fe92b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdc04194430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.450875 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-76769871-edd8-4591-afb5-ff5d72fe92b7 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/55135b3f-0fc5-44f1-96ff-1c906f77b511" status: 202 len: 0 microversion: 2.1 time: 0.920763 Jul 14 14:52:43.454803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1465/3050] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:42 2022] DELETE /compute/v2.1/os-security-groups/55135b3f-0fc5-44f1-96ff-1c906f77b511 => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:43.466600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.467808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:43.497268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.498376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.499124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.499614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.617433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:43.646602 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-105975a4-c8af-4c99-9847-1ff0ae274a64 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1534 microversion: 2.1 time: 1.467632 Jul 14 14:52:43.648452 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1586/3051] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:42 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1534 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:43.675629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.677249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:43.690205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.691331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.701390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.707494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.832424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:43.842924 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-431aa848-0e24-480f-8a20-a5764be2acc6 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1511 microversion: 2.1 time: 0.388696 Jul 14 14:52:43.848881 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1466/3052] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:43 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1511 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:43.854090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-082c9274-3b14-47ae-8009-d0a9c498866e req-83dc3d43-906f-485e-8b9d-b83045b35233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70", "name": "network-vif-deleted", "tag": "ee19a7b3-b658-4895-8c41-7627ca326bb8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:43.864632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-082c9274-3b14-47ae-8009-d0a9c498866e req-83dc3d43-906f-485e-8b9d-b83045b35233 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.865421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-082c9274-3b14-47ae-8009-d0a9c498866e req-83dc3d43-906f-485e-8b9d-b83045b35233 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.912291 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-082c9274-3b14-47ae-8009-d0a9c498866e req-83dc3d43-906f-485e-8b9d-b83045b35233 service nova] Creating event network-vif-deleted:ee19a7b3-b658-4895-8c41-7627ca326bb8 for instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 on n-h1-768852-23 Jul 14 14:52:43.934177 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-082c9274-3b14-47ae-8009-d0a9c498866e req-83dc3d43-906f-485e-8b9d-b83045b35233 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083844 Jul 14 14:52:43.936764 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1467/3053] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:43.946160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:43.951069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:43.983325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.985441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:43.990455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:43.990750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:43.992831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.007405 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2edbc8f-c954-4dad-874f-4e68a152bc76 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1283 microversion: 2.1 time: 0.356391 Jul 14 14:52:44.020612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1587/3054] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:43 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1283 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:44.034543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.040064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.052072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.052833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.061449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.062756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.135187 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 HTTP/1.1 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '440ce25a-de3f-4234-87b5-8ba763984008'} Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:44.145585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.163740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:44.167812 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3cf23983-e5f1-42e2-bb88-49461492c3f1 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 404 len: 111 microversion: 2.1 time: 0.144876 Jul 14 14:52:44.170067 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1588/3055] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:44 2022] DELETE /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:44.180444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.183159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.197506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.198728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.201016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.203223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.249930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 could not be found. Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 HTTP/1.1 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 could not be found. Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70'} Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 could not be found. Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 could not be found. Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.253723 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 could not be found. Jul 14 14:52:44.262119 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.266238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance 4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:44.268255 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7db2c5f8-1d10-4f61-aa9f-dac983fdf59e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70" status: 404 len: 111 microversion: 2.1 time: 0.094939 Jul 14 14:52:44.269602 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1589/3056] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:44 2022] GET /compute/v2.1/servers/4cbaa0ef-4e56-4ee5-8ec9-8bf055343c70 => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:44.301656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.302619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.330025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.330740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.336236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.338605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.860784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:44.884596 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee018712-cb21-4bb4-a53d-8344ef0bca47 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1512 microversion: 2.1 time: 0.607132 Jul 14 14:52:44.885441 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1590/3057] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:44 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1512 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:44.906000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:44.909805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: 440ce25a-de3f-4234-87b5-8ba763984008] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:44.929024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.930379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.932875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:44.934310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:44.974009 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 HTTP/1.1 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '440ce25a-de3f-4234-87b5-8ba763984008'} Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:44.977792 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. Jul 14 14:52:44.986734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:44.991550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Instance 440ce25a-de3f-4234-87b5-8ba763984008 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:44.993738 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8298e285-316f-4c13-b884-836aa5d0e3e4 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008" status: 404 len: 111 microversion: 2.1 time: 0.105721 Jul 14 14:52:45.002206 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1591/3058] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:44 2022] GET /compute/v2.1/servers/440ce25a-de3f-4234-87b5-8ba763984008 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:45.014640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4848f35d-9834-4377-bcb5-9f1c7b77a0cb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '.version_select at 0x7fdbf2a61e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.085250 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4848f35d-9834-4377-bcb5-9f1c7b77a0cb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Image not found. Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4848f35d-9834-4377-bcb5-9f1c7b77a0cb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654 HTTP/1.1 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: exception: Image not found. Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '5e025e96-9796-4515-b8c5-6f58ae7ef654'} Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5e025e96-9796-4515-b8c5-6f58ae7ef654 to delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5e025e96-9796-4515-b8c5-6f58ae7ef654 could not be found. Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:45.089615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.099073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4848f35d-9834-4377-bcb5-9f1c7b77a0cb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Image not found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:45.107307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4848f35d-9834-4377-bcb5-9f1c7b77a0cb tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654" status: 404 len: 62 microversion: 2.1 time: 0.097980 Jul 14 14:52:45.107307 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1592/3059] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:45 2022] DELETE /compute/v2.1/images/5e025e96-9796-4515-b8c5-6f58ae7ef654 => generated 62 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:52:45.125621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.131896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.170645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.172034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.188074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.188824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.302033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:45.381263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:45.421943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:45.427197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:45.432438 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26dbf242-2750-4514-93e0-d1bccfb2595a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 1.492363 Jul 14 14:52:45.441219 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1468/3060] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:43 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:45.470922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.471827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.506098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.509542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.513231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.514156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.622460 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bd494d01-e731-4c18-a753-cf78f1c1dc77 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/ips" status: 200 len: 145 microversion: 2.1 time: 0.179152 Jul 14 14:52:45.623598 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1469/3061] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/ips => generated 145 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:45.644518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.652329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.674158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.679427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.683631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.685231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.701644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:45.730933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:45.744699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e322e1e8-9968-4f09-88d7-a2c74669c0e4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1527 microversion: 2.1 time: 0.633499 Jul 14 14:52:45.748922 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1593/3062] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1527 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:45.757024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2adc700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.787917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:45.789394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:52:45.790230 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.790230 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c HTTP/1.1 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fa774309-c2bc-4e52-9fc7-42aab63a2a3c'} Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:45.792675 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] Jul 14 14:52:45.797413 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:45.805610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group fa774309-c2bc-4e52-9fc7-42aab63a2a3c does not exist Jul 14 14:52:45.805610 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-7b286fe3-922f-4d25-b2df-c571f068922f'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:45.806747 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e11dd808-1e59-4c11-906e-be84bf7f3c9b tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c" status: 404 len: 194 microversion: 2.1 time: 0.056196 Jul 14 14:52:45.807855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1594/3063] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:45 2022] DELETE /compute/v2.1/os-security-groups/fa774309-c2bc-4e52-9fc7-42aab63a2a3c => generated 194 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:45.817511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:45.820355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:45.844209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.845362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:45.846374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:45.846995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.033678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:46.049130 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8de0b8bb-4b14-4c98-a876-d3754207f36d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1283 microversion: 2.1 time: 0.239902 Jul 14 14:52:46.054841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1595/3064] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1283 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:46.078825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.086335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.114471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.119310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.121466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.131644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.174421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 HTTP/1.1 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '47dc97db-700a-4df6-a377-eea717c9fa71'} Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:46.178069 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.186597 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.189653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.191599 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-159fc629-6b58-4bcc-94da-9cddc8bea585 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 404 len: 111 microversion: 2.1 time: 0.133430 Jul 14 14:52:46.197834 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1596/3065] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:46 2022] DELETE /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:46.218383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.228215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.235616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:46.257689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.260385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.262032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.267695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.275459 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf148ff4-2774-4d23-a65a-fb76d46ecd95 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1513 microversion: 2.1 time: 0.644737 Jul 14 14:52:46.285413 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1470/3066] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:45 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1513 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:46.309279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2b3d8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.538816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:46.540539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:52:46.541506 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.541506 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 HTTP/1.1 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8'} Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:46.549163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group 0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 does not exist Jul 14 14:52:46.557782 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-84a54a39-f701-49f7-bf8c-99ac5da3107c'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.563845 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-512cc991-605a-4051-b227-19e664403504 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8" status: 404 len: 194 microversion: 2.1 time: 0.274858 Jul 14 14:52:46.568592 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1471/3067] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:46 2022] DELETE /compute/v2.1/os-security-groups/0eb16ce4-14ff-4d2c-8eb9-9ebb783b99e8 => generated 194 bytes in 282 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:46.598257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.604760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: 47dc97db-700a-4df6-a377-eea717c9fa71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:46.637015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.637902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.639608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:46.672520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:46.737542 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 HTTP/1.1 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '47dc97db-700a-4df6-a377-eea717c9fa71'} Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.739209 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. Jul 14 14:52:46.743414 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:46.752263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance 47dc97db-700a-4df6-a377-eea717c9fa71 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:46.756288 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-629a18c1-72d3-416f-becb-e4e578f28c49 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71" status: 404 len: 111 microversion: 2.1 time: 0.181939 Jul 14 14:52:46.761403 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1472/3068] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:46 2022] GET /compute/v2.1/servers/47dc97db-700a-4df6-a377-eea717c9fa71 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:46.773349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:46.782816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:46.785866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'ip': '172.20.0.14', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:47.428903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.430795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.433295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.435151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.507920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:47.550476 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-40c73e78-3452-4d03-867c-0d069724e5a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1527 microversion: 2.1 time: 1.345294 Jul 14 14:52:47.577370 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1597/3069] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:46 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1527 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:47.594452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:47.601186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:47.625611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.627696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.631725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:47.635411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:47.923782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:48.153213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.172321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.176975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.183753 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-42eaf85f-6372-4725-8a1d-a7562a7de4a6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.604305 Jul 14 14:52:48.186549 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1598/3070] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:47 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:48.193449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf1fd2160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.270442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:48.271719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:52:48.271719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.271719 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d HTTP/1.1 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c58b5212-9615-4e7b-a88c-7a0f28e2f53d'} Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:48.273532 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group c58b5212-9615-4e7b-a88c-7a0f28e2f53d does not exist Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-c61c22e0-7ce2-4ec4-b36c-36fb98e8bc2a'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d434ef8e-72be-424a-b7f3-db02f66a96cd tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d" status: 404 len: 194 microversion: 2.1 time: 0.087151 Jul 14 14:52:48.281758 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1599/3071] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:48 2022] DELETE /compute/v2.1/os-security-groups/c58b5212-9615-4e7b-a88c-7a0f28e2f53d => generated 194 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:48.287703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b573d6f7-f334-40e1-888c-b166aab79e5c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '.version_select at 0x7fdbf232b9d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.337415 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b573d6f7-f334-40e1-888c-b166aab79e5c tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018033859" status: 202 len: 0 microversion: 2.1 time: 0.060187 Jul 14 14:52:48.342898 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1600/3072] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:52:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1018033859 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:52:48.346520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.347190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:48.364703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:48.365193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.366067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:48.366516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.703537 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e82aad36-ed95-4d49-a12f-69858e355108 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?ip=172.20.0.14" status: 200 len: 346 microversion: 2.1 time: 1.940457 Jul 14 14:52:48.714690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1473/3073] 10.222.0.98 () {58 vars in 1153 bytes} [Thu Jul 14 14:52:46 2022] GET /compute/v2.1/servers?ip=172.20.0.14 => generated 346 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:48.733364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-425ab20c-edaa-494c-8a04-fbc10d047971 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.735872 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:52:48.735872 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:52:48.743140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:48.757544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e43a20ae-af1d-48de-b7bc-73b1d7248424 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1325 microversion: 2.1 time: 0.417601 Jul 14 14:52:48.760028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-425ab20c-edaa-494c-8a04-fbc10d047971 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] HTTP exception thrown: Flavor 8040955d-8451-476c-ab33-3111d2da02a4 could not be found. Jul 14 14:52:48.768922 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1601/3074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:48 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1325 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-425ab20c-edaa-494c-8a04-fbc10d047971 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Request method failure captured: Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/flavors/8040955d-8451-476c-ab33-3111d2da02a4 HTTP/1.1 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CyRWbsXa4kAkB8IUgvlhzD8h3ypnntt5FmuZhvBBfwIR7c8jBgHdnndaMyWVdD9flxO5zBVUNO_Ndm_MwcVhlH22ZSRTGDqfNa2ciXL2Iw5jpQ1r8crqeYyAOwouVfY3SVN5crknKiF3BYK4SGVtGzZAEXnNSFYNGA1_paKRu8orqQ Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c954b5add82d484393972d3762652312 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MigrationsAdminTest-1585593062 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c954b5add82d484393972d3762652312"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c954b5add82d484393972d3762652312"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c954b5add82d484393972d3762652312"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c954b5add82d484393972d3762652312"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MigrationsAdminTest-1585593062 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c954b5add82d484393972d3762652312 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MigrationsAdminTest-1585593062 Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MigrationsAdminTest-1585593062-project-admin Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: f2cdc02847a74ce6adf37f360f247ade Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MigrationsAdminTest-1585593062-project-admin Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: exception: Flavor 8040955d-8451-476c-ab33-3111d2da02a4 could not be found. Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '8040955d-8451-476c-ab33-3111d2da02a4'} Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi flavor.destroy() Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8040955d-8451-476c-ab33-3111d2da02a4 could not be found. Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 8040955d-8451-476c-ab33-3111d2da02a4 could not be found. Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.773547 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8040955d-8451-476c-ab33-3111d2da02a4 could not be found. Jul 14 14:52:48.777741 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.783565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-425ab20c-edaa-494c-8a04-fbc10d047971 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Returning 404 to user: Flavor 8040955d-8451-476c-ab33-3111d2da02a4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:48.785688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf1fd2f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.792719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-425ab20c-edaa-494c-8a04-fbc10d047971 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/8040955d-8451-476c-ab33-3111d2da02a4" status: 404 len: 109 microversion: 2.1 time: 0.078254 Jul 14 14:52:48.794904 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1474/3075] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:48 2022] DELETE /compute/v2.1/flavors/8040955d-8451-476c-ab33-3111d2da02a4 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:48.814871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:48.816129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:48.868385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:48.869274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group eaac9313-bcb6-4016-ae16-79e789921dec not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:52:48.870037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.870037 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec HTTP/1.1 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'eaac9313-bcb6-4016-ae16-79e789921dec'} Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:48.873017 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] Jul 14 14:52:48.876877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:48.880040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group eaac9313-bcb6-4016-ae16-79e789921dec does not exist Jul 14 14:52:48.880040 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-d3650c16-a660-4737-b8ac-1b28823355c8'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:48.881397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c04db6cb-5cab-4cf4-b919-1bee0e52d2ff tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec" status: 404 len: 194 microversion: 2.1 time: 0.110967 Jul 14 14:52:48.881575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:48.882461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.882890 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1602/3076] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:48 2022] DELETE /compute/v2.1/os-security-groups/eaac9313-bcb6-4016-ae16-79e789921dec => generated 194 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:48.895647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:48.897317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:48.909788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf232bdc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:49.010526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG neutronclient.v2_0.client [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist", "detail": ""}} {{(pid=125965) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:49.011402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group bc2ff9d0-b579-4d28-bd99-652379e79890 not found {{(pid=125965) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:52:49.012167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.012167 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890 HTTP/1.1 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: exception: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'bc2ff9d0-b579-4d28-bd99-652379e79890'} Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:49.015236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group bc2ff9d0-b579-4d28-bd99-652379e79890 does not exist Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: Neutron server returns request_ids: ['req-12a98980-8f2e-433e-9cb7-5bc23181ebd4'] {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:49.024404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea089dbb-0088-4c52-abce-a8f832e61fe8 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890" status: 404 len: 194 microversion: 2.1 time: 0.133814 Jul 14 14:52:49.044392 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1603/3077] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:48 2022] DELETE /compute/v2.1/os-security-groups/bc2ff9d0-b579-4d28-bd99-652379e79890 => generated 194 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:49.049487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-331488717", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:49.286777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:52:50.069258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:50.100440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b80c13c-0aca-4c4c-9378-f4137579b3e8 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1511 microversion: 2.1 time: 1.298908 Jul 14 14:52:50.106292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1475/3078] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:48 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1511 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:50.122377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf29bda60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:50.244461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:52:50.244461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.security_group_api [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Neutron security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 not found {{(pid=125966) get /opt/stack/nova/nova/network/security_group_api.py:313}} Jul 14 14:52:50.244461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.244461 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9 HTTP/1.1 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: exception: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'cfe6268b-a797-4f65-8cc5-8740f13df0d9'} Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:52:50.246497 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Security group cfe6268b-a797-4f65-8cc5-8740f13df0d9 does not exist Jul 14 14:52:50.251135 n-d-768852-23 devstack@n-api.service[125966]: Neutron server returns request_ids: ['req-9c7a488b-f4f9-40e4-b71f-6217d226ae4b'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:50.265352 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-14ead0db-e7a4-4c14-b485-dd627bb2e769 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9" status: 404 len: 194 microversion: 2.1 time: 0.140019 Jul 14 14:52:50.266571 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1476/3079] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:50 2022] DELETE /compute/v2.1/os-security-groups/cfe6268b-a797-4f65-8cc5-8740f13df0d9 => generated 194 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:50.312753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-cafa064c-c0fc-4546-b1ee-ec9906fdd9bb req-3fc040da-c744-4645-ab18-03b07c9b0fb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "name": "network-vif-plugged", "status": "completed", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:50.364995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cafa064c-c0fc-4546-b1ee-ec9906fdd9bb req-3fc040da-c744-4645-ab18-03b07c9b0fb0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.366078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cafa064c-c0fc-4546-b1ee-ec9906fdd9bb req-3fc040da-c744-4645-ab18-03b07c9b0fb0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:50.417084 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-cafa064c-c0fc-4546-b1ee-ec9906fdd9bb req-3fc040da-c744-4645-ab18-03b07c9b0fb0 service nova] Creating event network-vif-plugged:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h2-768852-23 Jul 14 14:52:50.439984 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-cafa064c-c0fc-4546-b1ee-ec9906fdd9bb req-3fc040da-c744-4645-ab18-03b07c9b0fb0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165947 Jul 14 14:52:50.442956 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1477/3080] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:50.460647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:50.482169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:50.511662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.521456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:50.523842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:50.525156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.039786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:52:51.041125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:52:51.042447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:52:51.045406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:52:51.046477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:52:51.156481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.156938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.157784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.158237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.257867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:52:51.292834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Getting quotas for user a185fa24374c417aa2bb9302a608cbcd and project e29ad9c0a3664715b0a8384bc9840b7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:52:51.311526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:51.354132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:52:51.358152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:52:51.500863 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-66b3f90d-439c-4369-b1a8-f1940d3449f0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.454700 Jul 14 14:52:51.501898 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1604/3081] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:52:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2457 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:52:51.506960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:51.515997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:51.547605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.548061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.549104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.549730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.697853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.754047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.765017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.781295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f113eca-703f-4ced-b34b-b433fe0a885f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 1.334016 Jul 14 14:52:51.786738 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1478/3082] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:50 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:51.808155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:51.815391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:51.842680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.844036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.845977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:51.847581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:51.980717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:51.990509 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ee2a87f-0d46-470a-b640-bb402ecfc752 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1325 microversion: 2.1 time: 0.487476 Jul 14 14:52:52.000487 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1605/3083] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:51 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1325 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:52.029060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:52.030451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:52.069598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.077202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.083820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.085862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.181073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:52:52.187685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:52.509964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2896cb9-c68b-49f7-869d-c4d048aa248e tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 204 len: 0 microversion: 2.1 time: 0.505711 Jul 14 14:52:52.511045 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1606/3084] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:52 2022] DELETE /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:52:52.541439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bc668f76-fe62-4f79-a25b-bdf277f3ff0a req-a481b82d-00e9-4828-8fc0-2684c76e3576 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c8e28f-4db1-4b7b-9e7d-890f7064d541", "tag": "e96e2fcb-6bdc-499c-b9b0-8ee61e05dade"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:52.564919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bc668f76-fe62-4f79-a25b-bdf277f3ff0a req-a481b82d-00e9-4828-8fc0-2684c76e3576 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.566069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bc668f76-fe62-4f79-a25b-bdf277f3ff0a req-a481b82d-00e9-4828-8fc0-2684c76e3576 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.571066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:52.588001 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-76804c41-ba91-42b1-9a52-1d8d31092120 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1512 microversion: 2.1 time: 0.797959 Jul 14 14:52:52.590541 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1479/3085] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:51 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1512 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:52.604521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78db7f05-1cf1-45eb-8e53-7f325aff25cc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '.version_select at 0x7fdbf2d3a940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:52.647394 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bc668f76-fe62-4f79-a25b-bdf277f3ff0a req-a481b82d-00e9-4828-8fc0-2684c76e3576 service nova] Creating event network-changed:e96e2fcb-6bdc-499c-b9b0-8ee61e05dade for instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 on n-h1-768852-23 Jul 14 14:52:52.650855 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-78db7f05-1cf1-45eb-8e53-7f325aff25cc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Image not found. Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78db7f05-1cf1-45eb-8e53-7f325aff25cc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/images/a28b9235-9a66-4063-b616-9cf1ca53ad22 HTTP/1.1 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: exception: Image not found. Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a28b9235-9a66-4063-b616-9cf1ca53ad22'} Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a28b9235-9a66-4063-b616-9cf1ca53ad22 to delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a28b9235-9a66-4063-b616-9cf1ca53ad22 could not be found. Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:52.653820 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78db7f05-1cf1-45eb-8e53-7f325aff25cc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Image not found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78db7f05-1cf1-45eb-8e53-7f325aff25cc tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/images/a28b9235-9a66-4063-b616-9cf1ca53ad22" status: 404 len: 62 microversion: 2.1 time: 0.062423 Jul 14 14:52:52.664466 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1480/3086] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:52 2022] DELETE /compute/v2.1/images/a28b9235-9a66-4063-b616-9cf1ca53ad22 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:52:52.672133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff5bec9e-6371-4dcf-8f00-740319f25479 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:52.673214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ff5bec9e-6371-4dcf-8f00-740319f25479 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:52.693041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bc668f76-fe62-4f79-a25b-bdf277f3ff0a req-a481b82d-00e9-4828-8fc0-2684c76e3576 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162855 Jul 14 14:52:52.696367 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1607/3087] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:52.713700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd791c84-5ce8-4ed9-b49e-5c990e01965b"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:52.718044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:52.736422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.738097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.739681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.740788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.770905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ff5bec9e-6371-4dcf-8f00-740319f25479 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:52.781631 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff5bec9e-6371-4dcf-8f00-740319f25479 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1212 microversion: 2.1 time: 0.122418 Jul 14 14:52:52.782901 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1481/3088] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:52 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1212 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:52.788744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:52.789653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:52.809028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.813339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:52.814437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:52.815823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.281506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:53.301940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25e4d216-b5b7-4ef6-9d14-7ee22c110c76 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1647 microversion: 2.1 time: 0.517072 Jul 14 14:52:53.306880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1482/3089] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:52 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1647 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:53.321747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:53.322316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:53.339001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.340251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.341532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.342251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.601347 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcd01e35-3c2c-4efa-8e6c-30ba5f8da519 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902147 Jul 14 14:52:53.603905 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1608/3090] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:52:52 2022] POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-volume_attachments => generated 194 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:53.644436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:53.648926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:53.678278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.680176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.683512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.684755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.727945 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 HTTP/1.1 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219'} Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:53.747794 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:53.756947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:53.762359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:53.765843 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3cb2862d-5bc5-4f4e-a9f8-6f4afc20db3e tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 404 len: 111 microversion: 2.1 time: 0.143529 Jul 14 14:52:53.767753 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1609/3091] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:52:53 2022] DELETE /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:53.781304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:53.783474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:53.797922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:53.810194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.811473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.815869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.816972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.890640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:53.909551 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0aa077a4-c292-45a5-917f-8988808f621b tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1513 microversion: 2.1 time: 0.600335 Jul 14 14:52:53.923762 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1483/3092] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:53 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1513 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:53.947972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:53.949334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:53.961357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.962385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:53.964189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:53.965450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.215066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.235102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.238936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.242666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63dd0200-c7e9-4b1c-961c-5dc57f0d7d4d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.471110 Jul 14 14:52:54.244476 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1610/3093] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:53 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:54.255197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:54.256881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] [instance: c613e631-44c4-4528-b21f-6919a2785219] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:54.270414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.272107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.273998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.275015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.316267 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] HTTP exception thrown: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Request method failure captured: Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 HTTP/1.1 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C0kPIq7qMVSoV2TtR7QEkOxLrEWDi7EQGxpXXIuNQn8m-UPlKXa-h2rtOq-22v9fFwnLFFHaDfo4PReYVannL2D691AnWb5WqwZBHMCNd7yKjyJH23tc8HEWzCG-nu1O52K95ZmTMvM9jwCL3EDMRYFwR01x9BSMNjb7rr9iFCh3DM Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f30b8cc1b9254cca90487359e0872a93"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f30b8cc1b9254cca90487359e0872a93 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a7edefb2896948e39ac7aed5a3884233 Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1619303950-project Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c613e631-44c4-4528-b21f-6919a2785219'} Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:54.320517 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. Jul 14 14:52:54.330579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:54.333540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] Returning 404 to user: Instance c613e631-44c4-4528-b21f-6919a2785219 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:54.336689 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15371080-1928-46e3-935b-ed340d41f6b5 tempest-ImagesOneServerNegativeTestJSON-1619303950 tempest-ImagesOneServerNegativeTestJSON-1619303950-project] 10.222.0.98 "GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219" status: 404 len: 111 microversion: 2.1 time: 0.088912 Jul 14 14:52:54.338506 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1611/3094] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:54 2022] GET /compute/v2.1/servers/c613e631-44c4-4528-b21f-6919a2785219 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:54.375763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:54.377009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:54.399605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.400414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.401878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.402673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.557065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.568220 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db607afb-1717-4e1a-9439-75203fa5dd48 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1325 microversion: 2.1 time: 0.641756 Jul 14 14:52:54.570672 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1484/3095] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:53 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1325 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:54.585329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:54.594510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.599599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:54.616785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.617925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.620944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.622517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:54.696562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:54.772693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:54.792938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:54.793532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.033688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:55.052527 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b82f1e3-c273-44a2-8fdd-d0fbef78754c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1264 microversion: 2.1 time: 0.711679 Jul 14 14:52:55.055474 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1612/3096] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:54 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1264 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:55.067963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:55.069751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:55.083672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.085280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.087847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.089401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.377909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68e55362-468c-4df4-aea2-828f58c7aff7 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.804854 Jul 14 14:52:55.391714 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1485/3097] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:52:54 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:55.398090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:55.399017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:55.416355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.417089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:55.418308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:55.419863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.090533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:56.163498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:56.175743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:56.180653 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b96b2234-eaa1-4cb8-bf72-23a6f2501a3a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1738 microversion: 2.20 time: 0.784911 Jul 14 14:52:56.230752 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1486/3098] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:55 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1738 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:56.259942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:56.284595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:56.289353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:56.779668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ef211f562144656a4a95f4e0df02341', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1a307dcb18fe4909bc0421fb1fb18892', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:56.795783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-760f9022-f84f-4edf-840e-7aa8c3348519 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 200 len: 1647 microversion: 2.1 time: 1.737515 Jul 14 14:52:56.797987 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1613/3099] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:55 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 1647 bytes in 1741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:56.821526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:56.825996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:56.863469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:56.866557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.869914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:56.875356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.884217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:56.885683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:56.888770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:56.890259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:57.050468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:57.175653 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d17f7ef4-6298-4069-8bc7-4e4ee10e51a2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.939587 Jul 14 14:52:57.178295 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1487/3100] 10.222.0.98 () {58 vars in 1149 bytes} [Thu Jul 14 14:52:56 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:57.192332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:57.194410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:57.209248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:57.210608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:57.213124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:57.216420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:57.613374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:57.636206 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ba8a2b7d-d419-4340-9336-a1345940af01 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1270 microversion: 2.1 time: 0.455293 Jul 14 14:52:57.639687 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1488/3101] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:57 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1270 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:57.680246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7b474959-cda1-44e8-afd5-c798f6b52395 req-dc9ca7b0-8d36-4d6e-a128-f1ee19cf58b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f502d653-a001-463d-822c-62943de2ff18", "name": "network-vif-deleted", "tag": "36ea74e1-0e36-43ef-9f27-c1220f9a55ad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:57.735104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7b474959-cda1-44e8-afd5-c798f6b52395 req-dc9ca7b0-8d36-4d6e-a128-f1ee19cf58b2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:57.736589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7b474959-cda1-44e8-afd5-c798f6b52395 req-dc9ca7b0-8d36-4d6e-a128-f1ee19cf58b2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:57.807333 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7b474959-cda1-44e8-afd5-c798f6b52395 req-dc9ca7b0-8d36-4d6e-a128-f1ee19cf58b2 service nova] Creating event network-vif-deleted:36ea74e1-0e36-43ef-9f27-c1220f9a55ad for instance f502d653-a001-463d-822c-62943de2ff18 on n-h2-768852-23 Jul 14 14:52:57.827647 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7b474959-cda1-44e8-afd5-c798f6b52395 req-dc9ca7b0-8d36-4d6e-a128-f1ee19cf58b2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.182889 Jul 14 14:52:57.833699 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1489/3102] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:57.856394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:57.877511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:57.879378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:57.892004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:57.894604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:57.896815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:57.898025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.295098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:58.400474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:58.432113 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d51a17d-6ac5-412f-9b2c-b1eb553d3c23 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.595791 Jul 14 14:52:58.443192 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-83d4c1b4-77c9-49b8-8649-dd952123b618 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1325 microversion: 2.1 time: 1.640454 Jul 14 14:52:58.447526 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1490/3103] 10.222.0.98 () {58 vars in 1211 bytes} [Thu Jul 14 14:52:57 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:58.459834 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1614/3104] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:56 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1325 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:58.467919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:58.470321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:58.482713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.483538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.484995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.485798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.495218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:58.496705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] [instance: f502d653-a001-463d-822c-62943de2ff18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:58.529313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.530783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.535580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.538644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.608765 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] HTTP exception thrown: Instance f502d653-a001-463d-822c-62943de2ff18 could not be found. Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Request method failure captured: Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 HTTP/1.1 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1UDaDel-jA06089jgDIUBF4EF6uHtrYPHrTQbSfzwekVio26gTtuHWrFo4YruVyyRX89xLJORU91ubWJ-_HWZeqflahe8G9o3ikHv8i0fp53QqmLjXZtxMnzwbzW3MF3qRCEezSJeTU7bVbig9IXbCcOhJgCfnls-J85GiV3_Y3MM Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/1a307dcb18fe4909bc0421fb1fb18892"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 1a307dcb18fe4909bc0421fb1fb18892 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-804244551 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7ef211f562144656a4a95f4e0df02341 Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-SecurityGroupsTestJSON-804244551-project Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f502d653-a001-463d-822c-62943de2ff18 could not be found. Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f502d653-a001-463d-822c-62943de2ff18'} Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f502d653-a001-463d-822c-62943de2ff18 could not be found. Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f502d653-a001-463d-822c-62943de2ff18 could not be found. Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:52:58.611684 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f502d653-a001-463d-822c-62943de2ff18 could not be found. Jul 14 14:52:58.620578 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:52:58.623723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Returning 404 to user: Instance f502d653-a001-463d-822c-62943de2ff18 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:52:58.630219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cbd3af2-7742-4de5-8389-3a2420f91eba tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18" status: 404 len: 111 microversion: 2.1 time: 0.168326 Jul 14 14:52:58.636514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1615/3105] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:58 2022] GET /compute/v2.1/servers/f502d653-a001-463d-822c-62943de2ff18 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:52:58.645129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:58.663180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:58.669258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:58.694835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.695615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:58.697031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:58.708989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.005885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:52:59.149803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:59.183433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:59.187806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:59.192617 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a88eef16-574b-445b-90e4-bf2fcde5c0ff tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1720 microversion: 2.20 time: 0.741473 Jul 14 14:52:59.197202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1491/3106] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:52:58 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1720 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:52:59.219388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f6eadc09-d306-4725-8f22-cb4daffb69f9 req-4d69eaeb-8bd8-4764-bc6e-ee8d5ae197f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "name": "network-vif-unplugged", "status": "completed", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:52:59.240896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f6eadc09-d306-4725-8f22-cb4daffb69f9 req-4d69eaeb-8bd8-4764-bc6e-ee8d5ae197f3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.243873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f6eadc09-d306-4725-8f22-cb4daffb69f9 req-4d69eaeb-8bd8-4764-bc6e-ee8d5ae197f3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.272029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:52:59.276685 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f6eadc09-d306-4725-8f22-cb4daffb69f9 req-4d69eaeb-8bd8-4764-bc6e-ee8d5ae197f3 service nova] Creating event network-vif-unplugged:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:52:59.304286 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d0971d72-936e-4b79-967d-15f44459d23e tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.663451 Jul 14 14:52:59.319237 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1616/3107] 10.222.0.98 () {58 vars in 1195 bytes} [Thu Jul 14 14:52:58 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:59.324034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f6eadc09-d306-4725-8f22-cb4daffb69f9 req-4d69eaeb-8bd8-4764-bc6e-ee8d5ae197f3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117195 Jul 14 14:52:59.327973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1492/3108] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:52:59.332117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6705a9f4-8e83-4bac-876a-f28175c6256c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2971550>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:59.340774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:59.341906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:52:59.359751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.360442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.361488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.362120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.458528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:59.470971 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d4dc3a8-5316-40d1-a75e-40c4c13aff07 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1270 microversion: 2.1 time: 0.141008 Jul 14 14:52:59.473723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1493/3109] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:52:59 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1270 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:52:59.491630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:52:59.496279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:52:59.498899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': '-157705253', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:52:59.506109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.506580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.507958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:52:59.508696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:52:59.750494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:53:00.021212 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9ee9da5-26ab-4f44-abd1-a8145f4062fb tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?name=-157705253" status: 200 len: 345 microversion: 2.1 time: 0.545125 Jul 14 14:53:00.029096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1494/3110] 10.222.0.98 () {58 vars in 1155 bytes} [Thu Jul 14 14:52:59 2022] GET /compute/v2.1/servers?name=-157705253 => generated 345 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:00.038548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:00.040097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:00.062804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:00.063693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:00.065392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:00.066218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:00.520077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:00.553959 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-202525c7-a453-44d9-b149-10f99a33d41c tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1325 microversion: 2.1 time: 0.528490 Jul 14 14:53:00.557350 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1495/3111] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:00 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1325 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:00.593782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:00.619860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:00.621557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:53:00.634206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:00.635526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:00.637044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:00.638572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:00.910587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:53:01.144674 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ef51db9-bc60-4682-8a7f-e6750e0ff237 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.576147 Jul 14 14:53:01.149010 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1496/3112] 10.222.0.98 () {58 vars in 1153 bytes} [Thu Jul 14 14:53:00 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:01.170664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:01.174483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:01.194565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.198160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:01.203833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.204564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:01.279638 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6705a9f4-8e83-4bac-876a-f28175c6256c tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/7bcae5f9-a718-470e-a862-f72c5a47521e" status: 202 len: 0 microversion: 2.1 time: 1.957685 Jul 14 14:53:01.285043 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1617/3113] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:52:59 2022] DELETE /compute/v2.1/os-security-groups/7bcae5f9-a718-470e-a862-f72c5a47521e => generated 0 bytes in 1961 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:01.288972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:01.289744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:01.327879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.332332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:01.334632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.335355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:01.371903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:01.806511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:01.830707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:01.832323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:01.834632 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a889792a-bab4-4f4f-8855-f18fcbf8881a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1723 microversion: 2.20 time: 0.683559 Jul 14 14:53:01.835319 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1497/3114] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:01 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1723 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:01.842028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:01.846041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:01.846732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-15770525', 'deleted': False, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:53:01.869141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:01.877463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.878212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:01.882458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:01.883199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:02.115845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:53:02.289726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:02.305932 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d530e46-404a-47cb-abfb-af80a1cc1789 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 1.017819 Jul 14 14:53:02.316891 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1618/3115] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:01 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:02.324434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-98f692b7-7d3d-4b85-9652-1e1027959967 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] Calling method '.version_select at 0x7fdbf2adc820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:02.384003 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79907aa0-9dab-418d-87b9-efa9af54fbf4 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-15770525" status: 200 len: 345 microversion: 2.1 time: 0.546887 Jul 14 14:53:02.387554 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1498/3116] 10.222.0.98 () {58 vars in 1225 bytes} [Thu Jul 14 14:53:01 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-15770525 => generated 345 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:02.413498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c26093fd-2192-4fde-874b-68d4868fdeb7 req-23fed3a6-fe54-4234-9ac6-c6027e9a66c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c8e28f-4db1-4b7b-9e7d-890f7064d541", "name": "network-vif-plugged", "status": "completed", "tag": "e96e2fcb-6bdc-499c-b9b0-8ee61e05dade"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:02.444618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c26093fd-2192-4fde-874b-68d4868fdeb7 req-23fed3a6-fe54-4234-9ac6-c6027e9a66c6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:02.446578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c26093fd-2192-4fde-874b-68d4868fdeb7 req-23fed3a6-fe54-4234-9ac6-c6027e9a66c6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:02.470127 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c26093fd-2192-4fde-874b-68d4868fdeb7 req-23fed3a6-fe54-4234-9ac6-c6027e9a66c6 service nova] Creating event network-vif-plugged:e96e2fcb-6bdc-499c-b9b0-8ee61e05dade for instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 on n-h1-768852-23 Jul 14 14:53:02.486311 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c26093fd-2192-4fde-874b-68d4868fdeb7 req-23fed3a6-fe54-4234-9ac6-c6027e9a66c6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096509 Jul 14 14:53:02.488302 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1499/3117] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:02.498636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:02.510557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:02.533512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:02.542007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:02.544110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:02.548336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:03.401994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:03.415885 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6db09a79-ac87-493a-9c1c-a0bd5d4ce40d tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1325 microversion: 2.1 time: 0.925452 Jul 14 14:53:03.416518 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1500/3118] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:02 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1325 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:03.433303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edc9e47-0d96-4aa0-a155-9b9f8f375821"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:03.435757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:03.449003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:03.450331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:03.454348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:03.455853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.218312 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5d22871-2df3-4708-89c2-c9ca7b1ac710 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.800627 Jul 14 14:53:04.219689 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1501/3119] 10.222.0.98 () {62 vars in 1363 bytes} [Thu Jul 14 14:53:03 2022] POST /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 188 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:53:04.225281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:04.225796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:04.264228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:04.280088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.282008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:04.282668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.415686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:04.522982 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-98f692b7-7d3d-4b85-9652-1e1027959967 tempest-SecurityGroupsTestJSON-804244551 tempest-SecurityGroupsTestJSON-804244551-project] 10.222.0.98 "DELETE /compute/v2.1/os-security-groups/94c03fa3-d69c-4823-94cb-562fcbc73843" status: 202 len: 0 microversion: 2.1 time: 2.203889 Jul 14 14:53:04.524513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1619/3120] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:53:02 2022] DELETE /compute/v2.1/os-security-groups/94c03fa3-d69c-4823-94cb-562fcbc73843 => generated 0 bytes in 2207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:04.549523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:04.565835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:04.665872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:04.667060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.668914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:04.674288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.766575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:04.838655 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a6f3d9a-cce8-47aa-87f6-9c23ede41907 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 204 len: 0 microversion: 2.1 time: 0.616725 Jul 14 14:53:04.843041 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1502/3121] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:04 2022] DELETE /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 0 bytes in 619 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:04.861633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:04.875817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:04.889479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:04.890295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:04.891786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:04.892562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:05.409357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:05.443815 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5acf5d8d-99bc-4f65-ae79-b69f07845d3e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 0.917116 Jul 14 14:53:05.453426 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1620/3122] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:04 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:05.475739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:05.476840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:05.503016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:05.504014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:05.505269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:05.506063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:06.014401 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8864c98-d227-4b50-9418-a6598f35b8b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/action" status: 202 len: 0 microversion: 2.20 time: 0.555176 Jul 14 14:53:06.019401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1621/3123] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:53:05 2022] POST /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:06.049806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:06.054377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:06.071144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:06.101427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:06.102655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:06.111429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bad0f409-a35c-434c-81d7-b5730cf94418 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1523 microversion: 2.1 time: 1.265706 Jul 14 14:53:06.114967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:06.120899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:06.133044 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1503/3124] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:04 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1523 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:06.146809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d45f32ea-958f-4dcd-9421-fe9f6ca25d28 req-9e3b87d0-3b02-4177-9590-d9f046a5c88d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:06.180796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d45f32ea-958f-4dcd-9421-fe9f6ca25d28 req-9e3b87d0-3b02-4177-9590-d9f046a5c88d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:06.181829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d45f32ea-958f-4dcd-9421-fe9f6ca25d28 req-9e3b87d0-3b02-4177-9590-d9f046a5c88d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:06.227706 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d45f32ea-958f-4dcd-9421-fe9f6ca25d28 req-9e3b87d0-3b02-4177-9590-d9f046a5c88d service nova] Creating event network-changed:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h1-768852-23 Jul 14 14:53:06.248972 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d45f32ea-958f-4dcd-9421-fe9f6ca25d28 req-9e3b87d0-3b02-4177-9590-d9f046a5c88d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104914 Jul 14 14:53:06.252564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1504/3125] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:06.271083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:06.275403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:06.297354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:06.297828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:06.298738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:06.299194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:06.337296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:07.000476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:07.012821 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ebac7c5-6bd6-467d-aa95-2b6566093809 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1519 microversion: 2.1 time: 0.988659 Jul 14 14:53:07.023582 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1622/3126] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:06 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1519 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:07.031566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:07.032475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:07.040334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.041275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.042338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.043301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.073459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] HTTP exception thrown: Instance is not a member of specified network Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Request method failure captured: Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541/ips/invalid HTTP/1.1 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C20usugzrO6PYpMX1Bi8tMavfPj9rBSwD2oWZ2p4gBT8g5NEXPJNEzs-JI9a9AREPYmT6XcPD1Oj-mvp0v9ttFF_5FU3ATgeLyrTPdsR0XDBBHpOjtEkqHMojYpVel57MnfFIeEuCv29aL6U-wYz-p3VD0YYYx2bOCLEhZsm1A5gjo Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4381d698f8624ab2b1e932305ea8b67a Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4381d698f8624ab2b1e932305ea8b67a Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerAddressesNegativeTestJSON-540605605-project Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b72083f0df93495194118d6a12088c75 Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-540605605-project Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance is not a member of specified network Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': 'e3c8e28f-4db1-4b7b-9e7d-890f7064d541', 'id': 'invalid'} Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Jul 14 14:53:07.094777 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.108390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Returning 404 to user: Instance is not a member of specified network {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:07.111603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4b19c919-adaa-4d3d-879c-8d773d59dee4 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.084985 Jul 14 14:53:07.114393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1623/3127] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 14:53:07 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541/ips/invalid => generated 91 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:53:07.134685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:07.139169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:07.154385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.155763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.175020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.176348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.196017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:07.276807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:07.294868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:07.296553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:07.297825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ecc62961-276c-4f60-b6fa-4895edc3eb32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1749 microversion: 2.20 time: 1.043887 Jul 14 14:53:07.298428 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1505/3128] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:06 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1749 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:07.313352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c379649d-8118-4c5c-8f18-ed97b4b2d7ed tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:07.313863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c379649d-8118-4c5c-8f18-ed97b4b2d7ed tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Failed to fetch instance by id 999 {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 14:53:07.314429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c379649d-8118-4c5c-8f18-ed97b4b2d7ed tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] HTTP exception thrown: Instance 999 could not be found. Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c379649d-8118-4c5c-8f18-ed97b4b2d7ed tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Request method failure captured: Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C20usugzrO6PYpMX1Bi8tMavfPj9rBSwD2oWZ2p4gBT8g5NEXPJNEzs-JI9a9AREPYmT6XcPD1Oj-mvp0v9ttFF_5FU3ATgeLyrTPdsR0XDBBHpOjtEkqHMojYpVel57MnfFIeEuCv29aL6U-wYz-p3VD0YYYx2bOCLEhZsm1A5gjo Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4381d698f8624ab2b1e932305ea8b67a Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4381d698f8624ab2b1e932305ea8b67a Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerAddressesNegativeTestJSON-540605605-project Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b72083f0df93495194118d6a12088c75 Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-540605605-project Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 999 could not be found. Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': '999'} Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Jul 14 14:53:07.316366 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:07.326064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c379649d-8118-4c5c-8f18-ed97b4b2d7ed tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Returning 404 to user: Instance 999 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:07.326064 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c379649d-8118-4c5c-8f18-ed97b4b2d7ed tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.018465 Jul 14 14:53:07.326064 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1506/3129] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 14:53:07 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:53:07.337449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:07.345126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:07.361840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.362589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.363619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.376108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.439867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:07.599028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9340d50-f5f9-4d16-9a39-2f19ab3c0e2a tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 204 len: 0 microversion: 2.1 time: 0.265832 Jul 14 14:53:07.606113 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1507/3130] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:07 2022] DELETE /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:07.614821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:07.617339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:07.626850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.627384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.628902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:07.629702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:07.991536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:08.010568 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-494cf1bc-bced-4533-b1d8-874c8b4deee1 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1529 microversion: 2.1 time: 0.402289 Jul 14 14:53:08.011867 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1508/3131] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:07 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1529 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:08.047593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:08.049341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:08.060485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:08.083791 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c47a693-1d78-43fc-a5bc-a5cdfa41ab11 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 0.965479 Jul 14 14:53:08.084517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.084874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.085533 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1624/3132] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:07 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:08.095624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.096175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.320382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:08.321510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:08.343555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.347640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.348879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.351293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.612830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:08.622200 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-82e7d324-b8e7-416c-8477-4e6411c0f808 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1477 microversion: 2.1 time: 0.591450 Jul 14 14:53:08.634494 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1509/3133] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:08 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1477 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:08.666441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0e0d0131-e147-465f-a1f5-8b9dd952a8e4 req-655aa857-cb62-4c86-9fb5-eb44c3ca94e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d55f15dc-73cc-4117-b88f-d92f33ec54ce", "name": "network-vif-deleted", "tag": "a142398e-7667-4e97-a5f7-e65d6c80fb1d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:08.693094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e0d0131-e147-465f-a1f5-8b9dd952a8e4 req-655aa857-cb62-4c86-9fb5-eb44c3ca94e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:08.703255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e0d0131-e147-465f-a1f5-8b9dd952a8e4 req-655aa857-cb62-4c86-9fb5-eb44c3ca94e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:08.733362 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0e0d0131-e147-465f-a1f5-8b9dd952a8e4 req-655aa857-cb62-4c86-9fb5-eb44c3ca94e0 service nova] Creating event network-vif-deleted:a142398e-7667-4e97-a5f7-e65d6c80fb1d for instance d55f15dc-73cc-4117-b88f-d92f33ec54ce on n-h2-768852-23 Jul 14 14:53:08.750667 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0e0d0131-e147-465f-a1f5-8b9dd952a8e4 req-655aa857-cb62-4c86-9fb5-eb44c3ca94e0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087883 Jul 14 14:53:08.752539 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1510/3134] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:08.893163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:09.049267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:09.050906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:09.076854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.079787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.081304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.084987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.109248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:09.124137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:09.126924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:09.129096 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7cedb3ee-59de-406a-ae06-c0d894a01a34 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1749 microversion: 2.20 time: 0.815513 Jul 14 14:53:09.130311 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1625/3135] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:08 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1749 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:09.152001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:09.158051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:09.166648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.167580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.169330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.169979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.525861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:09.544667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:09.557174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7e209c27-1947-4337-a17d-7af25afcc588 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1529 microversion: 2.1 time: 0.517877 Jul 14 14:53:09.558228 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1511/3136] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:09 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1529 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:09.561799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f50e2a2e-e827-41c7-99fa-adf40a29617a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 0.430033 Jul 14 14:53:09.565951 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1626/3137] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:09 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:09.654863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:09.659696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:09.698156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.699572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.702247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.705553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.760920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:09.762895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:09.763728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lazy-loading 'fault' on Instance uuid d55f15dc-73cc-4117-b88f-d92f33ec54ce {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:09.982108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:10.036151 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57ed93c1-ce0f-4633-8aca-5dfde9bc8185 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 200 len: 1311 microversion: 2.1 time: 0.397918 Jul 14 14:53:10.041119 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1512/3138] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:09 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 1311 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:10.166256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:10.167626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:10.183053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.183758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:10.185819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.187492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:10.590822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:10.593184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:10.633741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.634411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:10.649749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:10.650751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:11.813882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:11.825918 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e6b2b837-1dc8-48f0-8322-72a021cf8758 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 1.243444 Jul 14 14:53:11.828026 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1513/3139] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:10 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:11.842978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:11.844532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:11.860605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:11.862216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:11.865388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:11.865934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:11.920272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=16 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:12.050320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:12.062213 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98ba4714-8606-4a22-8b76-92e6f6126bf7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1487 microversion: 2.1 time: 0.232420 Jul 14 14:53:12.064160 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1514/3140] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:11 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1487 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:12.071198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:12.072213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: d55f15dc-73cc-4117-b88f-d92f33ec54ce] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:12.097541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.101756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.102965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.104783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.151461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] HTTP exception thrown: Instance d55f15dc-73cc-4117-b88f-d92f33ec54ce could not be found. Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Request method failure captured: Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce HTTP/1.1 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1zSo5TWIpdEmsSGisFvr9NP3EWIE-q7SRj7dwSHxuxYDjU07ZXSpbk7hw425tfTjngsV9xQggUFrXA2nEGs89atfT46ZuqrH4bmbjoeMa--aEIVCpkQ0IBN3QjWyUg3uFfgvwf0YOb3YgkSyAWCYMcpSGWkA2MfzJTstquOXMAmRU Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: adc60bcb471e44fb8787afd9f5b623ab Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: adc60bcb471e44fb8787afd9f5b623ab Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ListServerFiltersTestJSON-25066287-project Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 3323669591584736b1e19db6da8fa08f Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ListServerFiltersTestJSON-25066287-project Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d55f15dc-73cc-4117-b88f-d92f33ec54ce could not be found. Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd55f15dc-73cc-4117-b88f-d92f33ec54ce'} Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d55f15dc-73cc-4117-b88f-d92f33ec54ce could not be found. Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d55f15dc-73cc-4117-b88f-d92f33ec54ce could not be found. Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:12.159540 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d55f15dc-73cc-4117-b88f-d92f33ec54ce could not be found. Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:12.164650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Returning 404 to user: Instance d55f15dc-73cc-4117-b88f-d92f33ec54ce could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:12.170473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db90b274-4e9d-4203-8ac0-ba9a9645529a tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce" status: 404 len: 111 microversion: 2.1 time: 0.102460 Jul 14 14:53:12.174176 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1515/3141] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:12 2022] GET /compute/v2.1/servers/d55f15dc-73cc-4117-b88f-d92f33ec54ce => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:12.189500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8f22b169-b41f-47b1-bffb-b34797984ec5 req-588c0235-dda9-4d3b-9d18-c6ce31234c40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c8e28f-4db1-4b7b-9e7d-890f7064d541", "name": "network-vif-deleted", "tag": "e96e2fcb-6bdc-499c-b9b0-8ee61e05dade"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:12.222511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8f22b169-b41f-47b1-bffb-b34797984ec5 req-588c0235-dda9-4d3b-9d18-c6ce31234c40 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.223054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8f22b169-b41f-47b1-bffb-b34797984ec5 req-588c0235-dda9-4d3b-9d18-c6ce31234c40 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.254003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:12.271891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:12.274462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:12.276814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f66d694-5c3a-48e3-bc36-c1ffca1a4908 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 2.117120 Jul 14 14:53:12.281537 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1627/3142] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:10 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 2123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:12.282259 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8f22b169-b41f-47b1-bffb-b34797984ec5 req-588c0235-dda9-4d3b-9d18-c6ce31234c40 service nova] Creating event network-vif-deleted:e96e2fcb-6bdc-499c-b9b0-8ee61e05dade for instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 on n-h1-768852-23 Jul 14 14:53:12.296752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:12.297617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:12.308012 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8f22b169-b41f-47b1-bffb-b34797984ec5 req-588c0235-dda9-4d3b-9d18-c6ce31234c40 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134465 Jul 14 14:53:12.310096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1516/3143] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:12.317608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.318305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.330237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.332575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.383130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:12.549665 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-636ec55b-ba0c-43ad-b6ab-03e0907da204 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 204 len: 0 microversion: 2.1 time: 0.265296 Jul 14 14:53:12.550712 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1628/3144] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:12 2022] DELETE /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:12.562913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:12.564636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:12.576940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.577627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.578659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.579375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.845142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:12.846285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:12.863285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.864436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:12.865465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:12.866190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.064562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.084323 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07dcecec-eb97-4b02-b894-f2b583820856 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1518 microversion: 2.1 time: 0.527972 Jul 14 14:53:13.086088 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1517/3145] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:12 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1518 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:13.115401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:13.116217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:13.127536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.128299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.132625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.133447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.232842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.234614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.237956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lazy-loading 'fault' on Instance uuid e3c8e28f-4db1-4b7b-9e7d-890f7064d541 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:13.476760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.489309 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5391741-4996-42bf-ae00-1b4a7ebb66b7 tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1315 microversion: 2.1 time: 0.401666 Jul 14 14:53:13.494521 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1518/3146] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:13 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1315 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:13.520116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:13.521465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:13.539004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.539507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.543205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:13.543780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:13.622389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.638781 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5c47859-af48-4350-8e03-e55c84be6300 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 0.796531 Jul 14 14:53:13.639823 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1629/3147] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:12 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:13.962616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.981372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.992791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:13.995114 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad53d7be-b87b-40bf-81bd-35bccec5280e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 0.488919 Jul 14 14:53:13.999304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1519/3148] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:13 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:14.103414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:14.104415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:14.143690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.144155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.147599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.152198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.516952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:14.521994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:14.563738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.564498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.565627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.574573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.701218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.702048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.704687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lazy-loading 'fault' on Instance uuid e3c8e28f-4db1-4b7b-9e7d-890f7064d541 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:14.762388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:14.778720 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e6a7c06-f13f-48ea-9f4c-56678d72f977 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1518 microversion: 2.1 time: 0.678272 Jul 14 14:53:14.792114 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1630/3149] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:14 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1518 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:14.800779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:14.802420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:14.813467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.814255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.815304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:14.815974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:14.820759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b72083f0df93495194118d6a12088c75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4381d698f8624ab2b1e932305ea8b67a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:14.839092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62be9693-9103-44c9-b332-6b7f25a955ef tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 200 len: 1315 microversion: 2.1 time: 0.326590 Jul 14 14:53:14.840497 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1520/3150] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:14 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:15.032128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:15.032848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:15.057475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:15.060676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:15.067136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:15.067805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:15.643467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:15.674541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:15.684918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:15.686045 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43d4edc3-af36-4bf9-adef-10562b06d671 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 0.658723 Jul 14 14:53:15.703337 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1521/3151] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:15 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:15.752962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5fd16f97-4b62-4f81-903e-1d44efd32108 req-1a29cb94-9153-4717-8fda-834fa7fa2a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "name": "network-vif-plugged", "status": "completed", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:15.784240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5fd16f97-4b62-4f81-903e-1d44efd32108 req-1a29cb94-9153-4717-8fda-834fa7fa2a76 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:15.784725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5fd16f97-4b62-4f81-903e-1d44efd32108 req-1a29cb94-9153-4717-8fda-834fa7fa2a76 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:15.852192 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5fd16f97-4b62-4f81-903e-1d44efd32108 req-1a29cb94-9153-4717-8fda-834fa7fa2a76 service nova] Creating event network-vif-plugged:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h1-768852-23 Jul 14 14:53:15.863506 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5fd16f97-4b62-4f81-903e-1d44efd32108 req-1a29cb94-9153-4717-8fda-834fa7fa2a76 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114604 Jul 14 14:53:15.866632 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1522/3152] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:15.880376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:15.880938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:15.927941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:15.929928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:15.934804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:15.939779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:15.960922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:16.046162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:16.071650 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0dc507f9-43ba-43e8-960c-08a8ab8ab6ba tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 1.274073 Jul 14 14:53:16.084837 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1631/3153] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:14 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:16.098449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4af27336-c0d8-4a0f-9af6-7de3609642b8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:16.136380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4af27336-c0d8-4a0f-9af6-7de3609642b8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.137245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4af27336-c0d8-4a0f-9af6-7de3609642b8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.213310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4af27336-c0d8-4a0f-9af6-7de3609642b8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Going to try to stop instance {{(pid=125965) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:53:16.382324 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4af27336-c0d8-4a0f-9af6-7de3609642b8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action" status: 202 len: 0 microversion: 2.1 time: 0.276358 Jul 14 14:53:16.384449 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1632/3154] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:53:16 2022] POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:16.458476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:16.464703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] [instance: e3c8e28f-4db1-4b7b-9e7d-890f7064d541] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:16.487721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:16.501620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.502446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.503016 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c652742-f57b-4b5d-8711-fec8034ba2d2 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1518 microversion: 2.1 time: 0.629950 Jul 14 14:53:16.503850 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1523/3155] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:15 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1518 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:16.512470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:16.517568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:16.531150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.531736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.532361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.533276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.533506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.534223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.610146 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] HTTP exception thrown: Instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 could not be found. Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Request method failure captured: Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 HTTP/1.1 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C20usugzrO6PYpMX1Bi8tMavfPj9rBSwD2oWZ2p4gBT8g5NEXPJNEzs-JI9a9AREPYmT6XcPD1Oj-mvp0v9ttFF_5FU3ATgeLyrTPdsR0XDBBHpOjtEkqHMojYpVel57MnfFIeEuCv29aL6U-wYz-p3VD0YYYx2bOCLEhZsm1A5gjo Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4381d698f8624ab2b1e932305ea8b67a Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4381d698f8624ab2b1e932305ea8b67a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4381d698f8624ab2b1e932305ea8b67a Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-540605605 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerAddressesNegativeTestJSON-540605605-project Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b72083f0df93495194118d6a12088c75 Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-540605605-project Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 could not be found. Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e3c8e28f-4db1-4b7b-9e7d-890f7064d541'} Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 could not be found. Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 could not be found. Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:16.616397 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 could not be found. Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] Returning 404 to user: Instance e3c8e28f-4db1-4b7b-9e7d-890f7064d541 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:16.621941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4c070b58-44e5-44bc-bef3-8ecb9acf1cdc tempest-ServerAddressesNegativeTestJSON-540605605 tempest-ServerAddressesNegativeTestJSON-540605605-project] 10.222.0.98 "GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541" status: 404 len: 111 microversion: 2.1 time: 0.219228 Jul 14 14:53:16.635863 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1633/3156] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:16 2022] GET /compute/v2.1/servers/e3c8e28f-4db1-4b7b-9e7d-890f7064d541 => generated 111 bytes in 250 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:16.725448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:16.726087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:16.744280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.745840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:16.747787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:16.748261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:17.311519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:17.327144 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-82daefd6-5cc1-4fd4-a4fd-23fe60512012 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 0.819485 Jul 14 14:53:17.329180 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1524/3157] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:16 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:17.337433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:17.338065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:17.357903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:17.358377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:17.359192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:17.362545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:17.368012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:17.402264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:17.411016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:17.413749 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06bc8312-db0f-4c1f-83ad-0e5986d1b9b5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 0.694253 Jul 14 14:53:17.415110 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1634/3158] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:16 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:53:17.540898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:17.548553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:17.596543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:17.603340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:17.607234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:17.608069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:17.870348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:17.919321 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-839128fe-b0d7-41a0-890b-97bdbbe360b5 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1476 microversion: 2.1 time: 0.388446 Jul 14 14:53:17.922054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1635/3159] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:17 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1476 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:17.942061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4b879085-8017-4248-9ab5-acad094a5a0b req-39f61e34-f65a-491a-a4fa-9b9f63398f92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e899757-5400-47c4-ba27-33091c4a7cdb", "name": "network-vif-deleted", "tag": "11f06ce6-6bc0-4d29-9c5e-acfc5bfbe497"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:17.983918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4b879085-8017-4248-9ab5-acad094a5a0b req-39f61e34-f65a-491a-a4fa-9b9f63398f92 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:17.984397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4b879085-8017-4248-9ab5-acad094a5a0b req-39f61e34-f65a-491a-a4fa-9b9f63398f92 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.031348 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4b879085-8017-4248-9ab5-acad094a5a0b req-39f61e34-f65a-491a-a4fa-9b9f63398f92 service nova] Creating event network-vif-deleted:11f06ce6-6bc0-4d29-9c5e-acfc5bfbe497 for instance 2e899757-5400-47c4-ba27-33091c4a7cdb on n-h1-768852-23 Jul 14 14:53:18.044586 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4b879085-8017-4248-9ab5-acad094a5a0b req-39f61e34-f65a-491a-a4fa-9b9f63398f92 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119988 Jul 14 14:53:18.045223 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1636/3160] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:18.088507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:18.097447 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-208abdec-2a8d-4dbb-abd3-5ae9dd22fcd8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1312 microversion: 2.1 time: 0.767051 Jul 14 14:53:18.108293 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1525/3161] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:17 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1312 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:18.363456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:18.364912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:18.380187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:18.380827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.389008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:18.392026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.451939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:18.453155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:18.473135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:18.478699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.480470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:18.483528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:18.926471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:18.943676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f0a0d0c-03dc-4571-a916-e9f61c0b6b3e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 0.585056 Jul 14 14:53:18.947042 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1637/3162] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:18 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:18.981919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:18.987769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:19.011100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.012599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.014714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.016041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.102036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:19.119469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:19.121319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:19.138233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c254b52d-e6de-4f4f-813d-f9386cba3658 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 0.699102 Jul 14 14:53:19.139469 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1526/3163] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:18 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:53:19.160073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:19.161007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:19.166953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.170178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.176521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lazy-loading 'fault' on Instance uuid 2e899757-5400-47c4-ba27-33091c4a7cdb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:19.180575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.185956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.187233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.191938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.340760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:19.355308 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c6355c4b-bcbe-4423-9211-d8d4b5521437 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 200 len: 1311 microversion: 2.1 time: 0.406686 Jul 14 14:53:19.356985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1638/3164] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:18 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 1311 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:19.900838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:19.924472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65d992ae-cea2-4d04-888e-877f6617c2b4 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1462 microversion: 2.1 time: 0.782902 Jul 14 14:53:19.927783 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1527/3165] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:19 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1462 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:19.974999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:19.975636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:19.985614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.986077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:19.987450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:19.988488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:20.351337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:20.369873 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c8e962fb-90ba-45c3-9a0b-90835152b696 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 0.402225 Jul 14 14:53:20.373738 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1528/3166] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:19 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:20.384360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:20.385233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:20.401164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:20.401439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:20.402250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:20.403243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:20.711047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:20.712477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:20.736970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:20.738158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:20.741738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:20.745243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:20.767693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:21.031770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:21.068549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:21.071744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:21.083597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5e632e3-cc7d-45d4-9088-6a8d90751394 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 0.707446 Jul 14 14:53:21.095817 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1529/3167] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:20 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:21.104875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.106064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2e899757-5400-47c4-ba27-33091c4a7cdb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:21.136073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.136797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.138731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.139645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.185632 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] HTTP exception thrown: Instance 2e899757-5400-47c4-ba27-33091c4a7cdb could not be found. Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Request method failure captured: Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb HTTP/1.1 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1zSo5TWIpdEmsSGisFvr9NP3EWIE-q7SRj7dwSHxuxYDjU07ZXSpbk7hw425tfTjngsV9xQggUFrXA2nEGs89atfT46ZuqrH4bmbjoeMa--aEIVCpkQ0IBN3QjWyUg3uFfgvwf0YOb3YgkSyAWCYMcpSGWkA2MfzJTstquOXMAmRU Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: adc60bcb471e44fb8787afd9f5b623ab Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: adc60bcb471e44fb8787afd9f5b623ab Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ListServerFiltersTestJSON-25066287-project Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 3323669591584736b1e19db6da8fa08f Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ListServerFiltersTestJSON-25066287-project Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2e899757-5400-47c4-ba27-33091c4a7cdb could not be found. Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2e899757-5400-47c4-ba27-33091c4a7cdb'} Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e899757-5400-47c4-ba27-33091c4a7cdb could not be found. Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e899757-5400-47c4-ba27-33091c4a7cdb could not be found. Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:21.187528 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e899757-5400-47c4-ba27-33091c4a7cdb could not be found. Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Returning 404 to user: Instance 2e899757-5400-47c4-ba27-33091c4a7cdb could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:21.191767 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-efe65993-e795-4b98-845d-d95ed772d41f tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb" status: 404 len: 111 microversion: 2.1 time: 0.091680 Jul 14 14:53:21.199549 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1530/3168] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/v2.1/servers/2e899757-5400-47c4-ba27-33091c4a7cdb => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:21.218810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.219615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:21.238932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.239838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.240956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.244563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.271874 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5fabb42-0b48-4aa4-8f69-cf3719bd0d9f tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1615 microversion: 2.1 time: 1.324735 Jul 14 14:53:21.283926 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1639/3169] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:19 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1615 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:21.304931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:21.305951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:21.319606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.322364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.326560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.327442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.328395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:53:21.423482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'f2cdc02847a74ce6adf37f360f247ade', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c954b5add82d484393972d3762652312', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:21.425448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] flavor_id is None. Assuming migration. {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 14:53:21.426656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 14:53:21.569452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db4b3639-c55b-403e-8683-87cd0c3a9c3d tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 204 len: 0 microversion: 2.1 time: 0.361906 Jul 14 14:53:21.579503 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1531/3170] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:53:21 2022] DELETE /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:53:21.595824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:21.597717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:21.614383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.618957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.620768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:21.629522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:21.982358 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eafd6683-6b38-44c7-8d4a-d03e3abc8c8c tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1/action" status: 202 len: 0 microversion: 2.1 time: 0.685169 Jul 14 14:53:21.986161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1640/3171] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:53:21 2022] POST /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1/action => generated 0 bytes in 688 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:22.003933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:22.005091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:22.025174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.026760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.029369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.030522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.338697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:22.363530 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a5bb648-fa2f-4280-a305-8a7d575b6568 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 0.781358 Jul 14 14:53:22.375804 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1532/3172] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:22.393446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:22.394489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:22.442545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.444637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.446423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.447229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.778955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:22.830826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-feb0d23f-21b8-416c-88c1-2afecf0866dc tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1517 microversion: 2.1 time: 0.845340 Jul 14 14:53:22.837456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1641/3173] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:21 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1517 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:22.860984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:22.866569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:22.895947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.897942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:22.904290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:22.906850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:23.760782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:23.796277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:23.820347 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5e5d19f-5342-4e61-94d1-07f8c13028f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1471 microversion: 2.1 time: 1.442513 Jul 14 14:53:23.830673 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1533/3174] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:22 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1471 bytes in 1454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:23.854660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:23.859144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:23.864959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-827f2772-1499-4773-a19e-2e246452ffe6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1751 microversion: 2.20 time: 1.029056 Jul 14 14:53:23.865690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:23.867759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:23.869308 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1642/3175] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:22 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1751 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:23.895184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:23.897508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:23.898622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:23.909769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:23.915141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:23.916273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:23.946290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:23.947090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:23.963891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:23.965624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:24.577135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:24.620289 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a570e96e-f0b3-4db5-80ea-76277bbd53ed tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1517 microversion: 2.1 time: 0.731795 Jul 14 14:53:24.621422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1643/3176] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:23 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1517 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:24.851229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:24.857861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:24.877938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:24.881662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:24.890317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:24.891403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:24.895540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:25.760753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:25.785221 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a8aa615-5d4d-46f5-b43e-c41d779b56b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 1.948483 Jul 14 14:53:25.798202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1534/3177] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:23 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 1955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:25.819991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:25.821485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:25.856655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:25.857870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:25.863825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:25.864891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:26.349480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:26.361980 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53160f6d-4108-49ac-8112-f5caf3897fb6 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1471 microversion: 2.1 time: 1.517242 Jul 14 14:53:26.366347 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1644/3178] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:24 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1471 bytes in 1522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:26.379246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:26.380200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:26.395373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:26.396156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:26.397202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:26.397840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:26.850089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:26.865035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:26.866669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:26.875401 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74772daa-f36f-43a7-8073-b17efd73c548 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.074492 Jul 14 14:53:26.876230 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1535/3179] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:25 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:26.905721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-23db65a0-8925-4c8d-9971-81d13f1221ff req-5455a17d-2859-48f7-b00e-20596e86ae88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0e25f9-4c23-4d7b-8c01-fdcaa641c256", "name": "network-vif-unplugged", "status": "completed", "tag": "28679601-624d-40ec-b3d6-a96a019636d0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:26.923186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-23db65a0-8925-4c8d-9971-81d13f1221ff req-5455a17d-2859-48f7-b00e-20596e86ae88 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:26.924131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-23db65a0-8925-4c8d-9971-81d13f1221ff req-5455a17d-2859-48f7-b00e-20596e86ae88 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:26.947716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-23db65a0-8925-4c8d-9971-81d13f1221ff req-5455a17d-2859-48f7-b00e-20596e86ae88 service nova] Creating event network-vif-unplugged:28679601-624d-40ec-b3d6-a96a019636d0 for instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 on n-h2-768852-23 Jul 14 14:53:26.954221 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-23db65a0-8925-4c8d-9971-81d13f1221ff req-5455a17d-2859-48f7-b00e-20596e86ae88 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065047 Jul 14 14:53:26.956599 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1536/3180] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:26.963657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:26.964807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:26.971588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:26.975887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:26.976843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:26.977926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:26.978606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:27.471088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:27.488916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4025ba03-4341-45e5-94e9-08451683c370 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1517 microversion: 2.1 time: 1.121191 Jul 14 14:53:27.489782 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1645/3181] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:26 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1517 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:27.495030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:27.504796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:27.518700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:27.520497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:27.522288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:27.529486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.147895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:28.184805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfc9a7ef-255b-45ee-8006-350efab38f92 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 1.224779 Jul 14 14:53:28.186118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1537/3182] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:26 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:28.210576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:28.212322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:28.249060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:28.250292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.257729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:28.279664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.290926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:28.306901 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f25a71bf-c50a-415d-a2d3-023cb7ba6208 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1471 microversion: 2.1 time: 0.815828 Jul 14 14:53:28.314193 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1646/3183] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:27 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1471 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:28.520498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:28.521544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:28.533472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:28.533918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.544669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:28.545945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:28.946960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:28.966050 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25a4133c-40a5-4487-ae6b-da29b88d3caf tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1475 microversion: 2.1 time: 0.450763 Jul 14 14:53:28.978841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1647/3184] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:28 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1475 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:29.138457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9e3e5204-4718-4d27-8a45-c99010597503 req-370c946f-c0b1-4ba3-bdd7-0109eb671d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b0e25f9-4c23-4d7b-8c01-fdcaa641c256", "name": "network-vif-deleted", "tag": "28679601-624d-40ec-b3d6-a96a019636d0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:29.191033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e3e5204-4718-4d27-8a45-c99010597503 req-370c946f-c0b1-4ba3-bdd7-0109eb671d60 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.192072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e3e5204-4718-4d27-8a45-c99010597503 req-370c946f-c0b1-4ba3-bdd7-0109eb671d60 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.241217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9e3e5204-4718-4d27-8a45-c99010597503 req-370c946f-c0b1-4ba3-bdd7-0109eb671d60 service nova] Creating event network-vif-deleted:28679601-624d-40ec-b3d6-a96a019636d0 for instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 on n-h2-768852-23 Jul 14 14:53:29.268987 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9e3e5204-4718-4d27-8a45-c99010597503 req-370c946f-c0b1-4ba3-bdd7-0109eb671d60 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133678 Jul 14 14:53:29.270676 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1648/3185] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:29.284155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:29.286819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:29.307373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.308046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.314683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.315328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.511555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:29.536708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:29.549219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:29.551927 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8d0d277-62c6-4376-982c-5e1d1d4cf9a4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.362980 Jul 14 14:53:29.557296 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1538/3186] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:28 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:29.586954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:29.589639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:29.605589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.609107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.612248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:29.615937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:29.687649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:30.300281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:30.329848 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2232b104-91b5-4985-973c-ede65c396e50 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 1.057239 Jul 14 14:53:30.355646 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1649/3187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:29 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:30.396348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:30.401771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:30.437566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.452512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.458767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.461897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.562592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.565268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.566702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lazy-loading 'fault' on Instance uuid 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:53:30.802706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3323669591584736b1e19db6da8fa08f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc60bcb471e44fb8787afd9f5b623ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:30.823093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c6bd9c1a-2e15-4f33-a1f7-ae6e985bf842 tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 200 len: 1310 microversion: 2.1 time: 0.463946 Jul 14 14:53:30.824202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1650/3188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:30 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 1310 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:30.831059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:30.837903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:30.843419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:30.843658 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-06f885e8-fa93-444a-88c8-40339f6e54cc tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1471 microversion: 2.1 time: 1.270698 Jul 14 14:53:30.852114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1539/3189] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:29 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1471 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:30.858400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.862105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:30.866828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:30.867995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:31.383725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:31.390633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:31.409986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:31.411123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:31.413172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:31.416129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:31.893294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:31.911093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:31.914068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:31.919185 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-130f4828-0307-4289-8da9-a32947698c7c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.091943 Jul 14 14:53:31.921079 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1651/3190] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:30 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:31.935788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:31.936894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] [instance: 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:31.961051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:31.964171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:31.970080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:31.975398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:32.082888 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] HTTP exception thrown: Instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 could not be found. Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Request method failure captured: Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 HTTP/1.1 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1zSo5TWIpdEmsSGisFvr9NP3EWIE-q7SRj7dwSHxuxYDjU07ZXSpbk7hw425tfTjngsV9xQggUFrXA2nEGs89atfT46ZuqrH4bmbjoeMa--aEIVCpkQ0IBN3QjWyUg3uFfgvwf0YOb3YgkSyAWCYMcpSGWkA2MfzJTstquOXMAmRU Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: adc60bcb471e44fb8787afd9f5b623ab Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/adc60bcb471e44fb8787afd9f5b623ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: adc60bcb471e44fb8787afd9f5b623ab Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-25066287 Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ListServerFiltersTestJSON-25066287-project Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 3323669591584736b1e19db6da8fa08f Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ListServerFiltersTestJSON-25066287-project Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 could not be found. Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2b0e25f9-4c23-4d7b-8c01-fdcaa641c256'} Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 could not be found. Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 could not be found. Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:53:32.095098 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 could not be found. Jul 14 14:53:32.109191 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:53:32.111480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] Returning 404 to user: Instance 2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:53:32.113998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4f247a3f-fa9c-4dd4-a387-33cacf91d3ab tempest-ListServerFiltersTestJSON-25066287 tempest-ListServerFiltersTestJSON-25066287-project] 10.222.0.98 "GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256" status: 404 len: 111 microversion: 2.1 time: 0.189631 Jul 14 14:53:32.115127 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1652/3191] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:31 2022] GET /compute/v2.1/servers/2b0e25f9-4c23-4d7b-8c01-fdcaa641c256 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:53:32.136114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:32.137181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:32.166185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:32.167712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:32.170268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:32.171498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:33.261673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:33.279241 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-402b81e4-f2a8-474f-8fb4-79c81a592d19 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1724 microversion: 2.1 time: 1.909080 Jul 14 14:53:33.279882 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1540/3192] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:31 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1724 bytes in 1911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:33.327158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:33.329121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:33.359573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:33.360031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:33.364020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:33.366042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.220094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.280800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-495854b1-9409-4ca4-8072-41a3b53114fe tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 2.159271 Jul 14 14:53:34.296267 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1653/3193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:32 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 2180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:34.316198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:34.317160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:34.344828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:34.351345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.353736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:34.354609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:34.670598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.702553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.711686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.724503 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-30d07610-0832-4ff2-886d-7022db135309 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.417330 Jul 14 14:53:34.727618 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1541/3194] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:33 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:34.936134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:34.973849 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c2bac80-4ddf-4171-af7b-35b473224983 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1701 microversion: 2.1 time: 0.673264 Jul 14 14:53:34.999544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b936afbd-e21d-4acf-9ba8-530f159e66d8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:35.005808 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1654/3195] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:34 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1701 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:35.008594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b936afbd-e21d-4acf-9ba8-530f159e66d8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.009376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b936afbd-e21d-4acf-9ba8-530f159e66d8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.046847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b936afbd-e21d-4acf-9ba8-530f159e66d8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Going to try to start instance {{(pid=125966) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:53:35.135074 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b936afbd-e21d-4acf-9ba8-530f159e66d8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action" status: 202 len: 0 microversion: 2.1 time: 0.139046 Jul 14 14:53:35.142146 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1542/3196] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:53:34 2022] POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:53:35.150670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:35.151876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:35.197263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.197837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.198688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.202374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.208368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:35.313640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:35.315341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:35.334019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.334961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:35.336006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:35.337522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:36.234489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:36.252863 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f51d332-da6e-444b-9363-35b00c9634ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 0.942250 Jul 14 14:53:36.274883 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1543/3197] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:35 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:36.310997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:36.312180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:36.376712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:36.384467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:36.390002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:36.392552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.059481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:37.070200 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57da6cf6-14ee-4f58-96db-2a2af0a780fb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1710 microversion: 2.1 time: 1.927047 Jul 14 14:53:37.081876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1655/3198] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:35 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1710 bytes in 1939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:37.298614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:37.300478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:37.321825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.322677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:37.323802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:37.332509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.812522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:38.829951 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d0ca4001-5db2-4ca6-8f08-38100bc04c5c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 1.535550 Jul 14 14:53:38.833337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1656/3199] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:37 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:38.855312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:38.860093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:38.887841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:38.895765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.899539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:38.906129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:38.999362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:39.026544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:39.032012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:39.033311 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f020ee6e-4a06-4e91-964b-ffc034fd88e7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 2.753637 Jul 14 14:53:39.055412 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1544/3200] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:36 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 2779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:39.854969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:39.856600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:39.879079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.881043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:39.883823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:39.885797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:40.809198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:40.828983 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-229f5e7f-6d1e-4a66-9016-48991f27e402 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1710 microversion: 2.1 time: 1.985674 Jul 14 14:53:40.840556 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1657/3201] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:38 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1710 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:40.851543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:40.856648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:40.869236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:40.870083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:40.872770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:40.873526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:41.568655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:41.606577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8281dfc3-f75c-4378-b4bc-1c085c9b9bff tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 1.758207 Jul 14 14:53:41.612081 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1545/3202] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:39 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:41.851891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:41.853437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:41.871843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:41.873330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:41.873890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:41.878104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:41.885952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:41.888171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:41.889801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:41.891180 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af06130a-c2cc-4d67-8e02-b49ab923f877 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.049369 Jul 14 14:53:41.907232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1658/3203] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:40 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:42.638847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:42.639651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:42.656391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:42.656841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:42.657660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:42.658116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:43.289678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:43.323879 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2d34766-4107-48eb-8f02-e3177f2dc7be tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1710 microversion: 2.1 time: 1.478201 Jul 14 14:53:43.370131 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1546/3204] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:41 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1710 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:43.404344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:43.413159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:43.458852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:43.462270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:43.467971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:43.478513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:43.606376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:43.623219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-200a812c-b62f-4bad-a51e-4d0874c5cf5a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 0.989058 Jul 14 14:53:43.628175 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1659/3205] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:42 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:44.219310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:44.253526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:44.255528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:44.268055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e70c3f4-6025-4340-af18-75042e51dd93 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.895583 Jul 14 14:53:44.288388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1547/3206] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:43 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:44.340976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7b66805-1c7e-4211-8587-8ff89b22e22c tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Action: 'create', calling method: .version_select at 0x7fdbf1f19d30>, body: {"keypair": {"name": "tempest-keypair-1956997583", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEOFmE6Kgvv5+P83LPfRrd2QQ+Zgvv/RQyLZ2DptMUY6L2pcn8IJXlDpFXSFMTb8vZq5s9Ba6YVmNWJLMLsxFSGyD/jJz4B33aBbE6VQ7OMxOA/NcdhR4Nf7haRMiYJNXA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:44.343958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:44.344849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:44.364563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.365494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.367066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.369086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.437550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c7b66805-1c7e-4211-8587-8ff89b22e22c tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Getting quotas for project 19d9bbcda6704f11af30fedcc7e5a295. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:53:44.453853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c7b66805-1c7e-4211-8587-8ff89b22e22c tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Getting quotas for user 136f061873624ac4a28fbe80de7c7363 and project 19d9bbcda6704f11af30fedcc7e5a295. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:53:44.563857 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7b66805-1c7e-4211-8587-8ff89b22e22c tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.847625 Jul 14 14:53:44.565798 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1660/3207] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:53:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:53:44.650932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:44.658251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:44.705745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.711361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:44.717807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:44.720867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:45.869431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:45.915030 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee836088-4e72-445f-bc80-884fc42e0621 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 1.272080 Jul 14 14:53:45.922472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1661/3208] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:44 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:45.951231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:45.955110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:45.995191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:45.997572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.004571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.008715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.609839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:46.656074 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11685683-322c-4c41-a015-f339a43021a0 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1714 microversion: 2.1 time: 2.316630 Jul 14 14:53:46.661805 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1548/3209] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:44 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1714 bytes in 2324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:53:46.939015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:46.940156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:46.961979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.968552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:46.972060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:46.974902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:47.179363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:47.204305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:47.211599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:47.219293 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9093414e-9803-4227-8d84-4b11402dd02b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.295060 Jul 14 14:53:47.221684 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1662/3210] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:45 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:47.538392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:47.562389 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-92ecccf1-d5fb-4198-9691-f533a6136c43 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1476 microversion: 2.1 time: 0.625160 Jul 14 14:53:47.565142 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1549/3211] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:46 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1476 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:48.258708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:48.260322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:48.296357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.297151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.300119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.302178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.593924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:48.594731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:48.623004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.625016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.628426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:48.630421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:48.983858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:49.016961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:49.028552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:49.032787 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93fa2fc1-624b-4a01-a3d5-6d1835d48ecd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.795992 Jul 14 14:53:49.033907 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1663/3212] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:48 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:49.496805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:49.513930 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d4f432ae-7501-4e91-b612-f04b98625128 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1475 microversion: 2.1 time: 0.926422 Jul 14 14:53:49.514604 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1550/3213] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:48 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1475 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:50.054914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:50.056589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:50.078205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:50.080445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.083439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:50.086415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.535137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:50.536581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:50.549987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:50.556134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.557499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:50.564133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:50.885060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:50.911792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:50.916525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:50.921330 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85a95200-7ad3-41bc-b4e2-d54bd853fd20 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.868957 Jul 14 14:53:50.922636 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1664/3214] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:50 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:51.942703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:51.943457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:51.956968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:51.957263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:51.959979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:51.961184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:52.437130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:52.454354 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ddafa39-e557-4788-9e8f-f330cc4b54f5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1475 microversion: 2.1 time: 1.925590 Jul 14 14:53:52.455320 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1551/3215] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:50 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1475 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:52.481027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0cc090a1-fdea-4df6-82bf-accf31f1d07f req-530edecf-ec40-41a0-a3fd-654c3bb5af3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:52.526215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0cc090a1-fdea-4df6-82bf-accf31f1d07f req-530edecf-ec40-41a0-a3fd-654c3bb5af3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:52.527854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0cc090a1-fdea-4df6-82bf-accf31f1d07f req-530edecf-ec40-41a0-a3fd-654c3bb5af3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:52.674203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0cc090a1-fdea-4df6-82bf-accf31f1d07f req-530edecf-ec40-41a0-a3fd-654c3bb5af3f service nova] Creating event network-vif-unplugged:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h2-768852-23 Jul 14 14:53:52.697501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-0cc090a1-fdea-4df6-82bf-accf31f1d07f req-530edecf-ec40-41a0-a3fd-654c3bb5af3f service nova] Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:53:52.712673 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0cc090a1-fdea-4df6-82bf-accf31f1d07f req-530edecf-ec40-41a0-a3fd-654c3bb5af3f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.244785 Jul 14 14:53:52.714838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1552/3216] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:53.473542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:53.474610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:53.489514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:53.491197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:53.496753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:53.497477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:53.634776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:53.692950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:53.698301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:53.701588 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e71d7408-87cb-47cf-b7cf-1d7c8bc21815 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.762903 Jul 14 14:53:53.716316 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1665/3217] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:51 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:54.541418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:54.601808 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6a43269-b57a-4dee-8767-2b9b9ec79972 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1475 microversion: 2.1 time: 1.131327 Jul 14 14:53:54.620940 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1553/3218] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:53 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1475 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:54.737462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:54.746965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:54.774825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:54.807515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:54.808825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:54.810243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:54.823224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.038339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-985522f3-c62a-469c-b1fb-529b143a455c req-6b583ddc-5e4d-40fd-823d-10074e8c9601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:55.069529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-985522f3-c62a-469c-b1fb-529b143a455c req-6b583ddc-5e4d-40fd-823d-10074e8c9601 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.070656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-985522f3-c62a-469c-b1fb-529b143a455c req-6b583ddc-5e4d-40fd-823d-10074e8c9601 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.099128 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-985522f3-c62a-469c-b1fb-529b143a455c req-6b583ddc-5e4d-40fd-823d-10074e8c9601 service nova] Creating event network-changed:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h2-768852-23 Jul 14 14:53:55.127703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-985522f3-c62a-469c-b1fb-529b143a455c req-6b583ddc-5e4d-40fd-823d-10074e8c9601 service nova] Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:53:55.171180 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-985522f3-c62a-469c-b1fb-529b143a455c req-6b583ddc-5e4d-40fd-823d-10074e8c9601 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140681 Jul 14 14:53:55.179329 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1554/3219] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:53:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:53:55.652649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:55.656638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:55.705809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.722351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:55.724782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:55.731099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:56.023701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:56.082480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:56.096680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:56.105447 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29fd3ac6-5f45-4fd4-99c1-b7da83de994b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.377491 Jul 14 14:53:56.106615 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1666/3220] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:54 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:56.899899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:56.908110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:56.970900 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d6c2d15-c139-454b-9349-1e1c6e22748d tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1475 microversion: 2.1 time: 1.327980 Jul 14 14:53:56.972393 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1555/3221] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:55 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1475 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:57.135457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:57.136422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:57.172531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:57.180116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:57.181071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:57.189537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:57.190396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:57.724689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1653882029", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "851cd224-663c-4ef8-9a83-b171c6ccf20c"}], "security_groups": [{"name": "tempest-securitygroup--1304634723"}], "key_name": "tempest-keypair-1956997583", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:53:57.744051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=38 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:53:58.562643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:58.586082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:58.589716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:58.593968 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f47777a-63c0-41f9-b0bb-dcf4de171b89 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 1.468806 Jul 14 14:53:58.597899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1667/3222] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:57 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:53:58.610546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:58.612052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:58.630381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:58.631221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:58.633607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:58.637622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:58.714769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] validate_networks() for [('851cd224-663c-4ef8-9a83-b171c6ccf20c', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:53:59.231570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:53:59.249717 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31b3eb5e-4635-49aa-994a-a31f2f04890f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1475 microversion: 2.1 time: 0.649214 Jul 14 14:53:59.250711 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1668/3223] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:53:58 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1475 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:53:59.618600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:53:59.619586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:53:59.652579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.655243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:53:59.656759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:53:59.662568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:00.073810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Getting quotas for project 19d9bbcda6704f11af30fedcc7e5a295. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:00.079082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Getting quotas for user 136f061873624ac4a28fbe80de7c7363 and project 19d9bbcda6704f11af30fedcc7e5a295. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:00.097625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:00.098509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:00.099240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:00.100867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:00.101603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:00.134601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:00.135628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:00.136877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:00.140325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:00.206709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Getting quotas for project 19d9bbcda6704f11af30fedcc7e5a295. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:00.213381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Getting quotas for user 136f061873624ac4a28fbe80de7c7363 and project 19d9bbcda6704f11af30fedcc7e5a295. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:00.227814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:00.231072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:00.302273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.318346 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-09000526-d641-4814-b9ba-9b7b46cf4528 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.598656 Jul 14 14:54:00.319047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1556/3224] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:53:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 2600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:00.351358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1421207514", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "cd2b4d88-ae45-4257-9163-ad5163ce921f"}, {"uuid": "6f2a2fc1-9821-4130-8a56-845d161b876b"}, {"uuid": "cd2b4d88-ae45-4257-9163-ad5163ce921f"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:00.362544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.389989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:00.392635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6213e711-eca0-41d8-b9ff-dc9e9d7f6e7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.778053 Jul 14 14:54:00.407283 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1669/3225] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:53:59 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:54:00.463524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:00.473386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:00.481277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] validate_networks() for [('cd2b4d88-ae45-4257-9163-ad5163ce921f', None, None, None, None, None), ('6f2a2fc1-9821-4130-8a56-845d161b876b', None, None, None, None, None), ('cd2b4d88-ae45-4257-9163-ad5163ce921f', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:00.531532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:00.535597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:00.537943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:00.540426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:02.372801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:02.420462 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1af1d8f6-e894-48cb-b379-747ef8e003a0 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1473 microversion: 2.1 time: 2.008301 Jul 14 14:54:02.423958 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1670/3226] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:00 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1473 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:02.458075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:02.468325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:02.501971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:02.503985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:02.510504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:02.512069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:02.845859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:02.912140 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc99b119-3fe4-451a-a5c2-7b669175432a tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1274 microversion: 2.1 time: 0.475440 Jul 14 14:54:02.921972 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1671/3227] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:02 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1274 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:02.935244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:02.936408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:02.999723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:03.000483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:03.001682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:03.017539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:05.015496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:05.018865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:05.033645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:05.037814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:05.041609 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8816623e-114b-4426-907c-43f5a8fa4fab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 2.118053 Jul 14 14:54:05.042290 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1672/3228] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:02 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 2120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:05.059840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:05.065618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:05.077125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:05.077593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:05.078487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:05.078939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:06.001531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:06.029595 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a99f45d-8973-4cf3-8ca0-622bc72233d2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1470 microversion: 2.1 time: 0.971118 Jul 14 14:54:06.031682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1673/3229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:05 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1470 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:06.048300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:06.052167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:06.075434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:06.078481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:06.081436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:06.083151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:06.243888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:06.263859 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f924e407-f5ff-4bbb-b8a5-6b8234ced50f tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1336 microversion: 2.1 time: 0.230248 Jul 14 14:54:06.265853 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1674/3230] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:06 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1336 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:07.023849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fe579f8-0a50-49e8-9905-78c52c42eee9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Action: 'create', calling method: .version_select at 0x7fdbf1f190d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-856451013", "policies": ["affinity"]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:07.141033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4fe579f8-0a50-49e8-9905-78c52c42eee9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:07.162865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4fe579f8-0a50-49e8-9905-78c52c42eee9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:07.409781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4fe579f8-0a50-49e8-9905-78c52c42eee9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:07.432378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4fe579f8-0a50-49e8-9905-78c52c42eee9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:07.524399 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fe579f8-0a50-49e8-9905-78c52c42eee9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 1.251824 Jul 14 14:54:07.527291 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1675/3231] 10.222.0.98 () {60 vars in 1173 bytes} [Thu Jul 14 14:54:06 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:07.555212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:07.568810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:07.598855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.602602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.603669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.604138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.892534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ad29ffd-d244-4412-85a6-489cf2bfb476 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "POST /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1/action" status: 202 len: 0 microversion: 2.1 time: 0.361287 Jul 14 14:54:07.893592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1676/3232] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:07 2022] POST /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:54:07.934647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:07.950387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:07.985437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.986236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:07.987719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:07.988974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.198991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:08.200050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:08.201145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:08.202343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:08.203518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:08.258400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.259743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.271772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.274008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.350879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Getting quotas for project 5db5c93660ef41728634e8e57039da1a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:08.363884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Getting quotas for user 126f8683e55647bc9605e05c7aa654fd and project 5db5c93660ef41728634e8e57039da1a. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:08.394638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.413054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.417318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.418437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:08.421337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a432e88d-a967-4367-af8e-45b49ab3a8f0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.518617 Jul 14 14:54:08.423245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:08.437330 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1677/3233] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:07 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:08.453861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:08.454975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:08.472929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.474818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.476933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.482972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.621840 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-249c830a-fa7a-44ed-bbed-d01b218181ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.301559 Jul 14 14:54:08.624080 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1557/3234] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 8304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:08.632356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-999b21b9-312b-42aa-b4ad-87c1aaee6fa9 req-47daf988-10e9-4727-899b-f73a52a3c170 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "name": "network-vif-plugged", "status": "completed", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:08.676091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-999b21b9-312b-42aa-b4ad-87c1aaee6fa9 req-47daf988-10e9-4727-899b-f73a52a3c170 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.679254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-999b21b9-312b-42aa-b4ad-87c1aaee6fa9 req-47daf988-10e9-4727-899b-f73a52a3c170 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.706578 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-999b21b9-312b-42aa-b4ad-87c1aaee6fa9 req-47daf988-10e9-4727-899b-f73a52a3c170 service nova] Creating event network-vif-plugged:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:54:08.723156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:08.735685 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-999b21b9-312b-42aa-b4ad-87c1aaee6fa9 req-47daf988-10e9-4727-899b-f73a52a3c170 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109944 Jul 14 14:54:08.738376 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b4536eb-75f3-4a86-9340-94f62a3bcbd4 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1336 microversion: 2.1 time: 0.298052 Jul 14 14:54:08.740347 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1558/3235] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:08.744387 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1678/3236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:08 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1336 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:08.750072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c6523aa6-c49b-4aff-9322-a29d18468ade tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Action: 'create', calling method: .version_select at 0x7fdbf2b6f550>, body: {"server_group": {"name": "tempest-server-group-1108219985", "policies": ["affinity"]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:08.753026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:08.772366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:08.821850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.824115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.826035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:08.827852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c6523aa6-c49b-4aff-9322-a29d18468ade tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:08.828549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:08.845781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c6523aa6-c49b-4aff-9322-a29d18468ade tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:08.958462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c6523aa6-c49b-4aff-9322-a29d18468ade tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:08.965955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-c6523aa6-c49b-4aff-9322-a29d18468ade tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:08.985331 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c6523aa6-c49b-4aff-9322-a29d18468ade tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.242846 Jul 14 14:54:08.986890 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1559/3237] 10.222.0.98 () {60 vars in 1172 bytes} [Thu Jul 14 14:54:08 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:09.005572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-362afc37-766f-4907-99a8-fb107ad74ac5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:09.007178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-362afc37-766f-4907-99a8-fb107ad74ac5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:09.275587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-362afc37-766f-4907-99a8-fb107ad74ac5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.310111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-362afc37-766f-4907-99a8-fb107ad74ac5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1213 microversion: 2.1 time: 0.321306 Jul 14 14:54:09.312495 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1560/3238] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:08 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1213 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:09.351801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32722cc5-0e21-4e82-a7de-fc84a58240d3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Action: 'create', calling method: .version_select at 0x7fdbf2b8a310>, body: {"server_group": {"name": "tempest-server-group-1108219985", "policies": ["affinity"]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:09.438849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-32722cc5-0e21-4e82-a7de-fc84a58240d3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:09.456482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-32722cc5-0e21-4e82-a7de-fc84a58240d3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:09.637093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-32722cc5-0e21-4e82-a7de-fc84a58240d3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:09.650890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-32722cc5-0e21-4e82-a7de-fc84a58240d3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:09.691677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:09.698982 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32722cc5-0e21-4e82-a7de-fc84a58240d3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.363396 Jul 14 14:54:09.703226 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1561/3239] 10.222.0.98 () {60 vars in 1172 bytes} [Thu Jul 14 14:54:09 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:09.741670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:09.743849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:09.769127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.772099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.773353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:09.774099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:09.967083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:09.982343 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c160089-e118-467f-aa63-d335025ae65a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1469 microversion: 2.1 time: 1.236008 Jul 14 14:54:09.986161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1679/3240] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:08 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1469 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:09.997391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9fe3f250-19ce-4c30-9d5d-6fcd5e5417f4 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.088071 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9fe3f250-19ce-4c30-9d5d-6fcd5e5417f4 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/1530eb78-f767-47fc-933c-061bd23153c2" status: 204 len: 0 microversion: 2.1 time: 0.100408 Jul 14 14:54:10.100018 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1680/3241] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:09 2022] DELETE /compute/v2.1/os-server-groups/1530eb78-f767-47fc-933c-061bd23153c2 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:10.156399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.162961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:10.207421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.208209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.209643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.219173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.447921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.461763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.474182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.484359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1adad2df-a862-4b7c-a0a8-d61269490dd0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.775265 Jul 14 14:54:10.486812 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1562/3242] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:09 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:10.512940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b15cd2ad-3dd5-4877-a883-3b787cc02ed8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.582471 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b15cd2ad-3dd5-4877-a883-3b787cc02ed8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.091709 Jul 14 14:54:10.583787 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1563/3243] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:10.606341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.610338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:10.628584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.639837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.641518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:10.642275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:10.730306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.754418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00abdf87-92f9-4885-8bf6-e60145692890 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.651535 Jul 14 14:54:10.775735 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1681/3244] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:10.798380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1fad0a39-6179-4dd2-8acc-1a80f9e361a5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.851855 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1fad0a39-6179-4dd2-8acc-1a80f9e361a5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/966108c1-2a27-4724-9937-0750bc401303" status: 204 len: 0 microversion: 2.1 time: 0.073991 Jul 14 14:54:10.852935 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1682/3245] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:10 2022] DELETE /compute/v2.1/os-server-groups/966108c1-2a27-4724-9937-0750bc401303 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:10.867605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dbdb5c9d-3e0e-4b49-bf12-71fde530c4ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:10.910360 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dbdb5c9d-3e0e-4b49-bf12-71fde530c4ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.046240 Jul 14 14:54:10.913627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1683/3246] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:10.929474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92802369-ab6a-4b0e-8579-dea6fa7536ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Action: 'create', calling method: .version_select at 0x7fdc04256d30>, body: {"server_group": {"name": "tempest-server-group-1791282040", "policies": ["affinity"]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:10.965563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:10.974613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-92802369-ab6a-4b0e-8579-dea6fa7536ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:11.015465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-92802369-ab6a-4b0e-8579-dea6fa7536ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:11.017491 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b7ca440-b461-4de9-9763-c4e6ae41a72a tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1209 microversion: 2.1 time: 0.421209 Jul 14 14:54:11.023782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1564/3247] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:10 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1209 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:11.048353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:11.052104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:11.086818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:11.087305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:11.093261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:11.094162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:11.182619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-92802369-ab6a-4b0e-8579-dea6fa7536ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:11.213078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-92802369-ab6a-4b0e-8579-dea6fa7536ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:11.238243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:11.265285 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92802369-ab6a-4b0e-8579-dea6fa7536ea tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.340265 Jul 14 14:54:11.267090 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1684/3248] 10.222.0.98 () {60 vars in 1172 bytes} [Thu Jul 14 14:54:10 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:12.314059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2233013-ea97-4e36-bf62-309279fcc213 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'create', calling method: .version_select at 0x7fdbf1e94280>, body: {"keypair": {"name": "tempest-keypair-1607770276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/5esE9Ycukc7exfufL8P51r09Hmxw84qMRkrg5ih+5vsLT42teYTgQhrJ/nXKHwLlX1PwyZ0LX14QOQk3c6PZm9hF5pLeSceOsm++0X0QBObSiv6FIDItXYnYN5hDqvA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:12.415859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b2233013-ea97-4e36-bf62-309279fcc213 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:12.440538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b2233013-ea97-4e36-bf62-309279fcc213 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for user 4813aa5acf744a8dac42de00d7e5a519 and project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:12.552840 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2233013-ea97-4e36-bf62-309279fcc213 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.282311 Jul 14 14:54:12.556071 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1685/3249] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:54:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:12.611921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23aadd91-d25a-4cf6-9e85-83879b90cb7b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:12.716803 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23aadd91-d25a-4cf6-9e85-83879b90cb7b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179" status: 204 len: 0 microversion: 2.1 time: 0.146636 Jul 14 14:54:12.718977 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1686/3250] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:12 2022] DELETE /compute/v2.1/os-server-groups/5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:12.743677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:12.745722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:12.756106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:12.757153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:12.758582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:12.759205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.312227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.332682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.347704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.353100 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3e13e16-047e-4048-aacf-8f1234a3d725 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1807 microversion: 2.20 time: 0.627369 Jul 14 14:54:13.356944 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1687/3251] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:12 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1807 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:13.374099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:13.374744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:13.405345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.410814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.411856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.412315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:13.898516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:13.914572 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5fd2f34-d151-46db-bdf1-a72eff025820 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.555240 Jul 14 14:54:13.915952 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1688/3252] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:13 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:13.929634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3e37bcaa-41f5-4b8c-9d84-38baedc8d6c3 req-666d9339-3f2f-47a0-895f-3b875216c2ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "name": "network-vif-plugged", "status": "completed", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:13.958625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3e37bcaa-41f5-4b8c-9d84-38baedc8d6c3 req-666d9339-3f2f-47a0-895f-3b875216c2ad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:13.959549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3e37bcaa-41f5-4b8c-9d84-38baedc8d6c3 req-666d9339-3f2f-47a0-895f-3b875216c2ad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.001184 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3e37bcaa-41f5-4b8c-9d84-38baedc8d6c3 req-666d9339-3f2f-47a0-895f-3b875216c2ad service nova] Creating event network-vif-plugged:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h2-768852-23 Jul 14 14:54:14.016550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-3e37bcaa-41f5-4b8c-9d84-38baedc8d6c3 req-666d9339-3f2f-47a0-895f-3b875216c2ad service nova] Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:54:14.054642 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3e37bcaa-41f5-4b8c-9d84-38baedc8d6c3 req-666d9339-3f2f-47a0-895f-3b875216c2ad service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129487 Jul 14 14:54:14.056423 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1689/3253] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:14.067801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.072864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:14.090873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.097671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.098983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.099856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.226032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:14.251682 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0f9ca76-da62-4989-8eaa-7ca15aab3426 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1469 microversion: 2.1 time: 3.219021 Jul 14 14:54:14.252406 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1565/3254] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:11 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1469 bytes in 3228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:14.271649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78c3b75d-1be0-4beb-be28-0ebbcd36c020 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.303749 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78c3b75d-1be0-4beb-be28-0ebbcd36c020 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.047873 Jul 14 14:54:14.304453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1566/3255] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:14.324513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9c782a23-fcc0-4a43-be81-481e5cf749be tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Action: 'create', calling method: .version_select at 0x7fdbf349d160>, body: {"server_group": {"name": "tempest-server-group-870525159", "policies": ["anti-affinity"]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:14.370365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9c782a23-fcc0-4a43-be81-481e5cf749be tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:14.396251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9c782a23-fcc0-4a43-be81-481e5cf749be tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:14.415859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:14.425816 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ee13db6-b227-4bc1-8113-b8da3b169360 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1271 microversion: 2.1 time: 0.366925 Jul 14 14:54:14.434794 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1690/3256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1271 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:14.439999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.440714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:14.460798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.461444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.462358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.462909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.568279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9c782a23-fcc0-4a43-be81-481e5cf749be tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:14.590238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9c782a23-fcc0-4a43-be81-481e5cf749be tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_groups'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:14.634638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9c782a23-fcc0-4a43-be81-481e5cf749be tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.315312 Jul 14 14:54:14.636616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1567/3257] 10.222.0.98 () {60 vars in 1172 bytes} [Thu Jul 14 14:54:14 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:14.654136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2963149d-bb2a-46b4-a0b9-6ba37bdd575e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.706117 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2963149d-bb2a-46b4-a0b9-6ba37bdd575e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/50764977-332a-4add-bb99-64a95c392f9e" status: 204 len: 0 microversion: 2.1 time: 0.060648 Jul 14 14:54:14.707405 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1568/3258] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:14 2022] DELETE /compute/v2.1/os-server-groups/50764977-332a-4add-bb99-64a95c392f9e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:54:14.728168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5fde693f-71aa-4c98-a7cd-33bc3c75268d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.757295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5fde693f-71aa-4c98-a7cd-33bc3c75268d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.040595 Jul 14 14:54:14.758097 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1569/3259] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:14.950863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:14.951972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:14.992713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:14.993328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:14.997248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.001668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.264571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.299263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.301282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.302471 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7111cbc-672e-4de1-85ab-e3305374aac5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1794 microversion: 2.20 time: 0.866533 Jul 14 14:54:15.316362 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1691/3260] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1794 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:54:15.324078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1973054068", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "2844dcc9-be2e-4ebb-9f06-51cc223e3f5a"}]}, "os:scheduler_hints": {"group": "5f46f1ea-3e6f-48a0-800f-117beb0aac27"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:15.417521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] validate_networks() for [('2844dcc9-be2e-4ebb-9f06-51cc223e3f5a', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:15.725265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:15.747208 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db6eb497-3095-4e51-be91-e4e9faa5a605 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.803102 Jul 14 14:54:15.749001 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1570/3261] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:14 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:15.754444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:15.764499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:15.793137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.793606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:15.794417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:15.797184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.561748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:16.590469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-130ff02a-4c3f-4f71-83fa-337a373ec9ea tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1469 microversion: 2.1 time: 0.836368 Jul 14 14:54:16.596412 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1571/3262] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:15 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1469 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:16.618975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:16.622087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:16.649669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.651473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:16.653687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:16.654163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.607956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:17.609149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:17.609921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:17.610610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:17.612207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:17.645453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:17.675047 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5ba617ca-c551-4861-bedf-a00f9c6898ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1313 microversion: 2.1 time: 1.075932 Jul 14 14:54:17.678289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1572/3263] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:16 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1313 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:17.693287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.705807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.709806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bd1b52c1-fd77-4813-a729-8b691404f15e req-074d42fb-4dcf-4983-98be-97ff522369d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a17e55-bc54-425c-b149-468e6816aa34", "tag": "d0e7224e-98e7-4415-bb27-34578ae62c19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:17.712258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.733600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.785540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bd1b52c1-fd77-4813-a729-8b691404f15e req-074d42fb-4dcf-4983-98be-97ff522369d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.793914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bd1b52c1-fd77-4813-a729-8b691404f15e req-074d42fb-4dcf-4983-98be-97ff522369d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.857914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bd1b52c1-fd77-4813-a729-8b691404f15e req-074d42fb-4dcf-4983-98be-97ff522369d5 service nova] Creating event network-changed:d0e7224e-98e7-4415-bb27-34578ae62c19 for instance 25a17e55-bc54-425c-b149-468e6816aa34 on n-h2-768852-23 Jul 14 14:54:17.875865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:17.884816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:17.906087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bd1b52c1-fd77-4813-a729-8b691404f15e req-074d42fb-4dcf-4983-98be-97ff522369d5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218855 Jul 14 14:54:17.907327 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1573/3264] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:17.912098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:17.921550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:17.926784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:17.931670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:17.958770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.972543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:17.974425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:17.975595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.092664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:18.100370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:18.186157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:18.198928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Getting quotas for user a17530aa8b8a42f19d738bf4aacf3c07 and project 8bc64c6200fc44c1a310da04279013c4. Resources: {'server_group_members'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:18.273900 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-82c31d88-8902-4c4c-8dbf-96dbbaeb7bcf tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.955914 Jul 14 14:54:18.277184 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1692/3265] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:18.283592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:18.284229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:18.308747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:18.314328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.314802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.315695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.316111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.609161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:18.625167 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc4fa0da-a4ff-42aa-843b-9598d54892c6 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.715479 Jul 14 14:54:18.625996 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1574/3266] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:17 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:18.657402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:18.658295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:18.692855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.693711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.695447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:18.701369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:18.778132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:18.790168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2c1e1a4-3046-4006-9d8f-1e749fe04b7c tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1469 microversion: 2.1 time: 0.511350 Jul 14 14:54:18.791177 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1693/3267] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:18 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1469 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:18.797119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57d68c5d-6d2e-42b3-96bb-259b477ce9a7 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:18.797744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57d68c5d-6d2e-42b3-96bb-259b477ce9a7 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:18.993112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57d68c5d-6d2e-42b3-96bb-259b477ce9a7 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:19.018635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lazy-loading 'services' on Instance uuid f6c479bb-f2bf-46bb-a256-cd2431bb117a {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:54:19.021432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57d68c5d-6d2e-42b3-96bb-259b477ce9a7 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1213 microversion: 2.1 time: 0.228175 Jul 14 14:54:19.024841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1694/3268] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:18 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1213 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:19.052541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-349462584", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4c9ebcf6-34f2-4c45-b411-0023bc6fae9d"}], "security_groups": [{"name": "tempest-securitygroup--735887379"}], "key_name": "tempest-keypair-1607770276", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:19.264896 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05322d1c-af82-41e2-8ed0-02249c8468cc tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-volume_attachments/bd791c84-5ce8-4ed9-b49e-5c990e01965b" status: 202 len: 0 microversion: 2.1 time: 0.623441 Jul 14 14:54:19.269914 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1575/3269] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 14:54:18 2022] DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-volume_attachments/bd791c84-5ce8-4ed9-b49e-5c990e01965b => generated 0 bytes in 643 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:54:19.293451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:19.313178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:19.333708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:19.335597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:19.340684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:19.347022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:19.455761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] validate_networks() for [('4c9ebcf6-34f2-4c45-b411-0023bc6fae9d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:54:20.833363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:20.847246 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db31d0be-f88e-4700-9e62-b1ca41eb61df tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1334 microversion: 2.1 time: 1.560310 Jul 14 14:54:20.851634 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1576/3270] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:19 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1334 bytes in 1577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:20.865468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6681f26f-4948-49da-b265-fd08fb2bcf15 req-0291af99-db1b-4247-8cae-756f42b28830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "name": "network-vif-unplugged", "status": "completed", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:20.893114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6681f26f-4948-49da-b265-fd08fb2bcf15 req-0291af99-db1b-4247-8cae-756f42b28830 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:20.893984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6681f26f-4948-49da-b265-fd08fb2bcf15 req-0291af99-db1b-4247-8cae-756f42b28830 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:20.942041 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6681f26f-4948-49da-b265-fd08fb2bcf15 req-0291af99-db1b-4247-8cae-756f42b28830 service nova] Creating event network-vif-unplugged:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h1-768852-23 Jul 14 14:54:20.957718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-6681f26f-4948-49da-b265-fd08fb2bcf15 req-0291af99-db1b-4247-8cae-756f42b28830 service nova] Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:54:20.989639 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6681f26f-4948-49da-b265-fd08fb2bcf15 req-0291af99-db1b-4247-8cae-756f42b28830 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136308 Jul 14 14:54:20.990289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1577/3271] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:21.011309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.012125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.023486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.024040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.024878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.025591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.253564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:54:21.254747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:54:21.260725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:54:21.261293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:54:21.269133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:54:21.285988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.286517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.287554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.288021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.318351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:54:21.323780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for user 4813aa5acf744a8dac42de00d7e5a519 and project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:54:21.343008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:54:21.346115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:54:21.433305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee01e4d7-09f3-4503-b50f-ec6d46d52b30 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.406901 Jul 14 14:54:21.439497 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1695/3272] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:54:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:54:21.451849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.452742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.468272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.469009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.470643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.472839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.543306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.555176 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2894469-4ac5-4856-9c72-f1a61b093e36 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.562670 Jul 14 14:54:21.556471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1578/3273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:20 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:21.562080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.573053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:21.595312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.595759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.602887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:21.605932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:21.818963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:21.840090 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b24317a-524f-409c-82c9-b5ca954fb0e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1271 microversion: 2.1 time: 0.271368 Jul 14 14:54:21.846009 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1579/3274] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:21.855572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-371c64a0-ad56-4285-a2e4-0299c834fcba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:21.865637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-371c64a0-ad56-4285-a2e4-0299c834fcba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:22.034074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-371c64a0-ad56-4285-a2e4-0299c834fcba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:22.049930 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-371c64a0-ad56-4285-a2e4-0299c834fcba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1238 microversion: 2.1 time: 0.202197 Jul 14 14:54:22.050546 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1580/3275] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1238 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:22.055871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:22.056565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:22.076719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.077601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.078967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.079475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.526832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:22.554861 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89b0a1c9-1028-4787-9b90-90270ace86b9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1334 microversion: 2.1 time: 0.502564 Jul 14 14:54:22.568114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1581/3276] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:22 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1334 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:22.586169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:22.587941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:22.610330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.618890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.621347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.622276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.836638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:22.847568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad3b1dbb-9aeb-4a97-b305-4a23701a142b tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1469 microversion: 2.1 time: 1.401919 Jul 14 14:54:22.851184 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1696/3277] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:21 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1469 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:22.870977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:22.872010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:22.882447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:DELETE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:22.885021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.886517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.887607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:22.888263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:22.896938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:22.974414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:22.984892 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fa999cfd-f808-4c91-b286-ab298f49003c tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1271 microversion: 2.1 time: 0.119874 Jul 14 14:54:22.996047 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1697/3278] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:22 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:23.041475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c6f77d38-2927-48eb-abc7-90a42c0494d3 req-7c82996b-2737-43c9-9fd4-414ef3be6721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:23.052129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c6f77d38-2927-48eb-abc7-90a42c0494d3 req-7c82996b-2737-43c9-9fd4-414ef3be6721 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.053167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c6f77d38-2927-48eb-abc7-90a42c0494d3 req-7c82996b-2737-43c9-9fd4-414ef3be6721 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.069441 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c6f77d38-2927-48eb-abc7-90a42c0494d3 req-7c82996b-2737-43c9-9fd4-414ef3be6721 service nova] Creating event network-changed:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h1-768852-23 Jul 14 14:54:23.078774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-c6f77d38-2927-48eb-abc7-90a42c0494d3 req-7c82996b-2737-43c9-9fd4-414ef3be6721 service nova] Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 14:54:23.092601 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c6f77d38-2927-48eb-abc7-90a42c0494d3 req-7c82996b-2737-43c9-9fd4-414ef3be6721 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055145 Jul 14 14:54:23.093606 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1698/3279] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:23.102403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:23.103350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:23.111351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.111964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.113640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.114271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.207348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:23.218684 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02b8e934-2e7b-4e4d-9c74-9e1dbb20ede5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1290 microversion: 2.1 time: 0.120763 Jul 14 14:54:23.219431 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1699/3280] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:23 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1290 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:23.570236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:23.587079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:23.588048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:23.594784 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1eb6f23a-3fef-41f4-9100-56fd629f5017 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 1.023846 Jul 14 14:54:23.596478 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1582/3281] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:22 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:23.601008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.601453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.605618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.607973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.884933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:23.886472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:23.901671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.903190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.905098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:23.906180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:23.909542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:23.928418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30e1d9ec-9d54-4914-99e3-b59e24421535 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.345201 Jul 14 14:54:23.933872 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1700/3282] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:23 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:24.003081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.004043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.018943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.019737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.020767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.021401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.188533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.212183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd331594-ba31-483e-9d18-334fa65e202b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1271 microversion: 2.1 time: 0.212525 Jul 14 14:54:24.213276 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1701/3283] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:23 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:24.240718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.244929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.271003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.272144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.275252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.277916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.493354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:24.522225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-200a27c3-47a9-471e-b203-642a9bcaebf9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1290 microversion: 2.1 time: 0.288097 Jul 14 14:54:24.579684 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1702/3284] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1290 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:24.616154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:24.616904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:24.629040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.629506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:24.630328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:24.630777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.000963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:25.071756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:25.091803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89c8b091-fd78-4ecc-8c07-bdd38cd01fe2 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1469 microversion: 2.1 time: 1.211137 Jul 14 14:54:25.103160 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1583/3285] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:23 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1469 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:25.131688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:25.138425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:25.192911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.194155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.200149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.204493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.526548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:25.539390 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-013e557e-0346-437d-be02-0594d3312732 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.927125 Jul 14 14:54:25.550590 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1703/3286] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:24 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:25.566014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:25.567058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:25.587556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.588865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:25.591580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:25.591580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.481932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:26.512086 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68a05aa7-78a7-4f49-af5b-a939f769a2e5 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 1.405754 Jul 14 14:54:26.513515 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1584/3287] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:25 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:26.521054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f0aa5eb5-9744-4a81-b18c-6604b77d91b6 req-0ba761f8-e7f2-47a6-bc88-b332b1d5781f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a17e55-bc54-425c-b149-468e6816aa34", "name": "network-vif-plugged", "status": "completed", "tag": "d0e7224e-98e7-4415-bb27-34578ae62c19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:26.564214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f0aa5eb5-9744-4a81-b18c-6604b77d91b6 req-0ba761f8-e7f2-47a6-bc88-b332b1d5781f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.568367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f0aa5eb5-9744-4a81-b18c-6604b77d91b6 req-0ba761f8-e7f2-47a6-bc88-b332b1d5781f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.614973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f0aa5eb5-9744-4a81-b18c-6604b77d91b6 req-0ba761f8-e7f2-47a6-bc88-b332b1d5781f service nova] Creating event network-vif-plugged:d0e7224e-98e7-4415-bb27-34578ae62c19 for instance 25a17e55-bc54-425c-b149-468e6816aa34 on n-h2-768852-23 Jul 14 14:54:26.640127 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f0aa5eb5-9744-4a81-b18c-6604b77d91b6 req-0ba761f8-e7f2-47a6-bc88-b332b1d5781f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123974 Jul 14 14:54:26.642118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1585/3288] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:26.652572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:26.654507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:26.689050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.690527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.692569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.695482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.890109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:26.934975 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84ad3f3e-d0f9-41a6-b089-702f01984181 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 1.382501 Jul 14 14:54:26.936176 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1704/3289] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:25 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:26.946748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:26.949372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:26.968917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.969654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:26.970956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:26.971777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.441094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:27.456044 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1765c80-9999-40bc-9ad5-3e102f7cbd96 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1462 microversion: 2.1 time: 0.517879 Jul 14 14:54:27.458061 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1705/3290] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:26 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1462 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:27.468380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:27.470335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:27.485156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.486030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.487648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.488510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.882408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:27.914575 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c5a14bd-68ed-43ee-b3f3-967e879f8914 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1296 microversion: 2.1 time: 1.269775 Jul 14 14:54:27.931439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1586/3291] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:26 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1296 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:27.931439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:27.931439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:27.975563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.977376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:27.978386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:27.979896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.339616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:28.367380 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2c2b507-0c26-42d8-befe-83fe275690e3 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1404 microversion: 2.1 time: 0.906746 Jul 14 14:54:28.383694 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1706/3292] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:27 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1404 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:28.402883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:28.404252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:28.420688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.426781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.429880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.431302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.786438 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-560408a3-32a8-4c4c-90ef-3ba57488e0a8 tempest-MigrationsAdminTest-1585593062 tempest-MigrationsAdminTest-1585593062-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1615 microversion: 2.1 time: 0.867761 Jul 14 14:54:28.801773 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1587/3293] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:27 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1615 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:28.814105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:28.818793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:28.837889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.840149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:28.842443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:28.844196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.344223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:29.360531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77b26888-82f4-4d17-8a6e-ef3924b78875 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.982497 Jul 14 14:54:29.366542 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1707/3294] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:28 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:29.384506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:29.385042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:29.403811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.406885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.408284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.411414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.489465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:29.497855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:29.513563 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf364eb7-1b58-402a-8595-da4055aeba28 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.709890 Jul 14 14:54:29.529235 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1588/3295] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:28 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:29.548237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6fada03b-16d2-4e89-8232-d9e07686186c req-d96eb6b8-33c8-4eda-a245-54ff711109b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "name": "network-vif-plugged", "status": "completed", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:29.590810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6fada03b-16d2-4e89-8232-d9e07686186c req-d96eb6b8-33c8-4eda-a245-54ff711109b6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.591992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6fada03b-16d2-4e89-8232-d9e07686186c req-d96eb6b8-33c8-4eda-a245-54ff711109b6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.667029 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6fada03b-16d2-4e89-8232-d9e07686186c req-d96eb6b8-33c8-4eda-a245-54ff711109b6 service nova] Creating event network-vif-plugged:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h1-768852-23 Jul 14 14:54:29.700589 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c48fe96-209a-42cf-9907-6f4922ee1094 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 204 len: 0 microversion: 2.1 time: 0.331243 Jul 14 14:54:29.705704 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1708/3296] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:29 2022] DELETE /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:29.709068 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6fada03b-16d2-4e89-8232-d9e07686186c req-d96eb6b8-33c8-4eda-a245-54ff711109b6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177236 Jul 14 14:54:29.726519 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1589/3297] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:29.727449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:29.731260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:29.752009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.752493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.754180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.754713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.764756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:29.766057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:29.799234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.851764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.045s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:29.854952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:29.855755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.285961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:30.296448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7457309-e997-4f98-a3f0-bb2f8918c9bc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.588312 Jul 14 14:54:30.303846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1709/3298] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:29 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:30.314659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:30.315592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:30.337028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.345335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.347033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.347699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.615029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:30.629223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89599b3c-6c11-4512-ad6b-711db2fd102b tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1590 microversion: 2.1 time: 0.896083 Jul 14 14:54:30.630806 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1590/3299] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:29 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1590 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:30.639018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-81e45d0f-baf1-480b-abad-2f109643b27b req-51317412-1767-447a-9e74-2f1c7a7eba7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4", "tag": "8c5865bb-0f64-4b14-bd51-ea3f7f5d765b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:30.656565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81e45d0f-baf1-480b-abad-2f109643b27b req-51317412-1767-447a-9e74-2f1c7a7eba7e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.657320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-81e45d0f-baf1-480b-abad-2f109643b27b req-51317412-1767-447a-9e74-2f1c7a7eba7e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.675821 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-81e45d0f-baf1-480b-abad-2f109643b27b req-51317412-1767-447a-9e74-2f1c7a7eba7e service nova] Creating event network-changed:8c5865bb-0f64-4b14-bd51-ea3f7f5d765b for instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 on n-h2-768852-23 Jul 14 14:54:30.686315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:30.687777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-81e45d0f-baf1-480b-abad-2f109643b27b req-51317412-1767-447a-9e74-2f1c7a7eba7e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054693 Jul 14 14:54:30.688964 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1591/3300] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:30.695565 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6b337c4-b31c-41ff-a3fc-1c1cd26f0c2e tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1468 microversion: 2.1 time: 0.390342 Jul 14 14:54:30.696333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:30.698294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:30.701457 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1710/3301] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:30 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1468 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:30.706508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:30.709068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:30.720571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.721784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.723177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.723780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.749146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.750847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:30.752786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:30.753598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.188140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:31.210723 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e26b3d16-ebdc-4326-b72f-9470a8635c29 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.507520 Jul 14 14:54:31.212721 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1711/3302] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:30 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:31.223313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:31.225324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:31.240562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.241727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.243621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.245746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.327595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:31.329057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:31.336056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=42 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:31.432900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:31.447908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e6bb86d7-0b04-4859-8602-1165bb59ce65 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.752626 Jul 14 14:54:31.448586 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1592/3303] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:30 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:31.463097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b1d74da-dbd7-4e2b-b83c-0e7799a8d2ea tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:31.471603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b1d74da-dbd7-4e2b-b83c-0e7799a8d2ea tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.472476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b1d74da-dbd7-4e2b-b83c-0e7799a8d2ea tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.507160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b1d74da-dbd7-4e2b-b83c-0e7799a8d2ea tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:54:31.597226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b1d74da-dbd7-4e2b-b83c-0e7799a8d2ea tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action" status: 202 len: 0 microversion: 2.1 time: 0.138179 Jul 14 14:54:31.598535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1593/3304] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:31 2022] POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:54:31.607094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-1c29e168-f8d1-437d-af8e-c5e8974af058 req-5c53a61a-09c2-45f6-aff2-95638b47fe75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:31.621717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:31.628503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1c29e168-f8d1-437d-af8e-c5e8974af058 req-5c53a61a-09c2-45f6-aff2-95638b47fe75 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.629552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1c29e168-f8d1-437d-af8e-c5e8974af058 req-5c53a61a-09c2-45f6-aff2-95638b47fe75 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.649489 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-1c29e168-f8d1-437d-af8e-c5e8974af058 req-5c53a61a-09c2-45f6-aff2-95638b47fe75 service nova] Creating event network-changed:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:54:31.659674 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-1c29e168-f8d1-437d-af8e-c5e8974af058 req-5c53a61a-09c2-45f6-aff2-95638b47fe75 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058264 Jul 14 14:54:31.660983 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1594/3305] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:31.677970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:31.679257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:31.689259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.690233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.691354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.692694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.738721 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f364ffe4-2667-47be-9a83-57fe39b76c24 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.523607 Jul 14 14:54:31.741137 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1712/3306] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:54:31 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34/os-interface => generated 284 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:31.757877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:31.759126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:31.779421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.780693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:31.783474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:31.785272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.039210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=44 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:32.283625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:32.298689 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4857cfc9-25c2-44b9-9ef0-37113c50bd94 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1678 microversion: 2.1 time: 0.554809 Jul 14 14:54:32.301314 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1713/3307] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:31 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1678 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:32.311942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:32.313330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:32.318706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:32.333206 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57026d48-a2c5-4253-8cc0-60f8b67ada22 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.670312 Jul 14 14:54:32.334220 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1595/3308] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:31 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:32.339593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.340070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.340886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.341330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.347074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:32.347593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:32.365308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.365775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.366625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.367082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.829580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:32.839174 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fac0183b-3b43-405f-8089-14fae1ebbb3a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1468 microversion: 2.1 time: 0.535102 Jul 14 14:54:32.841736 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1714/3309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:32 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1468 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:32.848177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:32.849301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:32.859718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:32.865285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.868392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.870643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.874601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.882035 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e53aaf3-798c-4733-b024-37fdab033709 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.546608 Jul 14 14:54:32.882976 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1596/3310] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:32 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:32.891710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-48bf8a29-df58-420f-bd4c-786b9d343535 req-ee40c535-517b-4768-97d9-6437d7e67af5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "tag": "8419bbc2-8d6f-4f52-96b2-a1548012d848"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:32.911371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-48bf8a29-df58-420f-bd4c-786b9d343535 req-ee40c535-517b-4768-97d9-6437d7e67af5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:32.911942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-48bf8a29-df58-420f-bd4c-786b9d343535 req-ee40c535-517b-4768-97d9-6437d7e67af5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:32.940831 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-48bf8a29-df58-420f-bd4c-786b9d343535 req-ee40c535-517b-4768-97d9-6437d7e67af5 service nova] Creating event network-changed:8419bbc2-8d6f-4f52-96b2-a1548012d848 for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:54:32.959509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-48bf8a29-df58-420f-bd4c-786b9d343535 req-ee40c535-517b-4768-97d9-6437d7e67af5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074880 Jul 14 14:54:32.972564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1597/3311] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:33.308349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:33.327955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:33.330170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:33.348806 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ec08651-b593-440b-938c-e2d8616235ef tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.505628 Jul 14 14:54:33.356559 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1715/3312] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:32 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:33.359736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.382585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.390373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.391509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.394512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:33.395410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:33.417406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.418155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.419155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.420881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.768734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:33.779347 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-957c27f9-d8d4-49e3-8e76-69cfade20b36 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.420706 Jul 14 14:54:33.781557 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1716/3313] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:33 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:33.787048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1ae85afe-15c6-4616-9b2f-b99897935cd2 req-b4465dde-1a41-4f5f-9a38-3a0ad33df905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3894ad12-6405-4be6-8ff0-c13ca23b17c1", "name": "network-vif-deleted", "tag": "c8022571-5bc8-478b-baad-2d69d0393f62"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:33.798425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1ae85afe-15c6-4616-9b2f-b99897935cd2 req-b4465dde-1a41-4f5f-9a38-3a0ad33df905 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.799764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1ae85afe-15c6-4616-9b2f-b99897935cd2 req-b4465dde-1a41-4f5f-9a38-3a0ad33df905 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.817823 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1ae85afe-15c6-4616-9b2f-b99897935cd2 req-b4465dde-1a41-4f5f-9a38-3a0ad33df905 service nova] Creating event network-vif-deleted:c8022571-5bc8-478b-baad-2d69d0393f62 for instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 on n-h1-768852-23 Jul 14 14:54:33.823885 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1ae85afe-15c6-4616-9b2f-b99897935cd2 req-b4465dde-1a41-4f5f-9a38-3a0ad33df905 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040551 Jul 14 14:54:33.824511 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1717/3314] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:33.865347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:33.867607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:33.880093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.880908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:33.882318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:33.883127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.052683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:34.069098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ff0c873f-b493-4fd5-b687-79971ac94c4f tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 200 len: 1426 microversion: 2.1 time: 0.211348 Jul 14 14:54:34.070349 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1718/3315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:33 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 1426 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:34.095897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:34.098770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:34.113311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.114070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.115847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.118558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.600832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:34.607915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:34.622655 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-730c833a-3c6b-4b1b-b1b2-9a7eff796330 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1678 microversion: 2.1 time: 1.307172 Jul 14 14:54:34.627402 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1598/3316] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:33 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1678 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:34.632824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:34.634000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:34.643976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.644995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.647034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.647850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.664946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3d91f64-f77b-4e0e-9adf-f0b4b63a7cd9 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.590993 Jul 14 14:54:34.667051 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1719/3317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:34 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:34.807862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:34.814159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:34.832103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.833377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:34.835236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:34.836452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.283491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:35.316978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cca0c55f-c876-40c5-9561-6dbda6d59e88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.514819 Jul 14 14:54:35.320610 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1720/3318] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:34 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:35.339931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8052c830-1618-42e5-8039-87d19dfe823a req-78681d35-fd72-4c39-80cf-83b979c07459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "tag": "a4e9d10b-8acc-4c16-9cc0-483c4b951e76"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:35.357584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:35.409309 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-043b0f7f-f5c2-4121-b893-a822239f6376 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.763835 Jul 14 14:54:35.413644 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1599/3319] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:34 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:35.415029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8052c830-1618-42e5-8039-87d19dfe823a req-78681d35-fd72-4c39-80cf-83b979c07459 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.418974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8052c830-1618-42e5-8039-87d19dfe823a req-78681d35-fd72-4c39-80cf-83b979c07459 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.468620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:35.474232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 3894ad12-6405-4be6-8ff0-c13ca23b17c1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:35.521193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8052c830-1618-42e5-8039-87d19dfe823a req-78681d35-fd72-4c39-80cf-83b979c07459 service nova] Creating event network-changed:a4e9d10b-8acc-4c16-9cc0-483c4b951e76 for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:54:35.529942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.532334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.541518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.542576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.556176 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8052c830-1618-42e5-8039-87d19dfe823a req-78681d35-fd72-4c39-80cf-83b979c07459 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228254 Jul 14 14:54:35.560276 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1721/3320] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:35.613314 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] HTTP exception thrown: Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 could not be found. Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Request method failure captured: Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 HTTP/1.1 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CyPxonqoC79xVmQfxQDMwSviJYNcyj4tt7cv97Q0dPRDK5okiDq_8xnld6SYhlVR4W1whD7O1cHwWitUj7QYEtJjM49LRP7DZIZmlsSavDx4C957jKy6QZ8ft9CvhlN4QiVskB8LfNLeA5OM428pLnj3w5QVVAzO6aoxj-RL1aOprg Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a185fa24374c417aa2bb9302a608cbcd Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 could not be found. Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '3894ad12-6405-4be6-8ff0-c13ca23b17c1'} Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 could not be found. Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 could not be found. Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:35.618938 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 could not be found. Jul 14 14:54:35.628689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:35.631600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Returning 404 to user: Instance 3894ad12-6405-4be6-8ff0-c13ca23b17c1 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:35.633513 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa173d01-7e60-448d-a479-b6636722d6c1 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1" status: 404 len: 111 microversion: 2.1 time: 0.216052 Jul 14 14:54:35.634800 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1600/3321] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:35 2022] GET /compute/v2.1/servers/3894ad12-6405-4be6-8ff0-c13ca23b17c1 => generated 111 bytes in 220 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:35.666760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:35.678120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:35.683811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:35.690920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:35.720001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.724001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.730889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.731761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.733282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.734094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.735428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:35.737112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:35.831561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:36.065202 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a338eb0d-d4fd-46da-9422-3d96a19d3f83 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "DELETE /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 204 len: 0 microversion: 2.1 time: 0.419861 Jul 14 14:54:36.065892 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1722/3322] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:35 2022] DELETE /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:36.071717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:36.077573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:36.101754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.101754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.102471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.102471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.459324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:36.459569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:36.469583 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6d6466b-aa32-49d4-a19b-1a5e5a22c2e8 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.402280 Jul 14 14:54:36.470283 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1723/3323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:36 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:36.491064 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5910f588-9882-4f5e-a97d-e1e9dd15dd84 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1678 microversion: 2.1 time: 0.831004 Jul 14 14:54:36.497126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:36.497460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:36.511386 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1601/3324] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:35 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1678 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:36.516323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.517081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.518034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.519423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.539536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:36.542099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:36.570403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.572739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:36.575739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:36.581683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.113902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:37.141323 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-10ff38a7-379d-4202-8784-ada68fd665e4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.623444 Jul 14 14:54:37.142451 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1602/3325] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:36 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:37.161814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:37.163498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:37.178355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.180557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.182657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.184002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.233131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:37.359580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:37.387099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7693d029-4b31-4dba-9dd4-8ebbc4891312 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1533 microversion: 2.1 time: 0.894716 Jul 14 14:54:37.388318 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1724/3326] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:36 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1533 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:37.400450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:37.402374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:37.450617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.451721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.453295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.454175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.570960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:37.597146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79d64c4d-fc9a-4877-a018-358afae01ebc tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.448052 Jul 14 14:54:37.601330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1603/3327] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:37 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:37.620611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-60cba4f6-0e48-4ef3-b953-d0991ec690c4 req-aee933f7-859d-4ebe-acf8-d0130f75d423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "tag": "967bac30-e279-44ce-88b9-7d03dd9035ba"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:37.631686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-60cba4f6-0e48-4ef3-b953-d0991ec690c4 req-aee933f7-859d-4ebe-acf8-d0130f75d423 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.632420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-60cba4f6-0e48-4ef3-b953-d0991ec690c4 req-aee933f7-859d-4ebe-acf8-d0130f75d423 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.647744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-60cba4f6-0e48-4ef3-b953-d0991ec690c4 req-aee933f7-859d-4ebe-acf8-d0130f75d423 service nova] Creating event network-changed:967bac30-e279-44ce-88b9-7d03dd9035ba for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:54:37.655143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-60cba4f6-0e48-4ef3-b953-d0991ec690c4 req-aee933f7-859d-4ebe-acf8-d0130f75d423 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051508 Jul 14 14:54:37.656396 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1604/3328] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:37.669157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-156ae651-4e38-4a91-ab7a-e6efff3304ec req-ecd2c0f2-295e-4b41-b1a0-1d2c897ff3b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4", "name": "network-vif-plugged", "status": "completed", "tag": "8c5865bb-0f64-4b14-bd51-ea3f7f5d765b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:37.680076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-156ae651-4e38-4a91-ab7a-e6efff3304ec req-ecd2c0f2-295e-4b41-b1a0-1d2c897ff3b9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.680539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-156ae651-4e38-4a91-ab7a-e6efff3304ec req-ecd2c0f2-295e-4b41-b1a0-1d2c897ff3b9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.704403 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-156ae651-4e38-4a91-ab7a-e6efff3304ec req-ecd2c0f2-295e-4b41-b1a0-1d2c897ff3b9 service nova] Creating event network-vif-plugged:8c5865bb-0f64-4b14-bd51-ea3f7f5d765b for instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 on n-h2-768852-23 Jul 14 14:54:37.711647 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-156ae651-4e38-4a91-ab7a-e6efff3304ec req-ecd2c0f2-295e-4b41-b1a0-1d2c897ff3b9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053281 Jul 14 14:54:37.713198 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1605/3329] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:37.721980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:37.722965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:37.731997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.732979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.734056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.734683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.862792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:37.883787 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-155b650b-9e71-4f56-af3a-2a8f6e23f52e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1590 microversion: 2.1 time: 0.490701 Jul 14 14:54:37.885513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1725/3330] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:37 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1590 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:37.910576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:37.913157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:37.935038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.936262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:37.937728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:37.943301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:38.281481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:38.296611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de2686e6-6692-4ad8-85a7-2ac03f3ab403 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.581012 Jul 14 14:54:38.322245 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1606/3331] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:37 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:38.335536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5e28599f-8f9b-4e9a-bf46-14036f415a17 req-63290e07-d460-492d-a6de-a3e205920b42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25a17e55-bc54-425c-b149-468e6816aa34", "tag": "d0e7224e-98e7-4415-bb27-34578ae62c19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:38.355250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5e28599f-8f9b-4e9a-bf46-14036f415a17 req-63290e07-d460-492d-a6de-a3e205920b42 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:38.356499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5e28599f-8f9b-4e9a-bf46-14036f415a17 req-63290e07-d460-492d-a6de-a3e205920b42 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:38.384517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5e28599f-8f9b-4e9a-bf46-14036f415a17 req-63290e07-d460-492d-a6de-a3e205920b42 service nova] Creating event network-changed:d0e7224e-98e7-4415-bb27-34578ae62c19 for instance 25a17e55-bc54-425c-b149-468e6816aa34 on n-h2-768852-23 Jul 14 14:54:38.395453 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5e28599f-8f9b-4e9a-bf46-14036f415a17 req-63290e07-d460-492d-a6de-a3e205920b42 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070219 Jul 14 14:54:38.397267 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1607/3332] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:38.401361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:38.409090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:38.410910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:38.414315 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f4e6001-b893-4af4-b6db-75a6fa472b2f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1678 microversion: 2.1 time: 0.513723 Jul 14 14:54:38.415230 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1726/3333] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:37 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1678 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:38.426658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:38.444437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:38.445238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:38.446778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:38.448467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:38.450838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:38.487853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:38.488196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:38.491630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:38.492221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.070003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:39.090204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f6ccb51-1b02-4928-be37-c5e128bc64a7 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1533 microversion: 2.1 time: 0.673095 Jul 14 14:54:39.103305 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1727/3334] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:38 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1533 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:39.111840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:39.112884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:39.126190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:39.126597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.128000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:39.128910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.170939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:39.204230 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-87d5c8c0-47c0-4b8c-8790-2b66e58a1242 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.804384 Jul 14 14:54:39.215172 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1608/3335] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:38 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:39.329893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:39.330915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:39.389927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:39.390717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.392155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:39.392902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:39.941056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:39.985040 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c6b915ef-e0ea-40cd-88c0-470be7635c66 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.879320 Jul 14 14:54:39.986802 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1728/3336] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:39 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:40.001658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:40.003533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:40.020410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:40.020732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.021594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.023158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.024122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.046491 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a8ea930-4f8e-48f4-99f1-c704231256ce tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1313 microversion: 2.1 time: 0.723304 Jul 14 14:54:40.047573 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1609/3337] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:39 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1313 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:40.073807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:40.121800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:40.123026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:40.134626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.136368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.137944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.138993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.239171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.240083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.243407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lazy-loading 'fault' on Instance uuid 1e4a08ed-12f8-478a-bfa6-c8595567db46 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:54:40.405137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:40.424652 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-266a3ec3-84c6-4662-820c-c44fdef4c877 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 200 len: 1368 microversion: 2.1 time: 0.309179 Jul 14 14:54:40.426305 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1610/3338] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:40 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:40.467073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:40.471369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:40.484039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.484779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.486335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.487326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.612211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:40.625476 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1a9a938c-b650-4d54-ad31-269055d6bccf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1678 microversion: 2.1 time: 0.635202 Jul 14 14:54:40.626593 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1729/3339] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:39 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1678 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:40.646363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-89598567-a1bd-4f98-b8dc-45a96ff252f7 req-c918a48f-6224-4609-84e7-6908b5c5c0b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-plugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:40.658554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-89598567-a1bd-4f98-b8dc-45a96ff252f7 req-c918a48f-6224-4609-84e7-6908b5c5c0b4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.659100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-89598567-a1bd-4f98-b8dc-45a96ff252f7 req-c918a48f-6224-4609-84e7-6908b5c5c0b4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.676590 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-89598567-a1bd-4f98-b8dc-45a96ff252f7 req-c918a48f-6224-4609-84e7-6908b5c5c0b4 service nova] Creating event network-vif-plugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:54:40.688172 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-89598567-a1bd-4f98-b8dc-45a96ff252f7 req-c918a48f-6224-4609-84e7-6908b5c5c0b4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058971 Jul 14 14:54:40.690159 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1730/3340] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:40.702339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0c792309-9769-450b-b4f3-b18ab026860f req-9f998c0c-e416-4507-b3a8-668bc92893cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4a08ed-12f8-478a-bfa6-c8595567db46", "name": "network-vif-deleted", "tag": "a5e31359-5eb4-48c1-a98f-9293ae868878"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:40.720156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0c792309-9769-450b-b4f3-b18ab026860f req-9f998c0c-e416-4507-b3a8-668bc92893cd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:40.721241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0c792309-9769-450b-b4f3-b18ab026860f req-9f998c0c-e416-4507-b3a8-668bc92893cd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:40.745396 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0c792309-9769-450b-b4f3-b18ab026860f req-9f998c0c-e416-4507-b3a8-668bc92893cd service nova] Creating event network-vif-deleted:a5e31359-5eb4-48c1-a98f-9293ae868878 for instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 on n-h2-768852-23 Jul 14 14:54:40.755916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0c792309-9769-450b-b4f3-b18ab026860f req-9f998c0c-e416-4507-b3a8-668bc92893cd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062692 Jul 14 14:54:40.760172 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1731/3341] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:40.979159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:40.989360 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4bd2991-9467-403d-bc1a-7631e0cdd8f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.561487 Jul 14 14:54:40.990172 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1611/3342] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:40 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:41.009747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.011123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.023703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.024506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.026794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.027607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.068299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.069639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.078824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.079841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.080852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.081523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.238245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:41.251720 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5bbff60-3792-4f55-9b97-2b556678c901 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.248602 Jul 14 14:54:41.253046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1732/3343] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:41.458724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.460372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 1e4a08ed-12f8-478a-bfa6-c8595567db46] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.464048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:41.473640 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26b2da32-c25a-4975-944d-b3a961791b91 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1499 microversion: 2.1 time: 0.411136 Jul 14 14:54:41.479317 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1612/3344] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1499 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:41.484190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.485046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.486346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.487133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.505015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b4dbd58-ebb1-4e69-a605-580f2c26862a tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.526982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.server_groups [None req-0b4dbd58-ebb1-4e69-a605-580f2c26862a tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Querying cell 851d78d8-3f11-4b86-a356-449411903277(cell1) for 1 instances {{(pid=125966) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:54:41.528312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b4dbd58-ebb1-4e69-a605-580f2c26862a tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.529108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b4dbd58-ebb1-4e69-a605-580f2c26862a tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.530595 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] HTTP exception thrown: Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 could not be found. Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Request method failure captured: Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 HTTP/1.1 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CyPxonqoC79xVmQfxQDMwSviJYNcyj4tt7cv97Q0dPRDK5okiDq_8xnld6SYhlVR4W1whD7O1cHwWitUj7QYEtJjM49LRP7DZIZmlsSavDx4C957jKy6QZ8ft9CvhlN4QiVskB8LfNLeA5OM428pLnj3w5QVVAzO6aoxj-RL1aOprg Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a185fa24374c417aa2bb9302a608cbcd Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 could not be found. Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '1e4a08ed-12f8-478a-bfa6-c8595567db46'} Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 could not be found. Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 could not be found. Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:41.534757 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 could not be found. Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Returning 404 to user: Instance 1e4a08ed-12f8-478a-bfa6-c8595567db46 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6edba6e4-78c5-4975-a897-2bb9189b8785 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46" status: 404 len: 111 microversion: 2.1 time: 0.086063 Jul 14 14:54:41.541601 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1733/3345] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/servers/1e4a08ed-12f8-478a-bfa6-c8595567db46 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:41.550485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2f640d4c-8219-4062-9d44-59b807599007 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '.version_select at 0x7fdbf1ef3c10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.567029 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b4dbd58-ebb1-4e69-a605-580f2c26862a tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups/5f46f1ea-3e6f-48a0-800f-117beb0aac27" status: 200 len: 221 microversion: 2.1 time: 0.069502 Jul 14 14:54:41.568157 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1613/3346] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/os-server-groups/5f46f1ea-3e6f-48a0-800f-117beb0aac27 => generated 221 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:41.583983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.584470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.593635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2f640d4c-8219-4062-9d44-59b807599007 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789208874" status: 202 len: 0 microversion: 2.1 time: 0.042514 Jul 14 14:54:41.594935 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1734/3347] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:54:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1789208874 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:54:41.605340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.605808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.606830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.607331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.640405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:41.659565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.660735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.677411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.678207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.681253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.683087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.757704 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b728444a-c3e2-4d96-8ddd-ac99cd433d09 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 204 len: 0 microversion: 2.1 time: 0.178005 Jul 14 14:54:41.759318 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1614/3348] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:41 2022] DELETE /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:41.771169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:41.772124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:41.779953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.780822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:41.781816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:41.782439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.026549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:42.040505 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8fe1701c-925b-42d2-be10-40ddab3974e7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1678 microversion: 2.1 time: 0.386326 Jul 14 14:54:42.043202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1735/3349] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1678 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:42.059107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:42.061022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:42.071823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:42.073204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.075334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:42.076503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.549112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:42.560418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3f65cd0-3218-4d2b-aba0-c0c687a92a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.514949 Jul 14 14:54:42.561437 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1736/3350] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:42 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:42.569225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:42.570170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:42.583422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:42.584233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.585057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:42.585671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:42.625457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:42.644469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7ff698e-e0ed-4df8-b40d-dd68a5f92bef tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1505 microversion: 2.1 time: 0.878467 Jul 14 14:54:42.656000 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1615/3351] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:41 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1505 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:42.975842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:43.005688 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4c538f84-89b3-48aa-80e7-2e0c4021f812 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.442635 Jul 14 14:54:43.013192 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1737/3352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:42 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:43.077792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:43.078944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:43.093917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.095429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.097352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.098614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.419734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:43.432871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:43.433533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:43.434222 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4ea0967-b42c-464f-a63e-812d0bc8747e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1655 microversion: 2.1 time: 0.367330 Jul 14 14:54:43.435511 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1616/3353] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:43 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1655 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:43.453418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.454269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.455366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.456055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.456739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-920c9a01-cb00-4b83-8b3b-5f2fe821c3db tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:43.476983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-920c9a01-cb00-4b83-8b3b-5f2fe821c3db tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.477455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-920c9a01-cb00-4b83-8b3b-5f2fe821c3db tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.486164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:43.535617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-920c9a01-cb00-4b83-8b3b-5f2fe821c3db tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Going to try to start instance {{(pid=125966) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 14:54:43.640909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:43.679003 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e27d48c-6027-45d8-836a-b5a038cba894 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "DELETE /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 204 len: 0 microversion: 2.1 time: 0.250082 Jul 14 14:54:43.681082 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1738/3354] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:43 2022] DELETE /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:43.691017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:43.693320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:43.706501 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-920c9a01-cb00-4b83-8b3b-5f2fe821c3db tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action" status: 202 len: 0 microversion: 2.1 time: 0.256546 Jul 14 14:54:43.708720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.708972 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1617/3355] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:54:43 2022] POST /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:54:43.710062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.711875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.713573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.717365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:43.733278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:43.770226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.774140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:43.785398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:43.787724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.010880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.020675 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3219d5a9-7244-4c90-889c-579c7d7e5cb4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1363 microversion: 2.1 time: 0.337504 Jul 14 14:54:44.022160 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1739/3356] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:43 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1363 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.028087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.029163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.038053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.038948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.040194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.042395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.254741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.282285 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc5fc839-25ff-485d-a307-32299492ecbc tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1505 microversion: 2.1 time: 0.571677 Jul 14 14:54:44.295788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1618/3357] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:43 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1505 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.309071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.310643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.327512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.328344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.330235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.331075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.363532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.380335 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ee1c6b0-04d5-46d4-bb78-b9861734af76 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1469 microversion: 2.1 time: 0.351618 Jul 14 14:54:44.381114 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1740/3358] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:44.384442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:44.406645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:44.407475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:44.433122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.433860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.439013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:44.440051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:44.769006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:44.785314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9d827d8a-e1f1-4538-bc91-f51f798bca80 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.389952 Jul 14 14:54:44.804640 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1741/3359] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.059927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.063329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.103491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.109411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.112306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.116545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.121696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.139715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-932802b9-3044-4460-8450-189054c15aca tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1664 microversion: 2.1 time: 0.834463 Jul 14 14:54:45.141807 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1619/3360] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:44 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1664 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.314628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.316187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.340546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.341503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.343082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.343960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.579632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a17530aa8b8a42f19d738bf4aacf3c07', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8bc64c6200fc44c1a310da04279013c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.599247 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-597ade96-163c-4391-9d3e-2873c5d53643 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 200 len: 1463 microversion: 2.1 time: 0.300807 Jul 14 14:54:45.603480 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1620/3361] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 1463 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.673219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-12b291af-bdd1-484a-b3e5-6cc579da750e req-5e026b00-f59d-463c-b432-8c6a1363c0bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4", "name": "network-vif-deleted", "tag": "8c5865bb-0f64-4b14-bd51-ea3f7f5d765b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:45.719057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-12b291af-bdd1-484a-b3e5-6cc579da750e req-5e026b00-f59d-463c-b432-8c6a1363c0bd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.732240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-12b291af-bdd1-484a-b3e5-6cc579da750e req-5e026b00-f59d-463c-b432-8c6a1363c0bd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.773610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-12b291af-bdd1-484a-b3e5-6cc579da750e req-5e026b00-f59d-463c-b432-8c6a1363c0bd service nova] Creating event network-vif-deleted:8c5865bb-0f64-4b14-bd51-ea3f7f5d765b for instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 on n-h2-768852-23 Jul 14 14:54:45.814476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-12b291af-bdd1-484a-b3e5-6cc579da750e req-5e026b00-f59d-463c-b432-8c6a1363c0bd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.211956 Jul 14 14:54:45.816645 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1621/3362] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:45.835897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.837699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.858122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.859450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.861530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.863851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.889273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:45.904992 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c742227-0d3a-450d-8299-fc9b010478d3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1550 microversion: 2.1 time: 0.855441 Jul 14 14:54:45.906986 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1742/3363] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1550 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:45.917014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:45.919179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:45.932197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.933569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:45.935497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:45.936714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.239835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:46.269940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e08628a-6e45-46b5-b293-02a181a334d8 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1469 microversion: 2.1 time: 0.449929 Jul 14 14:54:46.270988 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1622/3364] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1469 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:46.290681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:46.294155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:46.319426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.320228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.321640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.329395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.523118 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c671dc11-3d35-468e-b647-1d0a5a301d99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.245350 Jul 14 14:54:46.535832 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1623/3365] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:54:46 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/os-interface => generated 285 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:46.542803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:46.543970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:46.555491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.556376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:46.558809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:46.559806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.037265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:47.081426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4de0587a-5810-4147-9fd3-d4e70dd6d65c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 1.171285 Jul 14 14:54:47.090542 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1743/3366] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:45 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:47.108761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:47.134375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:47.137602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:47.152446 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d4d128ca-a25b-460d-acc0-1f1aafbfe593 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1664 microversion: 2.1 time: 0.616807 Jul 14 14:54:47.162138 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1624/3367] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:46 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1664 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:47.176470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.183118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.188313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.190937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.303753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:47.311230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:47.355409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.356843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.360534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.362032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.655729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:47.656191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:47.656660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lazy-loading 'fault' on Instance uuid 81a29ece-d239-4899-aa1b-85f8151eb874 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:54:47.885912 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 HTTP/1.1 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4'} Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:47.915166 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:47.920109 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:47.922464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:47.927456 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d0bd9c4-5e6a-468b-9349-995c88770e8e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 404 len: 111 microversion: 2.1 time: 0.833390 Jul 14 14:54:47.930326 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1744/3368] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:47 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 111 bytes in 838 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:47.972491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-925b963d-754a-4568-90e8-c600b7b3bb8d req-050484cf-b8f7-4fb0-9081-c3a1f05a4c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81a29ece-d239-4899-aa1b-85f8151eb874", "name": "network-vif-deleted", "tag": "2094fac7-8553-4153-abaa-974a33ab82cf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:48.037357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-925b963d-754a-4568-90e8-c600b7b3bb8d req-050484cf-b8f7-4fb0-9081-c3a1f05a4c26 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.038710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-925b963d-754a-4568-90e8-c600b7b3bb8d req-050484cf-b8f7-4fb0-9081-c3a1f05a4c26 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.080706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:48.085440 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-925b963d-754a-4568-90e8-c600b7b3bb8d req-050484cf-b8f7-4fb0-9081-c3a1f05a4c26 service nova] Creating event network-vif-deleted:2094fac7-8553-4153-abaa-974a33ab82cf for instance 81a29ece-d239-4899-aa1b-85f8151eb874 on n-h1-768852-23 Jul 14 14:54:48.102808 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-925b963d-754a-4568-90e8-c600b7b3bb8d req-050484cf-b8f7-4fb0-9081-c3a1f05a4c26 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146667 Jul 14 14:54:48.109093 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1745/3369] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:48.113606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81437790-01f6-49b0-880f-0929b77db86a tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 200 len: 1303 microversion: 2.1 time: 0.817522 Jul 14 14:54:48.115288 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1625/3370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:47 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 1303 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:48.120741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:48.121655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:48.128537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.129292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.130581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.130864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-163987d1-082d-40a8-a623-027c4f79239e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:48.131444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.193414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.compute.server_groups [None req-163987d1-082d-40a8-a623-027c4f79239e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Querying cell 851d78d8-3f11-4b86-a356-449411903277(cell1) for 1 instances {{(pid=125965) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:54:48.195351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163987d1-082d-40a8-a623-027c4f79239e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.196485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163987d1-082d-40a8-a623-027c4f79239e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.354714 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-163987d1-082d-40a8-a623-027c4f79239e tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.242310 Jul 14 14:54:48.366196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1746/3371] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 14:54:48 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:48.374962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:48.377235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:48.397581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.404084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.405605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.406379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.789747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:48.802786 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bbd5a7a2-56c1-4f8a-adf1-fd47792b243c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1664 microversion: 2.1 time: 0.434507 Jul 14 14:54:48.803885 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1747/3372] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:48 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1664 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:48.836925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1e1837a-7b9a-4678-8dc9-d951a5f36ff3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:48.873336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.compute.server_groups [None req-e1e1837a-7b9a-4678-8dc9-d951a5f36ff3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Querying cell 851d78d8-3f11-4b86-a356-449411903277(cell1) for 1 instances {{(pid=125965) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Jul 14 14:54:48.875124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1e1837a-7b9a-4678-8dc9-d951a5f36ff3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.875910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1e1837a-7b9a-4678-8dc9-d951a5f36ff3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.912301 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1e1837a-7b9a-4678-8dc9-d951a5f36ff3 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups/5f46f1ea-3e6f-48a0-800f-117beb0aac27" status: 200 len: 183 microversion: 2.1 time: 0.090712 Jul 14 14:54:48.922466 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1748/3373] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 14:54:48 2022] GET /compute/v2.1/os-server-groups/5f46f1ea-3e6f-48a0-800f-117beb0aac27 => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:48.927388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:48.928405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:48.945505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.947094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.949681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:48.950708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:48.989164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:49.018878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:49.021524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-91d0f1d3-cffc-4ea8-b916-9209856a8e50 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.904539 Jul 14 14:54:49.023009 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1626/3374] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:48 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:49.025914 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16a13acf-0813-4f78-8d0e-07fb59701b98 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments/9edc9e47-0d96-4aa0-a155-9b9f8f375821" status: 200 len: 194 microversion: 2.20 time: 0.108123 Jul 14 14:54:49.027066 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1749/3375] 10.222.0.98 () {60 vars in 1453 bytes} [Thu Jul 14 14:54:48 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments/9edc9e47-0d96-4aa0-a155-9b9f8f375821 => generated 194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:49.033974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.035099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.057103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.057932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.059408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.065173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.111767 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 HTTP/1.1 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4'} Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:49.121119 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.132629 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.133817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.134465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.134642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.134818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60f1c6f8-65e7-4515-a847-8f61806b80e5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 404 len: 111 microversion: 2.1 time: 0.102540 Jul 14 14:54:49.134818 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1627/3376] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:49.143935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.145087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] [instance: c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.145298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.145900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.147082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.147702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.156581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.157300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.158533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.159429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.203260 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 HTTP/1.1 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4'} Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.216851 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. Jul 14 14:54:49.225524 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.229796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.235386 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-52c3dc4d-e8a9-4e2c-ae2d-70988f38e1b5 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4" status: 404 len: 111 microversion: 2.1 time: 0.100430 Jul 14 14:54:49.246776 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1628/3377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/c5a8fa34-1c16-4bcf-8fba-f2e7e95649f4 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:49.256513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.257922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 81a29ece-d239-4899-aa1b-85f8151eb874] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.269841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.271013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.272732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.273770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.305350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] HTTP exception thrown: Instance 81a29ece-d239-4899-aa1b-85f8151eb874 could not be found. Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Request method failure captured: Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 HTTP/1.1 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0CyPxonqoC79xVmQfxQDMwSviJYNcyj4tt7cv97Q0dPRDK5okiDq_8xnld6SYhlVR4W1whD7O1cHwWitUj7QYEtJjM49LRP7DZIZmlsSavDx4C957jKy6QZ8ft9CvhlN4QiVskB8LfNLeA5OM428pLnj3w5QVVAzO6aoxj-RL1aOprg Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a185fa24374c417aa2bb9302a608cbcd Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 81a29ece-d239-4899-aa1b-85f8151eb874 could not be found. Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '81a29ece-d239-4899-aa1b-85f8151eb874'} Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81a29ece-d239-4899-aa1b-85f8151eb874 could not be found. Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81a29ece-d239-4899-aa1b-85f8151eb874 could not be found. Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.309941 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81a29ece-d239-4899-aa1b-85f8151eb874 could not be found. Jul 14 14:54:49.319208 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.324940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Returning 404 to user: Instance 81a29ece-d239-4899-aa1b-85f8151eb874 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.325402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5db2aa12-c240-4e0f-8559-cc1466cd1f20 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874" status: 404 len: 111 microversion: 2.1 time: 0.074573 Jul 14 14:54:49.327190 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1629/3378] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/81a29ece-d239-4899-aa1b-85f8151eb874 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:49.336654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d013bccb-310a-4680-a11b-8c48ad680646 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.349521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d013bccb-310a-4680-a11b-8c48ad680646 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance group 50764977-332a-4add-bb99-64a95c392f9e could not be found. Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d013bccb-310a-4680-a11b-8c48ad680646 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-server-groups/50764977-332a-4add-bb99-64a95c392f9e HTTP/1.1 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance group 50764977-332a-4add-bb99-64a95c392f9e could not be found. Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '50764977-332a-4add-bb99-64a95c392f9e'} Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 50764977-332a-4add-bb99-64a95c392f9e could not be found. Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 50764977-332a-4add-bb99-64a95c392f9e could not be found. Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.361333 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 50764977-332a-4add-bb99-64a95c392f9e could not be found. Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.377182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d013bccb-310a-4680-a11b-8c48ad680646 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance group 50764977-332a-4add-bb99-64a95c392f9e could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.380120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d013bccb-310a-4680-a11b-8c48ad680646 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/50764977-332a-4add-bb99-64a95c392f9e" status: 404 len: 117 microversion: 2.1 time: 0.046891 Jul 14 14:54:49.381520 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1630/3379] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/os-server-groups/50764977-332a-4add-bb99-64a95c392f9e => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:49.400894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.401867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.415755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.417316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.419528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.419809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lazy-loading 'services' on Instance uuid 805e64f7-049d-4034-97c5-bf65914f6396 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:54:49.420523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.497345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:49.589186 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30baa1cb-0418-4910-a97a-f31c84f197ce tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments/9edc9e47-0d96-4aa0-a155-9b9f8f375821" status: 202 len: 0 microversion: 2.20 time: 0.470160 Jul 14 14:54:49.590849 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1750/3380] 10.222.0.98 () {60 vars in 1456 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments/9edc9e47-0d96-4aa0-a155-9b9f8f375821 => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 14:54:49.600459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b801fd8-7df7-401b-88f4-ee7cf3ea3e4d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.619565 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3b801fd8-7df7-401b-88f4-ee7cf3ea3e4d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance group 5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 could not be found. Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b801fd8-7df7-401b-88f4-ee7cf3ea3e4d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-server-groups/5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 HTTP/1.1 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance group 5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 could not be found. Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179'} Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 could not be found. Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 could not be found. Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.621872 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 could not be found. Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b801fd8-7df7-401b-88f4-ee7cf3ea3e4d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance group 5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b801fd8-7df7-401b-88f4-ee7cf3ea3e4d tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179" status: 404 len: 117 microversion: 2.1 time: 0.031221 Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1751/3381] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/os-server-groups/5a4f0a71-8b02-44c8-a9aa-ff1ac5b86179 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:49.641041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.644794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.660082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.660544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.661412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.662121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.741016 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de3f93c9-60c8-46fd-8a6f-9058e66b8e43 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.104147 Jul 14 14:54:49.752162 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1752/3382] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:49.757653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fb071bd-546a-4ea6-a09a-4af222fc0d6b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.783785 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6fb071bd-546a-4ea6-a09a-4af222fc0d6b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance group 966108c1-2a27-4724-9937-0750bc401303 could not be found. Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fb071bd-546a-4ea6-a09a-4af222fc0d6b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-server-groups/966108c1-2a27-4724-9937-0750bc401303 HTTP/1.1 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance group 966108c1-2a27-4724-9937-0750bc401303 could not be found. Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '966108c1-2a27-4724-9937-0750bc401303'} Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 966108c1-2a27-4724-9937-0750bc401303 could not be found. Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 966108c1-2a27-4724-9937-0750bc401303 could not be found. Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.789579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.794333 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.794333 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.794333 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.794333 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.794333 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 966108c1-2a27-4724-9937-0750bc401303 could not be found. Jul 14 14:54:49.794333 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.794720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ff47520-b21b-4115-80da-9ce08380b962 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "DELETE /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 204 len: 0 microversion: 2.1 time: 0.399729 Jul 14 14:54:49.795446 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1631/3383] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:49.796798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fb071bd-546a-4ea6-a09a-4af222fc0d6b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance group 966108c1-2a27-4724-9937-0750bc401303 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.798234 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6fb071bd-546a-4ea6-a09a-4af222fc0d6b tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/966108c1-2a27-4724-9937-0750bc401303" status: 404 len: 117 microversion: 2.1 time: 0.044609 Jul 14 14:54:49.801879 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1753/3384] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/os-server-groups/966108c1-2a27-4724-9937-0750bc401303 => generated 117 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:54:49.812516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a318e398-dfa5-4e42-a748-060ef70f1a51 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.817378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.818603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.832305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a318e398-dfa5-4e42-a748-060ef70f1a51 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] HTTP exception thrown: Instance group 1530eb78-f767-47fc-933c-061bd23153c2 could not be found. Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a318e398-dfa5-4e42-a748-060ef70f1a51 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Request method failure captured: Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-server-groups/1530eb78-f767-47fc-933c-061bd23153c2 HTTP/1.1 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4LDA4cqTC2Csy3z0ymnIRffw7IZViy0if_ZcfzHu6IKV58uEQ0PvrbFxWrBOSg0WYg2o0eIlTleL6JTsqyUWqra32A4mOE6oYe7heEZAxt7VMrETrxgBNomZOprHQ3nmRrIUXJslRjUodPZDfdOwC3R-NIMOtpRQqOnWkrXSTdGro Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8bc64c6200fc44c1a310da04279013c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8bc64c6200fc44c1a310da04279013c4 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerGroupTestJSON-1245736510 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a17530aa8b8a42f19d738bf4aacf3c07 Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerGroupTestJSON-1245736510-project Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance group 1530eb78-f767-47fc-933c-061bd23153c2 could not be found. Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '1530eb78-f767-47fc-933c-061bd23153c2'} Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 1530eb78-f767-47fc-933c-061bd23153c2 could not be found. Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 1530eb78-f767-47fc-933c-061bd23153c2 could not be found. Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.834738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:49.839288 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:49.839288 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:49.839288 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:49.839288 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:49.839288 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 1530eb78-f767-47fc-933c-061bd23153c2 could not be found. Jul 14 14:54:49.839288 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:49.839747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.841574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a318e398-dfa5-4e42-a748-060ef70f1a51 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Returning 404 to user: Instance group 1530eb78-f767-47fc-933c-061bd23153c2 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:49.842799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a318e398-dfa5-4e42-a748-060ef70f1a51 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/1530eb78-f767-47fc-933c-061bd23153c2" status: 404 len: 117 microversion: 2.1 time: 0.034433 Jul 14 14:54:49.844130 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1754/3385] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:49 2022] DELETE /compute/v2.1/os-server-groups/1530eb78-f767-47fc-933c-061bd23153c2 => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:54:49.847237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.852164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.853051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.856700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:49.859504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:49.870740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.877897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:49.879099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:49.879830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.340064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:50.347797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:50.355800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31378d42-1eb7-40bc-924e-8c99215587bd tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1668 microversion: 2.1 time: 0.508687 Jul 14 14:54:50.359202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1755/3386] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1668 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:50.364638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-588cf6ea-f8d6-4256-85ef-0a8c1deb8d03 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1468 microversion: 2.1 time: 0.562983 Jul 14 14:54:50.376043 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1632/3387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:49 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1468 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:50.380901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2916a363-082a-4995-b961-f03ee0888b03 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:50.387562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:50.388912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:50.403950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.405187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.409581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.411666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.471606 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2916a363-082a-4995-b961-f03ee0888b03 tempest-ServerGroupTestJSON-1245736510 tempest-ServerGroupTestJSON-1245736510-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/5f46f1ea-3e6f-48a0-800f-117beb0aac27" status: 204 len: 0 microversion: 2.1 time: 0.109894 Jul 14 14:54:50.474873 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1756/3388] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 14:54:50 2022] DELETE /compute/v2.1/os-server-groups/5f46f1ea-3e6f-48a0-800f-117beb0aac27 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:50.501670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cff0007d-8e7b-437b-a77c-1c0b2566c24b req-78a87e48-805f-459f-a016-14bb4b1e1bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "name": "network-vif-plugged", "status": "completed", "tag": "a4e9d10b-8acc-4c16-9cc0-483c4b951e76"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:50.543980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cff0007d-8e7b-437b-a77c-1c0b2566c24b req-78a87e48-805f-459f-a016-14bb4b1e1bbc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.544723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cff0007d-8e7b-437b-a77c-1c0b2566c24b req-78a87e48-805f-459f-a016-14bb4b1e1bbc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.606564 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cff0007d-8e7b-437b-a77c-1c0b2566c24b req-78a87e48-805f-459f-a016-14bb4b1e1bbc service nova] Creating event network-vif-plugged:a4e9d10b-8acc-4c16-9cc0-483c4b951e76 for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:54:50.654853 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cff0007d-8e7b-437b-a77c-1c0b2566c24b req-78a87e48-805f-459f-a016-14bb4b1e1bbc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163719 Jul 14 14:54:50.664296 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1757/3389] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:50.775737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:50.777751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:50.807952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.810808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.815170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:50.819448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:50.954956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1cf1af12-6409-4710-82ff-8f009185779b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.190858 Jul 14 14:54:50.957794 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1758/3390] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:50 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:54:50.971062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-866862c2-fa83-4f86-9667-9dae4e292f3e req-bebebed7-d0ad-421b-9f16-acb1824c9d7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:50.999311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-866862c2-fa83-4f86-9667-9dae4e292f3e req-bebebed7-d0ad-421b-9f16-acb1824c9d7f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.000846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-866862c2-fa83-4f86-9667-9dae4e292f3e req-bebebed7-d0ad-421b-9f16-acb1824c9d7f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.042139 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-866862c2-fa83-4f86-9667-9dae4e292f3e req-bebebed7-d0ad-421b-9f16-acb1824c9d7f service nova] Creating event network-changed:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:54:51.068674 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-866862c2-fa83-4f86-9667-9dae4e292f3e req-bebebed7-d0ad-421b-9f16-acb1824c9d7f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108388 Jul 14 14:54:51.069827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1759/3391] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:51.108556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:51.129945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95878e3d-e642-4763-8bc8-2b8747217ff3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.752299 Jul 14 14:54:51.130561 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1633/3392] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:50 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:51.397134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.402931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:51.425275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.432918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.434647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:51.442857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:51.983162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:51.985917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.014242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.015029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.016490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.017440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.107685 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ff45404-d106-4aee-ba95-b0cb91886c24 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.138253 Jul 14 14:54:52.115560 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1634/3393] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:51 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:54:52.130942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:52.142990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4759ac1-3934-4546-a146-037643bba0ac tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1468 microversion: 2.1 time: 0.756387 Jul 14 14:54:52.151513 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1760/3394] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:51 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1468 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:52.157172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:52.160049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:52.166919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:52.179107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.181919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.184272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:52.185531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:52.991057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:53.034753 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd986253-d2d1-4076-a4a8-61f1f91e91a0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.888530 Jul 14 14:54:53.036705 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1635/3395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:52 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:54:53.099805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e3ea57a4-ce69-4b4d-93c6-a0140bcaf774 req-0628fbeb-37fb-445b-80c5-223db1d1e7fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "name": "network-vif-plugged", "status": "completed", "tag": "8419bbc2-8d6f-4f52-96b2-a1548012d848"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:53.133219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.150444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.181767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.184331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e3ea57a4-ce69-4b4d-93c6-a0140bcaf774 req-0628fbeb-37fb-445b-80c5-223db1d1e7fd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.185930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.188647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e3ea57a4-ce69-4b4d-93c6-a0140bcaf774 req-0628fbeb-37fb-445b-80c5-223db1d1e7fd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.192925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.192925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.249912 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e3ea57a4-ce69-4b4d-93c6-a0140bcaf774 req-0628fbeb-37fb-445b-80c5-223db1d1e7fd service nova] Creating event network-vif-plugged:8419bbc2-8d6f-4f52-96b2-a1548012d848 for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:54:53.269594 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e3ea57a4-ce69-4b4d-93c6-a0140bcaf774 req-0628fbeb-37fb-445b-80c5-223db1d1e7fd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181629 Jul 14 14:54:53.270935 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1761/3396] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:53.279826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3a55330d-d0e2-434a-acb0-8934be354db9 req-f106263b-659b-4d25-a77f-66741d9d99e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "570420f0-9812-4164-b136-02e3f8d2068d", "name": "network-vif-deleted", "tag": "f3325209-778c-4269-b0f6-c9756ff6ad15"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:53.308631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3a55330d-d0e2-434a-acb0-8934be354db9 req-f106263b-659b-4d25-a77f-66741d9d99e1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.326830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3a55330d-d0e2-434a-acb0-8934be354db9 req-f106263b-659b-4d25-a77f-66741d9d99e1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.351855 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3a55330d-d0e2-434a-acb0-8934be354db9 req-f106263b-659b-4d25-a77f-66741d9d99e1 service nova] Creating event network-vif-deleted:f3325209-778c-4269-b0f6-c9756ff6ad15 for instance 570420f0-9812-4164-b136-02e3f8d2068d on n-h2-768852-23 Jul 14 14:54:53.364475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3a55330d-d0e2-434a-acb0-8934be354db9 req-f106263b-659b-4d25-a77f-66741d9d99e1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091816 Jul 14 14:54:53.366982 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1762/3397] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:53.378015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b9bef798-d4a4-49b0-947f-28723345a730 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.248801 Jul 14 14:54:53.380987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:53.382219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:53.389632 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1636/3398] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:53.397058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.401818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.403033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.403774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.487427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:53.488269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:53.488960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lazy-loading 'fault' on Instance uuid 570420f0-9812-4164-b136-02e3f8d2068d {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:54:53.591643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a185fa24374c417aa2bb9302a608cbcd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e29ad9c0a3664715b0a8384bc9840b7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:53.602754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e9fb4e0-4c1e-4c26-af02-fd9724c30546 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 200 len: 1303 microversion: 2.1 time: 0.233841 Jul 14 14:54:53.615686 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1763/3399] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:53 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 1303 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:54.081457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.096231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.158473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.160410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.167749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.169453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.397254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.398207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.429922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.430384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.431380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.431832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.498420 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0cea257a-5319-496d-9a6a-d57a9858e852 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.105137 Jul 14 14:54:54.499631 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1764/3400] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:54.610488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:54.621711 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6904a5e-d1ac-44ad-b8f3-45c15847e7e4 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.568757 Jul 14 14:54:54.622654 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1637/3401] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:54.651096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:54.653576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] [instance: 570420f0-9812-4164-b136-02e3f8d2068d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:54.667310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.674822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.677045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:54.677932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:54.720586 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] HTTP exception thrown: Instance 570420f0-9812-4164-b136-02e3f8d2068d could not be found. Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Request method failure captured: Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d HTTP/1.1 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0CyPxonqoC79xVmQfxQDMwSviJYNcyj4tt7cv97Q0dPRDK5okiDq_8xnld6SYhlVR4W1whD7O1cHwWitUj7QYEtJjM49LRP7DZIZmlsSavDx4C957jKy6QZ8ft9CvhlN4QiVskB8LfNLeA5OM428pLnj3w5QVVAzO6aoxj-RL1aOprg Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e29ad9c0a3664715b0a8384bc9840b7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e29ad9c0a3664715b0a8384bc9840b7b Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-MigrationsAdminTest-1128176140 Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a185fa24374c417aa2bb9302a608cbcd Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-MigrationsAdminTest-1128176140-project Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 570420f0-9812-4164-b136-02e3f8d2068d could not be found. Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '570420f0-9812-4164-b136-02e3f8d2068d'} Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 570420f0-9812-4164-b136-02e3f8d2068d could not be found. Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 570420f0-9812-4164-b136-02e3f8d2068d could not be found. Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:54:54.726545 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 570420f0-9812-4164-b136-02e3f8d2068d could not be found. Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] Returning 404 to user: Instance 570420f0-9812-4164-b136-02e3f8d2068d could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:54:54.740240 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef84dc1c-6112-4961-aedb-2fdc3b2d39a5 tempest-MigrationsAdminTest-1128176140 tempest-MigrationsAdminTest-1128176140-project] 10.222.0.98 "GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d" status: 404 len: 111 microversion: 2.1 time: 0.112359 Jul 14 14:54:54.745472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1765/3402] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:54 2022] GET /compute/v2.1/servers/570420f0-9812-4164-b136-02e3f8d2068d => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:54:55.300256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ba650cc5-5853-43f4-bb61-37c908c496ef req-4e16b46c-4b8d-40fc-8a3c-ccc70c7f0cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "name": "network-vif-plugged", "status": "completed", "tag": "967bac30-e279-44ce-88b9-7d03dd9035ba"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:54:55.324293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ba650cc5-5853-43f4-bb61-37c908c496ef req-4e16b46c-4b8d-40fc-8a3c-ccc70c7f0cca service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.328119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ba650cc5-5853-43f4-bb61-37c908c496ef req-4e16b46c-4b8d-40fc-8a3c-ccc70c7f0cca service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.335717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:54:55.360636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ba650cc5-5853-43f4-bb61-37c908c496ef req-4e16b46c-4b8d-40fc-8a3c-ccc70c7f0cca service nova] Creating event network-vif-plugged:967bac30-e279-44ce-88b9-7d03dd9035ba for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:54:55.374028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ba650cc5-5853-43f4-bb61-37c908c496ef req-4e16b46c-4b8d-40fc-8a3c-ccc70c7f0cca service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081273 Jul 14 14:54:55.376958 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1638/3403] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:54:55.530452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:55.531636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:55.564407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.570387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.573681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.577934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.640812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:55.641572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:55.678088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.680580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.685243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:55.691471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:55.739829 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9629849b-4da9-41ed-8dfe-e8f0087677e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.228137 Jul 14 14:54:55.756192 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1766/3404] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:55 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:56.171855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:56.191873 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e59f036b-803f-4514-8a6d-9f44a7ad9c9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.551707 Jul 14 14:54:56.210554 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1639/3405] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:55 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:56.767737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:56.772624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:56.806363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.810385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.812033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:56.815649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:56.920155 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3848856d-efc3-47a1-9802-4b78c3ddfcd3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160029 Jul 14 14:54:56.931789 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1767/3406] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:56 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:57.218715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:57.220031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:57.239674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:57.240146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:57.242264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:57.242709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:57.767786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:57.786577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2bd7996a-6555-4113-a4d7-a1eda1098c64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1355 microversion: 2.1 time: 0.571759 Jul 14 14:54:57.789011 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1640/3407] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:57 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1355 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:57.940086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:57.944124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.002967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.007708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.012337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.017241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.153681 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-83fdab8d-4c36-4e7c-8a5f-2dde3f55644b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.223472 Jul 14 14:54:58.154578 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1768/3408] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:57 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:58.810593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:58.811677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:58.843116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.843850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:58.849469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:58.849928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.192245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:59.193151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:54:59.198383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:59.208010 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-987adc17-4162-4e89-a0f6-346a4fdf7db0 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1806 microversion: 2.1 time: 0.403929 Jul 14 14:54:59.211260 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1641/3409] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:58 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1806 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:54:59.216009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.216822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.218265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.219057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.250553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:59.251983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:59.270418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.271472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.274699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.276412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.296346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f03afdfd-e538-4d52-83c3-79055c35b0b0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.131079 Jul 14 14:54:59.298385 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1769/3410] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:54:59 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:54:59.365015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-14e44520-d6fd-4455-b34e-515751017ee9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7/ips" status: 200 len: 219 microversion: 2.1 time: 0.125762 Jul 14 14:54:59.367196 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1642/3411] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:54:59 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7/ips => generated 219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:54:59.389892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:59.393570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:59.420779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.423880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.429654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.432068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.557137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:54:59.745682 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a364f479-aa74-44fb-909d-90d37ffc0407 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 204 len: 0 microversion: 2.1 time: 0.364038 Jul 14 14:54:59.752546 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1770/3412] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:54:59 2022] DELETE /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:54:59.764148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:54:59.769009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:54:59.797945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.798718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:54:59.800747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:54:59.801630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.191057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.208415 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db341179-f405-400f-b648-5d4eaad1d2e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1812 microversion: 2.1 time: 0.455007 Jul 14 14:55:00.210094 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1643/3413] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:54:59 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1812 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:00.318047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.319818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.333106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.333880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.335214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.335998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.344635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:00.393352 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b73eb6d2-5f33-4208-87af-07588e6da5ae tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083565 Jul 14 14:55:00.394928 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1771/3414] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:55:00 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396/os-volume_attachments => generated 25 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:00.495669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.502841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.515470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.515930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.516927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.517410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.550689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:00.666710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-31888c21-327b-42e7-91b7-796cb6f3cd86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 204 len: 0 microversion: 2.20 time: 0.189919 Jul 14 14:55:00.669901 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1644/3415] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:55:00 2022] DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:55:00.683564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:00.684427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:00.695231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.696009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.697381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:00.698053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:00.954041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.974543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.976811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:00.978999 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-750c4ab4-fc43-4a65-bcbd-a7880566195f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.303462 Jul 14 14:55:00.979920 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1772/3416] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:00 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:01.251499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:01.252900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:01.270687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.272011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.274297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:01.276038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:01.576353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:01.585721 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63ad0af7-2cc7-43ac-b453-a04c3bb1d1e3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1812 microversion: 2.1 time: 0.353139 Jul 14 14:55:01.586349 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1645/3417] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:01 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1812 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:01.786888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5296e57-45a1-4d5c-9eed-501e3783900d tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] Calling method '.version_select at 0x7fdbf1eb4ca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:01.790808 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:01.790808 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:55:01.825338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5296e57-45a1-4d5c-9eed-501e3783900d tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.359984 Jul 14 14:55:01.826843 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1773/3418] 10.222.0.98 () {60 vars in 1225 bytes} [Thu Jul 14 14:55:01 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:55:01.844425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-661d75bc-31d9-4cdf-aed4-0903fe9d3f1b tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf2a26dc0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:01.850441 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:01.850441 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:55:02.009671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.010987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.041068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.042499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.044611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.045797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.148470 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-661d75bc-31d9-4cdf-aed4-0903fe9d3f1b tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.310935 Jul 14 14:55:02.155471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1646/3419] 10.222.0.98 () {62 vars in 1246 bytes} [Thu Jul 14 14:55:01 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 14:55:02.167517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f67f134b-ae6c-4b8f-90e4-1e5d6aa8e418 tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] Calling method '.version_select at 0x7fdbf2ad0790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.170546 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:02.170546 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:55:02.209722 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f67f134b-ae6c-4b8f-90e4-1e5d6aa8e418 tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.047839 Jul 14 14:55:02.220372 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1647/3420] 10.222.0.98 () {60 vars in 1225 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:02.236434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15bb719d-a817-4315-8d24-f5b63a437603 tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf31b6ca0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:02.416364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15bb719d-a817-4315-8d24-f5b63a437603 tempest-QuotaClassesAdmin257Test-1556007241 tempest-QuotaClassesAdmin257Test-1556007241-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.189740 Jul 14 14:55:02.419697 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1648/3421] 10.222.0.98 () {62 vars in 1246 bytes} [Thu Jul 14 14:55:02 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:02.439467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.473157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.478798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:02.483620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7db224d9-fe7c-482c-973f-ccdf2febcca7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 0.485042 Jul 14 14:55:02.485835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1774/3422] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:01 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:02.607901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:02.612349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:02.624978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.625684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:02.626731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:02.630963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.351402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:03.376708 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e939a769-8e22-46bd-a785-7bb48a93d839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1791 microversion: 2.1 time: 0.776914 Jul 14 14:55:03.392824 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1649/3423] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:02 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1791 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:03.414554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d2e50805-2077-446e-90b5-0957b4da497c req-f521c7f3-f8c5-45a2-ae89-e516602103c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "name": "network-vif-deleted", "tag": "967bac30-e279-44ce-88b9-7d03dd9035ba"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:03.454410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d2e50805-2077-446e-90b5-0957b4da497c req-f521c7f3-f8c5-45a2-ae89-e516602103c6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.455450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d2e50805-2077-446e-90b5-0957b4da497c req-f521c7f3-f8c5-45a2-ae89-e516602103c6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.483229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90698bc7-3345-4d1b-8451-9c944a2c99a5 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Action: 'create', calling method: .version_select at 0x7fdbf1fe7a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-315507265"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:03.522954 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d2e50805-2077-446e-90b5-0957b4da497c req-f521c7f3-f8c5-45a2-ae89-e516602103c6 service nova] Creating event network-vif-deleted:967bac30-e279-44ce-88b9-7d03dd9035ba for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:55:03.554313 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d2e50805-2077-446e-90b5-0957b4da497c req-f521c7f3-f8c5-45a2-ae89-e516602103c6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160386 Jul 14 14:55:03.563103 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1650/3424] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:03.593778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:03.597956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:03.618385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.620320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:03.624963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:03.626744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.422061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-90698bc7-3345-4d1b-8451-9c944a2c99a5 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.646015 Jul 14 14:55:04.440480 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1775/3425] 10.222.0.98 () {60 vars in 1154 bytes} [Thu Jul 14 14:55:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1666 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 14:55:04.463384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:04.464599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:04.491089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.492044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.492393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:04.497961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:04.708087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.718709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.720908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.722634 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7b34c8a-8457-4ae2-855d-b4249a44ea26 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1722 microversion: 2.20 time: 1.157768 Jul 14 14:55:04.724838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1651/3426] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:03 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1722 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:04.730596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c5d8a37e-e444-41af-9150-e4dc09cfedcf tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf291b8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:04.908499 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c5d8a37e-e444-41af-9150-e4dc09cfedcf tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 344 microversion: 2.1 time: 0.182190 Jul 14 14:55:04.910292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1652/3427] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:04 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 344 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:04.939725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:04.982858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb04d2be-96ba-4d47-aa1d-f33edbdc6fff tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 200 len: 1655 microversion: 2.1 time: 0.532821 Jul 14 14:55:04.983578 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1776/3428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:04 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 1655 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:05.594966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-83ffb26f-459f-4a8f-8a3a-8725b2f4e4f0 req-6ac7fb3b-e802-4e4e-a457-17f4496d4356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "name": "network-vif-deleted", "tag": "a4e9d10b-8acc-4c16-9cc0-483c4b951e76"}, {"server_uuid": "9740023f-c7f0-4fef-8174-941796239fd7", "name": "network-vif-deleted", "tag": "8419bbc2-8d6f-4f52-96b2-a1548012d848"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:05.645817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-83ffb26f-459f-4a8f-8a3a-8725b2f4e4f0 req-6ac7fb3b-e802-4e4e-a457-17f4496d4356 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.646095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-83ffb26f-459f-4a8f-8a3a-8725b2f4e4f0 req-6ac7fb3b-e802-4e4e-a457-17f4496d4356 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.673623 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-83ffb26f-459f-4a8f-8a3a-8725b2f4e4f0 req-6ac7fb3b-e802-4e4e-a457-17f4496d4356 service nova] Creating event network-vif-deleted:a4e9d10b-8acc-4c16-9cc0-483c4b951e76 for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:55:05.674836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-83ffb26f-459f-4a8f-8a3a-8725b2f4e4f0 req-6ac7fb3b-e802-4e4e-a457-17f4496d4356 service nova] Creating event network-vif-deleted:8419bbc2-8d6f-4f52-96b2-a1548012d848 for instance 9740023f-c7f0-4fef-8174-941796239fd7 on n-h1-768852-23 Jul 14 14:55:05.685906 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-83ffb26f-459f-4a8f-8a3a-8725b2f4e4f0 req-6ac7fb3b-e802-4e4e-a457-17f4496d4356 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.104494 Jul 14 14:55:05.688015 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1653/3429] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:05.765345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:05.770503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:05.800421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.802823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.808454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:05.811242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:05.939887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-089a797a-7aa6-4c91-9fd1-3c94baa221d2 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2a26f70>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:06.157957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:06.179473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-089a797a-7aa6-4c91-9fd1-3c94baa221d2 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 344 microversion: 2.1 time: 0.252594 Jul 14 14:55:06.180529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1654/3430] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:05 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 344 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:06.209640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:06.222040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:06.223977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:06.233550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:06.235979 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-700cbeb3-329f-4bf1-80f7-bb5a78b0fc40 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1654 microversion: 2.20 time: 0.480892 Jul 14 14:55:06.237059 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1777/3431] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:05 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1654 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:06.260706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.261446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.262769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.271951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-60dad551-edfb-481e-b449-130fc1a7f4b6 req-04f3933f-1fd9-4838-89c3-cb396e0f2fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "805e64f7-049d-4034-97c5-bf65914f6396", "name": "network-vif-deleted", "tag": "ef005301-58b4-4b1a-826e-6f0a83a07a9b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:06.275761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.311097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-60dad551-edfb-481e-b449-130fc1a7f4b6 req-04f3933f-1fd9-4838-89c3-cb396e0f2fce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:06.311858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-60dad551-edfb-481e-b449-130fc1a7f4b6 req-04f3933f-1fd9-4838-89c3-cb396e0f2fce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:06.321420 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] HTTP exception thrown: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Request method failure captured: Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 HTTP/1.1 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C37wPTRqDG3JD0cPH-0dont03Nde6IbbfDYl56p2X5yfDmuJzublIjr4wJhkdwRuJGFk7_chpLhjX65yrOSyPkmdPJvgSVMB8mT_FUAOwmETvaYlkGM5v3-zmz7rUIhIW6_z5_O9ez8Q5P5SyB00MgMImI3Q2w7MfSTfvPVFuhuD28 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5db5c93660ef41728634e8e57039da1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestMultiNic-1145458478 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 126f8683e55647bc9605e05c7aa654fd Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9740023f-c7f0-4fef-8174-941796239fd7'} Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:06.324986 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:06.335830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Returning 404 to user: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:06.340664 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8cf263b-ff4f-4ee8-8cc3-0a9cc20ec80f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 404 len: 111 microversion: 2.1 time: 0.150316 Jul 14 14:55:06.341674 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1655/3432] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:06 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:06.347397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-60dad551-edfb-481e-b449-130fc1a7f4b6 req-04f3933f-1fd9-4838-89c3-cb396e0f2fce service nova] Creating event network-vif-deleted:ef005301-58b4-4b1a-826e-6f0a83a07a9b for instance 805e64f7-049d-4034-97c5-bf65914f6396 on n-h2-768852-23 Jul 14 14:55:06.358253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-60dad551-edfb-481e-b449-130fc1a7f4b6 req-04f3933f-1fd9-4838-89c3-cb396e0f2fce service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092596 Jul 14 14:55:06.360170 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1778/3433] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:07.204373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c436643d-e1c0-4003-aea4-de9e18467d73 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf291b8b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:07.264706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:07.272954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:07.311221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:07.314912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.316094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.317627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.324908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.416795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c436643d-e1c0-4003-aea4-de9e18467d73 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 345 microversion: 2.1 time: 0.223577 Jul 14 14:55:07.439433 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1656/3434] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:07 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 345 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:07.460478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f9d0e8e-6e9d-4aed-a0d8-364052fdeeaa tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Action: 'create', calling method: .version_select at 0x7fdbf29ce700>, body: {"snapshot": {"volume_id": "5f1c6386-6d60-4c4a-a490-25da92ae0a5a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1092718446"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:07.518528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:07.519397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:07.520236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lazy-loading 'fault' on Instance uuid 805e64f7-049d-4034-97c5-bf65914f6396 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:07.752985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.776803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.781388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:07.785874 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e26dd380-0d6c-4943-adb3-6578e0cb8d8a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 200 len: 1371 microversion: 2.20 time: 0.532711 Jul 14 14:55:07.789498 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1779/3435] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:07 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 1371 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:08.141188 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f9d0e8e-6e9d-4aed-a0d8-364052fdeeaa tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.697277 Jul 14 14:55:08.144226 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1657/3436] 10.222.0.98 () {60 vars in 1161 bytes} [Thu Jul 14 14:55:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:08.165202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7545891e-a546-441f-8c17-007b1bcb4755 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf1ed9670>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:08.369123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7545891e-a546-441f-8c17-007b1bcb4755 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.214500 Jul 14 14:55:08.370120 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1780/3437] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:08 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:08.398224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c872d1d5-4274-4574-842c-906068cef578 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2a3ec10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:08.513742 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c872d1d5-4274-4574-842c-906068cef578 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.133083 Jul 14 14:55:08.514642 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1658/3438] 10.222.0.98 () {58 vars in 1139 bytes} [Thu Jul 14 14:55:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:08.529967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93b027b0-265b-4d52-9be5-dc8d691bec8a tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf1fe7dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:08.617305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93b027b0-265b-4d52-9be5-dc8d691bec8a tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.095279 Jul 14 14:55:08.619188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1781/3439] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:08 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:08.828452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:08.830908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:08.864166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.871082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.872314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:08.873465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:08.955776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] HTTP exception thrown: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Request method failure captured: Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 HTTP/1.1 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C06d3ifq5wIfjzZMVoO46ElEk2hQHcE06N_T1ZR6oyjnbtdznWlEgNnrvYUhwrpQou_HAA7KViZ14itmIMm-EP7DeRZYpknAlHRv-Cb4AuDWkbYbNhZ-WvCAv7aDWm-B0avchhtex8OTLuTT873VZLNbDzfXTzyPNgHNKm5E8yycQ8 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2625ce3aa5034d048494fca0dc403c51 Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '805e64f7-049d-4034-97c5-bf65914f6396'} Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:08.962205 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Returning 404 to user: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f977b694-1533-492e-9199-ed2963dca0b4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 404 len: 111 microversion: 2.20 time: 0.152006 Jul 14 14:55:08.974034 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1659/3440] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:08 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:55:08.982674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-099078b7-a6de-44cc-a65f-50691c88d4bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '.version_select at 0x7fdbf1ea5ee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:09.030499 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-099078b7-a6de-44cc-a65f-50691c88d4bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279313034" status: 204 len: 0 microversion: 2.20 time: 0.052263 Jul 14 14:55:09.038893 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1782/3441] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:55:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1279313034 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:55:09.635165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-28fc157c-2763-436f-900d-a0f8714f2922 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf327b5e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:09.774869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-28fc157c-2763-436f-900d-a0f8714f2922 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.145458 Jul 14 14:55:09.776200 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1660/3442] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:09 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:10.812735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80b636e3-b5fb-4922-a7c3-86c6a5767763 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf1ea5310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:10.895430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80b636e3-b5fb-4922-a7c3-86c6a5767763 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.107059 Jul 14 14:55:10.896437 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1783/3443] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:10 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:11.004612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.019783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:11.021461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Searching by: {'deleted': False, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295'} {{(pid=125966) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:55:11.034426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.035739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.037364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.038336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.092471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.multi_cell_list [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125966) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:55:11.186102 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95506e3b-58b1-4955-9177-d67306e5b996 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.191863 Jul 14 14:55:11.187230 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1661/3444] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:55:10 2022] GET /compute/v2.1/servers => generated 340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:11.219908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.231964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:11.233617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Searching by: {'deleted': False, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:55:11.236147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0ae963d-0b3c-4427-b227-5fb6729eb12e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'create', calling method: .version_select at 0x7fdbf2a3e670>, body: {"keypair": {"name": "tempest-keypair-1284821431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdAHeaktkcD87D+Zb9koU5+Ib7M21h1Ou/p3oJpwRLcmIOwnZAiDsNR1Gykne4aaM16kLd85LqBJpJJQyBrXBGrmaqLCZfyy5+0o9OzkBolcb4JdkIdoSi/D0ih3RFjcw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:11.245291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.246379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.248251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.249348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.294944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d0ae963d-0b3c-4427-b227-5fb6729eb12e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:11.305561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:55:11.308630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=15,nova_api:INSERT=7 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:11.310110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d0ae963d-0b3c-4427-b227-5fb6729eb12e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for user 2625ce3aa5034d048494fca0dc403c51 and project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:11.389664 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0ae963d-0b3c-4427-b227-5fb6729eb12e tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.159238 Jul 14 14:55:11.391393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:11.400376 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1662/3445] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 14:55:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 173 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:55:11.403515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:11.405169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:11.661931 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-230ab69a-3bd5-45b6-b960-d8e1354db4ea tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.464495 Jul 14 14:55:11.663175 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1784/3446] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:11.686144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-78fc1656-58e5-4f33-8932-f83cb47e95ba tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.697567 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-78fc1656-58e5-4f33-8932-f83cb47e95ba tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017458 Jul 14 14:55:11.706344 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1785/3447] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:11.730081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc8c7f37-1e6b-4ff6-b9e4-e3f7943778d6 tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] Calling method '.version_select at 0x7fdbf2b8a310>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.732417 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:11.732417 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:55:11.752111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc8c7f37-1e6b-4ff6-b9e4-e3f7943778d6 tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.254089 Jul 14 14:55:11.753940 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1663/3448] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:11.787185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b69deb3-b653-4a54-86a0-37bf1dc8f788 tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf1ed95e0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:11.790441 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:11.790441 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:55:11.911934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf38b6f5-df0a-4974-979c-c4b2df1d13c7 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf298c940>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:11.984153 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf38b6f5-df0a-4974-979c-c4b2df1d13c7 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 288 microversion: 2.1 time: 0.079483 Jul 14 14:55:11.985072 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1664/3449] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:11 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:11.998868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63fad0a5-947e-47b1-a61d-88303d146766 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf298cb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:12.122588 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63fad0a5-947e-47b1-a61d-88303d146766 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "DELETE /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 202 len: 0 microversion: 2.1 time: 0.130816 Jul 14 14:55:12.123219 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1665/3450] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 14:55:11 2022] DELETE /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 14:55:12.131852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:12.132382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:12.145815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.146483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.147457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.148659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.254364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:12.305709 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b69deb3-b653-4a54-86a0-37bf1dc8f788 tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.542327 Jul 14 14:55:12.311623 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1786/3451] 10.222.0.98 () {60 vars in 1205 bytes} [Thu Jul 14 14:55:11 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:12.325554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6bb995bf-9cb3-4b2f-bba1-3197d2e7903d tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf232b4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:12.421791 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6bb995bf-9cb3-4b2f-bba1-3197d2e7903d tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.112689 Jul 14 14:55:12.422724 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1787/3452] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:12 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:12.429659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ab40182-35ed-4e3d-b33e-c6de16c7c55a tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] Calling method '.version_select at 0x7fdbf1fe0af0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:12.431304 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:12.431304 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 14:55:12.477124 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ab40182-35ed-4e3d-b33e-c6de16c7c55a tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.050085 Jul 14 14:55:12.480309 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1788/3453] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 14:55:12 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:12.482783 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f44da7df-205f-4094-ad6b-a761f0d0cd8e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "DELETE /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 204 len: 0 microversion: 2.1 time: 0.356343 Jul 14 14:55:12.485957 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1666/3454] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:12 2022] DELETE /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:55:12.501284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:12.501930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:12.513701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.513941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.514880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:12.515185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:12.518157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74f1d394-6f58-4fef-b8e1-a8b145cf47f2 tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf2f661f0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:12.522490 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 14:55:12.522490 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 14:55:12.809084 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74f1d394-6f58-4fef-b8e1-a8b145cf47f2 tempest-QuotaClassesAdminTestJSON-1397952930 tempest-QuotaClassesAdminTestJSON-1397952930-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.307410 Jul 14 14:55:12.812111 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1667/3455] 10.222.0.98 () {60 vars in 1205 bytes} [Thu Jul 14 14:55:12 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:12.926737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:12.962039 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f2f8671-4f04-4ead-bc77-c7954f0946d2 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1715 microversion: 2.1 time: 0.470222 Jul 14 14:55:12.969193 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1789/3456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:12 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1715 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:13.437348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21781fa2-2ab8-47ba-b475-f8b26d669f11 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2a3ec10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:13.554720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21781fa2-2ab8-47ba-b475-f8b26d669f11 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.122597 Jul 14 14:55:13.555907 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1668/3457] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:13 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:13.996646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:13.997580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:14.014220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:14.014688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:14.015595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:14.016232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:14.591071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3dfc2892-81a1-44a0-af48-b873b52d1ef7 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf298c430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:14.720862 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3dfc2892-81a1-44a0-af48-b873b52d1ef7 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 200 len: 287 microversion: 2.1 time: 0.150778 Jul 14 14:55:14.735495 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1669/3458] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:14 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:15.434676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:15.460169 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f9c8681-84fc-41c7-a97b-3fa08dfe244e tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1715 microversion: 2.1 time: 1.467560 Jul 14 14:55:15.460833 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1790/3459] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:13 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1715 bytes in 1470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:15.750642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e48b7676-06d1-47a0-a8ae-3b6a735dc29e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2a6fdc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:15.817425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e48b7676-06d1-47a0-a8ae-3b6a735dc29e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] HTTP exception thrown: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e48b7676-06d1-47a0-a8ae-3b6a735dc29e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Request method failure captured: Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 HTTP/1.1 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5G6dCAkLuxIwgv9CoXE-i3S30P68vzxXOxJptldbFSSlutCErgedpWPttAoj4sY3yTY2GCVeDqsV4iT_uEErByo553qrS1zYDJNlCjslnPR8mQPkH7wwCXVbRMCWmu-mfqyItlQ8zDHi0FzMw3Q1HnsWFqxgi8Iafbbx1499u3b0c Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2547a4f7fa834940b3deb6ac2a4f595d Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: exception: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'cac7880e-52a4-4aaa-8ca5-1b6355bf0808'} Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. (HTTP 404) (Request-ID: req-80ebc0ea-67c1-409d-a634-d6879d71cf4a) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:15.825865 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e48b7676-06d1-47a0-a8ae-3b6a735dc29e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Returning 404 to user: Snapshot cac7880e-52a4-4aaa-8ca5-1b6355bf0808 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e48b7676-06d1-47a0-a8ae-3b6a735dc29e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808" status: 404 len: 111 microversion: 2.1 time: 0.088350 Jul 14 14:55:15.842015 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1670/3460] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 14:55:15 2022] GET /compute/v2.1/os-snapshots/cac7880e-52a4-4aaa-8ca5-1b6355bf0808 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:15.855011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9fb418e1-6d06-4dae-81ec-21b394cbd7a5 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf29729d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:16.160536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9fb418e1-6d06-4dae-81ec-21b394cbd7a5 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 202 len: 0 microversion: 2.1 time: 0.320570 Jul 14 14:55:16.162291 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1791/3461] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:55:15 2022] DELETE /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:55:16.199645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-900c03c5-dbb1-4b1f-9f45-2c9f566a5f89 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2ba1040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:16.292488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1720580429", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "2c23dc70-9ab6-440b-8fb9-a630ca4fe01f"}, {"uuid": "bcc5f65a-b47f-4ff0-8dd0-24b185a60657"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:16.463005 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-900c03c5-dbb1-4b1f-9f45-2c9f566a5f89 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 344 microversion: 2.1 time: 0.287607 Jul 14 14:55:16.472210 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1671/3462] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:16 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 344 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:16.491056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:16.513020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:16.533774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] validate_networks() for [('2c23dc70-9ab6-440b-8fb9-a630ca4fe01f', None, None, None, None, None), ('bcc5f65a-b47f-4ff0-8dd0-24b185a60657', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:55:16.567758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:16.570217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:16.576946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:16.578390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:16.967969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:16.982417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:16.994498 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1692b69-f911-4142-a68a-2226d0f4dcfa tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1647 microversion: 2.1 time: 0.511758 Jul 14 14:55:17.011182 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1672/3463] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:16 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1647 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:17.130337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-96a60d7d-e1ae-4454-b7d5-3adc659982ae req-b1726d7f-70b5-4e3b-b0b0-03398b9525e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25a17e55-bc54-425c-b149-468e6816aa34", "name": "network-vif-deleted", "tag": "d0e7224e-98e7-4415-bb27-34578ae62c19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:17.141899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-96a60d7d-e1ae-4454-b7d5-3adc659982ae req-b1726d7f-70b5-4e3b-b0b0-03398b9525e6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:17.142672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-96a60d7d-e1ae-4454-b7d5-3adc659982ae req-b1726d7f-70b5-4e3b-b0b0-03398b9525e6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:17.161071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-96a60d7d-e1ae-4454-b7d5-3adc659982ae req-b1726d7f-70b5-4e3b-b0b0-03398b9525e6 service nova] Creating event network-vif-deleted:d0e7224e-98e7-4415-bb27-34578ae62c19 for instance 25a17e55-bc54-425c-b149-468e6816aa34 on n-h2-768852-23 Jul 14 14:55:17.194836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-96a60d7d-e1ae-4454-b7d5-3adc659982ae req-b1726d7f-70b5-4e3b-b0b0-03398b9525e6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071977 Jul 14 14:55:17.199613 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1673/3464] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:17.500599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8768f712-e1a3-4cf2-b034-039f76082f0e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2ad0ee0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:17.715168 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8768f712-e1a3-4cf2-b034-039f76082f0e tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 344 microversion: 2.1 time: 0.236278 Jul 14 14:55:17.731389 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1674/3465] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:17 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 344 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:18.052251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:18.056701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:18.122293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.123185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.124974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.127262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.216290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:18.218001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:18.219251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lazy-loading 'fault' on Instance uuid 25a17e55-bc54-425c-b149-468e6816aa34 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:18.462070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '136f061873624ac4a28fbe80de7c7363', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19d9bbcda6704f11af30fedcc7e5a295', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:18.474718 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b7c7417-424a-4a20-aa89-0c2de7d31479 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 200 len: 1368 microversion: 2.1 time: 0.461721 Jul 14 14:55:18.485850 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1675/3466] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:18 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 1368 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:18.490874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-128547365", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5159ddda-95bd-4e7f-87d5-260eea5ce87f"}], "security_groups": [{"name": "tempest-securitygroup--450782659"}], "key_name": "tempest-keypair-1284821431", "user_data": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:19.583988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:55:19.584850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:55:19.584850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:55:19.585280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:55:19.590994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:55:19.606838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.607202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.608271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:19.608715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:19.659582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] validate_networks() for [('5159ddda-95bd-4e7f-87d5-260eea5ce87f', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:55:19.663657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Getting quotas for project 5db5c93660ef41728634e8e57039da1a. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:19.674466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Getting quotas for user 126f8683e55647bc9605e05c7aa654fd and project 5db5c93660ef41728634e8e57039da1a. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:19.722509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:55:19.726493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:55:19.867888 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e803694e-ee95-4b92-b7f9-af38c5eadff9 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.593135 Jul 14 14:55:19.876511 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1792/3467] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:55:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 3597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:55:19.883558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c31de972-8331-4ac8-ac86-a61b1e677bf8 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2a20430>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:20.005918 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c31de972-8331-4ac8-ac86-a61b1e677bf8 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 344 microversion: 2.1 time: 0.127506 Jul 14 14:55:20.007148 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1793/3468] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:19 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 344 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:20.019087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:20.027169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] [instance: 25a17e55-bc54-425c-b149-468e6816aa34] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:20.063425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:20.066661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:20.067909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:20.075100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:20.131149 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] HTTP exception thrown: Instance 25a17e55-bc54-425c-b149-468e6816aa34 could not be found. Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Request method failure captured: Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 HTTP/1.1 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C33WOYt8LgvaEwlPoMvJWtZs-7tbxYXm-gCw9n4epDS86rRxPsIUCFv7qMxbD8Siqv7TySm2SJAOJefNqNsuQQnJIjfQcG5Vb2LIyO4Ksf6hahuzHyUMCIAc_KpzD4gvZXW0nf_RfCZw4W2gpiukg7c9FMsQXC8GOXxN05b-2E4mzQ Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 19d9bbcda6704f11af30fedcc7e5a295 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestManualDisk-525669048 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/19d9bbcda6704f11af30fedcc7e5a295"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_19d9bbcda6704f11af30fedcc7e5a295"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/19d9bbcda6704f11af30fedcc7e5a295"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/19d9bbcda6704f11af30fedcc7e5a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestManualDisk-525669048 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 19d9bbcda6704f11af30fedcc7e5a295 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestManualDisk-525669048 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestManualDisk-525669048-project Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 136f061873624ac4a28fbe80de7c7363 Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestManualDisk-525669048-project Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 25a17e55-bc54-425c-b149-468e6816aa34 could not be found. Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '25a17e55-bc54-425c-b149-468e6816aa34'} Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25a17e55-bc54-425c-b149-468e6816aa34 could not be found. Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25a17e55-bc54-425c-b149-468e6816aa34 could not be found. Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:20.138211 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25a17e55-bc54-425c-b149-468e6816aa34 could not be found. Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Returning 404 to user: Instance 25a17e55-bc54-425c-b149-468e6816aa34 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:20.153888 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c78e5211-2fe9-47b4-ae75-24906a2d7560 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34" status: 404 len: 111 microversion: 2.1 time: 0.132953 Jul 14 14:55:20.158207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1794/3469] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:20 2022] GET /compute/v2.1/servers/25a17e55-bc54-425c-b149-468e6816aa34 => generated 111 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:20.170774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74da6e2e-d7ad-48a5-a837-f53f467fb28d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:20.180125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74da6e2e-d7ad-48a5-a837-f53f467fb28d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:20.376806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-74da6e2e-d7ad-48a5-a837-f53f467fb28d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:20.387218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74da6e2e-d7ad-48a5-a837-f53f467fb28d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1213 microversion: 2.1 time: 0.224672 Jul 14 14:55:20.388587 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1795/3470] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:20 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:20.395134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0cf80119-8eea-42af-82fa-bc78e627abc9 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] Calling method '.version_select at 0x7fdbf1e90280>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:20.421597 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0cf80119-8eea-42af-82fa-bc78e627abc9 tempest-ServersTestManualDisk-525669048 tempest-ServersTestManualDisk-525669048-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956997583" status: 202 len: 0 microversion: 2.1 time: 0.031496 Jul 14 14:55:20.423107 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1796/3471] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:55:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1956997583 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:55:21.021387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a2d3cb5-f006-4c27-bbca-103739437e42 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2b303a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:21.066416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:21.260811 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a2d3cb5-f006-4c27-bbca-103739437e42 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 200 len: 344 microversion: 2.1 time: 0.243465 Jul 14 14:55:21.285796 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1797/3472] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:21 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 344 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:21.422079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:21.422563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:21.430924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.431432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.432263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.432713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.651858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:21.672521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20dc943f-1710-4899-b652-132c55e6bf0d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1217 microversion: 2.1 time: 0.261497 Jul 14 14:55:21.683374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:55:21.683788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:55:21.684524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:55:21.685119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:55:21.685719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:55:21.690622 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1798/3473] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:21 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1217 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:21.709476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.710334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.715147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:21.716442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:21.769343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:21.790392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Getting quotas for user 2625ce3aa5034d048494fca0dc403c51 and project bcf2159a7a09439aa1be7f78d8b9d1eb. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:21.828460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:55:21.835023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:55:21.980721 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97e7ba18-fa52-4f85-ada1-8814d3b142ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.496529 Jul 14 14:55:21.988160 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1676/3474] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:55:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 3509 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:55:22.004692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c3a251f-eb3b-4123-8067-6dce9911f319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:22.005345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4c3a251f-eb3b-4123-8067-6dce9911f319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:22.176938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c3a251f-eb3b-4123-8067-6dce9911f319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.213157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c3a251f-eb3b-4123-8067-6dce9911f319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.224487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c3a251f-eb3b-4123-8067-6dce9911f319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:22.232774 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4c3a251f-eb3b-4123-8067-6dce9911f319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1281 microversion: 2.20 time: 0.226221 Jul 14 14:55:22.235015 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1799/3475] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:21 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1281 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:22.304050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-111c79c3-2e99-4279-bdb8-55c61d5a3e45 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf31d9040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:22.378637 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-111c79c3-2e99-4279-bdb8-55c61d5a3e45 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] HTTP exception thrown: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-111c79c3-2e99-4279-bdb8-55c61d5a3e45 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Request method failure captured: Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a HTTP/1.1 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5G6dCAkLuxIwgv9CoXE-i3S30P68vzxXOxJptldbFSSlutCErgedpWPttAoj4sY3yTY2GCVeDqsV4iT_uEErByo553qrS1zYDJNlCjslnPR8mQPkH7wwCXVbRMCWmu-mfqyItlQ8zDHi0FzMw3Q1HnsWFqxgi8Iafbbx1499u3b0c Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2547a4f7fa834940b3deb6ac2a4f595d Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: exception: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '5f1c6386-6d60-4c4a-a490-25da92ae0a5a'} Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. (HTTP 404) (Request-ID: req-66f2bea6-ec68-48c3-98ee-95d34ee5659e) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:22.381276 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-111c79c3-2e99-4279-bdb8-55c61d5a3e45 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Returning 404 to user: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:22.386846 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-111c79c3-2e99-4279-bdb8-55c61d5a3e45 tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 404 len: 109 microversion: 2.1 time: 0.087885 Jul 14 14:55:22.397833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86a448d1-1921-4a51-a9c6-278d6bb67a6f tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf2972dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:22.401004 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1677/3476] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:22 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:22.708500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:22.709464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:22.734510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:22.770737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.038s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:22.772319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:22.778904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.521278 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-86a448d1-1921-4a51-a9c6-278d6bb67a6f tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] HTTP exception thrown: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86a448d1-1921-4a51-a9c6-278d6bb67a6f tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Request method failure captured: Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a HTTP/1.1 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C5G6dCAkLuxIwgv9CoXE-i3S30P68vzxXOxJptldbFSSlutCErgedpWPttAoj4sY3yTY2GCVeDqsV4iT_uEErByo553qrS1zYDJNlCjslnPR8mQPkH7wwCXVbRMCWmu-mfqyItlQ8zDHi0FzMw3Q1HnsWFqxgi8Iafbbx1499u3b0c Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2547a4f7fa834940b3deb6ac2a4f595d Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: exception: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '5f1c6386-6d60-4c4a-a490-25da92ae0a5a'} Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. (HTTP 404) (Request-ID: req-bf76f086-657e-407f-81a7-adb9e241a3b9) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:23.526171 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86a448d1-1921-4a51-a9c6-278d6bb67a6f tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Returning 404 to user: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:23.530879 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86a448d1-1921-4a51-a9c6-278d6bb67a6f tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 404 len: 109 microversion: 2.1 time: 1.138365 Jul 14 14:55:23.543798 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1800/3477] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:55:22 2022] DELETE /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 109 bytes in 1154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:55:23.802724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:23.812082 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a9587d2-30f0-4dac-97a1-5a98e2d2eef8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1271 microversion: 2.1 time: 1.111073 Jul 14 14:55:23.818810 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1678/3478] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:22 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1271 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:23.824697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:23.830854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:23.845339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.846173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.847198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:23.853420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:23.875967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a253dc4b-4d67-4a32-9825-ae61c12a4d51 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf1ed9040>, body: {"quota_set": {"ram": "5120"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:24.042349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=2,nova_api:UPDATE=12,nova_api:INSERT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:24.044381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:24.070215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a253dc4b-4d67-4a32-9825-ae61c12a4d51 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.072615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a253dc4b-4d67-4a32-9825-ae61c12a4d51 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.076557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a253dc4b-4d67-4a32-9825-ae61c12a4d51 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.078997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a253dc4b-4d67-4a32-9825-ae61c12a4d51 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.079245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:24.080670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:24.081877 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf218f11-cc9c-4d23-a539-331a6d2e19ec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1333 microversion: 2.20 time: 0.261522 Jul 14 14:55:24.086100 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1679/3479] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:23 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1333 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:24.091585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.092204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.104595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.105519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.106592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.107252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.212915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a253dc4b-4d67-4a32-9825-ae61c12a4d51 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4" status: 200 len: 240 microversion: 2.36 time: 0.666486 Jul 14 14:55:24.215601 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1801/3480] 10.222.0.98 () {62 vars in 1302 bytes} [Thu Jul 14 14:55:23 2022] PUT /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4 => generated 240 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:24.233484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54cecf3b-3e8a-4f82-8c20-a96fba5e70ac tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Calling method '.version_select at 0x7fdbf1eb43a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.306022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-54cecf3b-3e8a-4f82-8c20-a96fba5e70ac tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] HTTP exception thrown: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54cecf3b-3e8a-4f82-8c20-a96fba5e70ac tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Request method failure captured: Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a HTTP/1.1 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C5G6dCAkLuxIwgv9CoXE-i3S30P68vzxXOxJptldbFSSlutCErgedpWPttAoj4sY3yTY2GCVeDqsV4iT_uEErByo553qrS1zYDJNlCjslnPR8mQPkH7wwCXVbRMCWmu-mfqyItlQ8zDHi0FzMw3Q1HnsWFqxgi8Iafbbx1499u3b0c Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/158b74e5a163458cb9b6249e9076c7ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 158b74e5a163458cb9b6249e9076c7ca Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1927690558 Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2547a4f7fa834940b3deb6ac2a4f595d Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1927690558-project Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: exception: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '5f1c6386-6d60-4c4a-a490-25da92ae0a5a'} Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. (HTTP 404) (Request-ID: req-863eb3c6-404e-4f48-bb6e-556846a6f9ea) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:24.309106 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54cecf3b-3e8a-4f82-8c20-a96fba5e70ac tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] Returning 404 to user: Volume 5f1c6386-6d60-4c4a-a490-25da92ae0a5a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54cecf3b-3e8a-4f82-8c20-a96fba5e70ac tempest-VolumesSnapshotsTestJSON-1927690558 tempest-VolumesSnapshotsTestJSON-1927690558-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a" status: 404 len: 109 microversion: 2.1 time: 0.093409 Jul 14 14:55:24.318336 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1802/3481] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/os-volumes/5f1c6386-6d60-4c4a-a490-25da92ae0a5a => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:24.326771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-805a11ea-84e3-46a4-9742-c5bc7ee0f916 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Calling method '.version_select at 0x7fdbf2a3e310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.659747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-805a11ea-84e3-46a4-9742-c5bc7ee0f916 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.666767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-805a11ea-84e3-46a4-9742-c5bc7ee0f916 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.670103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:24.675902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-805a11ea-84e3-46a4-9742-c5bc7ee0f916 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.676720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-805a11ea-84e3-46a4-9742-c5bc7ee0f916 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.692059 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-938b6e12-cd04-4395-8718-9ae785943df4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.604805 Jul 14 14:55:24.709061 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1680/3482] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:24.714916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.734420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.753319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.754120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.755115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.755768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.773680 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-805a11ea-84e3-46a4-9742-c5bc7ee0f916 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4/detail" status: 200 len: 672 microversion: 2.36 time: 0.458937 Jul 14 14:55:24.790216 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1803/3483] 10.222.0.98 () {60 vars in 1303 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4/detail => generated 672 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:24.859692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:24.861893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:24.901104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.906641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:24.910960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:24.916134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.275898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.304598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f80a357d-b7ee-4576-8c50-dfa719648cb3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1271 microversion: 2.1 time: 0.469912 Jul 14 14:55:25.305701 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1804/3484] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1271 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:25.320026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.321912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.335909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.336459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.338330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.339615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.537800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.551300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.554088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.556199 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aad2eb9f-0885-443e-9c41-497c4e3913bb tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1339 microversion: 2.20 time: 0.245901 Jul 14 14:55:25.556916 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1805/3485] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1339 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:25.562879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Action: 'update', calling method: .version_select at 0x7fdbf1fe75e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:25.718450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:25.747469 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66390cc8-09a0-4ea0-90fd-ca597134c331 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.036303 Jul 14 14:55:25.767009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.768319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.769657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.770351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.772317 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1681/3486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:24 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:25.787024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:25.788137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:25.803301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.804395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.808180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.812987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.818603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.819556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.820882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:25.822221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:25.982795 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ddebfc0-20b9-4679-80bb-bea5a1890d42 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4?user_id=53f254c0ca31441dbde65ecbc6dad8e2" status: 200 len: 240 microversion: 2.36 time: 0.424587 Jul 14 14:55:25.984028 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1806/3487] 10.222.0.98 () {62 vars in 1383 bytes} [Thu Jul 14 14:55:25 2022] PUT /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4?user_id=53f254c0ca31441dbde65ecbc6dad8e2 => generated 240 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:26.000391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f1c36c2-77e5-40b8-8171-808baa579f54 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] Calling method '.version_select at 0x7fdbf1ed98b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.151702 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f1c36c2-77e5-40b8-8171-808baa579f54 tempest-QuotasAdminTestV236-939407330 tempest-QuotasAdminTestV236-939407330-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4?user_id=53f254c0ca31441dbde65ecbc6dad8e2" status: 200 len: 282 microversion: 2.36 time: 0.160033 Jul 14 14:55:26.160964 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1807/3488] 10.222.0.98 () {60 vars in 1363 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/os-quota-sets/a2250626bdcb486496a9d0e0d78009d4?user_id=53f254c0ca31441dbde65ecbc6dad8e2 => generated 282 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:26.175659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.176928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.200377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.201199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.201544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.204426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.276594 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ecd17838-2134-421a-9cc8-e6d91a553ea4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108350 Jul 14 14:55:26.277909 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1808/3489] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:55:26 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:55:26.322964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.324032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.339484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.343725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.344769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.345450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.413421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:26.485854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.516222 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1d58df9-a7ed-4992-b5d2-621bf1914895 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.738068 Jul 14 14:55:26.521577 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1682/3490] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:25 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:26.557183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.560706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.581137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.582108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.584413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.594454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:26.598021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.626874 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f8958501-faea-4b00-98cb-593fadbc8074 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1271 microversion: 2.1 time: 0.307501 Jul 14 14:55:26.632988 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1809/3491] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:26 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1271 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:26.657586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:26.659613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-390099153"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:26.664764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.708399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.710620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.712687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.714950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.832393 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4596d9f8-f721-41cf-a3ec-45d2c6b76c82 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 204 len: 0 microversion: 2.1 time: 0.304259 Jul 14 14:55:26.834648 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1683/3492] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:55:26 2022] DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:55:26.860227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:26.862416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:26.906544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.912499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:26.919023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:26.920602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.593202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.628254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.647870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.649507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2323ee29-e6c7-4dce-be98-c8ee4c362bfa tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 0.809694 Jul 14 14:55:27.662041 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1684/3493] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:26 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:27.662041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:27.662041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:27.675015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.678514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.678732 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c61bdd9-c4e0-4a84-88f7-79f7649baac6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 1.042428 Jul 14 14:55:27.680089 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1810/3494] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:55:26 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 1046 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 14 14:55:27.682466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.683316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.695865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:27.696821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:27.714058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.714519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.723139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:27.723699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:27.980046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:27.996602 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cbd3533f-25a6-4b37-a6fd-5975d8c02f33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1674 microversion: 2.1 time: 0.345340 Jul 14 14:55:27.999762 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1685/3495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:27 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1674 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:28.388034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:28.421944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-72e193a2-a198-437a-8f9d-1f87597af6bd tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1313 microversion: 2.1 time: 0.733183 Jul 14 14:55:28.424146 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1811/3496] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:27 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1313 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:28.677173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:28.677977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:28.702725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.703501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:28.705295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:28.707531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.023972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:29.025403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:29.074871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.076205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.078975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.080127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.709461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.723604 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b1344f9-5850-4914-98a6-8cf7966a790c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1674 microversion: 2.1 time: 0.710874 Jul 14 14:55:29.725207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1812/3497] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:29 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1674 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:29.733160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8cbe2859-491b-4ecc-ac02-0ae8946cbb50 req-1029abd2-d41f-4253-854d-9ed2653e1cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:29.743196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8cbe2859-491b-4ecc-ac02-0ae8946cbb50 req-1029abd2-d41f-4253-854d-9ed2653e1cc6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.743888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8cbe2859-491b-4ecc-ac02-0ae8946cbb50 req-1029abd2-d41f-4253-854d-9ed2653e1cc6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.760762 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8cbe2859-491b-4ecc-ac02-0ae8946cbb50 req-1029abd2-d41f-4253-854d-9ed2653e1cc6 service nova] Creating event network-changed:0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53 for instance e902fe2d-9dd4-4533-8381-c44065e607bf on n-h1-768852-23 Jul 14 14:55:29.766580 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8cbe2859-491b-4ecc-ac02-0ae8946cbb50 req-1029abd2-d41f-4253-854d-9ed2653e1cc6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039558 Jul 14 14:55:29.767637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1813/3498] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:29.774058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:29.775713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:29.783211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.783704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.784767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:29.785194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:29.865929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.878940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.882021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:29.884473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fb2696ec-2ae4-4af0-93ec-fda96149c8be tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 1.211466 Jul 14 14:55:29.886379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1686/3499] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:28 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:30.157006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e3656583-3810-44b8-b4d3-20777e58d29b tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Action: 'create', calling method: .version_select at 0x7fdbf2ba1040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-192690437", "metadata": {"Type": "work"}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e3656583-3810-44b8-b4d3-20777e58d29b tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Request method failure captured: Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 121 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5hEtXXSkVEPFc7ZwviAuH-KfeJs36cgOwm0g8OhxW-nrod64pmQfpsU9fs5nDrusAiWmE64poEJMZ04xaKtU0NIG46DPsQyFvpNH8IYaUaPGQ5Oxve1Cc8h57mr0se1z1Mp6tI70ZnnNxYvUokwodTRk7kpWqrRQFUe-7x3qcxsiM Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 96f47b76a4754a7c8d20a3ab2eb24b8a Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-192690437", "metadata": {"Type": "work"}}} Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-192690437', 'metadata': {'Type': 'work'}}}} Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:55:30.164173 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e3656583-3810-44b8-b4d3-20777e58d29b tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:30.170951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e3656583-3810-44b8-b4d3-20777e58d29b tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.281633 Jul 14 14:55:30.176136 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1687/3500] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:55:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 289 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:55:30.224446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73867a51-3c30-4fae-af1a-6dd910593e42 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Action: 'create', calling method: .version_select at 0x7fdbf2a3eaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-154978380", "metadata": {"Type": "work"}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73867a51-3c30-4fae-af1a-6dd910593e42 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Request method failure captured: Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 119 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5hEtXXSkVEPFc7ZwviAuH-KfeJs36cgOwm0g8OhxW-nrod64pmQfpsU9fs5nDrusAiWmE64poEJMZ04xaKtU0NIG46DPsQyFvpNH8IYaUaPGQ5Oxve1Cc8h57mr0se1z1Mp6tI70ZnnNxYvUokwodTRk7kpWqrRQFUe-7x3qcxsiM Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 96f47b76a4754a7c8d20a3ab2eb24b8a Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-154978380", "metadata": {"Type": "work"}}} Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-154978380', 'metadata': {'Type': 'work'}}}} Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '0' Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:55:30.230922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 14:55:30.236140 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.237628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73867a51-3c30-4fae-af1a-6dd910593e42 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:30.240322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73867a51-3c30-4fae-af1a-6dd910593e42 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.051467 Jul 14 14:55:30.248854 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1688/3501] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:55:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 62 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:55:30.277188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f4d74c5-7396-4689-9bc8-9b39457337cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Action: 'create', calling method: .version_select at 0x7fdbf2ad0310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-578245469", "metadata": {"Type": "work"}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f4d74c5-7396-4689-9bc8-9b39457337cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Request method failure captured: Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 118 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5hEtXXSkVEPFc7ZwviAuH-KfeJs36cgOwm0g8OhxW-nrod64pmQfpsU9fs5nDrusAiWmE64poEJMZ04xaKtU0NIG46DPsQyFvpNH8IYaUaPGQ5Oxve1Cc8h57mr0se1z1Mp6tI70ZnnNxYvUokwodTRk7kpWqrRQFUe-7x3qcxsiM Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 96f47b76a4754a7c8d20a3ab2eb24b8a Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-578245469", "metadata": {"Type": "work"}}} Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-578245469', 'metadata': {'Type': 'work'}}}} Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '' Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 14:55:30.285272 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f4d74c5-7396-4689-9bc8-9b39457337cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f4d74c5-7396-4689-9bc8-9b39457337cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.026318 Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1689/3502] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 14:55:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 14:55:30.307762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4aa9c9e-6892-4328-8f1d-df2ffc0509cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Calling method '.version_select at 0x7fdbf2ba1820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.319891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:30.340380 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d0c8704c-c237-4446-b65b-5a1b8c6b15b8 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 0.564458 Jul 14 14:55:30.354724 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1814/3503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:29 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:30.454369 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c4aa9c9e-6892-4328-8f1d-df2ffc0509cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] HTTP exception thrown: Volume tempest-invalid-627776399 could not be found. Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4aa9c9e-6892-4328-8f1d-df2ffc0509cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Request method failure captured: Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-627776399 HTTP/1.1 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5hEtXXSkVEPFc7ZwviAuH-KfeJs36cgOwm0g8OhxW-nrod64pmQfpsU9fs5nDrusAiWmE64poEJMZ04xaKtU0NIG46DPsQyFvpNH8IYaUaPGQ5Oxve1Cc8h57mr0se1z1Mp6tI70ZnnNxYvUokwodTRk7kpWqrRQFUe-7x3qcxsiM Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 96f47b76a4754a7c8d20a3ab2eb24b8a Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: exception: Volume tempest-invalid-627776399 could not be found. Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'tempest-invalid-627776399'} Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-627776399 could not be found. (HTTP 404) (Request-ID: req-ab15c95a-5846-425b-9df7-85466443b84d) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:30.459400 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-627776399 could not be found. Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-627776399 could not be found. Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-627776399 could not be found. Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4aa9c9e-6892-4328-8f1d-df2ffc0509cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Returning 404 to user: Volume tempest-invalid-627776399 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:30.472380 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4aa9c9e-6892-4328-8f1d-df2ffc0509cd tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/tempest-invalid-627776399" status: 404 len: 98 microversion: 2.1 time: 0.162583 Jul 14 14:55:30.484705 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c889ff17-8a77-45b0-bccb-96e7c90fbca1 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004026 Jul 14 14:55:30.484705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1815/3504] 10.222.0.98 () {58 vars in 1139 bytes} [Thu Jul 14 14:55:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 14 14:55:30.488322 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1690/3505] 10.222.0.98 () {58 vars in 1214 bytes} [Thu Jul 14 14:55:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-627776399 => generated 98 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 14:55:30.495188 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3a2e3e2-e810-42f4-939b-89651effcf0c tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006038 Jul 14 14:55:30.496152 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1816/3506] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:55:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 14 14:55:30.525200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e5ef133-df01-4141-9fa7-2f5a348fdc85 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Calling method '.version_select at 0x7fdbf2ba11f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.603905 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4e5ef133-df01-4141-9fa7-2f5a348fdc85 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] HTTP exception thrown: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e5ef133-df01-4141-9fa7-2f5a348fdc85 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Request method failure captured: Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/os-volumes/3479cbb6-4cae-4022-8272-d97af16f38ef HTTP/1.1 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5hEtXXSkVEPFc7ZwviAuH-KfeJs36cgOwm0g8OhxW-nrod64pmQfpsU9fs5nDrusAiWmE64poEJMZ04xaKtU0NIG46DPsQyFvpNH8IYaUaPGQ5Oxve1Cc8h57mr0se1z1Mp6tI70ZnnNxYvUokwodTRk7kpWqrRQFUe-7x3qcxsiM Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 96f47b76a4754a7c8d20a3ab2eb24b8a Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: exception: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '3479cbb6-4cae-4022-8272-d97af16f38ef'} Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. (HTTP 404) (Request-ID: req-1e18d0d3-cad0-4da8-9426-20421ef6d13a) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:30.608911 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. Jul 14 14:55:30.615570 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.624478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e5ef133-df01-4141-9fa7-2f5a348fdc85 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Returning 404 to user: Volume 3479cbb6-4cae-4022-8272-d97af16f38ef could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:30.626377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e5ef133-df01-4141-9fa7-2f5a348fdc85 tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/3479cbb6-4cae-4022-8272-d97af16f38ef" status: 404 len: 109 microversion: 2.1 time: 0.110720 Jul 14 14:55:30.629842 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1691/3507] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:55:30 2022] DELETE /compute/v2.1/os-volumes/3479cbb6-4cae-4022-8272-d97af16f38ef => generated 109 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:30.649718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8bd2c58a-594e-4f02-b2f5-bc3111b264ae tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Calling method '.version_select at 0x7fdbf1ed98b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.742757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8bd2c58a-594e-4f02-b2f5-bc3111b264ae tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] HTTP exception thrown: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8bd2c58a-594e-4f02-b2f5-bc3111b264ae tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Request method failure captured: Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-volumes/e851d756-bd51-4b9c-abaf-f1a0cdd00613 HTTP/1.1 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C5hEtXXSkVEPFc7ZwviAuH-KfeJs36cgOwm0g8OhxW-nrod64pmQfpsU9fs5nDrusAiWmE64poEJMZ04xaKtU0NIG46DPsQyFvpNH8IYaUaPGQ5Oxve1Cc8h57mr0se1z1Mp6tI70ZnnNxYvUokwodTRk7kpWqrRQFUe-7x3qcxsiM Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8005e6d2ee1d4a4cbe541392dc60d7a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8005e6d2ee1d4a4cbe541392dc60d7a1 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesNegativeTest-468468697 Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 96f47b76a4754a7c8d20a3ab2eb24b8a Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesNegativeTest-468468697-project Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: exception: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e851d756-bd51-4b9c-abaf-f1a0cdd00613'} Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. (HTTP 404) (Request-ID: req-aa264e13-1224-4297-a004-a5570796e949) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 14:55:30.745623 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. Jul 14 14:55:30.751019 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:30.761140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8bd2c58a-594e-4f02-b2f5-bc3111b264ae tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] Returning 404 to user: Volume e851d756-bd51-4b9c-abaf-f1a0cdd00613 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:30.763563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.765375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8bd2c58a-594e-4f02-b2f5-bc3111b264ae tempest-VolumesNegativeTest-468468697 tempest-VolumesNegativeTest-468468697-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/e851d756-bd51-4b9c-abaf-f1a0cdd00613" status: 404 len: 109 microversion: 2.1 time: 0.121874 Jul 14 14:55:30.766600 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1817/3508] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:55:30 2022] GET /compute/v2.1/os-volumes/e851d756-bd51-4b9c-abaf-f1a0cdd00613 => generated 109 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:30.768339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:30.813481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.813939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.823827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.824740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.916894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:30.918085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:30.940130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.941087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:30.943728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:30.953295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.376815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:31.391090 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3fea472-2efc-44f2-81a1-c832960cee68 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1674 microversion: 2.1 time: 0.650994 Jul 14 14:55:31.410932 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1692/3509] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:30 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1674 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:31.419370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:31.420314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:31.435736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.437730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.440908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:31.443894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:31.490076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:31.509555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:31.520747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:31.525000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c128fef-72be-4b16-a567-4d3ac31d1238 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 0.611219 Jul 14 14:55:31.528592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1818/3510] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:30 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:55:31.742435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:31.803692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=41,nova_cell0:UPDATE=7 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:31.936680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:31.951406 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93953cbc-b747-4063-9934-d15606922839 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 0.535941 Jul 14 14:55:31.967486 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1693/3511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:31 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:32.452492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:32.461885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:32.550984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:32.558537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:32.559698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:32.560456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:32.575764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:32.576622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:32.614361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:32.615149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:32.640974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:32.641783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.231753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:33.247477 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9db68e0-4b28-4839-8243-1a2a8c1c2c7a tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1606 microversion: 2.1 time: 0.832920 Jul 14 14:55:33.249004 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1819/3512] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:32 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1606 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:33.255043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:33.280786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:33.301528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.302520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.303656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.304376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.442948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:33.459347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:33.472048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:33.473911 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-83c3c479-a594-46d4-838a-3cfc83f1f1e1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 0.933907 Jul 14 14:55:33.490070 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1694/3513] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:32 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:33.490070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-35ded2a1-b8e3-4bc8-93d8-ada9017852fa req-972ba2f4-9590-4a2c-a522-4e7d8161cf4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6c479bb-f2bf-46bb-a256-cd2431bb117a", "name": "network-vif-deleted", "tag": "2e5cda1c-624c-4920-96ff-61aae4a6717c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:33.506813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4,nova_api:UPDATE=14 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:33.509789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-35ded2a1-b8e3-4bc8-93d8-ada9017852fa req-972ba2f4-9590-4a2c-a522-4e7d8161cf4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:33.510357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-35ded2a1-b8e3-4bc8-93d8-ada9017852fa req-972ba2f4-9590-4a2c-a522-4e7d8161cf4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:33.542017 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-35ded2a1-b8e3-4bc8-93d8-ada9017852fa req-972ba2f4-9590-4a2c-a522-4e7d8161cf4b service nova] Creating event network-vif-deleted:2e5cda1c-624c-4920-96ff-61aae4a6717c for instance f6c479bb-f2bf-46bb-a256-cd2431bb117a on n-h1-768852-23 Jul 14 14:55:33.563139 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-35ded2a1-b8e3-4bc8-93d8-ada9017852fa req-972ba2f4-9590-4a2c-a522-4e7d8161cf4b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086426 Jul 14 14:55:33.573706 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1695/3514] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:34.272279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:34.273095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:34.305246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:34.306255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:34.320234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:34.323911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:34.407453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:34.490408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:34.491417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:34.492455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lazy-loading 'fault' on Instance uuid f6c479bb-f2bf-46bb-a256-cd2431bb117a {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:55:35.019194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:35.033638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9efc0acb-378c-462d-a6bb-62bac1eef5a3 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 200 len: 1328 microversion: 2.1 time: 0.769818 Jul 14 14:55:35.036960 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1696/3515] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:34 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 1328 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:35.382002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:35.382767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:35.403533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.405510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.410978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.412621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.587936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:35.626686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac8df16c-bafa-478c-88d6-3aba76b1de64 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 2.373227 Jul 14 14:55:35.639408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1820/3516] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:33 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 2378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:35.647375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a7a4c2c5-d20f-479d-b938-56c2d8244bf6 req-20349802-7952-4d10-8726-69e973cefb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "tag": "a4cf6e0d-3d37-472f-b85c-48d490ea096f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:35.718477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a7a4c2c5-d20f-479d-b938-56c2d8244bf6 req-20349802-7952-4d10-8726-69e973cefb89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:35.720368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a7a4c2c5-d20f-479d-b938-56c2d8244bf6 req-20349802-7952-4d10-8726-69e973cefb89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:35.790877 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a7a4c2c5-d20f-479d-b938-56c2d8244bf6 req-20349802-7952-4d10-8726-69e973cefb89 service nova] Creating event network-changed:a4cf6e0d-3d37-472f-b85c-48d490ea096f for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:55:35.813113 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a7a4c2c5-d20f-479d-b938-56c2d8244bf6 req-20349802-7952-4d10-8726-69e973cefb89 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181564 Jul 14 14:55:35.820964 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1821/3517] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:36.066268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.069154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:36.091929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=13 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:36.113910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.122560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.127954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.128713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.164712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=65,nova_cell0:UPDATE=7 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:36.219985 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] HTTP exception thrown: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Request method failure captured: Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a HTTP/1.1 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1rolyCNiQr2y7EKCOeCbJZrkjtQ574U4hFemWWw4EkAk0Lu6iEJYtyJxAXb3Ruo2iH0IlpXa-XVlAAldnH6nu8ljDYzuGzDG5jnfFiL_N3LBUTebGjsY1TE_-hXQMe7M84e-lVj8gaJortSdw1s2WEyz9yOyiYkP3pmwDCRVKEUns Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_27951e61632946f58c199f09723d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/27951e61632946f58c199f09723d6fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b06a5d6f31ea4d4a9a7e69f759a3c7ce Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f6c479bb-f2bf-46bb-a256-cd2431bb117a'} Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:55:36.223134 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:55:36.235691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Returning 404 to user: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:55:36.239360 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4d47d7b6-1a2c-4d8a-a8dd-81047b5ada4f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 404 len: 111 microversion: 2.1 time: 0.187974 Jul 14 14:55:36.244881 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1822/3518] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:36 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:55:36.261236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d269bf8-99a7-4707-be17-5acaea954a0f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '.version_select at 0x7fdbf1ed95e0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.342693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d269bf8-99a7-4707-be17-5acaea954a0f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543036864" status: 202 len: 0 microversion: 2.1 time: 0.095580 Jul 14 14:55:36.345660 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1823/3519] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1543036864 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:55:36.494423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:36.519486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:36.525278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:36.526916 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f0887d2e-68ec-4d04-88c1-fa36569400e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 1.488289 Jul 14 14:55:36.527565 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1697/3520] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:35 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:36.658457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:36.659294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:36.676670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.684358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:36.686812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:36.687922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:37.182513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:37.206458 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c3ca0b27-a3b3-4cfc-a095-6bef15616942 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 0.553873 Jul 14 14:55:37.208672 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1824/3521] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:36 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:37.552186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:37.554081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:37.581864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:37.587500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:37.590720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:37.593334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.010879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-78e54bf4-14c0-4757-9a40-16de7a1f2b76 req-512f2710-7b4d-4320-9dfb-e43f530c6296 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "tag": "fa7a3523-487e-4688-9d2d-82c50d30228b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:38.048177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-78e54bf4-14c0-4757-9a40-16de7a1f2b76 req-512f2710-7b4d-4320-9dfb-e43f530c6296 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.048869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-78e54bf4-14c0-4757-9a40-16de7a1f2b76 req-512f2710-7b4d-4320-9dfb-e43f530c6296 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.140831 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-78e54bf4-14c0-4757-9a40-16de7a1f2b76 req-512f2710-7b4d-4320-9dfb-e43f530c6296 service nova] Creating event network-changed:fa7a3523-487e-4688-9d2d-82c50d30228b for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:55:38.167900 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-78e54bf4-14c0-4757-9a40-16de7a1f2b76 req-512f2710-7b4d-4320-9dfb-e43f530c6296 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155782 Jul 14 14:55:38.174812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1825/3522] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:38.239820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:38.241045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:38.257305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.259922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:38.270344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:38.271412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:39.190027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:39.217061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:39.227609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:39.233939 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70ed5a9d-0891-456b-8cff-368a6e61976d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 1.688986 Jul 14 14:55:39.244371 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1698/3523] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:37 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:39.266553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-810f2153-f232-4271-874b-9e54bc8ded84 req-15f1a0be-c580-4cc3-9244-c7363cce6477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-plugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:39.338736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-810f2153-f232-4271-874b-9e54bc8ded84 req-15f1a0be-c580-4cc3-9244-c7363cce6477 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:39.346434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-810f2153-f232-4271-874b-9e54bc8ded84 req-15f1a0be-c580-4cc3-9244-c7363cce6477 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:39.393318 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-810f2153-f232-4271-874b-9e54bc8ded84 req-15f1a0be-c580-4cc3-9244-c7363cce6477 service nova] Creating event network-vif-plugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:55:39.408317 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-810f2153-f232-4271-874b-9e54bc8ded84 req-15f1a0be-c580-4cc3-9244-c7363cce6477 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157709 Jul 14 14:55:39.412616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1699/3524] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:39.838665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:39.859331 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9004f21-eaaa-41e7-a9de-96b0dc049a10 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.625936 Jul 14 14:55:39.860376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1826/3525] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:38 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:40.275842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:40.276663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:40.294460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.295529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.296939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.297759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.778727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91539b28-f4d6-4406-a6f0-b03559cd411d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: .version_select at 0x7fdbf1e90670>, body: {"keypair": {"name": "tempest-keypair-1031503142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxBkDf87kgDFnsUMvEix1TbefdrfKWFtQPBo38/DUUSTUo1oELeB9NRfKKH6tUWYspRS2vlpJ1O8yN2DeMRal9grb01kO//qGOaqBfQhtzNMivni3uTUgfRKFu/81nlkQ=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:40.809320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-91539b28-f4d6-4406-a6f0-b03559cd411d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for project 27951e61632946f58c199f09723d6fdd. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:40.825100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-91539b28-f4d6-4406-a6f0-b03559cd411d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for user b06a5d6f31ea4d4a9a7e69f759a3c7ce and project 27951e61632946f58c199f09723d6fdd. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:40.886418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91539b28-f4d6-4406-a6f0-b03559cd411d tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115982 Jul 14 14:55:40.889950 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1827/3526] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:55:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:40.905149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:40.906490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:40.924215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.925930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:40.927230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:40.931499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.422493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.433810 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-34d6b45d-b3c4-4217-8f97-63577cbb632c tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 0.539901 Jul 14 14:55:41.440435 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1828/3527] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:40 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:41.481451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-53852bd8-eebf-407e-a90e-0ca206868119 req-fa13aa09-ef0d-49dc-ac5f-50f7c43a9e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "name": "network-vif-plugged", "status": "completed", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:41.513545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:41.527462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.534504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-53852bd8-eebf-407e-a90e-0ca206868119 req-fa13aa09-ef0d-49dc-ac5f-50f7c43a9e11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:41.540349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.556050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:41.557580 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a32742fa-ac77-4322-9614-1f0705f7f994 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 1.288260 Jul 14 14:55:41.560085 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1700/3528] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:40 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:41.567310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-53852bd8-eebf-407e-a90e-0ca206868119 req-fa13aa09-ef0d-49dc-ac5f-50f7c43a9e11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:41.619028 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-53852bd8-eebf-407e-a90e-0ca206868119 req-fa13aa09-ef0d-49dc-ac5f-50f7c43a9e11 service nova] Creating event network-vif-plugged:0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53 for instance e902fe2d-9dd4-4533-8381-c44065e607bf on n-h1-768852-23 Jul 14 14:55:41.639307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-53852bd8-eebf-407e-a90e-0ca206868119 req-fa13aa09-ef0d-49dc-ac5f-50f7c43a9e11 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161968 Jul 14 14:55:41.640700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1829/3529] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:55:42.461010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:42.462512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:42.491219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.504449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.506473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.507990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.582039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:42.583653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:42.616575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.620901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:42.622185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:42.623379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:43.200056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:43.209932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:43.219228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:43.221031 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e6c93433-e62d-4a3d-a2b4-09a1affc9a77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1406 microversion: 2.20 time: 0.644438 Jul 14 14:55:43.224994 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1830/3530] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:42 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1406 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:44.171689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:44.221829 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc84d99e-204c-4c10-a726-5dafd1f87b4d tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.767503 Jul 14 14:55:44.226177 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1701/3531] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:42 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:44.245765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:44.246474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:44.276339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:44.277426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:44.281972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:44.283364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.073231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:45.112253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:45.121038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:45.139059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cdd76a0-30e0-4599-9e9c-962d95379129 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1597 microversion: 2.20 time: 0.888586 Jul 14 14:55:45.144085 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1831/3532] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:44 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1597 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:45.183959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:45.185921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:45.219594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:45.222871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.224994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:45.226232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.245549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:45.255350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:45.290818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:45.300526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.302278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:45.303211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:45.769589 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eb7b4a9e-21fb-4c9a-9eba-740348eb6cb1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.599143 Jul 14 14:55:45.771975 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1702/3533] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 14:55:45 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-interface => generated 284 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:55:46.035873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:46.072733 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5a6ab399-164f-4d3c-b05e-3273340590bb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 0.835729 Jul 14 14:55:46.080790 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1832/3534] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:45 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:47.113509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:47.114809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:47.157441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:47.157981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:47.173151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:47.179420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:47.288387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:47.878488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-757899806", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": "none"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:47.994432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:55:47.994432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:55:47.994432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:55:47.995657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:55:47.995657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:55:48.025717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:48.026188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:48.030692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:48.034901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:48.112145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Getting quotas for project 6ee00daa615a44dca0645ac6735ea176. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:48.144232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Getting quotas for user a22f242a85264177b686d8be0a1218c4 and project 6ee00daa615a44dca0645ac6735ea176. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:48.253997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:55:48.258605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:55:48.647623 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8778738b-da2b-4cb0-8d8a-2c28e1588fa7 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.908435 Jul 14 14:55:48.652345 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1703/3535] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:55:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:55:48.703874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-699aaec7-ccb7-4682-b681-12cb856fe221 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:48.713391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-699aaec7-ccb7-4682-b681-12cb856fe221 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:49.185306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-699aaec7-ccb7-4682-b681-12cb856fe221 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.229819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-699aaec7-ccb7-4682-b681-12cb856fe221 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.236427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-699aaec7-ccb7-4682-b681-12cb856fe221 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.241445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-699aaec7-ccb7-4682-b681-12cb856fe221 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1280 microversion: 2.47 time: 0.579737 Jul 14 14:55:49.242941 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1704/3536] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:48 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1280 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:49.435765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:49.446348 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33a25085-8a7a-47a7-8cae-e5e1a3f1fc9f tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 2.337138 Jul 14 14:55:49.465290 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1833/3537] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:47 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:55:50.261490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f71b1c5d-c2de-42c2-bc25-f46d964a7e80 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:50.263062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f71b1c5d-c2de-42c2-bc25-f46d964a7e80 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:50.487480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:50.488784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:50.516492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f71b1c5d-c2de-42c2-bc25-f46d964a7e80 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:50.537944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f71b1c5d-c2de-42c2-bc25-f46d964a7e80 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:50.539821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:50.546073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:50.548023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f71b1c5d-c2de-42c2-bc25-f46d964a7e80 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:50.551202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:50.553891 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f71b1c5d-c2de-42c2-bc25-f46d964a7e80 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1280 microversion: 2.47 time: 0.297450 Jul 14 14:55:50.554338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:50.570325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1705/3538] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:50 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1280 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:50.848029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:51.525693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9bc0d40c-4b3b-4fda-bb1b-ab8f586ab475 req-fa709a3a-9b5e-42a6-9c31-04faeca906e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:51.537503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.565649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9bc0d40c-4b3b-4fda-bb1b-ab8f586ab475 req-fa709a3a-9b5e-42a6-9c31-04faeca906e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:51.567020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9bc0d40c-4b3b-4fda-bb1b-ab8f586ab475 req-fa709a3a-9b5e-42a6-9c31-04faeca906e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:51.569863 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4de016d7-f079-4cc3-9f6f-97ffaf7be6c2 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.087916 Jul 14 14:55:51.571627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1834/3539] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:50 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:51.580617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-951106041", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88d93d25-4776-49a9-88b4-3b0c6033bbe9"}], "security_groups": [{"name": "tempest-securitygroup--1170693936"}], "key_name": "tempest-keypair-1031503142", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:51.620300 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9bc0d40c-4b3b-4fda-bb1b-ab8f586ab475 req-fa709a3a-9b5e-42a6-9c31-04faeca906e8 service nova] Creating event network-changed:0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53 for instance e902fe2d-9dd4-4533-8381-c44065e607bf on n-h1-768852-23 Jul 14 14:55:51.635703 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9bc0d40c-4b3b-4fda-bb1b-ab8f586ab475 req-fa709a3a-9b5e-42a6-9c31-04faeca906e8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112947 Jul 14 14:55:51.637121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1706/3540] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:51.652137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:51.653420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:51.670827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:51.672062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:51.673190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:51.673912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:51.957152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.970876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.973068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:51.978565 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97476b22-4f9b-4ddb-93fd-201fb31b9a97 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1332 microversion: 2.47 time: 0.339772 Jul 14 14:55:51.984089 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1707/3541] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:51 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1332 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:52.275770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] validate_networks() for [('88d93d25-4776-49a9-88b4-3b0c6033bbe9', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:55:52.590028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:52.590997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:52.622243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:52.624802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:52.627531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:52.631184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.063610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:55:54.064165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:55:54.064520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:55:54.064937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:55:54.065364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:55:54.096603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.097379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.098454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.099078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.157178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for project 27951e61632946f58c199f09723d6fdd. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:55:54.169755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Getting quotas for user b06a5d6f31ea4d4a9a7e69f759a3c7ce and project 27951e61632946f58c199f09723d6fdd. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:55:54.208790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:55:54.216004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:55:54.237436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.261113 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02efe1c7-9412-4065-9955-64cf8e330feb tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.675557 Jul 14 14:55:54.277252 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1708/3542] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:52 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:54.315161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:54.319011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:54.339048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.343148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.345759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:54.346333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:54.510461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-846701b6-726f-470d-9a08-882efc3a5368 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.936188 Jul 14 14:55:54.519354 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1835/3543] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:55:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 2947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:55:54.535551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db66a589-65b4-467f-9cee-02f25ef419b7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:54.538479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db66a589-65b4-467f-9cee-02f25ef419b7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:54.708446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.725024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.728271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.735988 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8e99c13-5ef2-4646-bd85-4b27b1552e5e tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1338 microversion: 2.47 time: 0.435322 Jul 14 14:55:54.756365 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1709/3544] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:54 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1338 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:54.897766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db66a589-65b4-467f-9cee-02f25ef419b7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:54.912696 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db66a589-65b4-467f-9cee-02f25ef419b7 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1237 microversion: 2.1 time: 0.388840 Jul 14 14:55:54.925418 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1836/3545] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:54 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1237 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:55.295468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:55.296129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:55.318162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.324604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:55.326007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.333113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:55.784701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:55.786383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:55.829576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.843318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:55.844924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:55.847770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.214552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.279968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.298521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.312198 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e635ac8-d32e-4286-b887-a96e81826f44 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1359 microversion: 2.47 time: 0.538500 Jul 14 14:55:56.332212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.341164 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1837/3546] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:55 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1359 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:56.378622 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-998df6a7-9d1e-4282-81d3-139543603d93 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.074943 Jul 14 14:55:56.390627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:56.391459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1710/3547] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:55 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:56.406904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:56.432723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1591220569"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:56.434765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:56.454591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:56.455411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.486197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:56.487949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.504466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:56.505657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.507620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:56.510254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:56.814360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:56.849483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29131b0e-80ea-4698-bbb4-c5da9d3ea71f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1233 microversion: 2.1 time: 0.503468 Jul 14 14:55:56.852956 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1838/3548] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:56 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1233 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:57.181390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-66c4bbc5-15fd-473d-a26c-ab7763508ac6 req-09762e78-de26-416d-be28-4c08572d5783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "name": "network-vif-plugged", "status": "completed", "tag": "fa7a3523-487e-4688-9d2d-82c50d30228b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:57.215209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-66c4bbc5-15fd-473d-a26c-ab7763508ac6 req-09762e78-de26-416d-be28-4c08572d5783 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.217041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-66c4bbc5-15fd-473d-a26c-ab7763508ac6 req-09762e78-de26-416d-be28-4c08572d5783 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.354274 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-66c4bbc5-15fd-473d-a26c-ab7763508ac6 req-09762e78-de26-416d-be28-4c08572d5783 service nova] Creating event network-vif-plugged:fa7a3523-487e-4688-9d2d-82c50d30228b for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:55:57.390922 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-66c4bbc5-15fd-473d-a26c-ab7763508ac6 req-09762e78-de26-416d-be28-4c08572d5783 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215805 Jul 14 14:55:57.404073 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1839/3549] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:57.461403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:57.462914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:57.515502 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b331a8f-8c41-453e-8e8c-10fceb9e1946 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "POST /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e/action" status: 202 len: 52 microversion: 2.47 time: 1.115360 Jul 14 14:55:57.525490 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1711/3550] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:55:56 2022] POST /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e/action => generated 52 bytes in 1133 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Jul 14 14:55:57.534886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.535794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.552416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.553523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:57.553665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.569393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:57.626962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.628416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.633869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:57.647322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:57.943033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:55:58.076412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:58.220341 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-59041dca-a051-4f0f-bd15-05e3e1cfc1d8 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "DELETE /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 204 len: 0 microversion: 2.47 time: 0.688934 Jul 14 14:55:58.229503 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1712/3551] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:55:57 2022] DELETE /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:55:58.295448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:58.300135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:58.333471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.336804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.341200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.341689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.346178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.354033 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-645c530f-5eee-4810-bac3-9f312510aca3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 0.942961 Jul 14 14:55:58.362723 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1840/3552] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:57 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:58.381100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:58.382128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:58.399588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.400336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.401378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:58.406711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:58.624369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.642235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.644525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.646163 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84b003ca-6b01-4cdc-939d-07e0a87a0b61 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1365 microversion: 2.47 time: 0.281977 Jul 14 14:55:58.652120 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1841/3553] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:58 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1365 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:58.729236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:58.744521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe7c463b-f7a4-4f10-a036-627bd0e5d3eb tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1295 microversion: 2.1 time: 0.509102 Jul 14 14:55:58.758690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1713/3554] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:58 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1295 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:55:59.375368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:59.376304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:59.395157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.395671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.396479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.396928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.511252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-29b11182-bb05-445f-a026-663040897de9 req-44a86df0-5b58-493f-af4e-0390d698a7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "name": "network-vif-plugged", "status": "completed", "tag": "a4cf6e0d-3d37-472f-b85c-48d490ea096f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:55:59.549387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-29b11182-bb05-445f-a026-663040897de9 req-44a86df0-5b58-493f-af4e-0390d698a7d2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.550885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-29b11182-bb05-445f-a026-663040897de9 req-44a86df0-5b58-493f-af4e-0390d698a7d2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.587996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:55:59.598216 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-29b11182-bb05-445f-a026-663040897de9 req-44a86df0-5b58-493f-af4e-0390d698a7d2 service nova] Creating event network-vif-plugged:a4cf6e0d-3d37-472f-b85c-48d490ea096f for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:55:59.629501 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-29b11182-bb05-445f-a026-663040897de9 req-44a86df0-5b58-493f-af4e-0390d698a7d2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135524 Jul 14 14:55:59.632517 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1714/3555] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:55:59.689513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:59.691992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:59.704807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.705658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.707110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.708142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.890952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.904172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.908861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:55:59.911886 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-306105ee-19f4-4d1d-b56d-7a59be3ddffc tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1365 microversion: 2.47 time: 0.232722 Jul 14 14:55:59.931638 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1715/3556] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:55:59 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:55:59.945777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:55:59.947143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:55:59.960253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.961733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:55:59.963173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:55:59.964035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:00.346242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:00.355091 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-788e3350-6a7f-47ce-9503-d262e34d49b6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1295 microversion: 2.1 time: 0.421714 Jul 14 14:56:00.355730 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1716/3557] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:59 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1295 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:00.934544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:00.937818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:00.939235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:00.944916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-79dc8d6f-a2b5-4437-9710-12fe08540db7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.574599 Jul 14 14:56:00.955613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1842/3558] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:55:59 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:00.980373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:00.993368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.000685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.002383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.005416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.372086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.372728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.384516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.391235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.395424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.399950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.545549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.558227 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c3e3fa1-7b88-4be9-902f-79aabea5aa58 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1295 microversion: 2.1 time: 0.190299 Jul 14 14:56:01.567893 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1843/3559] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1295 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:01.684357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.709246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.716887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a22f242a85264177b686d8be0a1218c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ee00daa615a44dca0645ac6735ea176', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:01.720052 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fdffae92-3796-4904-a285-4509273da495 tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 200 len: 1365 microversion: 2.47 time: 0.787783 Jul 14 14:56:01.724570 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1717/3560] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:00 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 1365 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:01.963054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:01.963660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:01.981891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.982364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:01.983205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:01.983825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.594090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:02.615505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:02.642180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.653599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:02.654939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:02.655738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.768143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:03.785314 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38bf54b2-20df-4a89-9cac-7134fc0d0a43 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 1.206312 Jul 14 14:56:03.786792 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1718/3561] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:02 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:03.793553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:03.794571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] [instance: 79973d88-6a86-4eba-8be2-15530180a46e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:03.827462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:03.829621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.833899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.839328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:03.840878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:03.859263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:03.879849 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d026597c-60d5-4bfa-8a85-b553a72ebd5b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1334 microversion: 2.1 time: 1.921544 Jul 14 14:56:03.880483 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1844/3562] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:01 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1334 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:03.921278 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] HTTP exception thrown: Instance 79973d88-6a86-4eba-8be2-15530180a46e could not be found. Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Request method failure captured: Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e HTTP/1.1 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C5yE7o8_BjuE8o7o_DbVz7UFkpcoMmHhqOZWiZARUD5S5qAjavwh5Q44m3VBHcpBouEQkf2TWp35x-5NSS6eINb-ZXFBgrm4JK9JTG7wRf52g1Om23qcz93qMMHogX3AoLclcIRCvY45gEHX3Pzbe-PkpGx7RbA9-YIlO62rC2UMz0 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.47 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 6ee00daa615a44dca0645ac6735ea176 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAaction247Test-1102165460 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6ee00daa615a44dca0645ac6735ea176"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6ee00daa615a44dca0645ac6735ea176"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6ee00daa615a44dca0645ac6735ea176"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6ee00daa615a44dca0645ac6735ea176"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAaction247Test-1102165460 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 6ee00daa615a44dca0645ac6735ea176 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAaction247Test-1102165460 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAaction247Test-1102165460-project Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a22f242a85264177b686d8be0a1218c4 Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAaction247Test-1102165460-project Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 79973d88-6a86-4eba-8be2-15530180a46e could not be found. Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '79973d88-6a86-4eba-8be2-15530180a46e'} Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79973d88-6a86-4eba-8be2-15530180a46e could not be found. Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79973d88-6a86-4eba-8be2-15530180a46e could not be found. Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:03.927746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79973d88-6a86-4eba-8be2-15530180a46e could not be found. Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] Returning 404 to user: Instance 79973d88-6a86-4eba-8be2-15530180a46e could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e9f2fc0-9ac1-4175-9417-24b70cd1c33f tempest-ServersAaction247Test-1102165460 tempest-ServersAaction247Test-1102165460-project] 10.222.0.98 "GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e" status: 404 len: 111 microversion: 2.47 time: 0.142508 Jul 14 14:56:03.939076 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1719/3563] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:03 2022] GET /compute/v2.1/servers/79973d88-6a86-4eba-8be2-15530180a46e => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:56:04.508266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:04.805117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:04.806495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:04.830983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.832649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.837525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:04.841999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:04.912535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:04.949611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7b353914-7c08-42aa-aac4-e55c195919cc req-4f4bd2cc-3c6c-4b80-ae26-009a793a652f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa5cb90-18bc-4c57-898e-47f7f81302fa", "tag": "8f050eac-5407-4eab-bf6e-26440baf950d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:05.100638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7b353914-7c08-42aa-aac4-e55c195919cc req-4f4bd2cc-3c6c-4b80-ae26-009a793a652f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.102277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7b353914-7c08-42aa-aac4-e55c195919cc req-4f4bd2cc-3c6c-4b80-ae26-009a793a652f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.163198 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7b353914-7c08-42aa-aac4-e55c195919cc req-4f4bd2cc-3c6c-4b80-ae26-009a793a652f service nova] Creating event network-changed:8f050eac-5407-4eab-bf6e-26440baf950d for instance cfa5cb90-18bc-4c57-898e-47f7f81302fa on n-h1-768852-23 Jul 14 14:56:05.173331 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7b353914-7c08-42aa-aac4-e55c195919cc req-4f4bd2cc-3c6c-4b80-ae26-009a793a652f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.682602 Jul 14 14:56:05.179057 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1845/3564] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:05.192924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:05.195913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:05.219325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.223168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.224452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.228577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.827850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.841159 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b243570-70de-42b3-b059-69f20a3306c6 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 1.039215 Jul 14 14:56:05.843405 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1720/3565] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:04 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:05.850157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:05.863783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fe2ccae-6f01-43ad-ba19-b1f3925f543b tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1670 microversion: 2.1 time: 0.681622 Jul 14 14:56:05.887669 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1846/3566] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:05 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1670 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:05.897154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:05.901503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:05.941414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.943166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:05.946604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:05.947057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.039967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a3bae5a-80a7-44ac-9499-6e189ed52192 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723/ips" status: 200 len: 180 microversion: 2.1 time: 0.146538 Jul 14 14:56:06.044865 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1847/3567] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:56:05 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723/ips => generated 180 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:56:06.062497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:06.064866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:06.087781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.090148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.092508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.094354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.186718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:56:06.361754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75592400-cc06-4f07-8211-b259e19d2bc3 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 204 len: 0 microversion: 2.1 time: 0.309330 Jul 14 14:56:06.365695 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1848/3568] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:56:06 2022] DELETE /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:56:06.376607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:06.377706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:06.387963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.389381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.390969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.391883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.711308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-317d9b59-58a7-46bf-af47-ddb1f120f3df tempest-FloatingIPDetailsNegativeTestJSON-1296074678 tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project] Calling method '.version_select at 0x7fdbf1f8c430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:06.843614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:06.860200 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a298c711-57c3-4f9c-90a1-2f9fbd97ed25 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1676 microversion: 2.1 time: 0.491606 Jul 14 14:56:06.870844 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1849/3569] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:06 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1676 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:06.881307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:06.882268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:06.900516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.901188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:06.902246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:06.905876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.304006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG neutronclient.v2_0.client [None req-317d9b59-58a7-46bf-af47-ddb1f120f3df tempest-FloatingIPDetailsNegativeTestJSON-1296074678 tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 820a1b95-008d-4dba-9c6d-f9a3fd353741 could not be found", "detail": ""}} {{(pid=125966) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Jul 14 14:56:07.305820 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-317d9b59-58a7-46bf-af47-ddb1f120f3df tempest-FloatingIPDetailsNegativeTestJSON-1296074678 tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project] HTTP exception thrown: Floating IP not found for ID 820a1b95-008d-4dba-9c6d-f9a3fd353741 Jul 14 14:56:07.311723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-317d9b59-58a7-46bf-af47-ddb1f120f3df tempest-FloatingIPDetailsNegativeTestJSON-1296074678 tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project] Request method failure captured: Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/os-floating-ips/820a1b95-008d-4dba-9c6d-f9a3fd353741 HTTP/1.1 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C6FaXw4n22dLrcXBG3FWUV972U15Ba7fEpOeqrwlaZW_wFBeqtTQUWSo8dBsFQiEmMu9tARYINRvegQOHLPIqbhDmBgnI7ZJ95yExAzZSQ3QI9d009L5Tc1S_UdzRpIPPHI2w1qlCEXe72WWBaYoy29o10tUJv0rDtcyXiPbqR_MX0 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b5a7b730114946778d55e6ee517a024a Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1296074678 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b5a7b730114946778d55e6ee517a024a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b5a7b730114946778d55e6ee517a024a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b5a7b730114946778d55e6ee517a024a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b5a7b730114946778d55e6ee517a024a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1296074678 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b5a7b730114946778d55e6ee517a024a Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1296074678 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ee88775f240740edacac3598b8901101 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: method: Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: exception: Floating IP not found for ID 820a1b95-008d-4dba-9c6d-f9a3fd353741 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '820a1b95-008d-4dba-9c6d-f9a3fd353741'} Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 820a1b95-008d-4dba-9c6d-f9a3fd353741 could not be found Jul 14 14:56:07.315792 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ba16519a-48df-4744-93a4-dbbb2e89fc9e'] Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 820a1b95-008d-4dba-9c6d-f9a3fd353741. Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 820a1b95-008d-4dba-9c6d-f9a3fd353741 Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 820a1b95-008d-4dba-9c6d-f9a3fd353741 Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-317d9b59-58a7-46bf-af47-ddb1f120f3df tempest-FloatingIPDetailsNegativeTestJSON-1296074678 tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project] Returning 404 to user: Floating IP not found for ID 820a1b95-008d-4dba-9c6d-f9a3fd353741 {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-317d9b59-58a7-46bf-af47-ddb1f120f3df tempest-FloatingIPDetailsNegativeTestJSON-1296074678 tempest-FloatingIPDetailsNegativeTestJSON-1296074678-project] 10.222.0.98 "GET /compute/v2.1/os-floating-ips/820a1b95-008d-4dba-9c6d-f9a3fd353741" status: 404 len: 111 microversion: 2.1 time: 1.473202 Jul 14 14:56:07.321107 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1721/3570] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 14:56:05 2022] GET /compute/v2.1/os-floating-ips/820a1b95-008d-4dba-9c6d-f9a3fd353741 => generated 111 bytes in 1475 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:07.338288 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-40c1b082-ef8a-48a4-a29d-14608dbce3e2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 0.471974 Jul 14 14:56:07.347370 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1850/3571] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:06 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:07.889073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:07.915545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:07.955727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.967189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:07.970377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:07.971051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.364008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:08.365062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:08.472193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.472945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.474406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:08.476108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:08.559492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:09.825549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:09.844734 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0cc8f54-a1bc-47ad-a710-7fd04aaed002 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1676 microversion: 2.1 time: 1.969028 Jul 14 14:56:09.846038 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1722/3572] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:07 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1676 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:09.863206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:09.864888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:09.902588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:09.906895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:09.908201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:09.909080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.315225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:10.328885 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5bc35cb9-060a-4bdc-932f-b180dbd239e1 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 1.973578 Jul 14 14:56:10.332551 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1851/3573] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:08 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 1978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:10.874670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:10.875370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:10.905905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.909492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:10.912942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:10.919713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.102173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:11.110358 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-478f0f70-1df5-4b78-abe4-04c6ede94b60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.263335 Jul 14 14:56:11.110973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1723/3574] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:09 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:11.136432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-405633515"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:11.137665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:11.152214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.163195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.173675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.174121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.897737 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e29b5d4c-fd19-4a43-9364-d62d39d1bf65 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.772793 Jul 14 14:56:11.899400 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1724/3575] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:11 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Jul 14 14:56:11.912514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-70c0ed13-246c-40fd-8290-45bf9494ee3c req-2f45cc3c-8f93-4022-9554-76fd466f8e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "name": "network-vif-deleted", "tag": "a4cf6e0d-3d37-472f-b85c-48d490ea096f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:11.932212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-70c0ed13-246c-40fd-8290-45bf9494ee3c req-2f45cc3c-8f93-4022-9554-76fd466f8e9e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.933386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-70c0ed13-246c-40fd-8290-45bf9494ee3c req-2f45cc3c-8f93-4022-9554-76fd466f8e9e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.949035 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-70c0ed13-246c-40fd-8290-45bf9494ee3c req-2f45cc3c-8f93-4022-9554-76fd466f8e9e service nova] Creating event network-vif-deleted:a4cf6e0d-3d37-472f-b85c-48d490ea096f for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:56:11.959625 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-70c0ed13-246c-40fd-8290-45bf9494ee3c req-2f45cc3c-8f93-4022-9554-76fd466f8e9e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058483 Jul 14 14:56:11.961534 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1725/3576] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:11.980143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:11.981266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:11.996020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.996470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:11.997508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:11.998145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:12.341912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:12.368043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ae05e8f-609f-4be6-bfd6-9012b5279584 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1655 microversion: 2.1 time: 1.496895 Jul 14 14:56:12.370300 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1852/3577] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:10 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1655 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:12.870978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dad8b8b9-70a1-453a-b027-a74682dcccf1 req-99ad608e-cb18-4b4b-be82-83194a0b7243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "name": "network-vif-unplugged", "status": "completed", "tag": "fa7a3523-487e-4688-9d2d-82c50d30228b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:12.918813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:12.951593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dad8b8b9-70a1-453a-b027-a74682dcccf1 req-99ad608e-cb18-4b4b-be82-83194a0b7243 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:12.953001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dad8b8b9-70a1-453a-b027-a74682dcccf1 req-99ad608e-cb18-4b4b-be82-83194a0b7243 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.020573 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dad8b8b9-70a1-453a-b027-a74682dcccf1 req-99ad608e-cb18-4b4b-be82-83194a0b7243 service nova] Creating event network-vif-unplugged:fa7a3523-487e-4688-9d2d-82c50d30228b for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:56:13.031303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dad8b8b9-70a1-453a-b027-a74682dcccf1 req-99ad608e-cb18-4b4b-be82-83194a0b7243 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.171776 Jul 14 14:56:13.042961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1853/3578] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:13.198322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:13.206638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7cf4ce03-547d-4f08-b710-88ce3f295f55 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 1.243582 Jul 14 14:56:13.207249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1726/3579] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:11 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:13.410131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:13.411849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:13.429201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.430441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:13.432310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:13.433213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.149608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8057bbd2-8f7b-4fd9-a403-43d1244ff84f req-2bc239f3-8869-4fdc-80da-9ac957122184 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44b0c0c-6c58-49e4-9fb3-4df1318ed723", "name": "network-vif-deleted", "tag": "fa7a3523-487e-4688-9d2d-82c50d30228b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:14.184610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8057bbd2-8f7b-4fd9-a403-43d1244ff84f req-2bc239f3-8869-4fdc-80da-9ac957122184 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.185215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8057bbd2-8f7b-4fd9-a403-43d1244ff84f req-2bc239f3-8869-4fdc-80da-9ac957122184 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.279526 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8057bbd2-8f7b-4fd9-a403-43d1244ff84f req-2bc239f3-8869-4fdc-80da-9ac957122184 service nova] Creating event network-vif-deleted:fa7a3523-487e-4688-9d2d-82c50d30228b for instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 on n-h2-768852-23 Jul 14 14:56:14.299606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8057bbd2-8f7b-4fd9-a403-43d1244ff84f req-2bc239f3-8869-4fdc-80da-9ac957122184 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154703 Jul 14 14:56:14.306790 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1727/3580] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:14.342634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:14.344794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:14.368804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.378529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.380583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:14.381439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:14.831189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '126f8683e55647bc9605e05c7aa654fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db5c93660ef41728634e8e57039da1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:14.870512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a912c23-acf4-4f50-a0a7-5706e9477b90 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 200 len: 1497 microversion: 2.1 time: 1.463900 Jul 14 14:56:14.873642 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1854/3581] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:13 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 1497 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:14.919011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:14.975008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-889c1d44-9760-4f51-ab4c-dcfa28998a9b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 0.662219 Jul 14 14:56:14.977102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1728/3582] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:14 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:15.480476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d1d44083-fc7f-4fd1-ae06-48eac947f43e req-ab6ffe97-47ea-41dd-9ae6-410d8ef1b238 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-unplugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:15.498870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d1d44083-fc7f-4fd1-ae06-48eac947f43e req-ab6ffe97-47ea-41dd-9ae6-410d8ef1b238 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.500054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d1d44083-fc7f-4fd1-ae06-48eac947f43e req-ab6ffe97-47ea-41dd-9ae6-410d8ef1b238 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.524852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d1d44083-fc7f-4fd1-ae06-48eac947f43e req-ab6ffe97-47ea-41dd-9ae6-410d8ef1b238 service nova] Creating event network-vif-unplugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:56:15.534429 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d1d44083-fc7f-4fd1-ae06-48eac947f43e req-ab6ffe97-47ea-41dd-9ae6-410d8ef1b238 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.392300 Jul 14 14:56:15.536353 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1855/3583] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:15.911802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:15.914284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:15.924941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.925890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.927426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:15.928188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:15.954974 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] HTTP exception thrown: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Request method failure captured: Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 HTTP/1.1 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C37wPTRqDG3JD0cPH-0dont03Nde6IbbfDYl56p2X5yfDmuJzublIjr4wJhkdwRuJGFk7_chpLhjX65yrOSyPkmdPJvgSVMB8mT_FUAOwmETvaYlkGM5v3-zmz7rUIhIW6_z5_O9ez8Q5P5SyB00MgMImI3Q2w7MfSTfvPVFuhuD28 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5db5c93660ef41728634e8e57039da1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 126f8683e55647bc9605e05c7aa654fd Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b44b0c0c-6c58-49e4-9fb3-4df1318ed723'} Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:15.958324 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Returning 404 to user: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:15.963726 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e82ffa0f-ca32-4602-8c69-adb95d0f8dc7 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 404 len: 111 microversion: 2.1 time: 0.061891 Jul 14 14:56:15.969271 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1729/3584] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:15 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:16.015805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:16.019871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:16.060167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:16.061532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:16.063526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:16.064885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.003015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:17.060881 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b68517b9-fcb6-4dba-9592-c201acf7a992 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 1.047377 Jul 14 14:56:17.074827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1856/3585] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:15 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:17.587808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3763d997-18ec-4d6d-8c06-f3afeef7e88d req-7a428e46-29b3-41e1-8af0-f1c29356acc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa5cb90-18bc-4c57-898e-47f7f81302fa", "name": "network-vif-plugged", "status": "completed", "tag": "8f050eac-5407-4eab-bf6e-26440baf950d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:17.638685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3763d997-18ec-4d6d-8c06-f3afeef7e88d req-7a428e46-29b3-41e1-8af0-f1c29356acc4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:17.642963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3763d997-18ec-4d6d-8c06-f3afeef7e88d req-7a428e46-29b3-41e1-8af0-f1c29356acc4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:17.697705 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3763d997-18ec-4d6d-8c06-f3afeef7e88d req-7a428e46-29b3-41e1-8af0-f1c29356acc4 service nova] Creating event network-vif-plugged:8f050eac-5407-4eab-bf6e-26440baf950d for instance cfa5cb90-18bc-4c57-898e-47f7f81302fa on n-h1-768852-23 Jul 14 14:56:17.743637 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3763d997-18ec-4d6d-8c06-f3afeef7e88d req-7a428e46-29b3-41e1-8af0-f1c29356acc4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163300 Jul 14 14:56:17.754921 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1730/3586] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:18.111553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:18.118823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:18.158293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.161289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:18.164111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:18.166927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:20.220308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:20.231036 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-981d95e6-1cd0-4662-9234-ce9180e0d14e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 2.130190 Jul 14 14:56:20.234805 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1857/3587] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:18 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 2137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:21.276655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:21.277591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:21.289929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:21.296004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:21.298624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:21.299776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.017328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:22.040462 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bb4f2edd-1e98-41fc-bfe7-5ba7cec26c7b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1363 microversion: 2.1 time: 0.776983 Jul 14 14:56:22.044878 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1731/3588] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:21 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1363 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:22.473777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d2c16c04-5e96-491f-b1e6-301aa8dbd776 req-d2466dda-2f8c-4424-8a2d-b8ac4f9442c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-plugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:22.541817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d2c16c04-5e96-491f-b1e6-301aa8dbd776 req-d2466dda-2f8c-4424-8a2d-b8ac4f9442c1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:22.542520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d2c16c04-5e96-491f-b1e6-301aa8dbd776 req-d2466dda-2f8c-4424-8a2d-b8ac4f9442c1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:22.611744 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d2c16c04-5e96-491f-b1e6-301aa8dbd776 req-d2466dda-2f8c-4424-8a2d-b8ac4f9442c1 service nova] Creating event network-vif-plugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:56:22.634164 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d2c16c04-5e96-491f-b1e6-301aa8dbd776 req-d2466dda-2f8c-4424-8a2d-b8ac4f9442c1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171336 Jul 14 14:56:22.640666 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1858/3589] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:23.068552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:23.073330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:23.105341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.106225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.111142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.124313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.180245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:23.191327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:23.235030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.235549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.240780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:23.241369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:23.380887 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a6e6ece-7b17-48b3-850b-5d356759a249 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/ips" status: 200 len: 151 microversion: 2.20 time: 0.212008 Jul 14 14:56:23.387802 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1859/3590] 10.222.0.98 () {60 vars in 1288 bytes} [Thu Jul 14 14:56:23 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/ips => generated 151 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:56:24.598959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:24.613610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a68cd24-072b-4557-b82b-a774f5b458b2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1550 microversion: 2.1 time: 1.552000 Jul 14 14:56:24.615979 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1732/3591] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:23 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1550 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:24.634419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:24.635077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:24.646659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:24.647118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:24.655725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:24.657419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:25.216842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5f1e9629-fdb9-4cb7-8eac-37d27e187a70 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.587986 Jul 14 14:56:25.223313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1860/3592] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:56:24 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-interface => generated 285 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:27.104349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:27.108231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:27.131186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:27.132337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:27.133622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:27.139651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:27.270678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lazy-loading 'flavor' on Instance uuid e902fe2d-9dd4-4533-8381-c44065e607bf {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:56:27.420596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:28.082132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:28.083002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:28.118720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.123840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.130405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.130992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.186201 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] HTTP exception thrown: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Request method failure captured: Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 HTTP/1.1 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C37wPTRqDG3JD0cPH-0dont03Nde6IbbfDYl56p2X5yfDmuJzublIjr4wJhkdwRuJGFk7_chpLhjX65yrOSyPkmdPJvgSVMB8mT_FUAOwmETvaYlkGM5v3-zmz7rUIhIW6_z5_O9ez8Q5P5SyB00MgMImI3Q2w7MfSTfvPVFuhuD28 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5db5c93660ef41728634e8e57039da1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 126f8683e55647bc9605e05c7aa654fd Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b44b0c0c-6c58-49e4-9fb3-4df1318ed723'} Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:28.189105 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.194452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.198041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Returning 404 to user: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:28.199725 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be92762a-30c5-41a7-8a02-0045542e7105 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 404 len: 111 microversion: 2.1 time: 0.122761 Jul 14 14:56:28.200612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1861/3593] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:56:28 2022] DELETE /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:56:28.209310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:28.209951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: b44b0c0c-6c58-49e4-9fb3-4df1318ed723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:28.227389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.227854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.231040 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d678be4d-da72-434b-9edf-c15c394d86d8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/action" status: 202 len: 0 microversion: 2.20 time: 1.131038 Jul 14 14:56:28.232516 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1733/3594] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:56:27 2022] POST /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/action => generated 0 bytes in 1134 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:56:28.233536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.234245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.265308 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] HTTP exception thrown: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Request method failure captured: Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 HTTP/1.1 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C37wPTRqDG3JD0cPH-0dont03Nde6IbbfDYl56p2X5yfDmuJzublIjr4wJhkdwRuJGFk7_chpLhjX65yrOSyPkmdPJvgSVMB8mT_FUAOwmETvaYlkGM5v3-zmz7rUIhIW6_z5_O9ez8Q5P5SyB00MgMImI3Q2w7MfSTfvPVFuhuD28 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5db5c93660ef41728634e8e57039da1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 126f8683e55647bc9605e05c7aa654fd Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b44b0c0c-6c58-49e4-9fb3-4df1318ed723'} Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.266957 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Returning 404 to user: Instance b44b0c0c-6c58-49e4-9fb3-4df1318ed723 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:28.280855 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c08d99e-8b1f-4966-8cbd-213aa364be38 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723" status: 404 len: 111 microversion: 2.1 time: 0.063592 Jul 14 14:56:28.285722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:28.285722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:28.286334 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1862/3595] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:28 2022] GET /compute/v2.1/servers/b44b0c0c-6c58-49e4-9fb3-4df1318ed723 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 14:56:28.286334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:28.286856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:28.304272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.304724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.306839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.310266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.310723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.311418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.312496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.313333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.368810 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] HTTP exception thrown: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Request method failure captured: Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 HTTP/1.1 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C37wPTRqDG3JD0cPH-0dont03Nde6IbbfDYl56p2X5yfDmuJzublIjr4wJhkdwRuJGFk7_chpLhjX65yrOSyPkmdPJvgSVMB8mT_FUAOwmETvaYlkGM5v3-zmz7rUIhIW6_z5_O9ez8Q5P5SyB00MgMImI3Q2w7MfSTfvPVFuhuD28 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5db5c93660ef41728634e8e57039da1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 126f8683e55647bc9605e05c7aa654fd Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9740023f-c7f0-4fef-8174-941796239fd7'} Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:28.375328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Returning 404 to user: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6cbd9848-b17b-4ef4-b7ee-6aa847c28a62 tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 404 len: 111 microversion: 2.1 time: 0.095035 Jul 14 14:56:28.388047 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1863/3596] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:56:28 2022] DELETE /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:28.399494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:28.400148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] [instance: 9740023f-c7f0-4fef-8174-941796239fd7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:28.422451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.422892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.427549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:28.434395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:28.496221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] HTTP exception thrown: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Request method failure captured: Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 HTTP/1.1 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C37wPTRqDG3JD0cPH-0dont03Nde6IbbfDYl56p2X5yfDmuJzublIjr4wJhkdwRuJGFk7_chpLhjX65yrOSyPkmdPJvgSVMB8mT_FUAOwmETvaYlkGM5v3-zmz7rUIhIW6_z5_O9ez8Q5P5SyB00MgMImI3Q2w7MfSTfvPVFuhuD28 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5db5c93660ef41728634e8e57039da1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5db5c93660ef41728634e8e57039da1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5db5c93660ef41728634e8e57039da1a Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestMultiNic-1145458478 Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 126f8683e55647bc9605e05c7aa654fd Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestMultiNic-1145458478-project Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9740023f-c7f0-4fef-8174-941796239fd7'} Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:28.502349 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:28.518704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] Returning 404 to user: Instance 9740023f-c7f0-4fef-8174-941796239fd7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:28.525954 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00fa5478-886a-4278-95dd-aa554a55ec2e tempest-ServersTestMultiNic-1145458478 tempest-ServersTestMultiNic-1145458478-project] 10.222.0.98 "GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7" status: 404 len: 111 microversion: 2.1 time: 0.134636 Jul 14 14:56:28.528028 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1864/3597] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:28 2022] GET /compute/v2.1/servers/9740023f-c7f0-4fef-8174-941796239fd7 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:56:29.814742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.831827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.835448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:29.837068 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13ca6bfc-c79a-438d-ba0f-3b0ff61fe9fd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.578506 Jul 14 14:56:29.842833 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1734/3598] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:28 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:30.877892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:30.878806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:30.898536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.901923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:30.903101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:30.908685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:31.234517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d868c79f-fcc2-46ae-9d99-c16412aa0b3e req-20395600-6dfd-4df5-9bc5-d815dfafa07d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cfa5cb90-18bc-4c57-898e-47f7f81302fa", "tag": "8f050eac-5407-4eab-bf6e-26440baf950d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:31.298765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d868c79f-fcc2-46ae-9d99-c16412aa0b3e req-20395600-6dfd-4df5-9bc5-d815dfafa07d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:31.315450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d868c79f-fcc2-46ae-9d99-c16412aa0b3e req-20395600-6dfd-4df5-9bc5-d815dfafa07d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:31.452739 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d868c79f-fcc2-46ae-9d99-c16412aa0b3e req-20395600-6dfd-4df5-9bc5-d815dfafa07d service nova] Creating event network-changed:8f050eac-5407-4eab-bf6e-26440baf950d for instance cfa5cb90-18bc-4c57-898e-47f7f81302fa on n-h1-768852-23 Jul 14 14:56:31.483414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d868c79f-fcc2-46ae-9d99-c16412aa0b3e req-20395600-6dfd-4df5-9bc5-d815dfafa07d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.908059 Jul 14 14:56:31.500698 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1865/3599] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:32.427920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.440975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.454921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:32.456763 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab1bbd6c-cfe9-44f7-961d-51205e998016 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.583992 Jul 14 14:56:32.457698 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1735/3600] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:30 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:33.493888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:33.494689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:33.525722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:33.526234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:33.537309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:33.539142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:34.672671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.712643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.721668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:34.727692 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14157108-e814-471c-908b-88488f9f0dc6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.239715 Jul 14 14:56:34.731675 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1866/3601] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:33 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:35.768138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:35.769621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:35.773639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=32 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:35.801030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:35.804789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:35.810587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:35.812118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:37.462647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:37.493093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:37.505791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:37.516262 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-202952bd-d9d1-474c-a136-7723b5965257 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.751836 Jul 14 14:56:37.519864 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1736/3602] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:35 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:37.994637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ead085a-a27b-45a0-9209-f269f3f10438 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Action: 'create', calling method: .version_select at 0x7fdbf2ae2ca0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:38.035490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-0ead085a-a27b-45a0-9209-f269f3f10438 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Getting quotas for project 566b2b65030345808ad3011db90e8425. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:56:38.049895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-0ead085a-a27b-45a0-9209-f269f3f10438 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Getting quotas for user e6ddbab17e1b4c47afcd0244006f2c5b and project 566b2b65030345808ad3011db90e8425. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:56:38.160373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-0ead085a-a27b-45a0-9209-f269f3f10438 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Getting quotas for project 566b2b65030345808ad3011db90e8425. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:56:38.174838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-0ead085a-a27b-45a0-9209-f269f3f10438 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Getting quotas for user e6ddbab17e1b4c47afcd0244006f2c5b and project 566b2b65030345808ad3011db90e8425. Resources: {'server_groups'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:56:38.196557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ead085a-a27b-45a0-9209-f269f3f10438 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] 10.222.0.98 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.824115 Jul 14 14:56:38.197802 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1867/3603] 10.222.0.98 () {62 vars in 1213 bytes} [Thu Jul 14 14:56:37 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:56:38.209699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4b92e41-0c27-4499-92a6-8d01cc81bb21 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.229187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4b92e41-0c27-4499-92a6-8d01cc81bb21 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.024534 Jul 14 14:56:38.244562 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1737/3604] 10.222.0.98 () {60 vars in 1192 bytes} [Thu Jul 14 14:56:38 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:56:38.250133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2fbbcfa-3a8b-41de-98ba-dc16a17f5a5e tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.272096 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2fbbcfa-3a8b-41de-98ba-dc16a17f5a5e tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] 10.222.0.98 "GET /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0" status: 200 len: 235 microversion: 2.64 time: 0.026244 Jul 14 14:56:38.286595 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1868/3605] 10.222.0.98 () {60 vars in 1303 bytes} [Thu Jul 14 14:56:38 2022] GET /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0 => generated 235 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:56:38.320893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03aa1a85-d367-4142-a1da-1ac76a8ce3c8 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.416627 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03aa1a85-d367-4142-a1da-1ac76a8ce3c8 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0" status: 204 len: 0 microversion: 2.64 time: 0.118410 Jul 14 14:56:38.439577 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1738/3606] 10.222.0.98 () {60 vars in 1306 bytes} [Thu Jul 14 14:56:38 2022] DELETE /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:56:38.442371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf867bce-e233-4f3c-879f-6c8fc956d6e9 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.457583 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-bf867bce-e233-4f3c-879f-6c8fc956d6e9 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] HTTP exception thrown: Instance group c045eab1-44eb-4083-8e73-16794f6c13e0 could not be found. Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf867bce-e233-4f3c-879f-6c8fc956d6e9 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Request method failure captured: Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0 HTTP/1.1 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C6loreosgPKHGwlmMIGh2wC0b1zvDVvXVMqiGeGJJJkYGSc1Huedsmea9T3UfqgVgy0xujZLJCpIasJH3u1PnUGYi_Yp_xztL2U0FbDQpL90_a06jRVRM4B1tVcHSbolFzsmxbh_NZQ7rYnXSccvYb-zOqhwralMmXR79nhyS8HGAc Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.64 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 566b2b65030345808ad3011db90e8425 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerGroup264TestJSON-1009841517 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/566b2b65030345808ad3011db90e8425"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_566b2b65030345808ad3011db90e8425"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/566b2b65030345808ad3011db90e8425"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/566b2b65030345808ad3011db90e8425"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerGroup264TestJSON-1009841517 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 566b2b65030345808ad3011db90e8425 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1009841517 Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerGroup264TestJSON-1009841517-project Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: e6ddbab17e1b4c47afcd0244006f2c5b Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerGroup264TestJSON-1009841517-project Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance group c045eab1-44eb-4083-8e73-16794f6c13e0 could not be found. Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c045eab1-44eb-4083-8e73-16794f6c13e0'} Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c045eab1-44eb-4083-8e73-16794f6c13e0 could not be found. Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c045eab1-44eb-4083-8e73-16794f6c13e0 could not be found. Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:38.463056 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:56:38.477910 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:56:38.477910 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:56:38.477910 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:56:38.477910 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:56:38.477910 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c045eab1-44eb-4083-8e73-16794f6c13e0 could not be found. Jul 14 14:56:38.477910 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:56:38.482263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf867bce-e233-4f3c-879f-6c8fc956d6e9 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] Returning 404 to user: Instance group c045eab1-44eb-4083-8e73-16794f6c13e0 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:56:38.486273 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bf867bce-e233-4f3c-879f-6c8fc956d6e9 tempest-ServerGroup264TestJSON-1009841517 tempest-ServerGroup264TestJSON-1009841517-project] 10.222.0.98 "DELETE /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0" status: 404 len: 117 microversion: 2.64 time: 0.054148 Jul 14 14:56:38.493124 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1869/3607] 10.222.0.98 () {60 vars in 1306 bytes} [Thu Jul 14 14:56:38 2022] DELETE /compute/v2.1/os-server-groups/c045eab1-44eb-4083-8e73-16794f6c13e0 => generated 117 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:56:38.546228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:38.546962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:38.568783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:38.569255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:38.581652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:38.582561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:39.473738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.492711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.494427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:39.499384 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-254c2442-a8af-4e53-9369-9707298391bc tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 0.957050 Jul 14 14:56:39.508999 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1739/3608] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:38 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:40.526557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:40.528761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:40.550516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:40.551047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:40.561422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:40.564587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:40.624394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=58 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:41.595069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.612773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.615922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:41.623259 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc16e461-450e-4c16-8a55-f57409dea766 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.100971 Jul 14 14:56:41.635200 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1870/3609] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:40 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:42.643703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:42.645007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:42.663862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.664823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:42.666346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:42.666976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:43.452482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.474552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.487620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:43.493338 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f433ad69-0ff3-4cb7-8834-32a37fce34ab tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 0.850656 Jul 14 14:56:43.494701 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1740/3610] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:42 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:44.521613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:44.524045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:44.563197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:44.569116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:44.588312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:44.593194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:44.596465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:46.364867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:46.405768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:46.409746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:46.426770 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b8a2c754-582e-44b2-b350-aa66113ad887 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1743 microversion: 2.20 time: 1.916473 Jul 14 14:56:46.432089 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1871/3611] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:44 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1743 bytes in 1923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:47.464721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:47.465341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:47.479263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:47.479756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:47.480586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:47.481035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:48.713543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.792784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.796714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:48.809088 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dad697b9-e954-461f-b26b-eec44a49a474 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.348275 Jul 14 14:56:48.810295 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1741/3612] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:47 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:49.037697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:49.040402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:49.056702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:49.061282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.065519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.066638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.072434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.846164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:49.855243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:49.919141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.926192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:49.930389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:49.940962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:50.477488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.499612 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-889ec4d3-f5e0-44a2-9b43-727122164406 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.463347 Jul 14 14:56:50.504742 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1872/3613] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:49 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:50.916289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.930607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.944880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:50.958544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4cef40c3-327e-4c20-8665-e6d3b2e904f4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.115891 Jul 14 14:56:50.972707 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1742/3614] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:49 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:51.536873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:51.538977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:51.606905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:51.610170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:51.614609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:51.621134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:51.986758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:51.988385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:52.004806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:52.018250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:52.024193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:52.025036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:53.021508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.037569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c6e7415-4b63-4171-a087-dde923688801 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.507130 Jul 14 14:56:53.047615 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1873/3615] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:51 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:56:53.084127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1342481941"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:53.085543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:53.102725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:53.103196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:53.104059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:53.114592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:53.154934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.202810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.234311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:53.304545 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a03c7f8-1c08-42f7-9e2e-b07b44857343 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.307926 Jul 14 14:56:53.305801 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1743/3616] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:51 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:53.398254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0d652e43-c66d-4f4e-95f3-2c0066827923 req-2e789026-e1e6-47a3-98fd-49a4da31b0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "name": "network-vif-plugged", "status": "completed", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:53.473918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0d652e43-c66d-4f4e-95f3-2c0066827923 req-2e789026-e1e6-47a3-98fd-49a4da31b0ef service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:53.475996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0d652e43-c66d-4f4e-95f3-2c0066827923 req-2e789026-e1e6-47a3-98fd-49a4da31b0ef service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:53.538448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0d652e43-c66d-4f4e-95f3-2c0066827923 req-2e789026-e1e6-47a3-98fd-49a4da31b0ef service nova] Creating event network-vif-plugged:0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53 for instance e902fe2d-9dd4-4533-8381-c44065e607bf on n-h1-768852-23 Jul 14 14:56:53.586925 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0d652e43-c66d-4f4e-95f3-2c0066827923 req-2e789026-e1e6-47a3-98fd-49a4da31b0ef service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254737 Jul 14 14:56:53.589261 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1744/3617] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:54.342970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:54.343723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:54.375136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.379233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.383387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.384578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.779685 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e4ba4cf-b764-4a88-b109-887f3fc08960 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 1.699529 Jul 14 14:56:54.783393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1874/3618] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:56:53 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 1708 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Jul 14 14:56:54.810842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:54.820132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:54.864163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.864634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:54.875089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:54.875089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:55.517082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:55.557373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:55.572284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:55.577710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7428b60a-3b5e-469a-bb14-7d9ebb71d821 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.240565 Jul 14 14:56:55.585393 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1745/3619] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:54 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:55.945621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4a4cf775-1eee-4cb8-9bf9-b3f20087e8b8 req-93297094-46b1-46f7-ad52-a7891ffaafbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-unplugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:55.962298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4a4cf775-1eee-4cb8-9bf9-b3f20087e8b8 req-93297094-46b1-46f7-ad52-a7891ffaafbb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:55.963946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4a4cf775-1eee-4cb8-9bf9-b3f20087e8b8 req-93297094-46b1-46f7-ad52-a7891ffaafbb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.029866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4a4cf775-1eee-4cb8-9bf9-b3f20087e8b8 req-93297094-46b1-46f7-ad52-a7891ffaafbb service nova] Creating event network-vif-unplugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:56:56.038698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:56.052497 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4a4cf775-1eee-4cb8-9bf9-b3f20087e8b8 req-93297094-46b1-46f7-ad52-a7891ffaafbb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110024 Jul 14 14:56:56.057471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1746/3620] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:56.069563 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3537ed7d-69ee-4c5c-a3c7-4f0ade76a099 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 1.279383 Jul 14 14:56:56.087900 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1875/3621] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:54 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:56.628063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:56.640221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:56.686497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.688748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:56.692683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:56.696564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.107806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:57.111405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:57.157784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.158894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.162069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:57.170411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:57.280865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.295712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.297521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.311482 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-20c2c882-0411-49c5-8cf7-176f0200ed44 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.691709 Jul 14 14:56:57.312118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1747/3622] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:56 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:56:57.836927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:57.872979 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d95ab4b-7762-463d-9384-c8656a4f01d0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1687 microversion: 2.1 time: 0.772536 Jul 14 14:56:57.874648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1876/3623] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:57 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1687 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:56:58.337089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:58.338115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:58.368364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.369443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:58.373426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.374141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:58.624851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-06d3ba7b-dd14-4294-a8c5-9eca2dd4fdcf tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Action: 'create', calling method: .version_select at 0x7fdbf1f58f70>, body: {"keypair": {"name": "tempest-keypair-1722411914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJTnVUelXDtU4W5vTopXDLmnfuRuW2SZcFrmxfn4X8FcxZsWlFSO24JmRuw+lYv4TbGrRsF/MgrrP4UTUjwg4q/yiJBRJ8drVLwwHtb7BYD6414ykD6NJDIe+tTVNVylw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:56:58.675625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-06d3ba7b-dd14-4294-a8c5-9eca2dd4fdcf tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Getting quotas for project da0dc51858c64e3589abc68587ab1b40. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:56:58.696407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-06d3ba7b-dd14-4294-a8c5-9eca2dd4fdcf tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Getting quotas for user d2cb918769c44026b2b4358f3fcd7cff and project da0dc51858c64e3589abc68587ab1b40. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:56:58.763381 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-06d3ba7b-dd14-4294-a8c5-9eca2dd4fdcf tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.612215 Jul 14 14:56:58.765760 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1748/3624] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 14:56:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:56:58.906023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:56:58.907176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:56:58.942455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.963893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:58.970166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:56:58.978098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:56:59.003458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:56:59.394376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.417617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.435837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.443391 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56762951-8fd0-48c6-960c-25bfc0f3302d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.114330 Jul 14 14:56:59.463308 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1877/3625] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:56:58 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:56:59.958529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:56:59.973435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4e72ca9-8b09-475a-8077-d4aa75f2b350 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1687 microversion: 2.1 time: 1.071737 Jul 14 14:56:59.975053 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1749/3626] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:56:58 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1687 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:00.525288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:00.532576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:00.583100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:00.588256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:00.594046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:00.598746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:01.010583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:01.023131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:01.109959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:01.118501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:01.128527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:01.136429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:01.624329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:01.676608 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0a31513d-76e1-4112-a579-aa9097709f99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 0.678714 Jul 14 14:57:01.700924 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1750/3627] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:00 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:02.255798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:02.316590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:02.328243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:02.330944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70a2d545-e3c1-472e-a64f-31fb795efaa7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.839252 Jul 14 14:57:02.336879 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1878/3628] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:00 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:02.716461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:02.723012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:02.788322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.800650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:02.814218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:02.818467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.360639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:03.361816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:03.395921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.396590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.398657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:03.411016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:03.681239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:03.697908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b9b4de2b-b7c3-4608-ae36-7c370e54a7ed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 0.992831 Jul 14 14:57:03.711750 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1751/3629] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:02 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:04.185811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:04.205362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:04.215664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:04.221652 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87b2984b-7109-422c-befe-8fac21acc825 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.869409 Jul 14 14:57:04.251673 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1879/3630] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:03 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:04.729222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:04.730037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:04.738910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.739389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:04.748462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:04.750671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.250879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:05.251756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:05.286229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.286839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:05.288295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:05.288754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.005942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:06.027610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:06.031040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:06.032786 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1910a60d-47f6-4320-b49c-b8ff78701140 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.786603 Jul 14 14:57:06.040053 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1880/3631] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:05 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:57:06.048944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:06.055989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:06.076170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.081866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.092432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.095458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.170425 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1935aeca-4c19-4d34-b40d-e34519d9dc89 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/ips" status: 200 len: 147 microversion: 2.1 time: 0.121981 Jul 14 14:57:06.173736 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1881/3632] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 14:57:06 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/ips => generated 147 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:06.697994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-749f6473-ae32-4e15-965f-95e9daf088af req-73d904a3-03c9-491c-9152-9e3a39322afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-plugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:06.736610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-749f6473-ae32-4e15-965f-95e9daf088af req-73d904a3-03c9-491c-9152-9e3a39322afa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:06.738156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-749f6473-ae32-4e15-965f-95e9daf088af req-73d904a3-03c9-491c-9152-9e3a39322afa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:06.792460 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-749f6473-ae32-4e15-965f-95e9daf088af req-73d904a3-03c9-491c-9152-9e3a39322afa service nova] Creating event network-vif-plugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:57:06.830352 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-749f6473-ae32-4e15-965f-95e9daf088af req-73d904a3-03c9-491c-9152-9e3a39322afa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135846 Jul 14 14:57:06.836460 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1882/3633] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:07.080527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:07.081690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:07.105165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:07.105613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:07.124992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:07.126409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:07.541138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:07.556851 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca7df443-6018-498d-8bff-3d1ce004421a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 2.831596 Jul 14 14:57:07.563066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1752/3634] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:04 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 2838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:07.790043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:07.830961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:07.834553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:07.837008 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-27fd6a97-4516-41fb-9dae-5c8c0c06959f tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.760912 Jul 14 14:57:07.859819 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1883/3635] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:07 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:08.592279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:08.593843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:08.597063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:08.658738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:08.659466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:08.667753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:08.668305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:08.806425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:08.872894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:08.873995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:08.890640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:08.890867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:08.891688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:08.892128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:09.794868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:09.804825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4758335-f693-473e-ac14-51fd7ef7af8b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.218413 Jul 14 14:57:09.817271 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1753/3636] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:08 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:10.772306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:10.776607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:10.782472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:10.798827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:10.800139 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e735ec74-a91c-4b79-b7d9-498590b4fa32 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.931376 Jul 14 14:57:10.824156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:10.826409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:10.835251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1884/3637] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:08 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:10.881868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:10.882450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:10.883064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:10.890356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:11.742390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a26b3cc2-bf02-453a-b47c-4aca0988f769"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:11.744162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:11.774463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:11.775465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:11.781792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:11.782362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:12.709595 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65baa918-99c6-41b0-9f60-e944ba5adf9f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.974750 Jul 14 14:57:12.714499 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1885/3638] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:57:11 2022] POST /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments => generated 194 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:12.727980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:12.737660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:12.769778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:12.778821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:12.794013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:12.797504 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4925f88a-a382-4c23-a8fa-21c17ae143a3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.977684 Jul 14 14:57:12.798833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:12.810656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:12.821661 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1754/3639] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:10 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 2003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:13.838875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:13.840413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:13.861432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:13.862323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:13.868667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:13.869625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:14.231668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:14.255472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:14.260292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:14.265435 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37b047c4-5ff6-4d52-a5ab-73d26e093bda tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 1.547067 Jul 14 14:57:14.269668 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1886/3640] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:12 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:15.286978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:15.289474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:15.308058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=32 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:15.310808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:15.313878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:15.315149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:15.319152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:15.399757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:15.415009 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd3eeb76-8ea6-4730-aabe-0e60568de4b4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.580267 Jul 14 14:57:15.429569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1755/3641] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:13 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:15.852942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:15.906006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:15.914025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:15.934372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37b1ce73-9ea1-408e-a026-40f9e931de56 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.644917 Jul 14 14:57:15.951486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1887/3642] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:15 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:16.437958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:16.438944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:16.453039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:16.459769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:16.464556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:16.467667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:16.957985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:16.959960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:16.986777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:17.002588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:17.003964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:17.004618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:19.182414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:19.211421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:19.217535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:19.225598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8fd61efb-7def-41c3-812e-4f91ed34acc4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 2.270955 Jul 14 14:57:19.229563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1888/3643] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:16 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:19.520576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:19.533995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c857c953-8f06-4e5d-9284-ec4b4b4d941f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 3.100099 Jul 14 14:57:19.551780 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1756/3644] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:16 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 3118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:20.252301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:20.262124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:20.297915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:20.298675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:20.299933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:20.305003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:20.552398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:20.553247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:20.647586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:20.648045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:20.648855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:20.649293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:21.024794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:21.070439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:21.078282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:21.093152 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1b66d67-ff51-40db-89c6-c01b87efbcac tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.848869 Jul 14 14:57:21.097557 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1889/3645] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:20 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:22.120565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:22.133023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:22.187486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:22.188264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:22.208095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:22.211493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:22.982652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:22.993681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:23.014129 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4613bf1-32c3-42ee-9650-a18bc88e0d8d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 2.465968 Jul 14 14:57:23.016156 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1757/3646] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:20 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:23.061634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:23.064896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:23.079065 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d311ba5-47af-4514-90d6-98e7ca4a05e9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1738 microversion: 2.20 time: 0.953855 Jul 14 14:57:23.080718 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1890/3647] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:22 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1738 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:23.743222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1061728061", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:24.050328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:24.059355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:24.135247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:24.138383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:57:24.145581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:24.150024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:24.154699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:25.516578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:25.549883 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c16f733a-f35f-4359-90a2-09997eb11882 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.509633 Jul 14 14:57:25.579930 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1891/3648] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:24 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:25.616924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:25.626611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:25.659317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:25.663546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:25.665505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:25.671201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:26.584557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:26.614360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:26.629262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:26.632754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e31d765-4d48-4057-8f26-dbf11bd123f6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1720 microversion: 2.20 time: 1.047660 Jul 14 14:57:26.638693 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1892/3649] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:25 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1720 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:26.656356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:26.656994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:26.671473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:26.671932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:26.673149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:26.673812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:27.628511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:27.633845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:57:27.635707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:57:27.637801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:57:27.638573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:57:27.639687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:57:27.649520 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1672087b-e900-4b35-b2b3-1879b340a764 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.007234 Jul 14 14:57:27.657783 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1893/3650] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:26 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:27.663733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:27.664363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:27.677180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:27.687561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:27.697442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:27.702076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:27.715589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:27.718433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:27.724112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:27.725543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:27.798149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:57:27.831224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:57:27.892306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:57:27.900456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:57:28.056274 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5446a5db-8d9b-4a7a-88dc-10bd05560506 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.038652 Jul 14 14:57:28.065351 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1758/3651] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:57:28.088465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bd608612-650d-4637-bb1e-9171934c36e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:28.090661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bd608612-650d-4637-bb1e-9171934c36e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:28.625022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bd608612-650d-4637-bb1e-9171934c36e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:28.639150 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bd608612-650d-4637-bb1e-9171934c36e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1215 microversion: 2.1 time: 0.566870 Jul 14 14:57:28.642342 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1759/3652] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:28 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1215 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:28.686162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:28.686907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:28.726101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:28.726564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:28.738099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:28.738797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:29.727504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:29.743194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:29.748009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:29.751827 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-95566001-9cc7-45fc-8a20-39ed7d549868 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1720 microversion: 2.20 time: 2.090969 Jul 14 14:57:29.769822 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1894/3653] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:27 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1720 bytes in 2110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:29.815919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:29.817303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:29.831834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:29.840188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=60 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:29.856099 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6bfa1a04-1bd3-4995-83e1-b64b83b03506 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.169860 Jul 14 14:57:29.859447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1760/3654] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:28 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:29.873725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:29.874530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:29.876117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:29.876895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:30.590968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:30.611542 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a536616d-9d3e-491b-bac5-a6231e06da01 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1211 microversion: 2.1 time: 0.835371 Jul 14 14:57:30.614855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1895/3655] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:29 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1211 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:30.775037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:30.775886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:30.814559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:30.819043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:30.820913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:30.826785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:30.883570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:30.884322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:30.910590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:30.913107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:30.918784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:30.919296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:31.938762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:31.987202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:32.018891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:32.020782 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38891b2d-f7f0-498d-b788-35c29450f177 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1663 microversion: 2.20 time: 1.251254 Jul 14 14:57:32.028755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1761/3656] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:30 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1663 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:57:32.053330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-952bd963-bdf9-4af8-8f02-ca1643fb95a1 req-60e7f836-dafb-4b74-8a0f-b1ab0b926521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "name": "network-vif-unplugged", "status": "completed", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:32.094542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-952bd963-bdf9-4af8-8f02-ca1643fb95a1 req-60e7f836-dafb-4b74-8a0f-b1ab0b926521 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:32.095000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-952bd963-bdf9-4af8-8f02-ca1643fb95a1 req-60e7f836-dafb-4b74-8a0f-b1ab0b926521 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:32.181761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.server_external_events [req-952bd963-bdf9-4af8-8f02-ca1643fb95a1 req-60e7f836-dafb-4b74-8a0f-b1ab0b926521 service nova] Unable to find a host for instance e902fe2d-9dd4-4533-8381-c44065e607bf. Dropping event network-vif-unplugged {{(pid=125966) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 14:57:32.182933 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-952bd963-bdf9-4af8-8f02-ca1643fb95a1 req-60e7f836-dafb-4b74-8a0f-b1ab0b926521 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.159376 Jul 14 14:57:32.210224 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1762/3657] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 187 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 14:57:32.227572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:32.235996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:32.288032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:32.288531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:32.289395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:32.289842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:32.504190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:32.528189 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db8c8d8a-ee35-4a65-8997-c5c351c29eef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.650144 Jul 14 14:57:32.530834 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1896/3658] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:30 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:32.537384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "63652a72-045c-4223-b0f0-7fd8471cdf3a"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:32.538818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:32.554612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:32.555412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:32.557177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:32.557888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:32.766705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:32.778099 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-090ea1e2-7369-4ef0-b00d-ffe374228c5d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1273 microversion: 2.1 time: 0.566228 Jul 14 14:57:32.804617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1763/3659] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:32 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1273 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:33.555656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:33.569863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:33.622371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:33.632629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:33.658323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:33.660674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:33.664997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:33.698408 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-304e07a8-ae16-4a07-923e-812260955df1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.164035 Jul 14 14:57:33.704143 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1897/3660] 10.222.0.98 () {62 vars in 1363 bytes} [Thu Jul 14 14:57:32 2022] POST /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-volume_attachments => generated 188 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 14:57:33.851709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:33.856142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:33.901673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:33.905820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:33.917190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:33.920870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:34.620471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:34.622978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:34.651244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e29dd7b0-614b-4b39-92a4-5d1cdabf1e5f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.103783 Jul 14 14:57:34.663097 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ffa6326c-893a-4bbc-a7aa-de4dced8af5c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1273 microversion: 2.1 time: 0.820728 Jul 14 14:57:34.664045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1764/3661] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:33 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:34.675151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1898/3662] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:33 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1273 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:34.695867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:34.696379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:34.715986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:34.719123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:34.720238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:34.723334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:35.682162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:35.683513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:35.775564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:35.776700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:35.792860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:35.795611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:35.829523 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-455a373a-5130-4821-84a8-e5afc7563955 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-volume_attachments/63652a72-045c-4223-b0f0-7fd8471cdf3a" status: 202 len: 0 microversion: 2.20 time: 1.164365 Jul 14 14:57:35.831667 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1765/3663] 10.222.0.98 () {60 vars in 1456 bytes} [Thu Jul 14 14:57:34 2022] DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-volume_attachments/63652a72-045c-4223-b0f0-7fd8471cdf3a => generated 0 bytes in 1167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:57:35.915929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:35.917279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:35.989488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:36.035879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.046s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:36.048515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:36.060549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:36.536703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:36.554932 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-974d6336-b911-436c-ac69-844ab9a80002 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 0.879493 Jul 14 14:57:36.558156 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1899/3664] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:35 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:36.579752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:36.580441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:36.592572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:36.598379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:36.600424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:36.600424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:36.866375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f34ec607-3e83-4fe2-b575-ba410c3a195d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "POST /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/action" status: 202 len: 0 microversion: 2.20 time: 0.306052 Jul 14 14:57:36.871647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1900/3665] 10.222.0.98 () {62 vars in 1318 bytes} [Thu Jul 14 14:57:36 2022] POST /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:57:36.894958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:36.895971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:36.925977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:36.926785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:36.928753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:36.929476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:37.759259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:37.892057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:37.902335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:37.903954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:37.927070 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3eb3425a-c8bd-4672-962b-6649ea49c95c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1671 microversion: 2.20 time: 1.041961 Jul 14 14:57:37.939390 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1901/3666] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:36 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1671 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:37.940713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:37.941352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:37.969437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:37.970322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:37.971554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:37.972505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:38.329497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:38.376671 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bbc72a07-3ae5-4d0e-bf54-79b692145219 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 2.542001 Jul 14 14:57:38.377457 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1766/3667] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:35 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:38.798283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:38.826473 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2ba39ce-76df-45d4-a314-9ffe5628bb92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 0.895971 Jul 14 14:57:38.829676 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1902/3668] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:37 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:38.944970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:38.946003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:38.960042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:38.960690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:38.969451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:38.977468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:38.982573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:38.984426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:38.986165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:38.987584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:38.990033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:38.990499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:38.991393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:38.991835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:39.147345 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aba600e8-85bf-43bd-b01b-4645e6fa3a0e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213089 Jul 14 14:57:39.148848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1767/3669] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:57:38 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:39.179586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:39.180437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:39.213406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:39.213873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:39.214678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:39.215111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:39.327017 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6f6ddaa-a18d-4df6-a5f2-af0a8cccaebf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/a26b3cc2-bf02-453a-b47c-4aca0988f769" status: 200 len: 194 microversion: 2.1 time: 0.165760 Jul 14 14:57:39.330910 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1768/3670] 10.222.0.98 () {58 vars in 1412 bytes} [Thu Jul 14 14:57:39 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/a26b3cc2-bf02-453a-b47c-4aca0988f769 => generated 194 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:39.396433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:39.397804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:39.410682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:39.412686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:39.416680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:39.417408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:40.112526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:40.163532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:40.196819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:40.207905 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-477f85a0-cee6-4002-8cb0-3c9086d84dd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1671 microversion: 2.20 time: 1.251110 Jul 14 14:57:40.223309 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1903/3671] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:38 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1671 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:40.456009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:40.519981 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b351569c-e54e-42dd-b2fc-494fb7ce6de1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 1.123467 Jul 14 14:57:40.547475 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1769/3672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:39 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:57:40.596716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:40.597489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:40.647802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:40.672308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:40.678449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:40.693469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:41.056267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1660091176", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "9dac2788-47f1-4516-aed2-b73751ffdb80"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:41.995145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:42.053466 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f2760ab7-2af4-4fcd-a77a-87d093364a6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1682 microversion: 2.1 time: 1.492435 Jul 14 14:57:42.075353 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1770/3673] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:40 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1682 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:42.092759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:42.094606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:42.124698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:42.127502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:42.131574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:42.134575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:42.593379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] validate_networks() for [('9dac2788-47f1-4516-aed2-b73751ffdb80', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:57:43.060908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:43.127466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:43.129499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:43.132803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de072cbf-672c-468e-a331-f610f0d74df7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1671 microversion: 2.20 time: 1.054716 Jul 14 14:57:43.139735 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1771/3674] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:42 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1671 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:43.145770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:43.146546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:43.194389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:43.196109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.198444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:43.199240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.736032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:57:43.737251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:57:43.737965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:57:43.738695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:57:43.739572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:57:43.763092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:43.764061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.765407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:43.766239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:43.818951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Getting quotas for project 5eb5073406d6445bbaaf9ce03f79dab3. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:57:43.832069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Getting quotas for user 9fae0a09c9c74d6f95b07606f5ae828b and project 5eb5073406d6445bbaaf9ce03f79dab3. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:57:43.873830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:57:43.888521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:57:44.098078 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a06f66bd-ccc1-4def-ab31-6946ed08bb12 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 3.880114 Jul 14 14:57:44.106324 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1904/3675] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 14:57:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3889 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 14:57:44.129312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e9152920-d7fd-4041-9809-c078b51e16d6 req-abe246a0-287c-48fe-a72c-efee4225e3a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b949c7-a5f4-4a10-8fa2-f66abc9711f6", "tag": "0ca55d4a-19ec-4636-b22b-4a27e83230bb"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:44.160012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e9152920-d7fd-4041-9809-c078b51e16d6 req-abe246a0-287c-48fe-a72c-efee4225e3a0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.164316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e9152920-d7fd-4041-9809-c078b51e16d6 req-abe246a0-287c-48fe-a72c-efee4225e3a0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.226531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e9152920-d7fd-4041-9809-c078b51e16d6 req-abe246a0-287c-48fe-a72c-efee4225e3a0 service nova] Creating event network-changed:0ca55d4a-19ec-4636-b22b-4a27e83230bb for instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 on n-h2-768852-23 Jul 14 14:57:44.269500 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e9152920-d7fd-4041-9809-c078b51e16d6 req-abe246a0-287c-48fe-a72c-efee4225e3a0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150520 Jul 14 14:57:44.273036 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1905/3676] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:44.289980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:44.296579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:44.325596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.330586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.332314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.337586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.804840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:44.820910 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4f130a9-7233-400c-90f3-12945b011e14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.544752 Jul 14 14:57:44.825694 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1906/3677] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:44 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:44.835091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9a2a02a-9eb0-416a-a7fa-29a74cc513cf"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:44.842303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:44.855397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:44.860965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.861886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.863022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:44.863813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:44.865813 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63e1fe04-39ce-40b1-9efd-c68598e52eaf tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 1.724162 Jul 14 14:57:44.877931 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1772/3678] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:43 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 1737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:44.907058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86b40eb1-757f-4e8b-bfd0-45ec0abe99a8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:44.915686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-86b40eb1-757f-4e8b-bfd0-45ec0abe99a8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:45.248901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-86b40eb1-757f-4e8b-bfd0-45ec0abe99a8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:45.269532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-86b40eb1-757f-4e8b-bfd0-45ec0abe99a8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:45.278368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-86b40eb1-757f-4e8b-bfd0-45ec0abe99a8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:45.286380 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-86b40eb1-757f-4e8b-bfd0-45ec0abe99a8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1262 microversion: 2.26 time: 0.393071 Jul 14 14:57:45.287071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1773/3679] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:44 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1262 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:45.312419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:45.313094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:45.334187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:45.334670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:45.335547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:45.335998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:45.676052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c0343b95-7f7b-4675-b74a-94e8ad2fcff4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "POST /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844398 Jul 14 14:57:45.685760 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1907/3680] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:57:44 2022] POST /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments => generated 194 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:45.754565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:45.773649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:45.775610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:45.777080 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4aa2a67c-0a83-4309-b6cf-3ebd7f411492 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1673 microversion: 2.20 time: 0.478297 Jul 14 14:57:45.792934 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1774/3681] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:45 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1673 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:45.895449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:45.896666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:45.898915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:45.919551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:45.920514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:45.923612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:45.925651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:46.304902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:46.305841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:46.325439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:46.330681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:46.332373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:46.335155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:46.561826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:46.595242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:46.602543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:46.613908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5dfdf1a9-27ae-4966-b074-3494d388a331 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1258 microversion: 2.26 time: 0.313156 Jul 14 14:57:46.616659 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1775/3682] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:46 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1258 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:46.625877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:46.635807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:46.688196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:46.689746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:46.693572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:46.694908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:46.795977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:46.863723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:46.918934 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f1f2d86-a19d-4c84-8292-1277d7d6734c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 1.036561 Jul 14 14:57:46.933959 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1908/3683] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:45 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:46.952310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:46.967107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:47.006802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:47.016141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:47.019557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:47.021071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:47.479438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:47.500768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8c81fb7-6ba0-4379-bde3-7e3c4b347d0e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.880251 Jul 14 14:57:47.503805 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1776/3684] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:46 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:47.652241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:47.653566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:47.665907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:47.672183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:47.673785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:47.674459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:47.836083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:47.850125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:47.867466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:47.874483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-41a75b9d-7d87-49ae-964e-d27f76dbb7ee tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.937382 Jul 14 14:57:47.882565 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1909/3685] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:46 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:47.950950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:47.952980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:47.968214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:47.972229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:47.973481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:47.975616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:48.088994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:48.104598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:48.110267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:48.115463 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1440fe58-418b-4515-b396-9496e43bffa8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1320 microversion: 2.26 time: 0.467326 Jul 14 14:57:48.117088 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1777/3686] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:47 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1320 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:57:48.917966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:48.919127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:48.962538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:48.963317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:48.966838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:48.968795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:49.648674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:49.717765 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0311e2e5-0a39-4956-87c0-43bf9f994485 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 1.770801 Jul 14 14:57:49.732864 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1910/3687] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:47 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 1787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:49.754561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:49.756743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:49.773641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:49.774809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:49.776872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:49.777842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:50.474408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:50.548601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:50.567846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:50.575321 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61ff12cc-21b4-45f6-a1f4-5e688645eb32 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1320 microversion: 2.26 time: 0.833245 Jul 14 14:57:50.585011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1911/3688] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:49 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1320 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:50.619537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a42d6d9e-8070-420e-9017-f54fca13679c req-96755643-f621-4341-8c18-e34ec2bd75a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-unplugged", "status": "completed", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:50.687491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a42d6d9e-8070-420e-9017-f54fca13679c req-96755643-f621-4341-8c18-e34ec2bd75a6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:50.688869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a42d6d9e-8070-420e-9017-f54fca13679c req-96755643-f621-4341-8c18-e34ec2bd75a6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:50.829057 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a42d6d9e-8070-420e-9017-f54fca13679c req-96755643-f621-4341-8c18-e34ec2bd75a6 service nova] Creating event network-vif-unplugged:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 14:57:50.846654 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a42d6d9e-8070-420e-9017-f54fca13679c req-96755643-f621-4341-8c18-e34ec2bd75a6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.255520 Jul 14 14:57:50.849733 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1912/3689] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:50.868415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:50.869173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:50.890189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:50.890652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:50.893864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:50.894331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:51.340831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:51.357679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:51.359350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:51.360621 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad7ee350-adf7-4329-83f6-00bc2f861f14 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 2.456046 Jul 14 14:57:51.361260 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1778/3690] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:48 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 2460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:51.507220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:51.513169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:51.536124 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d04344a-847f-49a4-9379-82ff854a1956 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 0.683468 Jul 14 14:57:51.537758 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1913/3691] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:50 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:51.620088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:51.620725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:51.644726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:51.645276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:51.646174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:51.646625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.384336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:52.386913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:52.444890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.449244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:52.450472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.451628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.452256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.461005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:52.471142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:52.472441 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45a8a9bd-8212-484a-9055-cf6d0abdc203 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 0.856984 Jul 14 14:57:52.473297 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1779/3692] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:51 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:52.505805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:52.512210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:52.536001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.537095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.539213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.548224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.907090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:52.919606 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-795d1f07-40d5-4b58-a76f-a1802d0a1536 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.551556 Jul 14 14:57:52.936797 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1914/3693] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:52 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:52.942749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:52.960279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:52.979051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.979914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:52.981283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:52.985188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.642903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:53.659958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:53.662050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:53.664625 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e444b17c-78b3-4a80-a479-170f38acc7bd tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 1.180095 Jul 14 14:57:53.664814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:53.670644 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1780/3694] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:52 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:53.690641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:53.691724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:53.708812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.716603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-829ef52a-1a62-4bee-a3af-f71bab843592 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 0.776592 Jul 14 14:57:53.720799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.722245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.722996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.732657 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1915/3695] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:52 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:53.768418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:53.769533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:53.794469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:53.800556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.803477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.804648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:53.806643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:53.882437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:54.500092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:54.564407 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-054e79d4-3066-425b-916c-d5a8641e30e9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.888170 Jul 14 14:57:54.576271 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1781/3696] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:53 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:54.605609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f287e013-146b-48e1-a511-5cb48aef0d90 req-23bd5980-4675-4210-be89-84db998c196b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c5e7885-a832-4691-8a34-9a0456eb2eeb", "tag": "12f9025f-6fdf-41d1-ba39-eac13e5425d6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:54.630097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f287e013-146b-48e1-a511-5cb48aef0d90 req-23bd5980-4675-4210-be89-84db998c196b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:54.630479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f287e013-146b-48e1-a511-5cb48aef0d90 req-23bd5980-4675-4210-be89-84db998c196b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:54.666179 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f287e013-146b-48e1-a511-5cb48aef0d90 req-23bd5980-4675-4210-be89-84db998c196b service nova] Creating event network-changed:12f9025f-6fdf-41d1-ba39-eac13e5425d6 for instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb on n-h1-768852-23 Jul 14 14:57:54.673132 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f287e013-146b-48e1-a511-5cb48aef0d90 req-23bd5980-4675-4210-be89-84db998c196b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091078 Jul 14 14:57:54.674168 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1782/3697] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:54.691886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:54.693807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:54.702630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:54.710370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:54.717150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:54.718105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.253642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:57:55.500224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.511336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.513131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.513356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.514493 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea8e5ba5-9a3b-47b0-8e85-ef8938121765 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 1.776890 Jul 14 14:57:55.526918 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1916/3698] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:53 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:55.532473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f1cb45e-7fe5-4d3e-a96b-bfcd3ac49ac5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.856765 Jul 14 14:57:55.537784 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1783/3699] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:54 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:55.551598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:55.554983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.572132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:55.573883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.576894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.584046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.585321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.586139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.630407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.630902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.631845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.632297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.865443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.874848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.888705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:55.894847 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b1748780-8e77-4197-87d5-fceaa927f2a7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.356180 Jul 14 14:57:55.897871 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1917/3700] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:55 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:55.906764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:55.907934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:55.931520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.934248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:55.936630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:55.939526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:56.422087 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5044c72b-a3cf-4d49-8cb7-938be367efa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.521815 Jul 14 14:57:56.434597 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1918/3701] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:57:55 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:57:56.451925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f18b440b-ddc6-45e9-bfdd-c1999fa64f45 req-d79cb562-00b7-4b8b-a631-f60c4a030b4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b949c7-a5f4-4a10-8fa2-f66abc9711f6", "name": "network-vif-plugged", "status": "completed", "tag": "0ca55d4a-19ec-4636-b22b-4a27e83230bb"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:57:56.493284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f18b440b-ddc6-45e9-bfdd-c1999fa64f45 req-d79cb562-00b7-4b8b-a631-f60c4a030b4d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:56.494001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f18b440b-ddc6-45e9-bfdd-c1999fa64f45 req-d79cb562-00b7-4b8b-a631-f60c4a030b4d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:56.561297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f18b440b-ddc6-45e9-bfdd-c1999fa64f45 req-d79cb562-00b7-4b8b-a631-f60c4a030b4d service nova] Creating event network-vif-plugged:0ca55d4a-19ec-4636-b22b-4a27e83230bb for instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 on n-h2-768852-23 Jul 14 14:57:56.574973 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f18b440b-ddc6-45e9-bfdd-c1999fa64f45 req-d79cb562-00b7-4b8b-a631-f60c4a030b4d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134703 Jul 14 14:57:56.580616 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1919/3702] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:57:56.599378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:56.610637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:56.638195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:56.639006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:56.655074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:56.655074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.138179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.169429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38865a81-5666-46c7-bb0f-b5ff36f40b66 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 1.628678 Jul 14 14:57:57.196333 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1784/3703] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:55 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:57.217386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:57.227610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:57.257292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.262481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.265680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.269271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.297938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.349837 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1dfea6fc-d883-44e0-a3b0-6b6781ccfd92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1671 microversion: 2.1 time: 0.766734 Jul 14 14:57:57.351928 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1920/3704] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:56 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1671 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:57.365341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:57.375418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:57.402280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.404236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.406359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:57.407565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:57.720717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.739191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.743845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.746829 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57cbc019-e4fb-4eb6-916d-8f6250d07fd2 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.392442 Jul 14 14:57:57.748928 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1921/3705] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:57 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:57.876790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.894176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.898831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:57.901891 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a8afbd2-edca-471f-b368-54f33346914c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 0.698554 Jul 14 14:57:57.903985 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1785/3706] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:57 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:57:58.215248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:58.216759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:58.248650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.249405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.255796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.257911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.391963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:58.393347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:58.416057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.417269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:58.418906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:58.419758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.078040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.095051 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-279af196-cce3-4a44-9528-9c92fb00ceab tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1315 microversion: 2.1 time: 0.886872 Jul 14 14:57:59.096723 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1922/3707] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:58 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:59.109926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:59.116088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:59.129037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.132046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.136333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.137455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.363496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:57:59.383820 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f94bd73c-6bb5-4fae-b58a-4be860ad3200 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1671 microversion: 2.1 time: 1.001487 Jul 14 14:57:59.388656 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1786/3708] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:57:58 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1671 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:57:59.399967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:57:59.404314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:57:59.424025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.424772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:57:59.426028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:57:59.426675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.420975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:00.466334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:00.486852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:00.488181 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f05843a-3e56-41a0-a950-fb4832d3482f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 1.097970 Jul 14 14:58:00.504071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1787/3709] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:59 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:00.509642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:00.510278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:00.567747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.568323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:00.569178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:00.573292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.514063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.565216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.577796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.582416 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af691491-34cc-40ae-9a5a-bb44e18bb319 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 2.481881 Jul 14 14:58:01.590937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1923/3710] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:57:59 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:01.637616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:01.639771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:01.674943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.675961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.678060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.679815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.696820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:01.769638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-496bfa03-9449-4b74-b31e-e97c97ec1a2d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1502 microversion: 2.1 time: 1.263759 Jul 14 14:58:01.771803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1788/3711] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:00 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1502 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:01.791140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:01.810905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:01.843779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.882185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:01.891195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:01.894531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:02.997449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.045898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.053440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.055881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b6b42c3-554e-4aab-8e5a-d3916cfbfda8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 1.282188 Jul 14 14:58:03.088697 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1789/3712] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:01 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:03.121919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.127096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:03.144619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:03.155935 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c3e9a5bb-fb28-4d9b-b64a-e83b7860758c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1676 microversion: 2.1 time: 1.535047 Jul 14 14:58:03.171055 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1924/3713] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:01 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1676 bytes in 1565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:03.198785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.199762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.201667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.205156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:03.209880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.215018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:03.264177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.266567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.271501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.274243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.412777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:58:03.713055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d704ee1f-7219-4938-9da3-8590ef4336b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 204 len: 0 microversion: 2.1 time: 0.619213 Jul 14 14:58:03.715668 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1790/3714] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:58:03 2022] DELETE /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:58:03.729909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-57887c25-7107-4ff5-b5da-4c1c9b036207 req-34e7c3c5-a1b5-4cd4-a26f-6c3129792965 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5e7885-a832-4691-8a34-9a0456eb2eeb", "name": "network-vif-plugged", "status": "completed", "tag": "12f9025f-6fdf-41d1-ba39-eac13e5425d6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:03.771957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57887c25-7107-4ff5-b5da-4c1c9b036207 req-34e7c3c5-a1b5-4cd4-a26f-6c3129792965 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.773788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57887c25-7107-4ff5-b5da-4c1c9b036207 req-34e7c3c5-a1b5-4cd4-a26f-6c3129792965 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.843247 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-57887c25-7107-4ff5-b5da-4c1c9b036207 req-34e7c3c5-a1b5-4cd4-a26f-6c3129792965 service nova] Creating event network-vif-plugged:12f9025f-6fdf-41d1-ba39-eac13e5425d6 for instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb on n-h1-768852-23 Jul 14 14:58:03.882201 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-57887c25-7107-4ff5-b5da-4c1c9b036207 req-34e7c3c5-a1b5-4cd4-a26f-6c3129792965 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152106 Jul 14 14:58:03.884369 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1791/3715] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:03.915077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.924800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:03.927045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.927667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:03.931621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:03.935813 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ca39957-8991-4b82-bf10-9e16a9707cf7 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.753741 Jul 14 14:58:03.938872 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1925/3716] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:03 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:03.945703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.948050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:03.950695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:03.952313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.110056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:04.111221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:04.123566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.125736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.128840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.130728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.568557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:04.583050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:04.585786 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8c6abc7c-5d03-4405-b1c2-753f9b58eca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1508 microversion: 2.1 time: 0.695000 Jul 14 14:58:04.593302 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1792/3717] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:03 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1508 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:04.608713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:04.625071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:04.653869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.657934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.665312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:04.667069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:04.936248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:04.972837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:04.984856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:04.993510 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10d108c9-08bd-4cb4-a131-e578bf2d4e6c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 0.882923 Jul 14 14:58:04.995873 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1926/3718] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:04 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:05.012708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:05.033145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:05.063822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.070495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.074948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.081382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.538566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:05.580215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:05.591594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:05.599554 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f330873e-fc73-4f7c-be82-e2d3ed94b37d tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.598253 Jul 14 14:58:05.601648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1927/3719] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:04 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:05.627650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:05.631134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:05.653905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.659956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:05.661963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:05.668278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.232797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:06.253585 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bc2f3959-efb6-4e69-ba52-52feae37629c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.658274 Jul 14 14:58:06.256969 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1793/3720] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:04 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:06.272056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:06.277891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:06.299559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.303080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.305511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.308507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.420753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:06.447373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b8ab79f-0db2-4b40-a859-795086190c14 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1508 microversion: 2.1 time: 0.841063 Jul 14 14:58:06.452321 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1928/3721] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:05 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1508 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:06.477562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:06.482494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:06.521389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.522154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.536488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.539428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.808775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:06.860714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:06.860714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:06.864597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db67947a-e53e-4f3a-9eab-4522802f29bb tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1362 microversion: 2.26 time: 0.605717 Jul 14 14:58:06.866185 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1794/3722] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:06 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1362 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:06.888606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:06.890208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:06.916972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.919728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.924151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:06.928012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:06.989301 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-751e2022-647b-411e-99fc-6b17ea72c518 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 200 len: 322 microversion: 2.1 time: 0.533260 Jul 14 14:58:06.991059 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1929/3723] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:58:06 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:07.056904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:07.080460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:07.143713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:07.159090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:07.171199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:07.187542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:07.357612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:08.080800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:08.107997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:08.112544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:08.116097 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7964cc20-587b-4737-9a0f-59a1a1299c13 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 1.245528 Jul 14 14:58:08.128729 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1795/3724] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:06 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:08.143319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c5e8e677-f4c2-4978-9fcd-8ea0115dec89 req-dca12260-0041-42d9-9f5c-74f5af2cde69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b949c7-a5f4-4a10-8fa2-f66abc9711f6", "name": "network-vif-deleted", "tag": "0ca55d4a-19ec-4636-b22b-4a27e83230bb"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:08.194400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:08.219980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c5e8e677-f4c2-4978-9fcd-8ea0115dec89 req-dca12260-0041-42d9-9f5c-74f5af2cde69 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.220756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c5e8e677-f4c2-4978-9fcd-8ea0115dec89 req-dca12260-0041-42d9-9f5c-74f5af2cde69 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.290645 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5f012aeb-b8b1-4665-8627-59e5dd5aff27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.280099 Jul 14 14:58:08.292180 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c5e8e677-f4c2-4978-9fcd-8ea0115dec89 req-dca12260-0041-42d9-9f5c-74f5af2cde69 service nova] Creating event network-vif-deleted:0ca55d4a-19ec-4636-b22b-4a27e83230bb for instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 on n-h2-768852-23 Jul 14 14:58:08.304659 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c5e8e677-f4c2-4978-9fcd-8ea0115dec89 req-dca12260-0041-42d9-9f5c-74f5af2cde69 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172829 Jul 14 14:58:08.306293 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1930/3725] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:07 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:08.323317 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1796/3726] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:08.365295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:08.366017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:08.371965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:08.376386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:08.402516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.408604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.408957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.413270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.417379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.419170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.420249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.420714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.625687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.632750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.637534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'fault' on Instance uuid 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:08.872141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:08.890669 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-04a37563-89f2-40b9-b014-c854a311c2af tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 200 len: 1305 microversion: 2.1 time: 0.551057 Jul 14 14:58:08.896961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1931/3727] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:08 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 1305 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:08.907670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:08.920714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:08.943758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.945669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:08.949698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:08.952847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.222522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.327814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.344081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.356612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21671257-fad4-4233-b6c0-c07be80fbb6f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1546 microversion: 2.26 time: 1.011716 Jul 14 14:58:09.364942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1797/3728] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:08 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1546 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:09.389904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:09.392832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:09.399021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:09.448988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.466714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.468912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.473000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.660834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:09.750639 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e0d0ccc0-6e33-41c2-a39e-7f4585956771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.848921 Jul 14 14:58:09.752075 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1932/3729] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:08 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:09.769281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2b0aca0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:09.781506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.782370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.783346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:09.806911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.817115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:09.823687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:09.824409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.006633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.007408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.172154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.172968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.372344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:10.406050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:10.444964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:10.459370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:10.468564 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-87edeec0-94e3-4548-b4f5-a713ca2875a9 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 1.101615 Jul 14 14:58:10.476575 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1798/3730] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:09 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:10.496991 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db479a5a-ebd2-4325-b4e0-5c4c65406a2a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-844621401" status: 201 len: 0 microversion: 2.26 time: 0.740747 Jul 14 14:58:10.507169 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1933/3731] 10.222.0.98 () {62 vars in 1376 bytes} [Thu Jul 14 14:58:09 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-844621401 => generated 0 bytes in 747 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 14 14:58:10.517438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:10.526014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:10.545297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:10.547538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:10.556480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.564910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.577553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.578065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.581274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.582223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.582799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.584212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.616348 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 HTTP/1.1 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '72b949c7-a5f4-4a10-8fa2-f66abc9711f6'} Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:10.618384 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 14:58:10.624174 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:10.625541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:58:10.625923 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6917e149-59af-4f5c-a42d-d58559052e9c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 404 len: 111 microversion: 2.1 time: 0.111866 Jul 14 14:58:10.626563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1934/3732] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:10 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:58:10.654797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:10.657809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:10.682200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.685912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.687442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.688264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.762733 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3c8b2f6-6ef4-4000-8d75-48051d90144c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.133506 Jul 14 14:58:10.764040 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1935/3733] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:58:10 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:10.773845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d409298-2b4a-4454-abd4-64ba687393be tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2bc39d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:10.783305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d409298-2b4a-4454-abd4-64ba687393be tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.784337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d409298-2b4a-4454-abd4-64ba687393be tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.798578 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d409298-2b4a-4454-abd4-64ba687393be tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-844621401" status: 204 len: 0 microversion: 2.26 time: 0.031854 Jul 14 14:58:10.800035 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1936/3734] 10.222.0.98 () {60 vars in 1357 bytes} [Thu Jul 14 14:58:10 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-844621401 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:10.816945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf3929dc0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:10.849134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.853549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.856744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:10.899870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.904376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:10.905655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:10.908455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.008652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:11.009701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.090187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:11.212762 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-82d85ee3-4063-4f25-8ab4-f1ff13766ca8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 204 len: 0 microversion: 2.26 time: 0.401059 Jul 14 14:58:11.216248 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1937/3735] 10.222.0.98 () {60 vars in 1294 bytes} [Thu Jul 14 14:58:10 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:11.247040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1011138343", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:11.423903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:58:11.772647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:11.789791 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a0d616f-83b8-4e19-93bf-91f9102480a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.310220 Jul 14 14:58:11.793448 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1799/3736] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:10 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:11.808121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:11.808986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:11.851552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:11.852178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.853083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:11.853812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:11.982429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5fd5fe3b-0704-41f5-b6af-66f9df1cc7ec tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/a26b3cc2-bf02-453a-b47c-4aca0988f769" status: 200 len: 194 microversion: 2.1 time: 0.178596 Jul 14 14:58:11.990233 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1800/3737] 10.222.0.98 () {58 vars in 1412 bytes} [Thu Jul 14 14:58:11 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/a26b3cc2-bf02-453a-b47c-4aca0988f769 => generated 194 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:12.009664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dea89447-933e-4089-9235-173e98575391 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf1ed39d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:12.058618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dea89447-933e-4089-9235-173e98575391 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.072634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dea89447-933e-4089-9235-173e98575391 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.133288 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dea89447-933e-4089-9235-173e98575391 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 200 len: 12 microversion: 2.26 time: 0.145701 Jul 14 14:58:12.134912 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1801/3738] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:58:11 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 12 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:12.148552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:12.160861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:12.173195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.174468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.177005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.178205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.412901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:58:12.414011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:58:12.414011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:58:12.414650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:58:12.415189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:58:12.427722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.428345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.429331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.429916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.452856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:12.459970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:12.478915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:58:12.482351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:58:12.548745 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-95f96f24-602c-47fe-93d6-d6f5871b37a4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.328040 Jul 14 14:58:12.549823 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1938/3739] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:58:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1333 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:58:12.561934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:12.563854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:12.575392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.576099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.577252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.578407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.865520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.904509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.915974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.922362 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c68d6b25-af68-4f00-b3cf-7d0475413fec tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.785254 Jul 14 14:58:12.939355 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1802/3740] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:12 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:12.949922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:12.956674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:12.988054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:12.990650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:12.992843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:12.999011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.001720 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e68b37b-caaf-4d7b-b96c-ec44bf8f9b9a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.450027 Jul 14 14:58:13.008204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.027305 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1939/3741] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:12 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:13.038680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf33f88b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:13.086016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.091996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.093649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:13.126733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.143345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.144962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.145808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.262737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.263206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.286687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.288294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.310114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lazy-loading 'services' on Instance uuid cfa5cb90-18bc-4c57-898e-47f7f81302fa {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:13.371306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:13.426184 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-48bb4ae9-0c08-42ad-a534-3df582c90e29 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1922796064" status: 201 len: 0 microversion: 2.26 time: 0.413790 Jul 14 14:58:13.431673 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1940/3742] 10.222.0.98 () {62 vars in 1379 bytes} [Thu Jul 14 14:58:13 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1922796064 => generated 0 bytes in 420 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 14 14:58:13.463941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be82efb4-25e9-41ce-932c-0c57bac8250c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:13.473822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be82efb4-25e9-41ce-932c-0c57bac8250c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:13.619696 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-973335bb-774a-48d2-85bd-0df81a77701b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/a26b3cc2-bf02-453a-b47c-4aca0988f769" status: 202 len: 0 microversion: 2.1 time: 0.692392 Jul 14 14:58:13.621217 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1803/3743] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 14:58:12 2022] DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/a26b3cc2-bf02-453a-b47c-4aca0988f769 => generated 0 bytes in 696 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:58:13.627449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2137822605", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "4c9ebcf6-34f2-4c45-b411-0023bc6fae9d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:13.795183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] validate_networks() for [('4c9ebcf6-34f2-4c45-b411-0023bc6fae9d', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:58:13.819699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be82efb4-25e9-41ce-932c-0c57bac8250c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:13.845498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be82efb4-25e9-41ce-932c-0c57bac8250c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1215 microversion: 2.1 time: 0.410768 Jul 14 14:58:13.860553 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1941/3744] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:13 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1215 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:13.892884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-51e6fcb0-b087-4ee3-b15a-56a5bcc591f8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2af7c10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:13.941162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51e6fcb0-b087-4ee3-b15a-56a5bcc591f8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:13.946145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51e6fcb0-b087-4ee3-b15a-56a5bcc591f8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:13.986170 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-51e6fcb0-b087-4ee3-b15a-56a5bcc591f8 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 200 len: 36 microversion: 2.26 time: 0.116274 Jul 14 14:58:13.987002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1942/3745] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:58:13 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 36 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:14.003160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:14.008661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:14.034152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:14.044258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:14.046302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:14.048747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:14.796731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:14.864295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:14.880101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:14.894620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-545956d4-36ce-47e1-87a3-1ba8bf1fd0b1 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.900836 Jul 14 14:58:14.899649 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1943/3746] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:13 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:14.986354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2b4ce50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:15.042651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.043467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.049152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:15.078153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.079102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.084492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.085283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.167927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.168388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.263870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:15.297017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:15.312562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c380b7a-f953-48ca-81af-482350a5b228 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1922796064" status: 204 len: 0 microversion: 2.26 time: 0.407692 Jul 14 14:58:15.322265 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1944/3747] 10.222.0.98 () {60 vars in 1363 bytes} [Thu Jul 14 14:58:14 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1922796064 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:15.335383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:15.338081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:15.350284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:15.412507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.413471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.414979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.417027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.787109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:15.806577 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-036a6f80-9cc8-4cfa-b3c7-abfc820af3e6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1285 microversion: 2.1 time: 0.482284 Jul 14 14:58:15.808166 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1945/3748] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:15 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1285 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:15.827345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-566baa7a-748c-429f-bb30-b3dcc548653c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdc0427d160>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:15.845866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-566baa7a-748c-429f-bb30-b3dcc548653c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.846448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-566baa7a-748c-429f-bb30-b3dcc548653c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.877231 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-566baa7a-748c-429f-bb30-b3dcc548653c tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 200 len: 12 microversion: 2.26 time: 0.066696 Jul 14 14:58:15.877478 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1946/3749] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:58:15 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 12 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:15.903415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2bba3a0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:15.926865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.927384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.928861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:15.949453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.950189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:15.952424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:15.952889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.002033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.002033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.033952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:16.056024 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d06fcf61-06ca-41de-a6f7-bcef7f60b90f tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 204 len: 0 microversion: 2.26 time: 0.166507 Jul 14 14:58:16.062701 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1947/3750] 10.222.0.98 () {60 vars in 1294 bytes} [Thu Jul 14 14:58:15 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:16.073110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:16.073110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:16.091137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.091776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.092973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.093682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.828044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:16.860845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:16.884944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:16.904421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94fd3e6b-e60c-40ff-a336-1cbd451f5ff6 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.833730 Jul 14 14:58:16.910262 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1948/3751] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:16 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:16.956439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf230a700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:16.987535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:16.988376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:16.995259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:17.029118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.029905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.033698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.034721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.202132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.215176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.237670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:58:17.238731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:58:17.245098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:58:17.249955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:58:17.257597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:58:17.290830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.291869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.323747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.328458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.337845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.342371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.390326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:17.453470 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dec76ad4-4941-4879-8c9d-15f1b81e7851 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-312893102" status: 201 len: 0 microversion: 2.26 time: 0.532655 Jul 14 14:58:17.460345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:17.471929 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1949/3752] 10.222.0.98 () {62 vars in 1376 bytes} [Thu Jul 14 14:58:16 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-312893102 => generated 0 bytes in 554 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 14 14:58:17.489610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:17.490751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:17.493835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for user 4813aa5acf744a8dac42de00d7e5a519 and project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:17.521156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.521615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.529525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.530000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.558554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:58:17.574041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:58:17.722592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:17.740730 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1a1a875c-df8d-4f29-94ad-2bcb03b0ae17 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1273 microversion: 2.1 time: 0.261280 Jul 14 14:58:17.750989 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1950/3753] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:17 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:17.752183 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-96db4098-e1b4-4dda-9f1d-a1805b64a6f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.127365 Jul 14 14:58:17.758317 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1804/3754] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:58:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:58:17.768616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf3312700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:17.782355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13e64fe1-10e9-4795-a975-b789327983a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:17.783716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13e64fe1-10e9-4795-a975-b789327983a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:17.828775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.829403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.829818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:17.874971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.882299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:17.884132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:17.884649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.067321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.077913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.169242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.170389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.322054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:18.416420 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75a04a9b-2f77-4d15-ab9c-25a3d1a5aa6a tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1687060451" status: 201 len: 0 microversion: 2.26 time: 0.671871 Jul 14 14:58:18.422250 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1951/3755] 10.222.0.98 () {62 vars in 1379 bytes} [Thu Jul 14 14:58:17 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1687060451 => generated 0 bytes in 679 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 14 14:58:18.431842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:18.433028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:18.474887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.475573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.477288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.478442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.497961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13e64fe1-10e9-4795-a975-b789327983a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:18.508277 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13e64fe1-10e9-4795-a975-b789327983a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1215 microversion: 2.1 time: 0.743879 Jul 14 14:58:18.523310 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1805/3756] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:17 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1215 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:18.523310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf1f58af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:18.531524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.531978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.533066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:18.540261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.540871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.542779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.543623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.584784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.585385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.628086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:18.669932 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1602155-74f8-4cf8-ba8a-b24e8635c88e tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 204 len: 0 microversion: 2.26 time: 0.158968 Jul 14 14:58:18.676030 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1806/3757] 10.222.0.98 () {60 vars in 1294 bytes} [Thu Jul 14 14:58:18 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:18.695119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3fe57074-2711-4680-91b2-16f337e6f175 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf298c0d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:18.719621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fe57074-2711-4680-91b2-16f337e6f175 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.722185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fe57074-2711-4680-91b2-16f337e6f175 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.764868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3fe57074-2711-4680-91b2-16f337e6f175 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 200 len: 12 microversion: 2.26 time: 0.082025 Jul 14 14:58:18.766720 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1807/3758] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:58:18 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 12 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:18.788738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:18.789022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:18.811779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.815678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:18.816543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:18.817035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.191510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:19.251867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:19.257116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:19.275325 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-96d78304-f1f0-4c0e-bfe9-b8e2bdbbe291 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.836792 Jul 14 14:58:19.275325 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1952/3759] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:18 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:19.275325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2333af0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:19.308243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.318548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.319141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:19.338056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.338535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.339382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.340242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.448662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.449400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.513815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:19.650169 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-930a0cb9-611a-4594-85c6-1cb14fc3f5af tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 204 len: 0 microversion: 2.26 time: 0.382098 Jul 14 14:58:19.657876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1953/3760] 10.222.0.98 () {60 vars in 1294 bytes} [Thu Jul 14 14:58:19 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:19.693904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:19.695080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:19.726986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.729296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.738513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.740278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.874642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:19.891731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5d4a046-06f5-4865-8450-edc32f82573f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1315 microversion: 2.1 time: 1.107873 Jul 14 14:58:19.894753 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1808/3761] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:18 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1315 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:19.913119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf1f585e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:19.965712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:19.969206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:19.972196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:20.006702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.007999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.009550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.015723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.099875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.100747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.149843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.153495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.164304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:20.175260 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb06d35a-39be-4697-859c-1a966cd1bcf6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1267 microversion: 2.1 time: 0.515491 Jul 14 14:58:20.185050 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1954/3762] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:19 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1267 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:20.227210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:20.238385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:20.291518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:20.292364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:20.314460 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78516390-0005-4e00-a991-6909ce59b0c5 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1291864957" status: 201 len: 0 microversion: 2.26 time: 0.415059 Jul 14 14:58:20.314946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.316043 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1809/3763] 10.222.0.98 () {62 vars in 1379 bytes} [Thu Jul 14 14:58:19 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-1291864957 => generated 0 bytes in 417 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Jul 14 14:58:20.317807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.320038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.320911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.328497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf29e7790>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:20.350397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.353812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.356370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:20.385718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.396118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.398881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.399911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.483603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.485818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.526941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.527527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.594228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:20.651523 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f99a3ffe-d546-4778-9c9d-9f13a37397b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-978121264" status: 201 len: 0 microversion: 2.26 time: 0.327816 Jul 14 14:58:20.656543 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1810/3764] 10.222.0.98 () {62 vars in 1376 bytes} [Thu Jul 14 14:58:20 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags/tempest-tag-978121264 => generated 0 bytes in 334 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Jul 14 14:58:20.668816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Action: 'update_all', calling method: .version_select at 0x7fdbf1f67ee0>, body: {"tags": ["tempest-tag-1030420091", "tempest-tag-1399856996"]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:20.689110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.696276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.700771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:20.727860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.732519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.736975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.737586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.814015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:20.824620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:20.926284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:21.013821 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2bf89f5-9da4-4101-82ed-a211038a36bf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 200 len: 62 microversion: 2.26 time: 0.348833 Jul 14 14:58:21.021329 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1811/3765] 10.222.0.98 () {62 vars in 1311 bytes} [Thu Jul 14 14:58:20 2022] PUT /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 62 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:21.038801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.042502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:21.085374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.086219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.092875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.096084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.103124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.108578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.136683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.136683 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a804da3-5f82-4039-aca0-1b35bd28c160 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.837368 Jul 14 14:58:21.136683 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1955/3766] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:20 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:21.143518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fe13f9f-8c0a-4455-94ba-c534cb77829d tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf31af820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.174630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fe13f9f-8c0a-4455-94ba-c534cb77829d tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.175130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fe13f9f-8c0a-4455-94ba-c534cb77829d tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.190585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fe13f9f-8c0a-4455-94ba-c534cb77829d tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 200 len: 62 microversion: 2.26 time: 0.063799 Jul 14 14:58:21.198751 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1956/3767] 10.222.0.98 () {60 vars in 1291 bytes} [Thu Jul 14 14:58:21 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 62 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:21.204186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.204816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:21.225303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.225596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.226651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.226881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.390936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:21.395456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:21.403387 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31f8fc54-4606-4c5b-b706-a98b6286ba58 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1273 microversion: 2.1 time: 0.210427 Jul 14 14:58:21.404009 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1957/3768] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:21 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1273 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:21.430466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '.version_select at 0x7fdbf2ab9310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.493427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.496145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.498037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:21.519517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.522824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.526026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.527023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.600065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.600985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.647520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'flavor' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:21.718261 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e35df815-e712-4148-9fe1-735b980dacc6 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags" status: 204 len: 0 microversion: 2.26 time: 0.292960 Jul 14 14:58:21.719169 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1958/3769] 10.222.0.98 () {60 vars in 1294 bytes} [Thu Jul 14 14:58:21 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb/tags => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:21.741149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:21.742361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:21.780096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.786472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.788041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:21.788709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:21.913657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:58:22.026858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:22.050994 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-858e4c20-501f-407c-afdd-ad04402f9ac7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1315 microversion: 2.1 time: 1.027267 Jul 14 14:58:22.052668 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1812/3770] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:21 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1315 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:22.097509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-744780372", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "bfe538f8-c007-43eb-a6ec-5964fb70da40"}], "security_groups": [{"name": "tempest-securitygroup--531787956"}], "key_name": "tempest-keypair-1722411914", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "9c8d54be-eca3-4aca-a4fe-2bf94bd1cce0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:22.378227 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ea47d2b-6d00-4e3c-b966-144c66bafabf tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 204 len: 0 microversion: 2.26 time: 0.647493 Jul 14 14:58:22.379890 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1959/3771] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:58:21 2022] DELETE /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:58:22.409560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:22.428394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:22.450551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:22.460467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:22.473718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:22.475062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:22.476107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:22.923399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] validate_networks() for [('bfe538f8-c007-43eb-a6ec-5964fb70da40', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:58:23.844484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:24.296549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.317397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.319969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:24.328557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f66bf7f-7651-471d-8587-7e5d98106eb8 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 1.941233 Jul 14 14:58:24.329807 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1960/3772] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:22 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:24.349460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:24.350426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:24.367593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.370221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.372207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.374455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.865178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Getting quotas for project da0dc51858c64e3589abc68587ab1b40. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:24.894596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Getting quotas for user d2cb918769c44026b2b4358f3fcd7cff and project da0dc51858c64e3589abc68587ab1b40. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:24.925714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:58:24.927784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:58:24.928836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:58:24.929627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:58:24.930401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:58:24.951939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.952757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:24.954418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:24.955455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.024212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:25.048086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:25.055783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:25.058917 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc8178bd-68c0-400a-803c-ce903e8d2e93 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1552 microversion: 2.26 time: 0.727717 Jul 14 14:58:25.059583 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1961/3773] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:24 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1552 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:25.086450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:25.090676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:25.111203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Getting quotas for project da0dc51858c64e3589abc68587ab1b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:58:25.119083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.120404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.121537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.122185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.132262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Getting quotas for user d2cb918769c44026b2b4358f3fcd7cff and project da0dc51858c64e3589abc68587ab1b40. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:58:25.290484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:58:25.292839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c8d54be-eca3-4aca-a4fe-2bf94bd1cce0',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:58:25.522220 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aac8ec15-c32c-4eb6-9496-ac3aa5b075e6 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.450238 Jul 14 14:58:25.523820 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1813/3774] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:58:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 3470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:58:25.534143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b0f44c00-a18c-4411-b80a-54805d1cb533 req-c0c9fad2-de72-4bb0-9b71-947c5f313d4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69", "tag": "b7f8b32a-6301-4890-a552-20ff163ce2b8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:25.547478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b0f44c00-a18c-4411-b80a-54805d1cb533 req-c0c9fad2-de72-4bb0-9b71-947c5f313d4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.548251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b0f44c00-a18c-4411-b80a-54805d1cb533 req-c0c9fad2-de72-4bb0-9b71-947c5f313d4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.566074 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b0f44c00-a18c-4411-b80a-54805d1cb533 req-c0c9fad2-de72-4bb0-9b71-947c5f313d4b service nova] Creating event network-changed:b7f8b32a-6301-4890-a552-20ff163ce2b8 for instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 on n-h2-768852-23 Jul 14 14:58:25.576116 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b0f44c00-a18c-4411-b80a-54805d1cb533 req-c0c9fad2-de72-4bb0-9b71-947c5f313d4b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050477 Jul 14 14:58:25.577505 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1814/3775] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:25.584492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:25.585554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:25.596173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.597166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.598739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.599398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.880058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:25.891046 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a07fb73e-83dc-466a-8dca-536872f805f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 0.826822 Jul 14 14:58:25.894150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1962/3776] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:25 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:25.911484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1e34cb67-9f7a-4a87-a3ef-164046831450 req-4bb6f86d-fcde-43f6-9de4-c09a2307d611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "name": "network-vif-plugged", "status": "completed", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:25.935641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1e34cb67-9f7a-4a87-a3ef-164046831450 req-4bb6f86d-fcde-43f6-9de4-c09a2307d611 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:25.936397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1e34cb67-9f7a-4a87-a3ef-164046831450 req-4bb6f86d-fcde-43f6-9de4-c09a2307d611 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:25.976137 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1e34cb67-9f7a-4a87-a3ef-164046831450 req-4bb6f86d-fcde-43f6-9de4-c09a2307d611 service nova] Creating event network-vif-plugged:0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53 for instance e902fe2d-9dd4-4533-8381-c44065e607bf on n-h1-768852-23 Jul 14 14:58:25.983686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1e34cb67-9f7a-4a87-a3ef-164046831450 req-4bb6f86d-fcde-43f6-9de4-c09a2307d611 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085296 Jul 14 14:58:25.985173 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1963/3777] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:25.994687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:25.995650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:26.005974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.008055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.009333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.010011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.399818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:26.428644 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d98d5c37-68b2-4246-a408-7c5b1d9d1fc8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1315 microversion: 2.1 time: 0.849061 Jul 14 14:58:26.430135 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1815/3778] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:25 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1315 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:26.462354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:26.464000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:26.476974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.478143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.479882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.480926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.537953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:26.563431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:26.567460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:26.570281 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37c02d6e-ac99-44af-a836-a3d77a88b8e4 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.582713 Jul 14 14:58:26.589760 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1964/3779] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:25 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:26.606226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:26.608231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:26.621129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.622433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.624646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.625744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.709734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:26.710577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:26.711753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lazy-loading 'fault' on Instance uuid 5c5e7885-a832-4691-8a34-9a0456eb2eeb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:26.868505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:26.942053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93fe18f7-5a87-451d-b524-08155b1f7789 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1171 microversion: 2.1 time: 0.496090 Jul 14 14:58:26.943141 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1816/3780] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:26 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1171 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:27.002255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:27.005010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:27.038364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.039065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.043348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.043817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.050573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:27.069434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:27.075456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fae0a09c9c74d6f95b07606f5ae828b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5eb5073406d6445bbaaf9ce03f79dab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:27.079103 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e848549f-0a9f-494a-8501-38b28ef49021 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 200 len: 1352 microversion: 2.26 time: 0.487027 Jul 14 14:58:27.100510 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1965/3781] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:26 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 1352 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:27.464033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:27.465314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:27.473803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.474611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.476434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.477116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.862054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:27.903149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:27.914275 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-95716c9d-fd4c-4bc4-99d2-bae2827741d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1315 microversion: 2.1 time: 0.453156 Jul 14 14:58:27.920868 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1966/3782] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:27 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1315 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:27.939023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:27.943087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c35a89c2-19e1-407e-984e-cf968579b97d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 0.994800 Jul 14 14:58:27.945076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:27.948187 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1817/3783] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:26 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:27.973710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c554f997-ebee-4e83-8aa2-076fbfd7e388 req-0f6073f9-8ce4-47de-b9ff-03992384b0cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c5e7885-a832-4691-8a34-9a0456eb2eeb", "name": "network-vif-deleted", "tag": "12f9025f-6fdf-41d1-ba39-eac13e5425d6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:27.976521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.989997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.991155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c554f997-ebee-4e83-8aa2-076fbfd7e388 req-0f6073f9-8ce4-47de-b9ff-03992384b0cb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.992354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c554f997-ebee-4e83-8aa2-076fbfd7e388 req-0f6073f9-8ce4-47de-b9ff-03992384b0cb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:27.995362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:27.998537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.030499 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c554f997-ebee-4e83-8aa2-076fbfd7e388 req-0f6073f9-8ce4-47de-b9ff-03992384b0cb service nova] Creating event network-vif-deleted:12f9025f-6fdf-41d1-ba39-eac13e5425d6 for instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb on n-h1-768852-23 Jul 14 14:58:28.051095 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c554f997-ebee-4e83-8aa2-076fbfd7e388 req-0f6073f9-8ce4-47de-b9ff-03992384b0cb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089317 Jul 14 14:58:28.057294 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1818/3784] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:28.077924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:28.087032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:28.117366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.119140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.125802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.127024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.506928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:28.522121 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15d0457a-431d-4cd8-854b-b685c3a6e062 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1237 microversion: 2.1 time: 0.462909 Jul 14 14:58:28.526879 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1819/3785] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:28 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1237 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:28.565493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:28.575361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] [instance: 5c5e7885-a832-4691-8a34-9a0456eb2eeb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:28.610415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.614589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.619170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.626937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.709220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] HTTP exception thrown: Instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb could not be found. Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Request method failure captured: Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb HTTP/1.1 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7i3DRiJNsIIHkmMuYiaCFATgBiy3o6UijnXIl25sQT2u0WazUQGZetMSS86JB-Q7zZkZ07GJsPEelSgSxVcHWDIrI047AZB88Js8w_wv5AvRS2xDB3PERrkGfNefLhShdLXgzT2uIzug7LEnyLkqywRsO_2G4z0nUz4GUOL8oLQOg Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.26 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 5eb5073406d6445bbaaf9ce03f79dab3 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerTagsTestJSON-1671590106 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5eb5073406d6445bbaaf9ce03f79dab3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5eb5073406d6445bbaaf9ce03f79dab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5eb5073406d6445bbaaf9ce03f79dab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5eb5073406d6445bbaaf9ce03f79dab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerTagsTestJSON-1671590106 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 5eb5073406d6445bbaaf9ce03f79dab3 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerTagsTestJSON-1671590106 Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerTagsTestJSON-1671590106-project Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 9fae0a09c9c74d6f95b07606f5ae828b Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerTagsTestJSON-1671590106-project Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb could not be found. Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '5c5e7885-a832-4691-8a34-9a0456eb2eeb'} Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb could not be found. Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:58:28.710207 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb could not be found. Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb could not be found. Jul 14 14:58:28.728574 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:58:28.733400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:28.733400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:28.733400 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2bfe5093-d874-4ffe-b22b-43e0bcf3bf17 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1729 microversion: 2.20 time: 0.757542 Jul 14 14:58:28.734307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] Returning 404 to user: Instance 5c5e7885-a832-4691-8a34-9a0456eb2eeb could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:58:28.734307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-000cbab8-2e65-4d87-8e10-6608c1acf6b1 tempest-ServerTagsTestJSON-1671590106 tempest-ServerTagsTestJSON-1671590106-project] 10.222.0.98 "GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb" status: 404 len: 111 microversion: 2.26 time: 0.171132 Jul 14 14:58:28.734766 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1967/3786] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:27 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1729 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:28.734922 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1820/3787] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:28 2022] GET /compute/v2.1/servers/5c5e7885-a832-4691-8a34-9a0456eb2eeb => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:58:28.735058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f674922b-a688-4217-a43d-89a2c123d94a req-e5404889-da75-44cf-b92a-99df16bd22d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "933f57d0-371d-4daf-bc96-5fb9f46f03c0", "tag": "1a8c887f-d790-4589-a78f-69a05273e672"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:28.742921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:28.745430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:28.759583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f674922b-a688-4217-a43d-89a2c123d94a req-e5404889-da75-44cf-b92a-99df16bd22d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.764559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.765740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f674922b-a688-4217-a43d-89a2c123d94a req-e5404889-da75-44cf-b92a-99df16bd22d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.780323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.781734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.782524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.795299 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f674922b-a688-4217-a43d-89a2c123d94a req-e5404889-da75-44cf-b92a-99df16bd22d5 service nova] Creating event network-changed:1a8c887f-d790-4589-a78f-69a05273e672 for instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 on n-h1-768852-23 Jul 14 14:58:28.830543 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f674922b-a688-4217-a43d-89a2c123d94a req-e5404889-da75-44cf-b92a-99df16bd22d5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111670 Jul 14 14:58:28.834389 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1968/3788] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:28.864607 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-06fca896-7eb4-42f6-a5e1-1f97174e9a3b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/f9a2a02a-9eb0-416a-a7fa-29a74cc513cf" status: 200 len: 194 microversion: 2.1 time: 0.144438 Jul 14 14:58:28.869457 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1821/3789] 10.222.0.98 () {58 vars in 1412 bytes} [Thu Jul 14 14:58:28 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/f9a2a02a-9eb0-416a-a7fa-29a74cc513cf => generated 194 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:28.890081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:28.892046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:28.928449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.930954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.936002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.936898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.950115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:28.951552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:28.966552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.970067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:28.975037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:28.975671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:29.271091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lazy-loading 'services' on Instance uuid cfa5cb90-18bc-4c57-898e-47f7f81302fa {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:58:29.516479 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f829c580-f6ee-412e-ba60-aaf55e255b8e tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/f9a2a02a-9eb0-416a-a7fa-29a74cc513cf" status: 202 len: 0 microversion: 2.1 time: 0.639185 Jul 14 14:58:29.523823 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1969/3790] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 14:58:28 2022] DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments/f9a2a02a-9eb0-416a-a7fa-29a74cc513cf => generated 0 bytes in 649 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:58:29.546300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:29.553653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:29.588715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:29.592175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:29.595940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:29.597073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.292829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:30.323470 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5264ad5-f81a-4dd3-a676-4b372917cf65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1315 microversion: 2.1 time: 1.382365 Jul 14 14:58:30.324723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1822/3791] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:28 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1315 bytes in 1387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:30.350140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:30.355739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:30.395353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.401955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.407433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.419443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.829242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:30.859652 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de9de0e3-20f2-4e35-9aad-e44c8d40a0d2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1237 microversion: 2.1 time: 0.531831 Jul 14 14:58:30.877238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:30.882414 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1823/3792] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:30 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1237 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:30.899823 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e9f122d1-fe6d-4274-a124-9c95b67b2e55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 1.373407 Jul 14 14:58:30.912613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1970/3793] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:29 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:30.923626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:30.923626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:30.944076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:30.945729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d411cc10-7c2f-4e6b-b5f4-a2cd787e84d4 req-1baa5823-fe0d-4b2e-b671-bf6f7610fa70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69", "name": "network-vif-plugged", "status": "completed", "tag": "b7f8b32a-6301-4890-a552-20ff163ce2b8"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:30.964376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.965068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.966455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.967963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:30.981472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d411cc10-7c2f-4e6b-b5f4-a2cd787e84d4 req-1baa5823-fe0d-4b2e-b671-bf6f7610fa70 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:30.986654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d411cc10-7c2f-4e6b-b5f4-a2cd787e84d4 req-1baa5823-fe0d-4b2e-b671-bf6f7610fa70 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:31.030463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d411cc10-7c2f-4e6b-b5f4-a2cd787e84d4 req-1baa5823-fe0d-4b2e-b671-bf6f7610fa70 service nova] Creating event network-vif-plugged:b7f8b32a-6301-4890-a552-20ff163ce2b8 for instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 on n-h2-768852-23 Jul 14 14:58:31.052618 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d411cc10-7c2f-4e6b-b5f4-a2cd787e84d4 req-1baa5823-fe0d-4b2e-b671-bf6f7610fa70 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123300 Jul 14 14:58:31.060553 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1971/3794] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:31.357161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:31.359429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:31.384710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:31.385723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:31.391072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:31.392424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:31.863115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:31.925360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:31.928245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:31.935433 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2ad1d935-c750-4782-bcbb-374d793d2721 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1716 microversion: 2.20 time: 1.051435 Jul 14 14:58:31.954374 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1824/3795] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:58:30 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1716 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:58:31.961851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:31.963137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:31.974957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:31.975659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:31.976638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:31.977240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:32.103065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:32.142303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cdf864fe-e5cd-422c-8eea-1f17a2805159 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1315 microversion: 2.1 time: 0.802424 Jul 14 14:58:32.143848 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1972/3796] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:31 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:32.171789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:32.175734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:32.234517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:32.239195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:32.247153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:32.248353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:32.309365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:DELETE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:32.748459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:32.804018 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8968709-9bac-4bf4-8d81-3cdf4a59f99e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 0.656882 Jul 14 14:58:32.806696 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1973/3797] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:32 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:33.162203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:33.163199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:33.178058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:33.179230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:33.180198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:33.183134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:33.459506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:33.512764 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-527aec8b-9d6e-451e-8395-33f33e54ba3d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 1.555294 Jul 14 14:58:33.514238 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1825/3798] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:31 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:33.839165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:33.840604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:33.883715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:33.892789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:33.895506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:33.896602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:33.972716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:34.235818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:34.293508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5f70574-d950-472a-bb64-adff08f11c87 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1502 microversion: 2.1 time: 1.135401 Jul 14 14:58:34.303203 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1974/3799] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:33 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1502 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:34.534370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cecc233e-20af-48b2-8a96-1ebffc8ea0bd req-a18de95a-05bc-4473-8cb5-bdf196f3f13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac407b64-a541-47c6-a16c-f52ca7a53ec3", "tag": "b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:34.585162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:34.604209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-377bc2b3-d809-49e9-a638-427e50c685e5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 0.773227 Jul 14 14:58:34.605980 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1826/3800] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:33 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:34.622846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cecc233e-20af-48b2-8a96-1ebffc8ea0bd req-a18de95a-05bc-4473-8cb5-bdf196f3f13d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:34.624185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cecc233e-20af-48b2-8a96-1ebffc8ea0bd req-a18de95a-05bc-4473-8cb5-bdf196f3f13d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:34.625669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:34.626428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:34.657830 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cecc233e-20af-48b2-8a96-1ebffc8ea0bd req-a18de95a-05bc-4473-8cb5-bdf196f3f13d service nova] Creating event network-changed:b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1 for instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 on n-h2-768852-23 Jul 14 14:58:34.658998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:34.661341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:34.662291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:34.665841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:34.674941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cecc233e-20af-48b2-8a96-1ebffc8ea0bd req-a18de95a-05bc-4473-8cb5-bdf196f3f13d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157139 Jul 14 14:58:34.686816 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1975/3801] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:35.054692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:35.154609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=18 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:35.545123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:35.578823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e676ea6e-dda6-40f1-8379-b75a7d7df277 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.971328 Jul 14 14:58:35.579741 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1827/3802] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:34 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:35.631729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:35.632508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:35.646708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:35.647157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:35.647993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:35.648436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:36.084137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:36.098378 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8829db5c-d34b-4726-b2c7-425e293c0837 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 0.472323 Jul 14 14:58:36.099408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1976/3803] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:35 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:36.608231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:36.608852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:36.621276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:36.623992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:36.625097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:36.625701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:37.117045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:37.118467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:37.138455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:37.139182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:37.140252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:37.140870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:37.315007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:37.328597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b6f59f95-3b97-4659-bc85-264b95659a5a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.725471 Jul 14 14:58:37.344052 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1828/3804] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:36 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:38.139931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:38.169452 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d61b5578-9e2a-48de-960f-324d63ae1aa8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 1.042785 Jul 14 14:58:38.171846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1977/3805] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:37 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:38.358056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:38.358691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:38.371885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:38.372469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:38.373486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:38.373981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:38.906190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0112f839-3085-40d0-a52c-418a4d60fb2a req-63811899-f325-4d63-a4ab-124e324d9ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933f57d0-371d-4daf-bc96-5fb9f46f03c0", "name": "network-vif-plugged", "status": "completed", "tag": "1a8c887f-d790-4589-a78f-69a05273e672"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:38.927589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0112f839-3085-40d0-a52c-418a4d60fb2a req-63811899-f325-4d63-a4ab-124e324d9ca8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:38.928369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0112f839-3085-40d0-a52c-418a4d60fb2a req-63811899-f325-4d63-a4ab-124e324d9ca8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:38.956802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0112f839-3085-40d0-a52c-418a4d60fb2a req-63811899-f325-4d63-a4ab-124e324d9ca8 service nova] Creating event network-vif-plugged:1a8c887f-d790-4589-a78f-69a05273e672 for instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 on n-h1-768852-23 Jul 14 14:58:38.984143 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0112f839-3085-40d0-a52c-418a4d60fb2a req-63811899-f325-4d63-a4ab-124e324d9ca8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079274 Jul 14 14:58:38.987914 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1978/3806] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:58:39.017333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:39.027347 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da4074a0-31f0-41e6-a344-a790a9a2cb59 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.673557 Jul 14 14:58:39.041759 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1829/3807] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:38 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:39.194980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:39.199508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:39.215491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:39.216867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:39.220310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:39.221586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:40.052388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:40.054482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:40.068023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:40.069398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:40.071264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:40.072835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:40.179029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:40.192645 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a82ab856-023e-4e80-a9c2-23f17b0f9ae9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 1.007040 Jul 14 14:58:40.193256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1979/3808] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:39 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:40.360909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:40.373102 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7eb8811b-85ed-4130-acee-6537542fa70b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.327766 Jul 14 14:58:40.383597 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1830/3809] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:40 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:41.226558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:41.232804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:41.281706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:41.282465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:41.283923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:41.293382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:41.392663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:41.396548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:41.408071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:41.408781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:41.409803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:41.412969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:41.687027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:41.703763 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b954f8f8-f775-473c-8c7d-c10dd17ad37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.315920 Jul 14 14:58:41.714935 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1831/3810] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:41 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:41.891312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:41.917172 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4abb8e85-00c9-4c0e-88ad-db96a3f8ff54 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1315 microversion: 2.1 time: 0.704166 Jul 14 14:58:41.920563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1980/3811] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:41 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1315 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:42.726883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:42.728095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:42.744006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.744781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.746304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.747043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.965190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:42.973844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:42.994397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.995998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:42.997727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:42.998562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:43.741043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:43.749218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1f4d795-1a9a-47bf-967d-55bd73cd3873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1502 microversion: 2.1 time: 0.799805 Jul 14 14:58:43.760235 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1981/3812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:42 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1502 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:43.779555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5696502c-168f-4917-9857-4ede9d08d073 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:43.806674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5696502c-168f-4917-9857-4ede9d08d073 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:43.807123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5696502c-168f-4917-9857-4ede9d08d073 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:43.842999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:43.851202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-38ea1162-1436-469d-af61-b5b578c9aff2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 1.132442 Jul 14 14:58:43.864109 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1832/3813] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:42 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:43.875979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5696502c-168f-4917-9857-4ede9d08d073 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Going to try to stop instance {{(pid=125965) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 14:58:43.977069 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5696502c-168f-4917-9857-4ede9d08d073 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0/action" status: 202 len: 0 microversion: 2.1 time: 0.196981 Jul 14 14:58:43.991661 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1982/3814] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:58:43 2022] POST /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0/action => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:58:43.992080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:43.992887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:44.016202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.016672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.017755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.018393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.287790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:44.293532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:44.325329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.326612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.331815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.332879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.490825 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-01fd6130-ba58-4606-a234-bbf734943af2 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.216458 Jul 14 14:58:44.494917 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1983/3815] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:58:44 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments => generated 25 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 14:58:44.653372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:44.663460 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50866037-fd7b-4b5d-a288-58c2a8d33086 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.675519 Jul 14 14:58:44.668817 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1833/3816] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:43 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:44.852536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:44.854668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:44.873089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.875377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.879890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.881006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.892000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:44.893086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:44.937082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.939227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:44.945204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:44.947294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:45.021613 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1dd27d77-cb56-4ea7-8f29-a094334e5a48 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.177148 Jul 14 14:58:45.036093 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1984/3817] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:58:44 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa/os-volume_attachments => generated 25 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:58:45.233693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:45.234958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:45.266444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:45.269945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:45.274249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:45.279542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:45.459566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:58:45.767828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:45.839440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bd16ad0-1493-4ef3-8890-5c2eddc136b1 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.958222 Jul 14 14:58:45.853052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:45.861372 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1834/3818] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:44 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:45.896853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:45.899220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:45.913915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:45.915307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:45.916977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:45.918168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:45.944222 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c41b46ab-8e7d-4c5f-bceb-1295f231ed33 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 204 len: 0 microversion: 2.1 time: 0.713503 Jul 14 14:58:45.957699 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1985/3819] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:58:45 2022] DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 0 bytes in 726 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:58:45.966104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:45.973919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:46.004568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:46.005437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:46.007029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:46.009175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:46.623765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:46.643628 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3374004-0118-4e0d-9ec2-519be723222c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.778341 Jul 14 14:58:46.660950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1835/3820] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:45 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:46.747238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9bce0640-0a0f-4d82-87c1-8ab1bbea3815"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:46.756422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:46.771586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:46.773311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:46.775076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:46.776324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:46.987317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:47.016298 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6813be62-5d8b-4245-9451-c326390d3331 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1675 microversion: 2.1 time: 1.056263 Jul 14 14:58:47.021709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1986/3821] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:45 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1675 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:47.055831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:47.059524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:47.092649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:47.097207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:47.101149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:47.102072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:47.326007 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11315c3d-2dbe-45b1-8295-be1b71180b55 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.587225 Jul 14 14:58:47.328566 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1836/3822] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 14:58:46 2022] POST /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69/os-volume_attachments => generated 194 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:47.683244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:47.684566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:47.698844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:47.699586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:47.700624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:47.701357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:47.761764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:47.779640 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2ae8f88-c75f-46c8-a799-25c1fa3d65fe tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1304 microversion: 2.1 time: 0.755814 Jul 14 14:58:47.780641 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1987/3823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:47 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1304 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:47.974428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:47.993215 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-adda748b-4255-42d4-992e-587525cd1cfa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.322971 Jul 14 14:58:47.996379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1837/3824] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:47 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:48.055763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:48.056335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:48.070763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:48.072818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:48.075596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:48.076747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:48.811138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:48.812399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:48.813121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:48.813510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:48.827950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:48.828564 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d7b0ada-8cb7-4772-9e81-c8532b1136d4 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1675 microversion: 2.1 time: 0.779745 Jul 14 14:58:48.829188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1988/3825] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:48 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1675 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:48.829549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:48.830643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:48.833066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:49.023480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:49.024232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:49.036422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:49.036422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:49.040280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:49.040914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:49.591366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:49.607089 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-798f0ae9-66d1-4b15-9515-008625eec191 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1292 microversion: 2.1 time: 0.800535 Jul 14 14:58:49.625376 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1838/3826] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:48 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1292 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:49.863975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:49.864882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:49.878192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:49.881967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:49.886063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:49.889485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:50.417083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:50.436544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-539e478a-f791-4ebb-b193-132486f6f98b tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1675 microversion: 2.1 time: 0.577464 Jul 14 14:58:50.439330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1839/3827] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:49 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1675 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:50.633136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:50.634241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:50.653417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:50.654292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:50.656324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:50.665754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:51.115984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:51.138199 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7a44ed8f-75b6-4a68-81e7-088979e96ad6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 2.119196 Jul 14 14:58:51.142593 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1989/3828] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:49 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:51.468047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:51.477428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:51.515688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:51.517201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:51.525682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:51.526985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:51.929217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:51.954568 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8fffde28-b5cb-4663-9c2b-aa9ec49be74d tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1292 microversion: 2.1 time: 1.333401 Jul 14 14:58:51.967820 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1840/3829] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:50 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1292 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:52.050414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-610c194f-12b5-46b7-bbe8-7c0ea007363c req-0a32a5b3-8295-4af2-8964-b269824890e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cfa5cb90-18bc-4c57-898e-47f7f81302fa", "name": "network-vif-deleted", "tag": "8f050eac-5407-4eab-bf6e-26440baf950d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:52.093970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-610c194f-12b5-46b7-bbe8-7c0ea007363c req-0a32a5b3-8295-4af2-8964-b269824890e1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:52.096571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-610c194f-12b5-46b7-bbe8-7c0ea007363c req-0a32a5b3-8295-4af2-8964-b269824890e1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:52.101529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b06a5d6f31ea4d4a9a7e69f759a3c7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27951e61632946f58c199f09723d6fdd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:52.136842 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-610c194f-12b5-46b7-bbe8-7c0ea007363c req-0a32a5b3-8295-4af2-8964-b269824890e1 service nova] Creating event network-vif-deleted:8f050eac-5407-4eab-bf6e-26440baf950d for instance cfa5cb90-18bc-4c57-898e-47f7f81302fa on n-h1-768852-23 Jul 14 14:58:52.141461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8f828ae-dbf3-4f69-bdac-ec861548dbc5 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 200 len: 1607 microversion: 2.1 time: 0.686215 Jul 14 14:58:52.150841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1990/3830] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:51 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 1607 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:52.158572 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-610c194f-12b5-46b7-bbe8-7c0ea007363c req-0a32a5b3-8295-4af2-8964-b269824890e1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114972 Jul 14 14:58:52.163845 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1841/3831] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:58:52.180154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:52.181753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:52.200768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:52.202254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:52.208291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:52.209281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:52.690446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:52.711140 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c0c53a9b-a581-47b5-820b-fdc3bb79adbe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.540780 Jul 14 14:58:52.723490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1991/3832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:52 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:52.981208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:52.983740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:53.011565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:53.024996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:53.028756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:53.029319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:53.087710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:58:53.189833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:53.196232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:53.233898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:53.243663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:53.245356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:53.246261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:53.353292 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] HTTP exception thrown: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Request method failure captured: Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa HTTP/1.1 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1rolyCNiQr2y7EKCOeCbJZrkjtQ574U4hFemWWw4EkAk0Lu6iEJYtyJxAXb3Ruo2iH0IlpXa-XVlAAldnH6nu8ljDYzuGzDG5jnfFiL_N3LBUTebGjsY1TE_-hXQMe7M84e-lVj8gaJortSdw1s2WEyz9yOyiYkP3pmwDCRVKEUns Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_27951e61632946f58c199f09723d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/27951e61632946f58c199f09723d6fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b06a5d6f31ea4d4a9a7e69f759a3c7ce Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'cfa5cb90-18bc-4c57-898e-47f7f81302fa'} Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:58:53.357905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:58:53.367455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:58:53.380409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Returning 404 to user: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:58:53.382428 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c257f1ac-b67a-4019-8f79-e09b33d5159c tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 404 len: 111 microversion: 2.1 time: 0.201331 Jul 14 14:58:53.385871 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1992/3833] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:53 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:58:53.404154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-491e07af-0221-4def-b118-b74926323b46 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '.version_select at 0x7fdbf23574c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:53.462853 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-491e07af-0221-4def-b118-b74926323b46 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031503142" status: 202 len: 0 microversion: 2.1 time: 0.064005 Jul 14 14:58:53.465792 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1993/3834] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 14:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1031503142 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:58:53.738957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:53.739855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:53.755180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:53.755680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:53.756477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:53.756920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:54.079208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:54.110075 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ea5fb7d4-74b0-403a-b43f-c6659f99fdef tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1292 microversion: 2.1 time: 1.132675 Jul 14 14:58:54.114504 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1842/3835] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:52 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1292 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:54.693144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:54.709709 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c3ba69f-3271-4cb7-82ac-8ac87ffcba71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.975751 Jul 14 14:58:54.710398 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1994/3836] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:53 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:55.139328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:55.145188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:55.188995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:55.195841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:55.197043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:55.197951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:55.757013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:55.765257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:55.787303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:55.794265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:55.810842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:55.812612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:55.882956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:55.899766 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fdec859e-fa80-4647-85ee-097135f591ba tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1292 microversion: 2.1 time: 0.758241 Jul 14 14:58:55.914698 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1843/3837] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:55 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1292 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:56.308642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:56.324157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ca76584-778e-45ce-af51-267b498c1c6f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.598383 Jul 14 14:58:56.325425 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1995/3838] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:55 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:56.910510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:56.911763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:56.936922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:56.937471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:56.938408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:56.938738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:57.359386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:57.360155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:57.386256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:57.387069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:57.388505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:57.389242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:57.649327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:57.659907 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66abaa33-f0a8-496f-a93b-10ac53fdff39 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1292 microversion: 2.1 time: 0.752882 Jul 14 14:58:57.673138 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1844/3839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:56 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1292 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:58.171751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:58.198919 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10a896e2-2862-4e50-844a-ab896714552e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.849306 Jul 14 14:58:58.199866 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1996/3840] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:57 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:58:58.471248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8da6623c-231f-408f-9182-57d70d1e2740 req-8ccef7bc-f20e-4996-9c88-a6b484647bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac407b64-a541-47c6-a16c-f52ca7a53ec3", "name": "network-vif-plugged", "status": "completed", "tag": "b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:58:58.483583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8da6623c-231f-408f-9182-57d70d1e2740 req-8ccef7bc-f20e-4996-9c88-a6b484647bbc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:58.484325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8da6623c-231f-408f-9182-57d70d1e2740 req-8ccef7bc-f20e-4996-9c88-a6b484647bbc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:58.500402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8da6623c-231f-408f-9182-57d70d1e2740 req-8ccef7bc-f20e-4996-9c88-a6b484647bbc service nova] Creating event network-vif-plugged:b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1 for instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 on n-h2-768852-23 Jul 14 14:58:58.506544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8da6623c-231f-408f-9182-57d70d1e2740 req-8ccef7bc-f20e-4996-9c88-a6b484647bbc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039506 Jul 14 14:58:58.507792 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1845/3841] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:58:58.680555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:58.681344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:58.699497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:58.699957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:58.700765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:58.701204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:59.232432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:58:59.238313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:58:59.288115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:59.289897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:59.291526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:58:59.292344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:58:59.454092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:59.474532 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75d9175d-ad15-47d7-afbb-a96d6ce279c2 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1292 microversion: 2.1 time: 0.799353 Jul 14 14:58:59.475578 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1997/3842] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:58 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1292 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:58:59.761512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:58:59.799682 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6bd2e088-f8a4-4983-bf62-eabc99f15b86 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 0.575560 Jul 14 14:58:59.803815 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1846/3843] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:58:59 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:00.508067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:00.508867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:00.529485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:00.533065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:00.538144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:00.541881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:00.833026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:00.833811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:00.872534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:00.890082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:00.891917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:00.900561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:01.827326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:01.903754 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ab80618-d2c0-40a7-b6e5-e67a02a71c6a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 1.078162 Jul 14 14:59:01.906107 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1847/3844] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:00 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:02.099766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:02.136394 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-def14310-bb1a-4ef8-bf04-839822478949 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1482 microversion: 2.1 time: 1.629088 Jul 14 14:59:02.138600 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1998/3845] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:00 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1482 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:02.183952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:02.185443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:02.208301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=48 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:02.214455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:02.224329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:02.235021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:02.260710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:02.788321 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0a4f7b9-e829-4da5-bc8a-964523c45311 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.621617 Jul 14 14:59:02.789449 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1848/3846] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 14:59:02 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3/os-interface => generated 284 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:59:02.930106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:02.934592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:02.966632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:02.976758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:02.978339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:02.979828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:04.019990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:04.022034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:04.053251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:04.054404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:04.055849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:04.056538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:04.122372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:59:04.366244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d00fb286-54a6-4ec6-965d-a475d4331986 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 204 len: 0 microversion: 2.1 time: 0.353205 Jul 14 14:59:04.367657 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1849/3847] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:04 2022] DELETE /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:59:04.377771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:04.379079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:04.386957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:04.387446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:04.388245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:04.388684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:04.755246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:04.796877 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7c4ce7b-8be4-41c0-a704-2956a4942333 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 1.874288 Jul 14 14:59:04.799302 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 1999/3848] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:02 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:04.869476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:04.903372 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7483ebd6-53a9-4842-918e-abbf0277348c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1554 microversion: 2.1 time: 0.527127 Jul 14 14:59:04.928357 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1850/3849] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:04 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1554 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:05.195891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:05.203243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:05.252387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:05.254703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:05.256170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:05.260513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:05.351478 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca37891d-733a-4a3a-9b1c-6bbedcb59ca5 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.165404 Jul 14 14:59:05.353844 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2000/3850] 10.222.0.98 () {60 vars in 1342 bytes} [Thu Jul 14 14:59:05 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf/os-volume_attachments => generated 25 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:05.531187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:05.536127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:05.560680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:05.564422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:05.565958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:05.571855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:05.688042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:59:05.819927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:05.821031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:05.878227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:05.882292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:05.891389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:05.892676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:06.143046 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65db1e29-efd8-4497-8544-47bc9e7d3391 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 204 len: 0 microversion: 2.20 time: 0.617386 Jul 14 14:59:06.159091 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1851/3851] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:59:05 2022] DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 0 bytes in 629 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:59:06.190325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:06.194140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:06.215344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:06.218909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:06.222008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:06.232248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:06.519069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:06.529715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65dfd994-67d6-4cf3-a167-09bcf223a0f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1554 microversion: 2.1 time: 0.366014 Jul 14 14:59:06.536269 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1852/3852] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:06 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1554 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:06.552290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:06.556573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:06.580022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:06.580497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:06.581895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:06.582335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:07.664496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:07.733292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:07.735332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:07.746341 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0cb2b863-ebed-4171-93ec-3b819bb59d86 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.207805 Jul 14 14:59:07.747352 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1853/3853] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:06 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:07.772203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:07.772816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:07.801231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:07.801695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:07.802566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:07.803116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:08.027997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:08.049522 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a69a8fc-3911-4a00-a36b-6bb251928f2c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1512 microversion: 2.1 time: 0.298794 Jul 14 14:59:08.054013 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1854/3854] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:07 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:08.071517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0e6c329b-028b-4b00-8e71-2424096eecfd req-288014dc-9547-452a-a58f-ca647507e05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69", "name": "network-vif-deleted", "tag": "b7f8b32a-6301-4890-a552-20ff163ce2b8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:08.093112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e6c329b-028b-4b00-8e71-2424096eecfd req-288014dc-9547-452a-a58f-ca647507e05f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:08.098148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e6c329b-028b-4b00-8e71-2424096eecfd req-288014dc-9547-452a-a58f-ca647507e05f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:08.129279 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0e6c329b-028b-4b00-8e71-2424096eecfd req-288014dc-9547-452a-a58f-ca647507e05f service nova] Creating event network-vif-deleted:b7f8b32a-6301-4890-a552-20ff163ce2b8 for instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 on n-h2-768852-23 Jul 14 14:59:08.144049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0e6c329b-028b-4b00-8e71-2424096eecfd req-288014dc-9547-452a-a58f-ca647507e05f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086765 Jul 14 14:59:08.152094 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1855/3855] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:08.397425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:08.448072 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea6f7d1a-222f-4eab-b2b4-0947be626f52 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 2.627275 Jul 14 14:59:08.449310 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2001/3856] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:05 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 2638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:08.773053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:08.774055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:08.801041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:08.803489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:08.806370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:08.807237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:09.083149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:09.083924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:09.103034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:09.104603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:09.107691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:09.114049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:09.464250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:09.482401 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df51e393-9483-453b-8733-a29bbec4b4e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1346 microversion: 2.1 time: 0.407179 Jul 14 14:59:09.493094 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2002/3857] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:09 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1346 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:09.513268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:09.523296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:09.537252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:09.540574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:09.544241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:09.557743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.032438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:10.051973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:10.056181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:10.059082 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f81a617-6713-4e8a-b3fe-2fd16db1037a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 1.294652 Jul 14 14:59:10.076447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1856/3858] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:08 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:10.521863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:10.522791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:10.539323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:10.541450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.543989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:10.548840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:10.619433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:10.703962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:10.717899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-398e7dca-0e9f-4eb4-96ad-e2aebda72b48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1346 microversion: 2.1 time: 0.200666 Jul 14 14:59:10.720670 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1857/3859] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:10 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1346 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:11.092851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:11.094260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:11.115890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:11.116753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:11.117764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:11.119347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:11.468144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:11.485556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:11.492045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:11.494205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-199656cd-1cb7-4eb2-8460-f7c45bebc7e0 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1722 microversion: 2.20 time: 0.408599 Jul 14 14:59:11.511423 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1858/3860] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:11 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1722 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 14:59:11.751045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:11.754007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:11.776193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:11.776193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:11.776662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:11.777477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:11.826849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:11.864486 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eadb8862-da41-4c8f-a186-efb4e164f648 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 2.369920 Jul 14 14:59:11.879215 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2003/3861] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:09 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:11.957928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:11.972763 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d1d20aa-9651-477b-ab0e-80f3d66843ba tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1346 microversion: 2.1 time: 0.226808 Jul 14 14:59:11.974359 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1859/3862] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:11 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1346 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:12.161993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:12.163528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:12.177540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.195034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-20e0f9a2-7c0b-48c1-bbbf-a8ac4b9c0423 req-a821bb95-a9dd-48e6-8705-feb24811a594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac407b64-a541-47c6-a16c-f52ca7a53ec3", "tag": "b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:12.201273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:12.203317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.206405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:12.240353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-20e0f9a2-7c0b-48c1-bbbf-a8ac4b9c0423 req-a821bb95-a9dd-48e6-8705-feb24811a594 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.244945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-20e0f9a2-7c0b-48c1-bbbf-a8ac4b9c0423 req-a821bb95-a9dd-48e6-8705-feb24811a594 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:12.763876 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-20e0f9a2-7c0b-48c1-bbbf-a8ac4b9c0423 req-a821bb95-a9dd-48e6-8705-feb24811a594 service nova] Creating event network-changed:b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1 for instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 on n-h2-768852-23 Jul 14 14:59:12.783024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-20e0f9a2-7c0b-48c1-bbbf-a8ac4b9c0423 req-a821bb95-a9dd-48e6-8705-feb24811a594 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.599101 Jul 14 14:59:12.786910 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1860/3863] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:12.805955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:12.810812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:12.833250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.838199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:12.839562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:12.840588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.053377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:13.064183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:13.066559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:13.067861 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37009b50-caf9-450c-a446-9d5468337f77 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1655 microversion: 2.20 time: 0.277338 Jul 14 14:59:13.080499 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1861/3864] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:12 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1655 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:13.086722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:13.087991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:13.095964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.096434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.097817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.098280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.117282 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] HTTP exception thrown: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Request method failure captured: Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa HTTP/1.1 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C1rolyCNiQr2y7EKCOeCbJZrkjtQ574U4hFemWWw4EkAk0Lu6iEJYtyJxAXb3Ruo2iH0IlpXa-XVlAAldnH6nu8ljDYzuGzDG5jnfFiL_N3LBUTebGjsY1TE_-hXQMe7M84e-lVj8gaJortSdw1s2WEyz9yOyiYkP3pmwDCRVKEUns Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_27951e61632946f58c199f09723d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/27951e61632946f58c199f09723d6fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: b06a5d6f31ea4d4a9a7e69f759a3c7ce Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'cfa5cb90-18bc-4c57-898e-47f7f81302fa'} Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:13.119110 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Returning 404 to user: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:13.122881 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d457d60-2feb-4c22-a6a5-1013262b5be8 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 404 len: 111 microversion: 2.1 time: 0.038926 Jul 14 14:59:13.125641 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1862/3865] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:13 2022] DELETE /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:13.757273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:13.760655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:13.765694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:13.778573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.778834 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7f4bf4e-b78a-4031-81cc-d8c52d288394 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1482 microversion: 2.1 time: 1.634104 Jul 14 14:59:13.780075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.781346 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2004/3866] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:12 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1482 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:13.782017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.783034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.807731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:13.812730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:13.834966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.842935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:13.844262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:13.844958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.165951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.193392 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4486f80a-6597-4829-8381-8ce45d8599d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1346 microversion: 2.1 time: 0.402606 Jul 14 14:59:14.194694 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2005/3867] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:13 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1346 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:14.232465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:14.245236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: cfa5cb90-18bc-4c57-898e-47f7f81302fa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:14.269339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.270583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.272082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.273262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.315158 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] HTTP exception thrown: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Request method failure captured: Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa HTTP/1.1 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1rolyCNiQr2y7EKCOeCbJZrkjtQ574U4hFemWWw4EkAk0Lu6iEJYtyJxAXb3Ruo2iH0IlpXa-XVlAAldnH6nu8ljDYzuGzDG5jnfFiL_N3LBUTebGjsY1TE_-hXQMe7M84e-lVj8gaJortSdw1s2WEyz9yOyiYkP3pmwDCRVKEUns Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_27951e61632946f58c199f09723d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/27951e61632946f58c199f09723d6fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b06a5d6f31ea4d4a9a7e69f759a3c7ce Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'cfa5cb90-18bc-4c57-898e-47f7f81302fa'} Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:14.327245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Returning 404 to user: Instance cfa5cb90-18bc-4c57-898e-47f7f81302fa could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:14.334956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85af144d-240e-4ce5-b5a6-708afe5ff76f tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa" status: 404 len: 111 microversion: 2.1 time: 0.113823 Jul 14 14:59:14.341913 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2006/3868] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:14 2022] GET /compute/v2.1/servers/cfa5cb90-18bc-4c57-898e-47f7f81302fa => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:14.366509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:14.367137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:14.374904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.375525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.376469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.377009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.422313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.436438 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-40f390d6-1363-4ced-b1b1-17184f1e7049 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1512 microversion: 2.1 time: 1.309475 Jul 14 14:59:14.437921 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1863/3869] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:13 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1512 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:14.630720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.650094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:14.660155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.664814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2625ce3aa5034d048494fca0dc403c51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcf2159a7a09439aa1be7f78d8b9d1eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:14.666220 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9868c7ae-1d68-4454-9c19-b456e6540d7b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 200 len: 1655 microversion: 2.20 time: 0.314073 Jul 14 14:59:14.679659 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2007/3870] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:14 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 1655 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 14:59:14.938853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-28f3e378-0d30-4257-8133-be72f2ccdef8 req-b21a483e-d87c-42f1-930d-d6f53b41e0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e902fe2d-9dd4-4533-8381-c44065e607bf", "name": "network-vif-deleted", "tag": "0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:14.960352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-28f3e378-0d30-4257-8133-be72f2ccdef8 req-b21a483e-d87c-42f1-930d-d6f53b41e0a4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:14.962116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-28f3e378-0d30-4257-8133-be72f2ccdef8 req-b21a483e-d87c-42f1-930d-d6f53b41e0a4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:14.997890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-28f3e378-0d30-4257-8133-be72f2ccdef8 req-b21a483e-d87c-42f1-930d-d6f53b41e0a4 service nova] Creating event network-vif-deleted:0ac8b8c1-00f9-4c4c-b2a8-c1b02e1f1a53 for instance e902fe2d-9dd4-4533-8381-c44065e607bf on n-h1-768852-23 Jul 14 14:59:15.004754 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-28f3e378-0d30-4257-8133-be72f2ccdef8 req-b21a483e-d87c-42f1-930d-d6f53b41e0a4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071857 Jul 14 14:59:15.006193 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1864/3871] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:15.224052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:15.224855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:15.254284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:15.254796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.257749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:15.258956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.458170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:15.459180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:15.496316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:15.506347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.513079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:15.515900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:15.983627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:15.998217 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ab0425f-7f31-42e6-a549-03283c714ae7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1489 microversion: 2.1 time: 0.546354 Jul 14 14:59:15.998838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1865/3872] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:15 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1489 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:16.020788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:16.022005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:16.030554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.031395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.033305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.033991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.051697 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] HTTP exception thrown: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Request method failure captured: Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf HTTP/1.1 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C06d3ifq5wIfjzZMVoO46ElEk2hQHcE06N_T1ZR6oyjnbtdznWlEgNnrvYUhwrpQou_HAA7KViZ14itmIMm-EP7DeRZYpknAlHRv-Cb4AuDWkbYbNhZ-WvCAv7aDWm-B0avchhtex8OTLuTT873VZLNbDzfXTzyPNgHNKm5E8yycQ8 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2625ce3aa5034d048494fca0dc403c51 Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e902fe2d-9dd4-4533-8381-c44065e607bf'} Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:16.054559 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:16.058130 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:16.063031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Returning 404 to user: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:16.064008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-450ee65e-72fb-44fb-a8ca-e4777108d36a tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 404 len: 111 microversion: 2.20 time: 0.051155 Jul 14 14:59:16.064893 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1866/3873] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:15 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:59:16.076326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:16.077363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:16.092246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.092711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.093536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.093980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.255580 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7413d030-155f-42d8-8715-efcbfe744ca9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 200 len: 139 microversion: 2.1 time: 0.189571 Jul 14 14:59:16.260667 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1867/3874] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:16 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 139 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:16.275016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f485292-f74d-4efa-afb4-72420f474a3b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '.version_select at 0x7fdbf1f49040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:16.309731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3f485292-f74d-4efa-afb4-72420f474a3b tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1284821431" status: 204 len: 0 microversion: 2.20 time: 0.047156 Jul 14 14:59:16.310342 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1868/3875] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 14:59:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1284821431 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 14:59:16.321347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:16.322354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:16.352904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.353348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.354347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.354946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.541712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:16.570304 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a69667d-b359-4fa1-80e7-ba8ebef772bb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1346 microversion: 2.1 time: 1.352437 Jul 14 14:59:16.570954 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2008/3876] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:15 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1346 bytes in 1354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:16.867870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:16.873153 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-efc66c1b-0c79-4cf3-9f35-e5a1aed10b99 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.556284 Jul 14 14:59:16.888514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1869/3877] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:16 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:16.920252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:16.920252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:16.922048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:16.941800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.942980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:16.943889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:16.948430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:17.080569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1955049863", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:17.177011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] validate_networks() for [('c59b259a-1165-406c-b959-1fabb0fd999d', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:59:17.746341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:17.796250 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6254c91-cd21-46aa-8e23-6eccafd3fd25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.884459 Jul 14 14:59:17.804622 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2009/3878] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:16 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:17.838319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:17.844551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:17.870494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:17.871791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:17.877923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:17.879385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.173132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:18.202263 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-048bd853-23ab-4e74-bf0c-652b4ddf5d0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 200 len: 1346 microversion: 2.1 time: 0.394912 Jul 14 14:59:18.214836 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2010/3879] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:17 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 1346 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:18.238578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:18.243914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:18.276735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.285210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.287994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.288467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.608484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:59:18.609033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:59:18.609599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:59:18.609901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:59:18.610378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:59:18.642244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.643610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.645916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:18.646390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:18.722516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Getting quotas for project c9a2c2bf376243c0ba8c572cc1bca54b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:59:18.739893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Getting quotas for user c1a4b4998ca6479f85adc2b9c65e1e06 and project c9a2c2bf376243c0ba8c572cc1bca54b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:59:18.785000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:59:18.787844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:59:18.894624 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cba6749e-5ff9-430c-abd9-1f4681674b84 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.944588 Jul 14 14:59:18.895688 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1870/3880] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:59:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 14:59:18.910466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5c33cc3-8c2f-4a56-b87b-691bc2bf5da6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:18.911146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5c33cc3-8c2f-4a56-b87b-691bc2bf5da6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:18.954684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:18.998453 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-beb05c58-5d6a-493e-813f-deff378566a5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.776680 Jul 14 14:59:18.998589 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2011/3881] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:18 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:19.035887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:19.036783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:19.053212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.053838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.055005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.055864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.210714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5c33cc3-8c2f-4a56-b87b-691bc2bf5da6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:19.220611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5c33cc3-8c2f-4a56-b87b-691bc2bf5da6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1217 microversion: 2.1 time: 0.314827 Jul 14 14:59:19.232677 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1871/3882] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:18 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1217 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:19.238415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:19.245590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:19.254105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.254829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.256523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.257260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.283815 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 HTTP/1.1 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69'} Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:19.287660 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.292063 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.293901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:19.296038 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9d02fd3-c2cd-40ca-b094-2f9db179fe97 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 404 len: 111 microversion: 2.1 time: 0.061928 Jul 14 14:59:19.296942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1872/3883] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:19 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:19.573432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:19.640531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88e26e4b-35c5-4e6e-909f-fe0288c825d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.593398 Jul 14 14:59:19.644447 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2012/3884] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:19 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:19.721058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:19.723901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:19.771832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.773428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.781932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:19.783493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:19.818921 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69/os-volume_attachments HTTP/1.1 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': 'b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69'} Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:19.823957 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 14:59:19.834317 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:19.836435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:19.838577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3f20808e-879a-40b3-87a2-a5ffc5936964 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.127111 Jul 14 14:59:19.844847 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1873/3885] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 14:59:19 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69/os-volume_attachments => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:19.852344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1986545881", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "4c9ebcf6-34f2-4c45-b411-0023bc6fae9d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:19.972924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] validate_networks() for [('4c9ebcf6-34f2-4c45-b411-0023bc6fae9d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:59:20.254408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:20.267105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:20.313020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:20.314511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:20.318110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:20.319375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:20.507515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:20.526594 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3804661a-ec5d-4643-b04b-7342371ce2d6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1221 microversion: 2.1 time: 0.285553 Jul 14 14:59:20.532083 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1874/3886] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:20 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1221 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:20.546830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1166106645", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:20.693172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:59:22.555220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:59:22.558039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:59:22.559675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:59:22.560779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:59:22.561815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:59:22.623191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.625969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.636433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:22.639070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:22.734160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:59:22.765650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for user 4813aa5acf744a8dac42de00d7e5a519 and project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:59:22.829446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:59:22.841243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:59:22.977872 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b8be1888-5805-4592-be3c-c790af9f2cfc tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.129776 Jul 14 14:59:22.989021 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2013/3887] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:59:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3142 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:59:22.998005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:23.009534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:23.048359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.049110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.053666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.058053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.313551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.347914 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-595fd01a-3f3d-4de4-b617-ccc8e597f9ce tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1275 microversion: 2.1 time: 0.351870 Jul 14 14:59:23.351446 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2014/3888] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:22 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1275 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:23.379226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4df3ee0-32df-4ae5-a66f-5cf270f4c655 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:23.382541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4df3ee0-32df-4ae5-a66f-5cf270f4c655 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:23.673920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4df3ee0-32df-4ae5-a66f-5cf270f4c655 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:23.701774 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4df3ee0-32df-4ae5-a66f-5cf270f4c655 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1215 microversion: 2.1 time: 0.346999 Jul 14 14:59:23.702882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2015/3889] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:23 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:23.759779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:59:23.760267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:59:23.760733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:59:23.761413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:59:23.762130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:59:23.783901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.784609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.786244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:23.786706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:23.875473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:59:23.889494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:59:23.950746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:59:23.953553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:59:24.122922 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b1a8168-46dc-4c6b-92e0-5473ee5cf692 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.589511 Jul 14 14:59:24.123669 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1875/3890] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:59:24.134706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f388984-30c2-48fe-b9b6-aa50e2f23a59 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:24.135716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f388984-30c2-48fe-b9b6-aa50e2f23a59 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:24.370425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:24.371095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:24.391739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:24.410498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.411069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.411979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.412479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.904795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0f388984-30c2-48fe-b9b6-aa50e2f23a59 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:24.926099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f388984-30c2-48fe-b9b6-aa50e2f23a59 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4" status: 200 len: 1215 microversion: 2.1 time: 0.795435 Jul 14 14:59:24.928711 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2016/3891] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:24 2022] GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 => generated 1215 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:24.953145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:24.954695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:24.974441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.978280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:24.981973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:24.984029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.236100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.252172 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-869f395b-bb3a-449d-86f2-3213ecfe2cdb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1267 microversion: 2.1 time: 0.319382 Jul 14 14:59:25.253236 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2017/3892] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:24 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1267 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:25.267870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:25.273918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:25.310730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:25.325037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:59:25.347474 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c513ce8-48d8-4cf4-9b83-9067faba1dc2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 0.979541 Jul 14 14:59:25.350671 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1876/3893] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:24 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:25.400799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:25.401019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.441169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'flavor' on Instance uuid 64111e67-b57b-4a66-9440-5befb8d66da4 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:59:25.467046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'system_metadata' on Instance uuid 64111e67-b57b-4a66-9440-5befb8d66da4 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:59:25.621452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'metadata' on Instance uuid 64111e67-b57b-4a66-9440-5befb8d66da4 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 14:59:25.934774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:25.939005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:25.989201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:25.991595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:25.998257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.003926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.159490 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] HTTP exception thrown: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Request method failure captured: Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf HTTP/1.1 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C06d3ifq5wIfjzZMVoO46ElEk2hQHcE06N_T1ZR6oyjnbtdznWlEgNnrvYUhwrpQou_HAA7KViZ14itmIMm-EP7DeRZYpknAlHRv-Cb4AuDWkbYbNhZ-WvCAv7aDWm-B0avchhtex8OTLuTT873VZLNbDzfXTzyPNgHNKm5E8yycQ8 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2625ce3aa5034d048494fca0dc403c51 Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e902fe2d-9dd4-4533-8381-c44065e607bf'} Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:26.161347 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Returning 404 to user: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e9de78eb-dfa2-47f0-a63e-95e63a823da3 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 404 len: 111 microversion: 2.20 time: 0.244100 Jul 14 14:59:26.164710 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1877/3894] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:59:25 2022] DELETE /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 111 bytes in 246 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:59:26.189893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:26.192686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: e902fe2d-9dd4-4533-8381-c44065e607bf] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:26.212647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.215831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.218248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.219530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.261331 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] HTTP exception thrown: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Request method failure captured: Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf HTTP/1.1 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C06d3ifq5wIfjzZMVoO46ElEk2hQHcE06N_T1ZR6oyjnbtdznWlEgNnrvYUhwrpQou_HAA7KViZ14itmIMm-EP7DeRZYpknAlHRv-Cb4AuDWkbYbNhZ-WvCAv7aDWm-B0avchhtex8OTLuTT873VZLNbDzfXTzyPNgHNKm5E8yycQ8 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2625ce3aa5034d048494fca0dc403c51 Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e902fe2d-9dd4-4533-8381-c44065e607bf'} Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.266882 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. Jul 14 14:59:26.282163 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:26.289104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Returning 404 to user: Instance e902fe2d-9dd4-4533-8381-c44065e607bf could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:26.290735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0a387202-46f8-4026-8a06-fe19d089695c tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf" status: 404 len: 111 microversion: 2.20 time: 0.112047 Jul 14 14:59:26.292583 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1878/3895] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:26 2022] GET /compute/v2.1/servers/e902fe2d-9dd4-4533-8381-c44065e607bf => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:59:26.316549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:26.318564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:26.336364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.337209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.338537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.343846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.779989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:26.804871 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77a7d040-0bc8-4d8b-90be-8198e961b9d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1273 microversion: 2.1 time: 0.510536 Jul 14 14:59:26.817070 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1879/3896] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:26 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1273 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:26.834716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:26.844533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:26.866510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.870873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:26.899095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:26.903666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.090112 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.scheduler.client.report [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Deleted allocations for instance 64111e67-b57b-4a66-9440-5befb8d66da4 Jul 14 14:59:27.169779 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a0d8c8d-4771-43b1-8fb3-fb5b972ca1b4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4" status: 204 len: 0 microversion: 2.1 time: 1.912194 Jul 14 14:59:27.175926 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2018/3897] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:25 2022] DELETE /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 => generated 0 bytes in 1918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:59:27.182786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:27.183678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:27.215902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.216948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.225916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.227412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.250988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] HTTP exception thrown: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Request method failure captured: Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a HTTP/1.1 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1rolyCNiQr2y7EKCOeCbJZrkjtQ574U4hFemWWw4EkAk0Lu6iEJYtyJxAXb3Ruo2iH0IlpXa-XVlAAldnH6nu8ljDYzuGzDG5jnfFiL_N3LBUTebGjsY1TE_-hXQMe7M84e-lVj8gaJortSdw1s2WEyz9yOyiYkP3pmwDCRVKEUns Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_27951e61632946f58c199f09723d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/27951e61632946f58c199f09723d6fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b06a5d6f31ea4d4a9a7e69f759a3c7ce Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f6c479bb-f2bf-46bb-a256-cd2431bb117a'} Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:27.254312 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.257830 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.261513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Returning 404 to user: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:27.262801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-897eec8b-0f64-4299-93f7-b0c9ed2fbcaf tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 404 len: 111 microversion: 2.1 time: 0.085290 Jul 14 14:59:27.265853 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2019/3898] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:27 2022] DELETE /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:27.283837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:27.286485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:27.307086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.309668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.313227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.314000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.344924 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 HTTP/1.1 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64111e67-b57b-4a66-9440-5befb8d66da4'} Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.350540 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.356974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:27.360026 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8db9269a-6b51-4023-94fe-3f170b7b173e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4" status: 404 len: 111 microversion: 2.1 time: 0.087810 Jul 14 14:59:27.361566 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2020/3899] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:27 2022] GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:27.406852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:27.411611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] [instance: f6c479bb-f2bf-46bb-a256-cd2431bb117a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:27.458247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.459762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.465828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:27.476810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:27.562397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] HTTP exception thrown: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Request method failure captured: Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a HTTP/1.1 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C1rolyCNiQr2y7EKCOeCbJZrkjtQ574U4hFemWWw4EkAk0Lu6iEJYtyJxAXb3Ruo2iH0IlpXa-XVlAAldnH6nu8ljDYzuGzDG5jnfFiL_N3LBUTebGjsY1TE_-hXQMe7M84e-lVj8gaJortSdw1s2WEyz9yOyiYkP3pmwDCRVKEUns Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_27951e61632946f58c199f09723d6fdd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/27951e61632946f58c199f09723d6fdd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/27951e61632946f58c199f09723d6fdd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 27951e61632946f58c199f09723d6fdd Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1464702419 Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b06a5d6f31ea4d4a9a7e69f759a3c7ce Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeTestJSON-1464702419-project Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f6c479bb-f2bf-46bb-a256-cd2431bb117a'} Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:27.570616 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. Jul 14 14:59:27.577178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:27.581692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] Returning 404 to user: Instance f6c479bb-f2bf-46bb-a256-cd2431bb117a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:27.592108 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed5809d9-c202-47cc-80b5-bee104071956 tempest-AttachVolumeTestJSON-1464702419 tempest-AttachVolumeTestJSON-1464702419-project] 10.222.0.98 "GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a" status: 404 len: 111 microversion: 2.1 time: 0.208029 Jul 14 14:59:27.597514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2021/3900] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:27 2022] GET /compute/v2.1/servers/f6c479bb-f2bf-46bb-a256-cd2431bb117a => generated 111 bytes in 217 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 14:59:27.626230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-3153381", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:27.895965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:59:28.115099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:28.172344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-644cd304-ca1c-4f3e-a2a2-fb41b7410684 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 1.347197 Jul 14 14:59:28.175674 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1880/3901] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:26 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:28.213958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:28.224079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:28.250857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.252152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:28.254759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:28.256487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.241922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:29.257774 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-92ca5b66-a594-4558-bd67-e7bf908daed1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1273 microversion: 2.1 time: 1.073981 Jul 14 14:59:29.273686 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1881/3902] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:28 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1273 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:29.290548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3e3c1eca-f610-42b3-adad-c5b9093d856d req-22279119-bafe-4308-b8f0-db74d5de2a49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:29.321979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3e3c1eca-f610-42b3-adad-c5b9093d856d req-22279119-bafe-4308-b8f0-db74d5de2a49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.323330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3e3c1eca-f610-42b3-adad-c5b9093d856d req-22279119-bafe-4308-b8f0-db74d5de2a49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.354324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3e3c1eca-f610-42b3-adad-c5b9093d856d req-22279119-bafe-4308-b8f0-db74d5de2a49 service nova] Creating event network-changed:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h2-768852-23 Jul 14 14:59:29.371249 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3e3c1eca-f610-42b3-adad-c5b9093d856d req-22279119-bafe-4308-b8f0-db74d5de2a49 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095194 Jul 14 14:59:29.374729 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1882/3903] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:29.392209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:29.393953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:29.419933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.420968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.423866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:29.424650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:29.878266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:29.881527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:29.895863 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-549d4529-f057-4d73-aa02-015a10d4249f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 0.516753 Jul 14 14:59:29.908084 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1883/3904] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:29 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:30.284679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:30.284679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:30.304013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:30.304429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:30.309288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:30.313697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:30.626637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:30.642097 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d79db5b9-1d43-432e-9c32-94c13448fabe tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1273 microversion: 2.1 time: 0.366134 Jul 14 14:59:30.643672 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1884/3905] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:30 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1273 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:30.947505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:30.949475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:30.975042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:30.979585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:30.982478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:30.983887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.396073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:59:31.398253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:59:31.401396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:59:31.403725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:59:31.406084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:59:31.458088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.458930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.462738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.464239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.505015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:59:31.532225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:59:31.570397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:31.591462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:59:31.600760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:59:31.606935 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4cb4ac24-72a4-4845-9eca-3df932a01236 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 0.668828 Jul 14 14:59:31.607595 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1885/3906] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:30 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:31.664798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:31.665424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:31.684027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.684479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.685457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:31.686048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:31.823086 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b04acfb-69c6-4249-b941-74b24a6c177c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.219509 Jul 14 14:59:31.832920 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2022/3907] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:59:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 4239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:59:31.849491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2f80e63-8ca7-4d1d-9e6d-d2e1494a2db4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:31.854652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d2f80e63-8ca7-4d1d-9e6d-d2e1494a2db4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:31.858839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:31.874008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fd2faa92-02a4-4e46-ae01-d7b5943a2c27 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1273 microversion: 2.1 time: 0.215706 Jul 14 14:59:31.891951 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1886/3908] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:31 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1273 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:32.036107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d2f80e63-8ca7-4d1d-9e6d-d2e1494a2db4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:32.065736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2f80e63-8ca7-4d1d-9e6d-d2e1494a2db4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1212 microversion: 2.1 time: 0.225196 Jul 14 14:59:32.078212 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2023/3909] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:31 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1212 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:32.626115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:32.627065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:32.665514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.666584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.667159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.667572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.893832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:32.894693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:32.920855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.923317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:32.926321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:32.931651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:33.057892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:33.076372 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9a92907a-beb9-4db9-b91d-62fe5b546383 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 0.454636 Jul 14 14:59:33.077028 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1887/3910] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:32 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:33.099363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a76a4a4e-768a-4ca9-a77d-3a8bd71b483a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:33.099880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a76a4a4e-768a-4ca9-a77d-3a8bd71b483a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:33.388671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a76a4a4e-768a-4ca9-a77d-3a8bd71b483a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:33.402073 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a76a4a4e-768a-4ca9-a77d-3a8bd71b483a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1212 microversion: 2.1 time: 0.308268 Jul 14 14:59:33.403331 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1888/3911] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:33 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1212 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:34.106452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:34.109334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:34.146219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:34.219342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.220499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.224940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.228535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.715988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:34.740611 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-09fc0ec9-dcbf-4a5b-9b95-02ee2d1e7fd9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 1.840802 Jul 14 14:59:34.752366 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2024/3912] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:32 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:34.767813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:34.767813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:34.786098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.786589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:34.787496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:34.788175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.064858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:35.087981 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba9eb219-6189-4781-9025-4e6d4ffe1414 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1270 microversion: 2.1 time: 0.339342 Jul 14 14:59:35.089115 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2025/3913] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:34 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1270 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:35.090285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:35.103128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:35.104188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:35.132899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.134037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.136727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.137908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.142294 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e31c1aa-e07f-4d61-a98f-bc389ef329c5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 1.044559 Jul 14 14:59:35.147811 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1889/3914] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:34 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:35.173604 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] HTTP exception thrown: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Request method failure captured: Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 HTTP/1.1 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C06d3ifq5wIfjzZMVoO46ElEk2hQHcE06N_T1ZR6oyjnbtdznWlEgNnrvYUhwrpQou_HAA7KViZ14itmIMm-EP7DeRZYpknAlHRv-Cb4AuDWkbYbNhZ-WvCAv7aDWm-B0avchhtex8OTLuTT873VZLNbDzfXTzyPNgHNKm5E8yycQ8 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2625ce3aa5034d048494fca0dc403c51 Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '805e64f7-049d-4034-97c5-bf65914f6396'} Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:35.175980 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Returning 404 to user: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47d1a4af-5a6f-4f16-9631-45db10901c70 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 404 len: 111 microversion: 2.20 time: 0.090691 Jul 14 14:59:35.189585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2026/3915] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 14:59:35 2022] DELETE /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:59:35.201348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:35.210872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] [instance: 805e64f7-049d-4034-97c5-bf65914f6396] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:35.240386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.241329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.243138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.244227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.303379 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] HTTP exception thrown: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Request method failure captured: Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 HTTP/1.1 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C06d3ifq5wIfjzZMVoO46ElEk2hQHcE06N_T1ZR6oyjnbtdznWlEgNnrvYUhwrpQou_HAA7KViZ14itmIMm-EP7DeRZYpknAlHRv-Cb4AuDWkbYbNhZ-WvCAv7aDWm-B0avchhtex8OTLuTT873VZLNbDzfXTzyPNgHNKm5E8yycQ8 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/bcf2159a7a09439aa1be7f78d8b9d1eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: bcf2159a7a09439aa1be7f78d8b9d1eb Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-149107459 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2625ce3aa5034d048494fca0dc403c51 Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeShelveTestJSON-149107459-project Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '805e64f7-049d-4034-97c5-bf65914f6396'} Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.313183 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] Returning 404 to user: Instance 805e64f7-049d-4034-97c5-bf65914f6396 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 14:59:35.318899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0755d5cb-9000-4230-8b7a-e864ba451161 tempest-AttachVolumeShelveTestJSON-149107459 tempest-AttachVolumeShelveTestJSON-149107459-project] 10.222.0.98 "GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396" status: 404 len: 111 microversion: 2.20 time: 0.128668 Jul 14 14:59:35.328934 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1890/3916] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 14:59:35 2022] GET /compute/v2.1/servers/805e64f7-049d-4034-97c5-bf65914f6396 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 14:59:35.754034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:35.755686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:35.775205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.779967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:35.781967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:35.782747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.112708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:36.113782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:36.123431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.124607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.126430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.128203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.420136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:36.435347 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ef437318-0ad7-472d-be47-e5d38266d9b2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1270 microversion: 2.1 time: 0.329707 Jul 14 14:59:36.445018 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1891/3917] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:36 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1270 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:36.448688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:36.450458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:36.463572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.464516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.467176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:36.468476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:36.512941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:36.522394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=11,nova_cell1:DELETE=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:36.525966 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-652ba01a-eb11-4b71-9bc7-ee229392fe4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 0.777077 Jul 14 14:59:36.527221 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2027/3918] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:35 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:37.191478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:37.209077 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f931930-2ac1-433e-80fc-483aff59d5ab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 0.771142 Jul 14 14:59:37.209880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1892/3919] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:36 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:37.469302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-453210dd-473b-4244-8864-6e7cee3da669 req-51f9e16c-915d-47ab-bcb8-316c7edf3cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "name": "network-vif-plugged", "status": "completed", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:37.473626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:37.476349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:37.503243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-453210dd-473b-4244-8864-6e7cee3da669 req-51f9e16c-915d-47ab-bcb8-316c7edf3cf3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.504592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-453210dd-473b-4244-8864-6e7cee3da669 req-51f9e16c-915d-47ab-bcb8-316c7edf3cf3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.511036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.514473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.517455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.518969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.532839 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-453210dd-473b-4244-8864-6e7cee3da669 req-51f9e16c-915d-47ab-bcb8-316c7edf3cf3 service nova] Creating event network-vif-plugged:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h2-768852-23 Jul 14 14:59:37.549638 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-453210dd-473b-4244-8864-6e7cee3da669 req-51f9e16c-915d-47ab-bcb8-316c7edf3cf3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087241 Jul 14 14:59:37.551750 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1893/3920] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:37.563499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:37.565744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:37.580571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.582410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.585913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:37.588583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:37.953016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:37.965274 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b053f4f-9cee-4c9d-ab90-4323da7b3ed8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1270 microversion: 2.1 time: 0.514001 Jul 14 14:59:37.966342 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2028/3921] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:37 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1270 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:38.236288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:38.237582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:38.253954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.254634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:38.255790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.256705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:38.452440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:38.466634 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56584e53-5d04-436d-a1b8-99de283b9b88 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 0.912107 Jul 14 14:59:38.471760 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1894/3922] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:37 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:38.891334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d4f9cd6e-7441-4888-84c3-98e23540c9ad req-6feff821-a662-40f2-a846-84b2f1527890 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d91e9b2-7708-4bda-8487-40bfa4579781", "tag": "1c4c4759-0bf7-4f43-bec4-1028577221fc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:38.980504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d4f9cd6e-7441-4888-84c3-98e23540c9ad req-6feff821-a662-40f2-a846-84b2f1527890 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:38.982299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d4f9cd6e-7441-4888-84c3-98e23540c9ad req-6feff821-a662-40f2-a846-84b2f1527890 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:39.003076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d4f9cd6e-7441-4888-84c3-98e23540c9ad req-6feff821-a662-40f2-a846-84b2f1527890 service nova] Creating event network-changed:1c4c4759-0bf7-4f43-bec4-1028577221fc for instance 7d91e9b2-7708-4bda-8487-40bfa4579781 on n-h1-768852-23 Jul 14 14:59:39.012002 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d4f9cd6e-7441-4888-84c3-98e23540c9ad req-6feff821-a662-40f2-a846-84b2f1527890 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128481 Jul 14 14:59:39.017853 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1895/3923] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:59:39.024012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:39.024738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:39.032832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:39.033653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:39.034825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:39.035510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:39.144026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:39.171226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60409483-062b-40cf-aa01-75b6afe50dd4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1317 microversion: 2.1 time: 0.935687 Jul 14 14:59:39.171966 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2029/3924] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:38 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1317 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:39.489621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:39.490537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:39.500800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:39.502156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:39.506242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:39.508646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.232092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:40.242340 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56b6d77d-4188-4ca9-bc20-446b99d71dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 1.222580 Jul 14 14:59:40.253681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1896/3925] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:39 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:40.259011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:40.259691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:40.266775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:40.267630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.269145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:40.269776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:40.311112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:40.323678 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df2fef4a-0859-439a-88a0-a1fe94238992 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 0.841558 Jul 14 14:59:40.334627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2030/3926] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:39 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:41.173224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:41.230115 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1864cc6c-d14d-49ff-ac8c-dd4f922ac885 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.974491 Jul 14 14:59:41.260519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:41.275309 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1897/3927] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:40 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:41.282412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:41.298244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:41.303566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.305304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:41.306011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.346993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:41.349277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:41.373410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:41.374189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.375638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:41.376432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:41.483821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:41.775479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:41.790151 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-977ba35e-cd8a-4658-9354-4ffae6ebd4fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 0.534105 Jul 14 14:59:41.804417 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2031/3928] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:41 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:41.810690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1154243765", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:41.909923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] validate_networks() for [('c59b259a-1165-406c-b959-1fabb0fd999d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 14:59:42.063106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=18 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:42.520214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:42.554202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1e3a786-e241-4b89-a9b5-2d820c7f2a6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 1.212944 Jul 14 14:59:42.564118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1898/3929] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:41 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 1218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:42.814827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:42.816335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:42.836933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:42.837533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:42.838534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:42.839228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.396249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=16 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:43.513457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 14:59:43.514358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 14:59:43.514646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 14:59:43.515200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 14:59:43.515774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 14:59:43.527591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.528432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.529866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.530617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.593089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Getting quotas for project c9a2c2bf376243c0ba8c572cc1bca54b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 14:59:43.600566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:43.620214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Getting quotas for user c1a4b4998ca6479f85adc2b9c65e1e06 and project c9a2c2bf376243c0ba8c572cc1bca54b. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 14:59:43.704617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 14:59:43.709633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 14:59:43.846333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80ac39c0-2a23-4d9f-8aba-80e5e85bf01d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.036988 Jul 14 14:59:43.855975 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2032/3930] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 14:59:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 14:59:43.883034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:43.906074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:43.907693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Searching by: {'deleted': False, 'project_id': 'da0dc51858c64e3589abc68587ab1b40'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:59:43.907845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:43.920504 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c0dffc9-5869-41ba-9d4c-052b8c64f719 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 1.113665 Jul 14 14:59:43.923012 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1899/3931] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:42 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:43.933527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.934116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.935003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.935679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.937158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:43.942513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:43.959179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.959889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:43.960922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:43.962574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.015192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:59:44.080104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fddefbc-b2a3-4e01-91d9-ba040453f37c tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.219534 Jul 14 14:59:44.087374 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2033/3932] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 14:59:43 2022] GET /compute/v2.1/servers => generated 343 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:44.098939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a60b9da2-64c7-469e-b4d3-e4e5d0cff84c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:44.101634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a60b9da2-64c7-469e-b4d3-e4e5d0cff84c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:44.309415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a60b9da2-64c7-469e-b4d3-e4e5d0cff84c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:44.333217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a60b9da2-64c7-469e-b4d3-e4e5d0cff84c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1217 microversion: 2.1 time: 0.250204 Jul 14 14:59:44.334122 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2034/3933] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:44 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1217 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:44.359719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:44.377637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:44.380087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Searching by: {'deleted': False, 'project_id': 'da0dc51858c64e3589abc68587ab1b40'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 14:59:44.396808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.397939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.400256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.402671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:44.501485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 14:59:44.624661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:44.648346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:44.649226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.088766 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23ea4040-3e62-4ab8-b01b-295607aad02a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.748297 Jul 14 14:59:45.090315 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2035/3934] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 14:59:44 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:45.110253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:45.112820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:45.121023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.121817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.123073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.123808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.179090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:45.194205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fab77658-b2e4-4e76-a6f4-9a4e57ceab57 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 1.268766 Jul 14 14:59:45.195238 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1900/3935] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:43 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:45.204715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-326c3b68-d957-41de-aa36-5a5ef2ddc2d4 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:45.215154 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-326c3b68-d957-41de-aa36-5a5ef2ddc2d4 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018654 Jul 14 14:59:45.225702 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1901/3936] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 14:59:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:45.335641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9c4b4124-a4f3-4d38-b640-6bae232ef933 req-096e8850-56f1-477a-9859-b2c7094ce660 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c372e22e-af4d-4781-9aae-f08c221d7430", "tag": "c56f7b70-a8ce-48f3-9b8a-e9fef1ef3536"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:45.344999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9c4b4124-a4f3-4d38-b640-6bae232ef933 req-096e8850-56f1-477a-9859-b2c7094ce660 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.345839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9c4b4124-a4f3-4d38-b640-6bae232ef933 req-096e8850-56f1-477a-9859-b2c7094ce660 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.380109 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9c4b4124-a4f3-4d38-b640-6bae232ef933 req-096e8850-56f1-477a-9859-b2c7094ce660 service nova] Creating event network-changed:c56f7b70-a8ce-48f3-9b8a-e9fef1ef3536 for instance c372e22e-af4d-4781-9aae-f08c221d7430 on n-h2-768852-23 Jul 14 14:59:45.390244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9c4b4124-a4f3-4d38-b640-6bae232ef933 req-096e8850-56f1-477a-9859-b2c7094ce660 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059697 Jul 14 14:59:45.393853 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1902/3937] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:45.405661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:45.407682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:45.422896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.423957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.425825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.426650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.653893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:45.679767 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b4484cf-8118-4ce9-b9b6-e41fe1c641e8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 0.574453 Jul 14 14:59:45.689448 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2036/3938] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:45 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:45.706434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:45.707366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:45.742191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.743012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.747000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:45.747913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:45.808502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 14:59:45.848948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:45.866503 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b538a5e8-7b82-42ba-9266-02806c73c176 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1213 microversion: 2.1 time: 0.469627 Jul 14 14:59:45.867646 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1903/3939] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:45 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1213 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:45.969205 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-89500a11-e1c0-4f9a-b97b-91b6bd84ca3a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 204 len: 0 microversion: 2.1 time: 0.274093 Jul 14 14:59:45.972722 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2037/3940] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 14:59:45 2022] DELETE /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 14:59:45.988610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:45.989967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:46.005417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.006808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.008878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.010171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.257491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:46.259727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:46.297203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.298202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.300371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:46.301823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:46.980679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:47.037444 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ea95d72-c935-44ae-b193-130517b57470 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1607 microversion: 2.1 time: 1.056930 Jul 14 14:59:47.039112 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1904/3941] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:45 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1607 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:47.053266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:47.063204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:47.084943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.086140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.088267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.089686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.107835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:47.363326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:47.383536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c330c23-7f87-4c8c-9a95-6803053a9a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 1.160134 Jul 14 14:59:47.385393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2038/3942] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:46 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:47.394917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:47.403635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:47.430178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.430653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.432043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.432427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.599770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:47.614599 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b3b03d82-236b-497d-a490-468f61046187 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 0.570524 Jul 14 14:59:47.615598 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1905/3943] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:47 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:47.628768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8f1b5212-7da6-48a2-b69e-4a0a573777cd req-b157d3c4-335c-4978-90bf-bf96350af45b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d91e9b2-7708-4bda-8487-40bfa4579781", "name": "network-vif-plugged", "status": "completed", "tag": "1c4c4759-0bf7-4f43-bec4-1028577221fc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:47.654051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8f1b5212-7da6-48a2-b69e-4a0a573777cd req-b157d3c4-335c-4978-90bf-bf96350af45b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:47.661348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8f1b5212-7da6-48a2-b69e-4a0a573777cd req-b157d3c4-335c-4978-90bf-bf96350af45b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:47.694940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8f1b5212-7da6-48a2-b69e-4a0a573777cd req-b157d3c4-335c-4978-90bf-bf96350af45b service nova] Creating event network-vif-plugged:1c4c4759-0bf7-4f43-bec4-1028577221fc for instance 7d91e9b2-7708-4bda-8487-40bfa4579781 on n-h1-768852-23 Jul 14 14:59:47.702562 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8f1b5212-7da6-48a2-b69e-4a0a573777cd req-b157d3c4-335c-4978-90bf-bf96350af45b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085527 Jul 14 14:59:47.703532 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1906/3944] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:48.020424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:48.035820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-851b71c7-b102-4dd4-bfa1-7f97c5311767 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1275 microversion: 2.1 time: 0.648526 Jul 14 14:59:48.036457 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2039/3945] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:47 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1275 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:48.064436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:48.066403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:48.083322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:48.083783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:48.084595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:48.085039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:48.410503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:48.411391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:48.426182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:48.426895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:48.427903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:48.428498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.005287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.018327 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f15a7bb-9ada-41d1-aefc-69724d522c6f tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1607 microversion: 2.1 time: 0.958508 Jul 14 14:59:49.033892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1907/3946] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:48 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1607 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:49.050663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:49.051686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:49.075535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:49.081901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.083169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:49.083683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.229336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.267311 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a22225b-7228-4488-931f-f42de86da4c3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1315 microversion: 2.1 time: 0.835572 Jul 14 14:59:49.282465 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2040/3947] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:48 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1315 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:49.308464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:49.310309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:49.336115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:49.337287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.341677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:49.347783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:49.681555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.708429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:49.726937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1cfcae86-3515-4bec-91b6-6f5422e230b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 0.690112 Jul 14 14:59:49.744743 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1908/3948] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:49 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:49.747747 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0054ad9a-94b7-4982-a18d-097dcd322111 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1275 microversion: 2.1 time: 0.456550 Jul 14 14:59:49.750746 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2041/3949] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:49 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1275 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:50.055147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:50.056658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:50.075951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.093220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:50.097828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.106220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:50.308408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:50.309350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:50.334197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.335730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:50.340900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.345431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:50.764447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:50.795124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d3def09-1417-47d0-840d-4c24fc6a04c8 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1540 microversion: 2.1 time: 0.740238 Jul 14 14:59:50.797125 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1909/3950] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:50 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1540 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:50.810892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:50.821510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:50.848314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.866248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:50.868117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:50.869110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:52.291974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:52.308533 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b167d6ff-aa64-4692-b47e-0ecb5891d067 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 1.509539 Jul 14 14:59:52.309843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1910/3951] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:50 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:52.315699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:52.316640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:52.325234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:52.325994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:52.327229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:52.328658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:52.887775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:52.897320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ba065b20-3790-4ded-b8d7-cf11fe4a6589 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 0.585932 Jul 14 14:59:52.910925 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1911/3952] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:52 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:52.910925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:52.910925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:52.930860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:52.931253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:52.939029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:52.940608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.062184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:53.078699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:53.092425 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d636bee-790a-4d70-89de-e0f2d13842f2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1502 microversion: 2.1 time: 2.788680 Jul 14 14:59:53.093745 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2042/3953] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:50 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1502 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:53.098541 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d58054b2-00b9-49f8-a1dc-63a0d1070298 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.194896 Jul 14 14:59:53.100609 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1912/3954] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:52 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:53.110577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ceba5652-58fb-401b-91c6-a9cd5dcf1be9 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1f47f70>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:53.121963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8de5bb21-491c-4778-b0c8-8e4876e7c3a4 req-d2e4254a-d817-4032-ae0c-dbeed3d9c828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac407b64-a541-47c6-a16c-f52ca7a53ec3", "name": "network-vif-deleted", "tag": "b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:53.150032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8de5bb21-491c-4778-b0c8-8e4876e7c3a4 req-d2e4254a-d817-4032-ae0c-dbeed3d9c828 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.151448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8de5bb21-491c-4778-b0c8-8e4876e7c3a4 req-d2e4254a-d817-4032-ae0c-dbeed3d9c828 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.194499 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8de5bb21-491c-4778-b0c8-8e4876e7c3a4 req-d2e4254a-d817-4032-ae0c-dbeed3d9c828 service nova] Creating event network-vif-deleted:b45f87d0-a1c2-45d3-bc1c-04ab3f4007c1 for instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 on n-h2-768852-23 Jul 14 14:59:53.209074 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8de5bb21-491c-4778-b0c8-8e4876e7c3a4 req-d2e4254a-d817-4032-ae0c-dbeed3d9c828 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112880 Jul 14 14:59:53.217647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2043/3955] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:53.225220 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ceba5652-58fb-401b-91c6-a9cd5dcf1be9 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/92fc8593-c47c-4515-9dc8-f90a6b5fa795" status: 200 len: 350 microversion: 2.1 time: 0.122086 Jul 14 14:59:53.226780 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1913/3956] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:59:53 2022] GET /compute/v2.1/os-volumes/92fc8593-c47c-4515-9dc8-f90a6b5fa795 => generated 350 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:53.242105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:53.244265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:53.261667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.262587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.264331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.267094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.379492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:53.387584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:53.391168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:53.429619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.434764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.437988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.441816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.451021 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d81d750-d917-47d8-9ed0-77db9706ed4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 14 microversion: 2.1 time: 0.222562 Jul 14 14:59:53.452149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2044/3957] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:53 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 14 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:59:53.945425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:53.949257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:53.982287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.983201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:53.987923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:53.991629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.113040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:54.143703 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2e8c0c3e-9e5a-4baf-8fa6-656d5e82f8c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 0.808444 Jul 14 14:59:54.155566 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1914/3958] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:53 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:54.174332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-128d4624-e3e5-4518-98cc-2fc84ff29a33 req-3b7fadad-84d5-47d2-977e-de70b0bd2181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372e22e-af4d-4781-9aae-f08c221d7430", "name": "network-vif-plugged", "status": "completed", "tag": "c56f7b70-a8ce-48f3-9b8a-e9fef1ef3536"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:54.227166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-128d4624-e3e5-4518-98cc-2fc84ff29a33 req-3b7fadad-84d5-47d2-977e-de70b0bd2181 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.234798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-128d4624-e3e5-4518-98cc-2fc84ff29a33 req-3b7fadad-84d5-47d2-977e-de70b0bd2181 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.317006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-128d4624-e3e5-4518-98cc-2fc84ff29a33 req-3b7fadad-84d5-47d2-977e-de70b0bd2181 service nova] Creating event network-vif-plugged:c56f7b70-a8ce-48f3-9b8a-e9fef1ef3536 for instance c372e22e-af4d-4781-9aae-f08c221d7430 on n-h2-768852-23 Jul 14 14:59:54.342581 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-128d4624-e3e5-4518-98cc-2fc84ff29a33 req-3b7fadad-84d5-47d2-977e-de70b0bd2181 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.184860 Jul 14 14:59:54.350027 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1915/3959] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:54.364627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:54.368504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:54.386159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.387378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.388444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.389125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.422773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:54.615990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:54.674147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:54.704178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c43b031c-acf6-4ef3-bafa-cc1154ab012e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.349489 Jul 14 14:59:54.709151 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1916/3960] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:54 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:54.732267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:54.733793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:54.742443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=82 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 14:59:54.759635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.760806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.762614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:54.769892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:54.958815 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a4f9573-59a2-4e2a-a501-ba65b6c58b7b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 14 microversion: 2.1 time: 0.245444 Jul 14 14:59:54.960662 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1917/3961] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:54 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 14 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:59:55.179399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:55.180740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:55.211027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:55.218638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:55.220096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:55.222125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:55.593236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:55.628280 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2d61c75-8a16-42e8-aa0d-908d68bea7fe tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 1.692342 Jul 14 14:59:55.629470 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2045/3962] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:53 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:55.738654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:55.750563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:55.773905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:55.774558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:55.775974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:55.776696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:56.505035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:56.520441 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-61c27b1d-fb1b-4e04-99a1-eca511e63e11 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1312 microversion: 2.1 time: 1.346686 Jul 14 14:59:56.529300 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1918/3963] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:55 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1312 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:56.540162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:56.561106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:56.566121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:56.591119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:56.595175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:56.598765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:56.601173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:56.601655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-595fa6e4-d655-471d-9fd9-7791072b3334 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.870515 Jul 14 14:59:56.605489 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2046/3964] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:55 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:56.662300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:56.663259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:56.684404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:56.685602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:56.687434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:56.689071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:56.726192 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54609272-6db8-4ea3-9736-f70d06f1928f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 14 microversion: 2.1 time: 0.195186 Jul 14 14:59:56.730312 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1919/3965] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:56 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 14 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:59:57.232171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:57.277262 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8fa9f171-985d-4525-9f28-ec18aad3cb46 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 0.621087 Jul 14 14:59:57.291798 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2047/3966] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:56 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 14:59:57.451760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-16c2c626-4cc2-4961-8c23-7613dc1d9f82 req-9b9adc0c-d327-4821-9284-897cbd21fd79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68afe110-fdf0-41d5-9cd1-e78627d0c73f", "tag": "fa35e6f2-f470-4b44-87e7-613df02aa186"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:57.470203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-16c2c626-4cc2-4961-8c23-7613dc1d9f82 req-9b9adc0c-d327-4821-9284-897cbd21fd79 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.472669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-16c2c626-4cc2-4961-8c23-7613dc1d9f82 req-9b9adc0c-d327-4821-9284-897cbd21fd79 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:57.492734 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-16c2c626-4cc2-4961-8c23-7613dc1d9f82 req-9b9adc0c-d327-4821-9284-897cbd21fd79 service nova] Creating event network-changed:fa35e6f2-f470-4b44-87e7-613df02aa186 for instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f on n-h1-768852-23 Jul 14 14:59:57.499952 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-16c2c626-4cc2-4961-8c23-7613dc1d9f82 req-9b9adc0c-d327-4821-9284-897cbd21fd79 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056302 Jul 14 14:59:57.502161 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1920/3967] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 14:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 14:59:57.566142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:57.566785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:57.621143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.625144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:57.628135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.636215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:57.637750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:57.647023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:57.666684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.667165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:57.675418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:57.681462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.122844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:58.137409 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec45587c-5d80-4b6d-a499-74043610d5c3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1498 microversion: 2.1 time: 0.584323 Jul 14 14:59:58.141238 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2048/3968] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:57 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1498 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:58.150596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:58.160472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:58.180023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.180829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.181920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.187431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.329598 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5944b2a9-5154-43e0-a9e4-b99ec1b94a25 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 14 microversion: 2.1 time: 0.183053 Jul 14 14:59:58.330743 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2049/3969] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:58 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 14:59:58.352108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e92e422-062d-4cd2-82b6-2b6c35e7895e tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1d738b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:58.494396 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e92e422-062d-4cd2-82b6-2b6c35e7895e tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/00d1f08a-1875-4084-8682-d19bcb4b47c3" status: 200 len: 351 microversion: 2.1 time: 0.158117 Jul 14 14:59:58.495660 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2050/3970] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 14:59:58 2022] GET /compute/v2.1/os-volumes/00d1f08a-1875-4084-8682-d19bcb4b47c3 => generated 351 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 14:59:58.501411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:58.505300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:58.527905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.529422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.530851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.532162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:58.534320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.548817 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9a0c552a-a45f-4e0d-bcac-f48fa0843876 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.916681 Jul 14 14:59:58.549460 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1921/3971] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:57 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:58.597921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:58.599778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:58.640898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.641659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.643104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.643890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.730637 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b01620bc-6bda-43cd-855a-95a8f1a652fb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430/action" status: 202 len: 0 microversion: 2.1 time: 0.219328 Jul 14 14:59:58.737142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2051/3972] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:58 2022] POST /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 14:59:58.758631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:58.759619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:58.769931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.770616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:58.771629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:58.772070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:59.075497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:59.103002 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-290bfc3d-175e-444a-aad1-d60108562c8a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1503 microversion: 2.1 time: 0.355461 Jul 14 14:59:59.108434 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2052/3973] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:58 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1503 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:59.292974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 14:59:59.316004 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fbef40fe-e0a3-4acf-927d-0828e5fb8218 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 0.754160 Jul 14 14:59:59.318274 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1922/3974] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:58 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 14:59:59.350935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 14:59:59.355741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:59.390127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:59.391747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:59.395454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:59.396895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:59.584283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 14:59:59.590609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 14:59:59.641129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:59.642873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 14:59:59.647793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 14:59:59.650410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.100610 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cafb61d4-a226-45cb-82dd-315953fc0684 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 14 microversion: 2.1 time: 0.759798 Jul 14 15:00:00.102427 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2053/3975] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 14:59:59 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 14 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:00:00.144153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:00.154157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:00.167500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:00.185267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.189025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.198023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.198023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.247143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-30abc77a-9e83-4da1-8035-6f39845b6f8b tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.684072 Jul 14 15:00:00.279345 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1923/3976] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 14:59:59 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:00.353846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:00.354771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:00.397509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.398106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:00.401502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:00.402842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.042330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:01.053710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a65ec785-a0e3-45ed-a499-683ec5e8a349 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 0.709880 Jul 14 15:00:01.056953 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1924/3977] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:00 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:01.059974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:01.086459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e1e1b6c-9eb2-4f5c-bfe7-7a713e0974b6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1483 microversion: 2.1 time: 0.949965 Jul 14 15:00:01.088954 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2054/3978] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:00 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1483 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:01.119564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:01.120703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:01.131566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:01.134464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:01.136941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.137565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.138522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.139028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.149374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.150512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.152495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.153613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.175208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:01.229059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:00:01.235313 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3639c18f-9d40-4432-85bf-1cd01a430fe6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 14 microversion: 2.1 time: 0.119839 Jul 14 15:00:01.236833 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1925/3979] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:01 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:00:01.288847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:01.289582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:01.324931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.326004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.327708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.328542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.488534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2381e8a8-6d32-4354-b351-de6e3e26a0e1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 204 len: 0 microversion: 2.1 time: 0.370363 Jul 14 15:00:01.489676 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2055/3980] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:00:01 2022] DELETE /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:00:01.500823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:01.502714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:01.518950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.519442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.520364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:01.520681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:01.633723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:01.654600 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c46f96e0-3d8f-452c-8e3d-189c17395208 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.369993 Jul 14 15:00:01.665588 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1926/3981] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:01 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:01.671615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9eb038b2-9b83-4b5e-b459-c391feec726f tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1f73700>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:01.838105 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9eb038b2-9b83-4b5e-b459-c391feec726f tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/ee3bfe22-cd78-4c77-a352-bf8869072fc1" status: 200 len: 351 microversion: 2.1 time: 0.170234 Jul 14 15:00:01.842982 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1927/3982] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:01 2022] GET /compute/v2.1/os-volumes/ee3bfe22-cd78-4c77-a352-bf8869072fc1 => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:01.880084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2521e4d7-28e1-4709-8b08-1829474c86b9 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1f473a0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:02.156048 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2521e4d7-28e1-4709-8b08-1829474c86b9 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.302904 Jul 14 15:00:02.158401 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1928/3983] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 15:00:01 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:02.171767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:02.172753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:02.192564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:02.193359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:02.194400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:02.195067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:02.704080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:02.737221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:02.748194 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-742cd0f0-6c7f-4569-96cc-7b973e692c35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 0.569681 Jul 14 15:00:02.755478 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1929/3984] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:02 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:02.775002 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39a39ec3-34fb-493f-906c-52ffea40cd4a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1489 microversion: 2.1 time: 1.276798 Jul 14 15:00:02.776181 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2056/3985] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:01 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1489 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:02.781325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f1e7cc6-9a65-4f14-9bc6-2199ddd5a4fa tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1eb4d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:02.804316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:02.806910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:02.833138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:02.834194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:02.836457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:02.837220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:02.940483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a747adf-d613-4df9-afcf-c7655714db55 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action" status: 200 len: 8208 microversion: 2.1 time: 0.160149 Jul 14 15:00:02.944097 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2057/3986] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:02 2022] POST /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781/action => generated 8208 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:02.953335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:02.957989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:02.985503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:02.990302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:02.994892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:02.996596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.087159 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f1e7cc6-9a65-4f14-9bc6-2199ddd5a4fa tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.327494 Jul 14 15:00:03.089473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1930/3987] 10.222.0.98 () {58 vars in 1148 bytes} [Thu Jul 14 15:00:02 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:03.106597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:03.107872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:03.157644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.159051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.166059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2cb918769c44026b2b4358f3fcd7cff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da0dc51858c64e3589abc68587ab1b40', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:03.170773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.177404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.185082 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af83e4fe-0b11-4d3a-bc8f-feba301a324a tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 200 len: 1252 microversion: 2.1 time: 0.238574 Jul 14 15:00:03.186899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2058/3988] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:02 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 1252 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:03.203089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1fb7e300-5a0a-4ca6-a2dd-e90cf65eb4ab tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf36200d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:03.473202 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1fb7e300-5a0a-4ca6-a2dd-e90cf65eb4ab tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.284304 Jul 14 15:00:03.475089 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2059/3989] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 15:00:03 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:03.492986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15211b6c-f127-497e-93e0-c3397a002633 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1d19b80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:03.715136 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15211b6c-f127-497e-93e0-c3397a002633 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.230726 Jul 14 15:00:03.725961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2060/3990] 10.222.0.98 () {58 vars in 1166 bytes} [Thu Jul 14 15:00:03 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:00:03.730870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d97f2390-36af-494e-871d-ad66c23c4300 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1cf0e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:03.794042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:03.841515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c821321d-81e1-4f7b-bc78-6adfffa60108 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.747435 Jul 14 15:00:03.855363 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1931/3991] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:03 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:03.874532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:03.880234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:03.962644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.967677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:03.975370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:03.979834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:04.149578 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d97f2390-36af-494e-871d-ad66c23c4300 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.422365 Jul 14 15:00:04.160856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2061/3992] 10.222.0.98 () {58 vars in 1169 bytes} [Thu Jul 14 15:00:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:04.166031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:04.166929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:04.176742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:04.178399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:04.179627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:04.180945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:04.893220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:04.915382 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc4071ff-676f-4586-8d18-8c1e4f191bbb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 200 len: 1489 microversion: 2.1 time: 0.745825 Jul 14 15:00:04.915382 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2062/3993] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:04 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 1489 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:04.918972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:04.919899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:04.929172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:04.929895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:04.931340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:04.932015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:05.012080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:05.108685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:05.148989 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8e328c0-1584-4dd2-837e-13f20214909d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 1.297839 Jul 14 15:00:05.164307 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1932/3994] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:03 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:05.184820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9966fbb6-10bc-45c9-9472-500b423be958 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdc041949d0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:05.456900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:05.476820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-49211d5e-be52-41d9-853e-f176e828f37a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.563291 Jul 14 15:00:05.477450 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2063/3995] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:04 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:05.495047 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9966fbb6-10bc-45c9-9472-500b423be958 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.332962 Jul 14 15:00:05.496812 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1933/3996] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 15:00:05 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:05.503963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:05.504592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] [instance: ac407b64-a541-47c6-a16c-f52ca7a53ec3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:05.508227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-827a5355-b976-49b9-b181-0886037b3ea9 req-1be01eb4-8153-4ddd-a0aa-3cca77243cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68afe110-fdf0-41d5-9cd1-e78627d0c73f", "name": "network-vif-plugged", "status": "completed", "tag": "fa35e6f2-f470-4b44-87e7-613df02aa186"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:05.528835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-827a5355-b976-49b9-b181-0886037b3ea9 req-1be01eb4-8153-4ddd-a0aa-3cca77243cb3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:05.530139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-827a5355-b976-49b9-b181-0886037b3ea9 req-1be01eb4-8153-4ddd-a0aa-3cca77243cb3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:05.532066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:05.534552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:05.541400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:05.541860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:05.589247 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] HTTP exception thrown: Instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 could not be found. Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Request method failure captured: Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 HTTP/1.1 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C65eU7WfSdPvOys9LpNTzEiFSLOfb-A2hpca0cd8BOZJyLTCP8scvdwUdsN1_XmOMi0eMJug9qPi-Ojw2nbLAB2BqfpIUkEqtzG7mnmJl6AIsC55Sl9WxtSpPr0bUMGw2pfXscu58JMftpK3GpII4d886xbBsFAu9eBQqDnpbEcrRI Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: da0dc51858c64e3589abc68587ab1b40 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestBootFromVolume-1404480616 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/da0dc51858c64e3589abc68587ab1b40"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_da0dc51858c64e3589abc68587ab1b40"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/da0dc51858c64e3589abc68587ab1b40"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/da0dc51858c64e3589abc68587ab1b40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestBootFromVolume-1404480616 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: da0dc51858c64e3589abc68587ab1b40 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1404480616 Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestBootFromVolume-1404480616-project Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: d2cb918769c44026b2b4358f3fcd7cff Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestBootFromVolume-1404480616-project Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 could not be found. Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'ac407b64-a541-47c6-a16c-f52ca7a53ec3'} Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 could not be found. Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 could not be found. Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:05.591059 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 could not be found. Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Returning 404 to user: Instance ac407b64-a541-47c6-a16c-f52ca7a53ec3 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:05.599945 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e8297da-0b1d-4628-bc24-dd1e02e6142e tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3" status: 404 len: 111 microversion: 2.1 time: 0.097526 Jul 14 15:00:05.601138 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-827a5355-b976-49b9-b181-0886037b3ea9 req-1be01eb4-8153-4ddd-a0aa-3cca77243cb3 service nova] Creating event network-vif-plugged:fa35e6f2-f470-4b44-87e7-613df02aa186 for instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f on n-h1-768852-23 Jul 14 15:00:05.613136 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2064/3997] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:05 2022] GET /compute/v2.1/servers/ac407b64-a541-47c6-a16c-f52ca7a53ec3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:05.620191 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-827a5355-b976-49b9-b181-0886037b3ea9 req-1be01eb4-8153-4ddd-a0aa-3cca77243cb3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121309 Jul 14 15:00:05.620817 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1934/3998] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:05.629200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:05.629856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:05.651945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:05.655013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:05.655943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:05.660961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:06.497182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:06.536312 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93bdf6c8-fd5f-4b95-beaf-85375063379a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.911196 Jul 14 15:00:06.545360 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1935/3999] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:05 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:06.583362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32304ed0-47af-45e5-99a9-4b40be401070 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1ff5af0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:06.765238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fc3296d-17f1-4f43-a1e5-c772cac13fc6 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Action: 'create', calling method: .version_select at 0x7fdbf1cda1f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-317430366", "metadata": {"Type": "work"}}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:07.062973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32304ed0-47af-45e5-99a9-4b40be401070 tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.515339 Jul 14 15:00:07.063613 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1936/4000] 10.222.0.98 () {58 vars in 1187 bytes} [Thu Jul 14 15:00:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:07.069660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5efdbf14-d2eb-4aff-8fd3-7c4a10792131 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] Calling method '.version_select at 0x7fdbf2a26ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:07.138278 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5efdbf14-d2eb-4aff-8fd3-7c4a10792131 tempest-ServersTestBootFromVolume-1404480616 tempest-ServersTestBootFromVolume-1404480616-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722411914" status: 202 len: 0 microversion: 2.1 time: 0.071347 Jul 14 15:00:07.148047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1937/4001] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722411914 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:07.166038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:07.168899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:07.191699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:07.192920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:07.201158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:07.201663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:07.239517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 HTTP/1.1 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c372e22e-af4d-4781-9aae-f08c221d7430'} Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:07.241280 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:07.248031 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c47e0ed6-9d5a-43f9-ab00-15c75e08b0e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 404 len: 111 microversion: 2.1 time: 0.091097 Jul 14 15:00:07.267757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1938/4002] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:07 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:07.283205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:07.285959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:07.311171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:07.311792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:07.312659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:07.320907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:07.984732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:08.001079 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c68cac4b-8a70-46e4-9098-e8eca368159a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1317 microversion: 2.1 time: 0.730357 Jul 14 15:00:08.004258 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1939/4003] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:07 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1317 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:08.026761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8d94dd36-683f-4a9c-a04b-0e00dfdde97b req-413b209b-9a96-4ca7-b1ab-6d74e438175c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c372e22e-af4d-4781-9aae-f08c221d7430", "name": "network-vif-deleted", "tag": "c56f7b70-a8ce-48f3-9b8a-e9fef1ef3536"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:08.031121 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fc3296d-17f1-4f43-a1e5-c772cac13fc6 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.416758 Jul 14 15:00:08.033636 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2065/4004] 10.222.0.98 () {60 vars in 1155 bytes} [Thu Jul 14 15:00:05 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2419 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 15:00:08.048064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:08.049414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:08.069379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.073187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:08.077483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8d94dd36-683f-4a9c-a04b-0e00dfdde97b req-413b209b-9a96-4ca7-b1ab-6d74e438175c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.078764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.081961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:08.083112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8d94dd36-683f-4a9c-a04b-0e00dfdde97b req-413b209b-9a96-4ca7-b1ab-6d74e438175c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:08.139733 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8d94dd36-683f-4a9c-a04b-0e00dfdde97b req-413b209b-9a96-4ca7-b1ab-6d74e438175c service nova] Creating event network-vif-deleted:c56f7b70-a8ce-48f3-9b8a-e9fef1ef3536 for instance c372e22e-af4d-4781-9aae-f08c221d7430 on n-h2-768852-23 Jul 14 15:00:08.164181 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8d94dd36-683f-4a9c-a04b-0e00dfdde97b req-413b209b-9a96-4ca7-b1ab-6d74e438175c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158098 Jul 14 15:00:08.170810 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1940/4005] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:08.186485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b53fa22-2805-49a5-bfe0-f7092536b54f tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] Calling method '.version_select at 0x7fdbf1ff5f70>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:08.444424 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b53fa22-2805-49a5-bfe0-f7092536b54f tempest-VolumesTestJSON-1191095453 tempest-VolumesTestJSON-1191095453-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.268683 Jul 14 15:00:08.445379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1941/4006] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 15:00:08 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:08.450956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1561486593", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:08.527321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:08.548465 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dd964672-b16e-4ee6-8e2a-6605b2a552ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.513316 Jul 14 15:00:08.560835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2066/4007] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:08 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:08.593671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca298916-fe86-4224-b92f-f2316f0e3a61 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1d73550>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:08.656020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:00:08.749825 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca298916-fe86-4224-b92f-f2316f0e3a61 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 352 microversion: 2.1 time: 0.184634 Jul 14 15:00:08.750989 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2067/4008] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:08 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 352 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:08.763854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:08.769678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:08.835948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.839107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:08.851753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:08.853493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:09.026201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Locking {{(pid=125965) lock /opt/stack/nova/nova/compute/api.py:4700}} Jul 14 15:00:09.285151 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-220235ad-f6d8-4cc5-a343-cd351259c754 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.532802 Jul 14 15:00:09.290867 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2068/4009] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:08 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:09.295089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:09.296011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:09.322976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:09.326107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:09.327310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:09.328999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:10.071017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:10.082441 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ae4858a-f8f5-4d3a-af99-684a324e9805 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1507 microversion: 2.1 time: 0.794867 Jul 14 15:00:10.087246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2069/4010] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:09 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1507 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:10.110600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:10.111794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:10.144791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:10.145488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:10.150167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:10.150948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:10.721871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:10.738545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70097450-f86e-41e6-aa50-e68d2fa1a933 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.639315 Jul 14 15:00:10.753213 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2070/4011] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:10 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:10.764414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0814312d-bfab-4071-b4be-3a56a54af022 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdc0423cb80>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:10.833842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0814312d-bfab-4071-b4be-3a56a54af022 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 353 microversion: 2.1 time: 0.079012 Jul 14 15:00:10.834810 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2071/4012] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:10 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:10.840091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:10.840599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:10.855452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:10.855908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:10.856711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:10.857156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:10.928226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:00:11.195707 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-896e41b9-6772-470e-ab14-66df590f44a1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "DELETE /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 204 len: 0 microversion: 2.1 time: 0.359493 Jul 14 15:00:11.198872 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2072/4013] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:00:10 2022] DELETE /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:00:11.225448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:11.244855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.245340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.333825 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] HTTP exception thrown: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 is locked Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Request method failure captured: Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action HTTP/1.1 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 15 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4ScudS3MixRmsrhjwF4cId0CghiVhli-wiEsml_Rpl-HBWvHt3Ni1QNIWwgCef49tNIWZCwwWsjSSRuw74Udi-GhpdeC_Blh_RvBRlJAXExZBwvrwvIFlIpi9lVZ_gCZC453Axfmt1BcQnZ1z0641qYJy0WHZfkJPu0Kk-ivoHM9w Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4813aa5acf744a8dac42de00d7e5a519 Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: {"os-stop": {}} Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 is locked Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '17571f24-33af-4696-bb50-4e9f14a6cc96', 'body': {'os-stop': {}}} Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 is locked Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1450, in _stop_server Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 is locked Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 is locked Jul 14 15:00:11.347332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:11.360158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Returning 409 to user: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 is locked {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:11.373089 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-042cf3f2-47b2-46e2-9149-750e91486230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 409 len: 107 microversion: 2.1 time: 0.172829 Jul 14 15:00:11.381636 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2073/4014] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:11 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 107 bytes in 182 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:00:11.400415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b8728be-83a4-481b-a3ee-065674298ea7 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1d2e040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:11.584484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b8728be-83a4-481b-a3ee-065674298ea7 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 353 microversion: 2.1 time: 0.195070 Jul 14 15:00:11.586768 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2074/4015] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:11 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 353 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:11.602427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:11.610656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:11.623353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:11.639616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.641263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.643916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.646258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.677516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:00:11.678040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:00:11.678411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:00:11.678825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:00:11.679242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:00:11.712723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.719723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.725770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:11.727757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:11.811091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:00:11.837789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:00:11.900304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:00:11.911299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:00:12.016143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7ab12f9c-4563-4a45-868f-f53c06443f88 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.569373 Jul 14 15:00:12.026851 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1942/4016] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 3579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:00:12.039606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:12.041048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:12.060481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:12.063322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:12.067147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:12.067722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:12.163209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Unlocking {{(pid=125966) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 14 15:00:12.308858 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0cd17cf9-895d-4a4d-8e72-3ee9b7af1172 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.280410 Jul 14 15:00:12.316256 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1943/4017] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:12 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:12.327245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b840ed1-4cec-436c-b19c-3fbea1d93319 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1fbaa60>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:12.417114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:12.508041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02ba17c9-8777-41fb-b301-633b61d25fcb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1513 microversion: 2.1 time: 0.895805 Jul 14 15:00:12.510583 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2075/4018] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:11 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1513 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:12.538462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d81133f0-84ed-4543-bd12-507f90a9092a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:12.539662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d81133f0-84ed-4543-bd12-507f90a9092a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:12.717223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b840ed1-4cec-436c-b19c-3fbea1d93319 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "DELETE /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 202 len: 0 microversion: 2.1 time: 0.403624 Jul 14 15:00:12.718650 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1944/4019] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:00:12 2022] DELETE /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:12.724432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f530c5c3-53a9-4849-886d-1641c0dea873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:12.771136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f530c5c3-53a9-4849-886d-1641c0dea873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:12.772415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f530c5c3-53a9-4849-886d-1641c0dea873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:12.880564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f530c5c3-53a9-4849-886d-1641c0dea873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:00:13.060719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f530c5c3-53a9-4849-886d-1641c0dea873 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.339565 Jul 14 15:00:13.065305 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1945/4020] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:12 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:13.087765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-797efe4a-ed0d-4f32-8c23-66e347fb47e9 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1ed5ca0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:13.336233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-797efe4a-ed0d-4f32-8c23-66e347fb47e9 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 352 microversion: 2.1 time: 0.268243 Jul 14 15:00:13.338470 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1946/4021] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:13 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 352 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:13.358862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:13.369428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:13.441722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:13.442537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:13.444067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:13.444870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:13.507523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d81133f0-84ed-4543-bd12-507f90a9092a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:13.527945 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d81133f0-84ed-4543-bd12-507f90a9092a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1215 microversion: 2.1 time: 1.007396 Jul 14 15:00:13.530785 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2076/4022] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:12 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1215 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:13.550679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:13.552011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:13.598175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:13.599234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:13.605518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:13.609493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:14.157343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:14.174872 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15874940-8d25-492e-a89a-3a9b553c1aa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 0.834599 Jul 14 15:00:14.177468 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1947/4023] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:13 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:14.359578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b83835e-1821-4aa6-bb1c-081cd4fe4988 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1ed5430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:14.496635 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b83835e-1821-4aa6-bb1c-081cd4fe4988 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 352 microversion: 2.1 time: 0.145684 Jul 14 15:00:14.497694 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1948/4024] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:14 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 352 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:00:14.553400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:14.554049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:14.562099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:14.562467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:14.563543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:14.563746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:14.893715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:14.901425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:14.910645 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d3ebedc-4222-4dad-8616-98d6dfd85da2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1211 microversion: 2.1 time: 0.366082 Jul 14 15:00:14.916497 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1949/4025] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:14 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1211 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:14.947127 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e93fefc1-04a4-448d-8ebd-14940dcee25a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1513 microversion: 2.1 time: 1.414491 Jul 14 15:00:14.948625 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2077/4026] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:13 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1513 bytes in 1417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:15.207447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:15.208973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:15.254707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:15.272170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:15.273853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:15.274634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:15.514737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b58de500-5656-4282-9431-f4248d3540b7 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1d2e700>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:15.668809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b58de500-5656-4282-9431-f4248d3540b7 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 352 microversion: 2.1 time: 0.158522 Jul 14 15:00:15.670263 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2078/4027] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:15 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 352 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:00:15.937000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:15.938146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:15.959682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:15.960747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:15.962179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:15.964970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:16.122025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:16.154909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67905204-ea7f-434d-a67f-74071a11a82c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1273 microversion: 2.1 time: 0.216590 Jul 14 15:00:16.157243 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2079/4028] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:15 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1273 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:16.182120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:16.188559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:16.229124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:16.229798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:16.230774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:16.233442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:16.590803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:16.612785 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39987954-d25f-49ef-a6ee-29593560e2f9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1513 microversion: 2.1 time: 0.450446 Jul 14 15:00:16.613419 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2080/4029] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:16 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1513 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:16.683361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-79c3d6d4-854d-46cf-823c-633bf6b1dcf3 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1cdaf70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:16.817613 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-79c3d6d4-854d-46cf-823c-633bf6b1dcf3 tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 352 microversion: 2.1 time: 0.138621 Jul 14 15:00:16.819402 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2081/4030] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:16 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:00:17.084582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:17.093269 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-112311b4-aee0-4a59-911f-3dd04414807c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 1.901597 Jul 14 15:00:17.115765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1950/4031] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:15 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:17.175897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:17.176523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:17.196178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:17.197807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:17.199055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:17.201226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:17.455789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:17.474401 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b220d931-4ce4-4497-8645-4852a301fc99 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1273 microversion: 2.1 time: 0.302544 Jul 14 15:00:17.492723 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2082/4032] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:17 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1273 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:17.631671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:17.632718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:17.652406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:17.653153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:17.654696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:17.659447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:17.740781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:17.835388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ebd4dec-ce12-40b0-a2b7-77c6085458fa tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1cda8b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:17.964587 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ebd4dec-ce12-40b0-a2b7-77c6085458fa tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 200 len: 352 microversion: 2.1 time: 0.133279 Jul 14 15:00:17.966602 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2083/4033] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:17 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:00:17.972926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-67e6548d-c735-4699-918e-7498c89be93f req-018df291-efcf-4bcc-bd1c-d535bf2b2473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68afe110-fdf0-41d5-9cd1-e78627d0c73f", "name": "network-vif-deleted", "tag": "fa35e6f2-f470-4b44-87e7-613df02aa186"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:18.050028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-67e6548d-c735-4699-918e-7498c89be93f req-018df291-efcf-4bcc-bd1c-d535bf2b2473 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.051616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-67e6548d-c735-4699-918e-7498c89be93f req-018df291-efcf-4bcc-bd1c-d535bf2b2473 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:18.082235 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-67e6548d-c735-4699-918e-7498c89be93f req-018df291-efcf-4bcc-bd1c-d535bf2b2473 service nova] Creating event network-vif-deleted:fa35e6f2-f470-4b44-87e7-613df02aa186 for instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f on n-h1-768852-23 Jul 14 15:00:18.093025 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-67e6548d-c735-4699-918e-7498c89be93f req-018df291-efcf-4bcc-bd1c-d535bf2b2473 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119739 Jul 14 15:00:18.098528 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2084/4034] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:18.118794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:18.123084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:18.143530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.145725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:18.148637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.152409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:18.506120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:18.523388 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21b2224d-4635-44c8-a0ce-8d8664bce973 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 200 len: 1471 microversion: 2.1 time: 0.887820 Jul 14 15:00:18.524825 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1951/4035] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:17 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 1471 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:18.530041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:18.530964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:18.551546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.552310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:18.553333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:18.554655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:18.776824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:18.779521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:18.787296 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-641dedf9-aaa1-46d5-87be-e68d5d389d85 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 0.678674 Jul 14 15:00:18.802697 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2085/4036] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:18 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:18.817647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:18.838777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf86a385-2f4f-4468-bc0d-04f4e17850c0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1273 microversion: 2.1 time: 0.312493 Jul 14 15:00:18.848111 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1952/4037] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:18 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1273 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:18.982658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-568068f8-6244-4c41-92aa-1baff57d588e tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Calling method '.version_select at 0x7fdbf1c88820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:19.043829 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-568068f8-6244-4c41-92aa-1baff57d588e tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] HTTP exception thrown: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-568068f8-6244-4c41-92aa-1baff57d588e tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Request method failure captured: Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 HTTP/1.1 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C90gDHQChXuXLVLD3hVD4fZkOfHIWUhtCvXrELaAB1JzGjulF-7edGD42J_PX-cA72hFhbEmB5vwYYSTRmNHwYYRc94yYrAb7oObaJUyqCS9Uzh0ZqL5JyDlprWYssnwJlCJNVnXB0fTX-n7M1CE6sZjH_C-aC_EYcShtKri9RfghA Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f363dcbe8c20457e9cba3d8cdcfa6eb0 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesGetTestJSON-624568535 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f363dcbe8c20457e9cba3d8cdcfa6eb0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f363dcbe8c20457e9cba3d8cdcfa6eb0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f363dcbe8c20457e9cba3d8cdcfa6eb0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f363dcbe8c20457e9cba3d8cdcfa6eb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesGetTestJSON-624568535 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f363dcbe8c20457e9cba3d8cdcfa6eb0 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesGetTestJSON-624568535 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesGetTestJSON-624568535-project Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 139fdab5e3524b4799be9fbc2b1e8c42 Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesGetTestJSON-624568535-project Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: exception: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '541a9da3-1621-4764-b9ad-11b45b720316'} Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. (HTTP 404) (Request-ID: req-38e71fcc-3dab-4371-bc69-828c82a6510d) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:00:19.045982 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-568068f8-6244-4c41-92aa-1baff57d588e tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] Returning 404 to user: Volume 541a9da3-1621-4764-b9ad-11b45b720316 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-568068f8-6244-4c41-92aa-1baff57d588e tempest-VolumesGetTestJSON-624568535 tempest-VolumesGetTestJSON-624568535-project] 10.222.0.98 "GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316" status: 404 len: 109 microversion: 2.1 time: 0.069701 Jul 14 15:00:19.058690 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2086/4038] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:00:18 2022] GET /compute/v2.1/os-volumes/541a9da3-1621-4764-b9ad-11b45b720316 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:19.546107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:19.547658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:19.566768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:19.567603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:19.569763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:19.570954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:19.616935 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f HTTP/1.1 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '68afe110-fdf0-41d5-9cd1-e78627d0c73f'} Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:19.619262 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:00:19.622813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:19.627108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:19.628428 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d069218-2e6c-42b1-9196-a781bbd59a98 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 404 len: 111 microversion: 2.1 time: 0.086431 Jul 14 15:00:19.629586 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1953/4039] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:19 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:19.642872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:19.644209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:19.653108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:19.654014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:19.655550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:19.656364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:19.811782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:19.813449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:19.832456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:19.833275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:19.835692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:19.837638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:20.168196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:20.187210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c15965e-d87c-4252-bfc6-17088a183a67 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.549356 Jul 14 15:00:20.203309 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2087/4040] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:19 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:20.214848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:20.217820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:20.257765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:20.258328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:20.266346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:20.267688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:21.138287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:21.185934 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad9e2d3d-37cb-4dac-94bc-87b90cbddc48 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 0.992769 Jul 14 15:00:21.189854 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2088/4041] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:20 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:21.226840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-825334fb-d30d-4b89-a15e-650c7acd1b38 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-825334fb-d30d-4b89-a15e-650c7acd1b38 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 163 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": 12345, "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 12345 Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:00:21.229712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Jul 14 15:00:21.233451 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:21.244247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-825334fb-d30d-4b89-a15e-650c7acd1b38 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:21.245748 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-825334fb-d30d-4b89-a15e-650c7acd1b38 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.049020 Jul 14 15:00:21.249949 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2089/4042] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:21 2022] POST /compute/v2.1/servers => generated 127 bytes in 55 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:00:21.258770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:21.259992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:21.278392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:21.279113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:21.284045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:21.284774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:21.756326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:21.774081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:21.796899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-23c0134e-1440-40d4-9700-f239a3a859de tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 1.989683 Jul 14 15:00:21.803616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1954/4043] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:19 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:21.835303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:21.847704 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-583eeeba-a027-4f8c-9fbc-30cc3a86c01e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.596298 Jul 14 15:00:21.851616 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2090/4044] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:21 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:21.884819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:21.885923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:21.907040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:21.922275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:21.922945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:21.935948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:21.936804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:22.210237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:22.211045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:22.228814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:22.229284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:22.230122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:22.230561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:23.156569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:23.173556 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce4ad921-4edc-48fc-8928-5fba59ebd73d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 0.968104 Jul 14 15:00:23.175733 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2091/4045] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:22 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:23.193083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:23.194408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:23.229013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:23.231313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:23.233275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:23.236558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:23.237422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:23.257140 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32e3ddd6-d59c-426c-af8d-09a4966aaafd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.378664 Jul 14 15:00:23.276024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1955/4046] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:21 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:23.476750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:23.488415 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06050c58-f762-4dd9-9f57-89f06c6bbd14 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 0.309326 Jul 14 15:00:23.489031 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2092/4047] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:23 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:24.214830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:24.216086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:24.229844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:24.230591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:24.232491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:24.233520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:24.523239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:24.524417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:24.538561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:24.574045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:24.575483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:24.580791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:24.581953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:25.498922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:25.546053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4fad8b80-a9d7-483c-8b30-d33e964019b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 1.339963 Jul 14 15:00:25.559245 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1956/4048] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:24 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:25.964899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:26.001846 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aca8d898-d0cc-4954-9f2e-4db8db110631 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1656 microversion: 2.1 time: 1.485375 Jul 14 15:00:26.031836 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2093/4049] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:24 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1656 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:26.060244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51c73e09-0750-4864-a4cc-676b69031771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:26.083464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:26.096461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c73e09-0750-4864-a4cc-676b69031771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.097241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c73e09-0750-4864-a4cc-676b69031771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:26.168979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51c73e09-0750-4864-a4cc-676b69031771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Going to try to start instance {{(pid=125966) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:00:26.274442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51c73e09-0750-4864-a4cc-676b69031771 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.227040 Jul 14 15:00:26.279514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1957/4050] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:26 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:26.297374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:26.304856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:26.333415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.334631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:26.336432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.337556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:26.589732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:26.593819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:26.623934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:26.629606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.630656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:26.636316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:26.637443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:26.641063 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3b4b4f2-7a1d-4c02-9582-ba77be3af087 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1665 microversion: 2.1 time: 0.357425 Jul 14 15:00:26.645077 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2094/4051] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:26 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1665 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:27.167432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88680073-c65c-442c-84cf-3659bb649117 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-661292968", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8746250a-2da5-4f92-b7a3-0525f2669ad5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:27.407913 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-88680073-c65c-442c-84cf-3659bb649117 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Block Device 8746250a-2da5-4f92-b7a3-0525f2669ad5 is not bootable. Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88680073-c65c-442c-84cf-3659bb649117 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 357 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-661292968", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8746250a-2da5-4f92-b7a3-0525f2669ad5", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: exception: Block Device 8746250a-2da5-4f92-b7a3-0525f2669ad5 is not bootable. Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-661292968', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '8746250a-2da5-4f92-b7a3-0525f2669ad5'}], 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1622, in _create_instance Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 8746250a-2da5-4f92-b7a3-0525f2669ad5 is not bootable. Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:27.420265 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 8746250a-2da5-4f92-b7a3-0525f2669ad5 is not bootable. Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 8746250a-2da5-4f92-b7a3-0525f2669ad5 is not bootable. Jul 14 15:00:27.430926 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:27.436467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88680073-c65c-442c-84cf-3659bb649117 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Block Device 8746250a-2da5-4f92-b7a3-0525f2669ad5 is not bootable. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:27.440637 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88680073-c65c-442c-84cf-3659bb649117 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.276829 Jul 14 15:00:27.441995 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2095/4052] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:27 2022] POST /compute/v2.1/servers => generated 110 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:00:27.482155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:27.484227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:27.511222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:27.513547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:27.514989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:27.519907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:27.940945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:27.967018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2e483ab-770a-414e-83b4-ca8c323f9ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 1.392346 Jul 14 15:00:27.975766 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1958/4053] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:26 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:27.995577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4e03b671-6b90-43f6-98a2-fa2892767283 req-354f239a-c7db-4468-bf8d-0adf4df4ed9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2b31260-a777-4511-a2cc-29a79bc4b3dd", "tag": "12fcf23b-e275-4e56-8629-133e6d808dee"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:28.053665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4e03b671-6b90-43f6-98a2-fa2892767283 req-354f239a-c7db-4468-bf8d-0adf4df4ed9a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:28.057731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4e03b671-6b90-43f6-98a2-fa2892767283 req-354f239a-c7db-4468-bf8d-0adf4df4ed9a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:28.143210 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4e03b671-6b90-43f6-98a2-fa2892767283 req-354f239a-c7db-4468-bf8d-0adf4df4ed9a service nova] Creating event network-changed:12fcf23b-e275-4e56-8629-133e6d808dee for instance f2b31260-a777-4511-a2cc-29a79bc4b3dd on n-h2-768852-23 Jul 14 15:00:28.161449 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4e03b671-6b90-43f6-98a2-fa2892767283 req-354f239a-c7db-4468-bf8d-0adf4df4ed9a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182978 Jul 14 15:00:28.168533 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1959/4054] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:28.206261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:28.215637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:28.245959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:28.251040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:28.265930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:28.268007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:28.303892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:28.317483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c8b55190-b83c-453b-8b8b-2782d383e6de tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.859255 Jul 14 15:00:28.318303 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2096/4055] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:27 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:28.365394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:28.372033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:28.384779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:28.386196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:28.390331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:28.391350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:29.053957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:29.084503 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a040b4d-7b87-497b-8f77-95e4e51d500f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.736903 Jul 14 15:00:29.088239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2097/4056] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:28 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:29.112041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:29.114710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:29.151911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:29.154520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:29.156180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:29.157404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:29.212497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:29.281941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97bc8b40-2d1e-4ed4-9e50-ec7d763c58c4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1665 microversion: 2.1 time: 1.099574 Jul 14 15:00:29.287321 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1960/4057] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:28 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1665 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:30.053299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:30.091040 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-263994ab-c243-4efd-9964-b8e44353c64e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 1.000251 Jul 14 15:00:30.092490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2098/4058] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:29 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:30.326938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:30.331804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:30.357416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:30.358201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:30.359692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:30.361247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:30.809107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:30.832691 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1358d977-05d6-400f-ab35-cb177cbd11d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.523184 Jul 14 15:00:30.833822 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1961/4059] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:30 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:30.865648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:30.866812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:30.902630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:30.903661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:30.908500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:30.909917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:31.124330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:31.125444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:31.164115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:31.164894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:31.172620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:31.173735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:31.513525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:31.537124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db2d3c2e-faf0-4814-9704-e5b0243c1087 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 0.420927 Jul 14 15:00:31.537755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1962/4060] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:31 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:32.311356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:32.355645 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d9e9d06-1b04-4f09-9c6d-04152ad0c6e8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.496847 Jul 14 15:00:32.356738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2099/4061] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:30 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:32.389919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:32.391235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:32.405733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.422537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:32.424357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.425264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:32.534913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Unlocking {{(pid=125966) unlock /opt/stack/nova/nova/compute/api.py:4729}} Jul 14 15:00:32.575540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:32.584101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:32.623061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.628717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:32.634363 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e07e3a98-6ec5-4f08-8631-88517630a571 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.253268 Jul 14 15:00:32.644268 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1963/4062] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:32 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:32.647044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.649123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:32.649753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:32.660628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:32.667182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.672063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:32.673111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:32.673620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.106241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:33.127123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99f8879c-52d5-451b-a154-834af365810f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.481893 Jul 14 15:00:33.128116 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1964/4063] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:32 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:33.161318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:33.161955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:33.169729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:33.170194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.171004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:33.174471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.333575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:33.342425 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aa81106a-3ece-4a5b-9d2c-74990ba10ade tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 0.779850 Jul 14 15:00:33.353161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2100/4064] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:32 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:33.469491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:33.500431 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64948c75-5eb4-4532-bc61-a07b12d82dc5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.343207 Jul 14 15:00:33.517960 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1965/4065] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:33 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:33.551061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:33.566024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:33.568224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:33.569405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.572025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:33.573168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.675541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7b501ee-3be7-4b0d-9a10-70abe4347f1e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-70948814", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "destination_type": "local"}, {"source_type": "volume", "uuid": "d6829420-88ce-47c9-81db-d00bc2b2f05e", "destination_type": "invalid"}], "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7b501ee-3be7-4b0d-9a10-70abe4347f1e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 493 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-70948814", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "destination_type": "local"}, {"source_type": "volume", "uuid": "d6829420-88ce-47c9-81db-d00bc2b2f05e", "destination_type": "invalid"}], "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-70948814', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd6829420-88ce-47c9-81db-d00bc2b2f05e', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'invalid' Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:33.690798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Jul 14 15:00:33.698318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:33.702503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7b501ee-3be7-4b0d-9a10-70abe4347f1e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:33.705825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c7b501ee-3be7-4b0d-9a10-70abe4347f1e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.039755 Jul 14 15:00:33.708011 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1966/4066] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:33 2022] POST /compute/v2.1/servers => generated 155 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:00:33.721049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:33.724046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:33.740203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:33.742144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.745802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:33.746640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:33.755392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:33.988126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:34.000457 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80cfc1b7-c1d8-435d-a9f3-c7835ba4686c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.286471 Jul 14 15:00:34.012792 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1967/4067] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:33 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:34.033817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8db8066a-405a-4e5c-b334-747fd62af29c req-3d777d8d-94b8-4c1c-a963-de2ddcb9fbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b31260-a777-4511-a2cc-29a79bc4b3dd", "name": "network-vif-plugged", "status": "completed", "tag": "12fcf23b-e275-4e56-8629-133e6d808dee"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:34.054698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8db8066a-405a-4e5c-b334-747fd62af29c req-3d777d8d-94b8-4c1c-a963-de2ddcb9fbbb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.055986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8db8066a-405a-4e5c-b334-747fd62af29c req-3d777d8d-94b8-4c1c-a963-de2ddcb9fbbb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.085487 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8db8066a-405a-4e5c-b334-747fd62af29c req-3d777d8d-94b8-4c1c-a963-de2ddcb9fbbb service nova] Creating event network-vif-plugged:12fcf23b-e275-4e56-8629-133e6d808dee for instance f2b31260-a777-4511-a2cc-29a79bc4b3dd on n-h2-768852-23 Jul 14 15:00:34.095689 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8db8066a-405a-4e5c-b334-747fd62af29c req-3d777d8d-94b8-4c1c-a963-de2ddcb9fbbb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084373 Jul 14 15:00:34.097804 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1968/4068] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:34.109370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:34.112520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:34.128428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.129556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.148407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.148407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.257440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:34.270137 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cb13a28e-02ce-4d27-a603-6266f74fe92c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.730114 Jul 14 15:00:34.271081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2101/4069] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:33 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:34.288759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:34.289364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:34.305397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.305867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.306689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.307141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.480804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b0577059-d9f5-414e-a775-9f36de54bcee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.195159 Jul 14 15:00:34.500565 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2102/4070] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:34 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:00:34.514649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:34.515876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:34.526399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.527103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.528110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.528921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.736929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:34.754269 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e67b411-a703-4e3b-8f1e-8fc51fc683ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.653858 Jul 14 15:00:34.755482 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1969/4071] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:34 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:34.763702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:34.769216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:34.770282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:34.779682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.781327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.783744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:34.784838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:34.803518 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dfc02cc2-3819-47d2-b909-fc7c10df0097 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 0.294850 Jul 14 15:00:34.817670 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2103/4072] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:34 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:35.176010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d03a15c8-f216-4ab5-883c-5dc67895b2d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-686522546", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d03a15c8-f216-4ab5-883c-5dc67895b2d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 491 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-686522546", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-686522546', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Jul 14 15:00:35.186617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:35.190524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d03a15c8-f216-4ab5-883c-5dc67895b2d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:35.192408 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d03a15c8-f216-4ab5-883c-5dc67895b2d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.023736 Jul 14 15:00:35.192998 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2104/4073] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:35 2022] POST /compute/v2.1/servers => generated 624 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:00:35.216685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:35.217571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:35.258433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:35.259262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:35.277337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:35.278789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:35.310990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:35.325270 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e7adfa9-fb75-401e-b38e-c0ca4b03f267 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1674 microversion: 2.1 time: 0.568207 Jul 14 15:00:35.328671 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1970/4074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:34 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1674 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:35.331770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:35.721430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:35.738426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-04f475f3-eb0f-474b-8293-24458656abec tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.538086 Jul 14 15:00:35.740537 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2105/4075] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:35 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:35.758643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:35.760199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:35.770477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:35.772022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:35.773552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:35.775243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:35.857178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:35.858355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:35.869116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:35.869857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:35.870827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:35.871452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.211489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:36.231554 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31b1c16f-b05d-4ed5-b78c-c5216f3d3223 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1315 microversion: 2.1 time: 0.398353 Jul 14 15:00:36.233615 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2106/4076] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:35 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:36.353407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:36.358508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:36.380019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.380827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.392540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.393435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.479361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:36.502015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d7975d0c-104d-471e-a0ff-c2a055385231 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.747699 Jul 14 15:00:36.520457 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1971/4077] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:35 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:36.792757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-512662dc-d8b1-4e52-8139-177c8cef4699 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-512662dc-d8b1-4e52-8139-177c8cef4699 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 416 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:36.805833 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:36.811448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-512662dc-d8b1-4e52-8139-177c8cef4699 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:36.815866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-512662dc-d8b1-4e52-8139-177c8cef4699 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.037189 Jul 14 15:00:36.818973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1972/4078] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:36 2022] POST /compute/v2.1/servers => generated 619 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:00:36.843217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:36.850922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:36.885003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.891467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:36.893091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:36.893565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.090220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:37.112644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06d6e305-939e-4717-8fc4-3e8ce2162f90 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1654 microversion: 2.1 time: 0.766655 Jul 14 15:00:37.118543 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2107/4079] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:36 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1654 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:37.136360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:37.137474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:37.148407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.149264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.151082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.152333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.293415 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05934042-da95-4251-a659-208ba7134c77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.162445 Jul 14 15:00:37.294124 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2108/4080] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:37 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:37.323209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:37.325820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:37.356104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.356858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.358413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.359213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.533961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:37.545287 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45af4c8b-66ae-484a-bec5-948076ea01cd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.719246 Jul 14 15:00:37.549298 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1973/4081] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:36 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:37.568059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:37.568844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:37.580902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.581816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.582795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.583494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.822922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:37.846711 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b05723c-548d-4360-9a7a-3fc88605ae83 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1502 microversion: 2.1 time: 0.541308 Jul 14 15:00:37.848482 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2109/4082] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:37 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1502 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:37.853930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:37.855438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:37.869520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.870518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:37.872046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:37.873726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.284197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:38.317652 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04f447f9-3bb1-45ee-a45b-92f37560ff94 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1661 microversion: 2.1 time: 0.759403 Jul 14 15:00:38.319140 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1974/4083] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:37 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1661 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:38.332528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:38.347433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:38.373941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:38.381488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.383197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:38.384025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:38.499473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'flavor' on Instance uuid f2b31260-a777-4511-a2cc-29a79bc4b3dd {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:00:38.701959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:38.733882 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed0815c6-1227-4e98-a6c1-b1aafcc8716b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.883266 Jul 14 15:00:38.739078 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2110/4084] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:37 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:39.102323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b83bd328-9adc-42f3-a0b9-cc4ae8d12afa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-947117203", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": -1, "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:39.164015 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b83bd328-9adc-42f3-a0b9-cc4ae8d12afa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Flavor -1 could not be found. Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b83bd328-9adc-42f3-a0b9-cc4ae8d12afa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 205 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-947117203", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": -1, "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: exception: Flavor -1 could not be found. Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-947117203', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': -1, 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 780, in create Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:39.177812 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Jul 14 15:00:39.187691 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:39.194157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b83bd328-9adc-42f3-a0b9-cc4ae8d12afa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:39.200622 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b83bd328-9adc-42f3-a0b9-cc4ae8d12afa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.119085 Jul 14 15:00:39.206682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2111/4085] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:39 2022] POST /compute/v2.1/servers => generated 73 bytes in 129 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:39.226867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:39.238317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:39.268592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.277041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.279118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.280406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.464893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c09df9e3-ac07-42ee-8e5e-7ff817c6482c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd/action" status: 202 len: 0 microversion: 2.1 time: 1.119947 Jul 14 15:00:39.467068 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1975/4086] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:38 2022] POST /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd/action => generated 0 bytes in 1141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:00:39.485310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:39.486306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:39.494438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.495184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.496668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.497305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.792088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:39.820652 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-094afc57-6a19-468f-bc91-777e8b20c0f4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.606035 Jul 14 15:00:39.824981 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2112/4087] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:39 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:39.858226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:39.859958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:39.897962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.898207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:39.899571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:39.900219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.214782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:40.258422 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e6043927-4299-4872-b391-8137a0e330d5 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.785409 Jul 14 15:00:40.261417 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1976/4088] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:39 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:40.288777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:40.290610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:40.318487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:40.320033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.328661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:40.332784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.508316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:40.526521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b46b361-11a6-4e6b-a0e6-7b1e44cbb2ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.699173 Jul 14 15:00:40.543486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2113/4089] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:39 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:40.568946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:40.572446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:40.594912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:40.595761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:40.597238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:40.598042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:41.304758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:41.317529 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32809a89-9103-4dff-8d55-5ec50732d6a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.772155 Jul 14 15:00:41.318903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2114/4090] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:40 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:41.340300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:41.341207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:41.354274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:41.357477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:41.358364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:41.359029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.018927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.034011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d76e25fd-95f2-4381-b6fc-3b74ea03641b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.767495 Jul 14 15:00:42.037003 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1977/4091] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:40 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:42.051603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:42.055935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:42.067852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.069223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.070309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.070989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.324267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:42.335782 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-639ee826-be5a-4627-bcde-e4c3423cb848 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.000715 Jul 14 15:00:42.340219 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2115/4092] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:41 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:42.360270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:42.360976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:42.382369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=72 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:42.388684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.390603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:42.396271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:42.397109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.476263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:43.492943 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-58b1ae7b-ff8d-4d6c-b63b-98dff0146c90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 1.453348 Jul 14 15:00:43.493603 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1978/4093] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:42 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:43.509727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db683a6f-2ab3-4e81-8a66-7d7ab1be682e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-590484298", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db683a6f-2ab3-4e81-8a66-7d7ab1be682e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 172 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-590484298", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-590484298', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi -1 Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:00:43.519425 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Jul 14 15:00:43.524399 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:43.527627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db683a6f-2ab3-4e81-8a66-7d7ab1be682e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:43.533662 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db683a6f-2ab3-4e81-8a66-7d7ab1be682e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.038104 Jul 14 15:00:43.535233 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1979/4094] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:43 2022] POST /compute/v2.1/servers => generated 145 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:00:43.558069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:43.561890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:43.578715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.579957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.580828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.592325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.691083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:43.701167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87c00b23-03e2-41a7-9c6f-4cdcde0f8062 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.345057 Jul 14 15:00:43.712211 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2116/4095] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:42 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:43.731251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:43.732079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:43.742205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.750449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:43.752272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:43.752841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:44.142492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:44.155827 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74cb4519-23c1-4ad8-8c6b-ebc9f350a4a7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.615793 Jul 14 15:00:44.172624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1980/4096] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:43 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:44.196063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:44.201368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:44.230210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:44.236696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:44.240118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:44.241009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:44.709049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:44.744055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05426da0-dd94-4df9-bfbd-ae840b21d069 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.565241 Jul 14 15:00:44.745641 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1981/4097] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:44 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:44.753192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:44.754188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:44.764440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:44.768219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:44.772466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:44.774649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.059582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:45.070770 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9bc0fbb-9178-43c6-a50b-af9e04bbd97b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.323441 Jul 14 15:00:45.071660 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1982/4098] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:44 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:45.117900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ac3b498-2874-4957-b305-d2fafa739fe5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-588592260", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:45.123886 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8ac3b498-2874-4957-b305-d2fafa739fe5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ac3b498-2874-4957-b305-d2fafa739fe5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 215 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-588592260", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-588592260', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 775, in create Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 549, in _process_networks_for_create Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 449, in _get_requested_networks Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._validate_network_id( Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 398, in _validate_network_id Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:45.134620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ac3b498-2874-4957-b305-d2fafa739fe5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:45.144699 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ac3b498-2874-4957-b305-d2fafa739fe5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.023501 Jul 14 15:00:45.148026 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1983/4099] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:45 2022] POST /compute/v2.1/servers => generated 123 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:00:45.155554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:45.158213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:45.185831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.186483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.192314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.193960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.652699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:45.662630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d5f26ea7-0c6a-4d27-8b85-250658fc261e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.515930 Jul 14 15:00:45.663453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1984/4100] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:45 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:45.683736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:45.684645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:45.692690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.693313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.694294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.694908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.714173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:45.867701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:45.880962 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cbd2d662-c0ca-43f0-b7ed-55636026557d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.201371 Jul 14 15:00:45.881564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1985/4101] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:45 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:45.946259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:45.963132 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9785cfd7-7380-441f-915e-416012f30620 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 2.235539 Jul 14 15:00:45.976177 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2117/4102] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:43 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 2249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:45.983792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:45.984441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:45.992094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.992802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:45.993973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:45.995209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.089046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:46.089619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:46.106983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:46.107778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.108772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:46.109613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.373986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:46.389008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-693d9482-ee67-45ef-ac8c-aedcbc958f47 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.409198 Jul 14 15:00:46.392437 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1986/4103] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:45 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:46.413821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1ec6362-223d-4a8d-b9bc-16489600db58 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-558911837", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-key-686587052", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:46.530664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-e1ec6362-223d-4a8d-b9bc-16489600db58 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] validate_networks() for [('c59b259a-1165-406c-b959-1fabb0fd999d', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:00:46.596600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:46.608462 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a37e6067-48ee-4788-ad31-8a378ea09bf2 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.521224 Jul 14 15:00:46.623601 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2118/4104] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:46 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:46.895740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e1ec6362-223d-4a8d-b9bc-16489600db58 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Invalid key_name provided. Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1ec6362-223d-4a8d-b9bc-16489600db58 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 245 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-558911837", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-key-686587052", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid key_name provided. Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-558911837', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'key_name': 'tempest-key-686587052', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1075, in _validate_and_build_base_options Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-686587052 not found for user c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:46.899954 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 809, in create Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Jul 14 15:00:46.907879 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:46.917741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1ec6362-223d-4a8d-b9bc-16489600db58 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid key_name provided. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:46.917741 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1ec6362-223d-4a8d-b9bc-16489600db58 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.506089 Jul 14 15:00:46.917741 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1987/4105] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:46 2022] POST /compute/v2.1/servers => generated 70 bytes in 521 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:00:46.926908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:46.928111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:46.952020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:46.952986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:46.952986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:46.953499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.635986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:47.643039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:47.683832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.686076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.700621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.705142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.862971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:47.881731 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1ee43ea-0804-4d61-b295-c69447532612 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.956718 Jul 14 15:00:47.883380 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2119/4106] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:46 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:47.908325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:47.912812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:47.925551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.928251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:47.929304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:47.932996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:48.453267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:48.480527 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-59897d0d-0e71-434c-954f-ab576f987fb3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.578408 Jul 14 15:00:48.484368 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2120/4107] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:47 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:48.825344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:48.869619 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08045eed-0546-491a-a97a-5a39e7881663 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 1.242773 Jul 14 15:00:48.883388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1988/4108] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:47 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:49.006007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37b7a95d-3ba8-4b6e-9223-7e94aadcab8e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639430291", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:49.219529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.security_group_api [None req-37b7a95d-3ba8-4b6e-9223-7e94aadcab8e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Neutron security group does_not_exist not found {{(pid=125965) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Jul 14 15:00:49.220523 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-37b7a95d-3ba8-4b6e-9223-7e94aadcab8e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37b7a95d-3ba8-4b6e-9223-7e94aadcab8e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 258 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1639430291", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: exception: Unable to find security_group with name or id 'does_not_exist' Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1639430291', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Jul 14 15:00:49.234611 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 786, in create Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2149, in create Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._create_instance( Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1632, in _create_instance Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1060, in _validate_and_build_base_options Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 507, in _check_requested_secgroups Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:49.240145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37b7a95d-3ba8-4b6e-9223-7e94aadcab8e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:49.248253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37b7a95d-3ba8-4b6e-9223-7e94aadcab8e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.261584 Jul 14 15:00:49.256750 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2121/4109] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:00:48 2022] POST /compute/v2.1/servers => generated 106 bytes in 279 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:00:49.264944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:49.265803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:49.286907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:49.293329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:49.296627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:49.297080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:49.904704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:49.908418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:49.926735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:49.933890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:49.935244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:49.939354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.457650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:50.467075 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-078dc3f8-c6c3-44e1-b002-170b2c16fb24 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.569598 Jul 14 15:00:50.472323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2122/4110] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:49 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:50.586119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:50.613059 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-531136b1-33fc-48d3-8352-c27540cd78c6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.350460 Jul 14 15:00:50.645066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:50.646044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:50.647782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1989/4111] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:49 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:50.663689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:50.666102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.667755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:50.670481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:50.733770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:51.345830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:51.390493 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee32589c-be12-400a-8249-6be98c0a2079 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.749915 Jul 14 15:00:51.403995 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2123/4112] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:50 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:51.425733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7ee97b7-6aba-428d-957f-9315e4a42ecf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:51.430080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d7ee97b7-6aba-428d-957f-9315e4a42ecf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: d59577d9-1e78-46ba-bd30-50e926bce922] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:51.452515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d7ee97b7-6aba-428d-957f-9315e4a42ecf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance d59577d9-1e78-46ba-bd30-50e926bce922 could not be found. Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7ee97b7-6aba-428d-957f-9315e4a42ecf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/d59577d9-1e78-46ba-bd30-50e926bce922 HTTP/1.1 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d59577d9-1e78-46ba-bd30-50e926bce922 could not be found. Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd59577d9-1e78-46ba-bd30-50e926bce922'} Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d59577d9-1e78-46ba-bd30-50e926bce922 could not be found. Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d59577d9-1e78-46ba-bd30-50e926bce922 could not be found. Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:51.461569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d59577d9-1e78-46ba-bd30-50e926bce922 could not be found. Jul 14 15:00:51.471181 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:51.486309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7ee97b7-6aba-428d-957f-9315e4a42ecf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance d59577d9-1e78-46ba-bd30-50e926bce922 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:51.488448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d7ee97b7-6aba-428d-957f-9315e4a42ecf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d59577d9-1e78-46ba-bd30-50e926bce922" status: 404 len: 111 microversion: 2.1 time: 0.069937 Jul 14 15:00:51.510087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:51.510863 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1990/4113] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:00:51 2022] DELETE /compute/v2.1/servers/d59577d9-1e78-46ba-bd30-50e926bce922 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:51.514931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:51.547823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:51.556181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:51.563330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:51.564895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:51.566688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:51.570993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:51.611915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:51.621216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:51.623300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:51.630959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:52.363142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:52.382420 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1555b02-ac21-4d35-b4be-42cbf10034c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.883222 Jul 14 15:00:52.386665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2124/4114] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:51 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:52.910834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:52.919512 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-29c0f4d3-8057-4873-9728-354311db996f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.406719 Jul 14 15:00:52.920135 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1991/4115] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:51 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:52.946792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:52.948581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:52.968366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:52.970313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:52.973820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:52.975949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.413400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:53.414374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:53.429770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:53.430507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.432170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:53.432850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.483172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:53.499858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-162dab30-4f49-4ac8-8ee0-cc593c8acc57 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.557170 Jul 14 15:00:53.500545 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2125/4116] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:52 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:53.530247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1722bfda-f0b3-4fbe-bd3c-f6f2286b0896 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:53.531351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1722bfda-f0b3-4fbe-bd3c-f6f2286b0896 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Failed to fetch instance by id 9223372036854775808 {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 15:00:53.532268 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-1722bfda-f0b3-4fbe-bd3c-f6f2286b0896 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1722bfda-f0b3-4fbe-bd3c-f6f2286b0896 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 9223372036854775808 could not be found. Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9223372036854775808'} Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:53.535196 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:53.540338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:53.540338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:53.540338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Jul 14 15:00:53.540338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:53.545743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1722bfda-f0b3-4fbe-bd3c-f6f2286b0896 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:53.550726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1722bfda-f0b3-4fbe-bd3c-f6f2286b0896 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.023699 Jul 14 15:00:53.554685 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2126/4117] 10.222.0.98 () {58 vars in 1187 bytes} [Thu Jul 14 15:00:53 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:00:53.572395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:53.573469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:53.589146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:53.589608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.590456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:53.590908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:53.867670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:53.882055 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-019b2b06-0840-4a39-ba8e-a07b364c8359 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.472741 Jul 14 15:00:53.886274 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1992/4118] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:53 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:54.224107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:54.244273 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-08c5695f-761f-4d3b-83e8-727749f260ca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.683386 Jul 14 15:00:54.283974 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2127/4119] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:53 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:54.287773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:54.289474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:54.307551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:54.308047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:54.309624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:54.310270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:54.916083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:54.918911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:54.961347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:54.974827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:54.976212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:54.976857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:55.070952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:55.085717 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-248dcbcf-fd6b-4449-a4b7-eb145a667c65 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.804576 Jul 14 15:00:55.086343 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1993/4120] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:54 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:55.121642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24479c33-8abc-436f-a8c0-c43f8d219459 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:55.122225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-24479c33-8abc-436f-a8c0-c43f8d219459 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Failed to fetch instance by id -1 {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2926}} Jul 14 15:00:55.122972 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-24479c33-8abc-436f-a8c0-c43f8d219459 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance -1 could not be found. Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24479c33-8abc-436f-a8c0-c43f8d219459 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance -1 could not be found. Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '-1'} Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in get Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:55.125812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:55.131897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:55.131897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:55.131897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Jul 14 15:00:55.131897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:55.143043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24479c33-8abc-436f-a8c0-c43f8d219459 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance -1 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:55.144600 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24479c33-8abc-436f-a8c0-c43f8d219459 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.033075 Jul 14 15:00:55.146319 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1994/4121] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 15:00:55 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 15:00:55.169015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:55.170434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:55.191922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:55.193463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:55.202290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:55.206953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:55.412357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:55.426830 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a841421-c6b8-4b45-9293-f76dedc0132d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.518337 Jul 14 15:00:55.430673 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2128/4122] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:54 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:56.485393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-306612ee-79bf-4ca5-92ce-25a71f8e8932 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Action: 'create', calling method: .version_select at 0x7fdbf1ce5160>, body: {"keypair": {"name": "tempest-keypair-1617915274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdtZL3lw96ioZmlaSh3wfzd/uzvH8dO0gj5ECxtQb6jlDtZnTC+XLS+4abuG2t9a4HB070UKtBjQ+/FWlO+DtXN7DH4+K1ja4JrzIyeB4L/Rphr0jfo3BMSv0rnJMf1mw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:56.502526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:56.538353 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eb7bac7c-8d07-409d-b55c-c25a5e3e8fef tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.381048 Jul 14 15:00:56.540944 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1995/4123] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:55 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:56.547054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-306612ee-79bf-4ca5-92ce-25a71f8e8932 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Getting quotas for project b9ea059a2cd047c0b59f066f38b01d27. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:00:56.562155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-306612ee-79bf-4ca5-92ce-25a71f8e8932 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Getting quotas for user b128110e3c7f4e2bb93292b8a6f0ea8b and project b9ea059a2cd047c0b59f066f38b01d27. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:00:56.593266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:56.599909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:56.602088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=70 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:00:56.621040 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-306612ee-79bf-4ca5-92ce-25a71f8e8932 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.656840 Jul 14 15:00:56.626439 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2129/4124] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:00:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:00:56.644282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:56.644869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:56.648502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:56.657040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:56.659524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:56.667027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:56.683695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:56.684329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:56.693974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:56.694552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:57.655536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:57.704955 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf0f3bf9-b315-4635-8942-4ed5da9c5316 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 1.162156 Jul 14 15:00:57.729820 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1996/4125] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:56 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:58.055259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:58.071555 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b54ad32-8923-47c9-a360-3b589dcd69dc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.443558 Jul 14 15:00:58.075524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2130/4126] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:56 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:58.129150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be215888-7c32-4a54-9aba-0b77d1d04e59 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:58.134170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be215888-7c32-4a54-9aba-0b77d1d04e59 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:58.183552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-be215888-7c32-4a54-9aba-0b77d1d04e59 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6 could not be found. Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be215888-7c32-4a54-9aba-0b77d1d04e59 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6/action HTTP/1.1 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 19 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: {"forceDelete": {}} Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6 could not be found. Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6', 'body': {'forceDelete': {}}} Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6 could not be found. Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6 could not be found. Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:58.205248 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:58.210388 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:58.210388 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:58.210388 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6 could not be found. Jul 14 15:00:58.210388 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:00:58.211077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be215888-7c32-4a54-9aba-0b77d1d04e59 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:58.212527 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be215888-7c32-4a54-9aba-0b77d1d04e59 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6/action" status: 404 len: 111 microversion: 2.1 time: 0.122230 Jul 14 15:00:58.216579 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1997/4127] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:58 2022] POST /compute/v2.1/servers/c09f1a03-90bc-4b12-9a47-4a86f6bdb5e6/action => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:58.232494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:58.237261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:58.291401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.292302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.293812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.294597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.710928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:58.724644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68587b53-c029-42ee-827d-339c00f2410b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.505376 Jul 14 15:00:58.729773 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2131/4128] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:58 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:00:58.752315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:58.753316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:58.761600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:58.769141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:58.780368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.781297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.782898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.784998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.823457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.826935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:58.830420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:58.832771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:59.242009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:59.261531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f86285ef-91cc-4a99-a705-09bdbb756eeb tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.514408 Jul 14 15:00:59.263313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2132/4129] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:58 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:00:59.280149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-920d4e8f-1c72-43c3-b8ff-85e64e6c74ff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:00:59.281782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-920d4e8f-1c72-43c3-b8ff-85e64e6c74ff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 6ba9fa73-41ba-40fe-8c76-15d1b4e16452] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:59.291334 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-920d4e8f-1c72-43c3-b8ff-85e64e6c74ff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 6ba9fa73-41ba-40fe-8c76-15d1b4e16452 could not be found. Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-920d4e8f-1c72-43c3-b8ff-85e64e6c74ff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/6ba9fa73-41ba-40fe-8c76-15d1b4e16452/action HTTP/1.1 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 39 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: {"os-getConsoleOutput": {"length": 10}} Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6ba9fa73-41ba-40fe-8c76-15d1b4e16452 could not be found. Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6ba9fa73-41ba-40fe-8c76-15d1b4e16452', 'body': {'os-getConsoleOutput': {'length': 10}}} Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ba9fa73-41ba-40fe-8c76-15d1b4e16452 could not be found. Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ba9fa73-41ba-40fe-8c76-15d1b4e16452 could not be found. Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:59.307699 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:00:59.314067 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:00:59.314067 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:00:59.314067 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:00:59.314067 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:00:59.314067 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ba9fa73-41ba-40fe-8c76-15d1b4e16452 could not be found. Jul 14 15:00:59.314067 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:00:59.317059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-920d4e8f-1c72-43c3-b8ff-85e64e6c74ff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 6ba9fa73-41ba-40fe-8c76-15d1b4e16452 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:00:59.318660 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-920d4e8f-1c72-43c3-b8ff-85e64e6c74ff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/6ba9fa73-41ba-40fe-8c76-15d1b4e16452/action" status: 404 len: 111 microversion: 2.1 time: 0.042592 Jul 14 15:00:59.319961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2133/4130] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:00:59 2022] POST /compute/v2.1/servers/6ba9fa73-41ba-40fe-8c76-15d1b4e16452/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:00:59.336451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:00:59.337441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:00:59.348731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:59.350295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:59.351891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:00:59.352580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:00:59.384703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:00:59.423873 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0eba4b4e-afe1-4506-b9cc-16b93180c4b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.681765 Jul 14 15:00:59.442378 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1998/4131] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:58 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:00.173032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:00.198364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ae09353-f1ce-4b0f-9120-1ab31a7d89a9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.860954 Jul 14 15:01:00.199977 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2134/4132] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:00:59 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:00.234064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:00.238988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:00.254985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.255835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.257789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.260026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.453619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:00.454920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:00.473072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.476649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:00.477766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:00.478384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:01.124275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:01.141520 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95bbe5b0-32c9-4988-b51d-553ae4a93c01 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.912304 Jul 14 15:01:01.142128 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 1999/4133] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:00 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:01.168504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e905a0a-f8eb-4401-8cdd-3330212a18e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:01.169150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e905a0a-f8eb-4401-8cdd-3330212a18e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 878beede-9b79-4d51-af3d-59a0606b1157] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:01.172885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:01.195256 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8e905a0a-f8eb-4401-8cdd-3330212a18e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 878beede-9b79-4d51-af3d-59a0606b1157 could not be found. Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e905a0a-f8eb-4401-8cdd-3330212a18e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/878beede-9b79-4d51-af3d-59a0606b1157 HTTP/1.1 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 878beede-9b79-4d51-af3d-59a0606b1157 could not be found. Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '878beede-9b79-4d51-af3d-59a0606b1157'} Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 878beede-9b79-4d51-af3d-59a0606b1157 could not be found. Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 878beede-9b79-4d51-af3d-59a0606b1157 could not be found. Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:01.197199 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:01.204006 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:01.204006 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:01.204006 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:01.204006 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 878beede-9b79-4d51-af3d-59a0606b1157 could not be found. Jul 14 15:01:01.204006 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:01.204006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e905a0a-f8eb-4401-8cdd-3330212a18e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 878beede-9b79-4d51-af3d-59a0606b1157 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:01.205809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5fa0f903-a21f-457e-9aef-b4da9f181748 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.738500 Jul 14 15:01:01.211978 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2135/4134] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:00 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:01.214227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e905a0a-f8eb-4401-8cdd-3330212a18e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/878beede-9b79-4d51-af3d-59a0606b1157" status: 404 len: 111 microversion: 2.1 time: 0.050566 Jul 14 15:01:01.214829 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2000/4135] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:01 2022] GET /compute/v2.1/servers/878beede-9b79-4d51-af3d-59a0606b1157 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:01.226221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:01.227164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:01.243137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:01.244303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:01.245515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:01.246243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:01.950001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:01.965965 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ab6c3f18-7ad3-47d2-bc6b-21f7cd1ed818 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.738791 Jul 14 15:01:01.967665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2136/4136] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:01 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:02.025874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:02.027624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:02.079011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:02.083459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.088547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:02.094593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.224977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:02.226657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:02.306027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:02.306824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.321772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:02.322710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:02.715749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:02.744410 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99205d66-d1e8-4488-8788-c82ff4cc3d43 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.747837 Jul 14 15:01:02.760517 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2001/4137] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:01 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:02.795463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b113a84b-e0bd-4f48-8bb7-0eba50586b5c"}], "security_groups": [{"name": "tempest-securitygroup--1347825155"}], "key_name": "tempest-keypair-1617915274", "user_data": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:02.860358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:02.876236 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1efb96ac-6ee4-4396-9af9-f4a08bd17dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.657145 Jul 14 15:01:02.878196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2137/4138] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:02 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:03.018546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-633befbb-4bc9-4e6c-acea-9d9e75d07e5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-144361256", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-633befbb-4bc9-4e6c-acea-9d9e75d07e5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 237 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-144361256", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-144361256', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:01:03.022617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Jul 14 15:01:03.026427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:03.029586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-633befbb-4bc9-4e6c-acea-9d9e75d07e5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:03.032055 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-633befbb-4bc9-4e6c-acea-9d9e75d07e5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.018414 Jul 14 15:01:03.035328 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2138/4139] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:01:03.045875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] validate_networks() for [('b113a84b-e0bd-4f48-8bb7-0eba50586b5c', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:01:03.066082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:03.068861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:03.083621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:03.084487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:03.085538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:03.086226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:03.945041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:03.960420 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ea6327b-2b6e-4a77-8393-fe09cdd3cdc4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.918946 Jul 14 15:01:03.964177 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2139/4140] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:03 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:03.990624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:03.991612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:04.011118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.016236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:04.017469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.022137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:04.624251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:04.651716 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14d83ee1-5a0f-43df-9156-b083eda1d14b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1508 microversion: 2.1 time: 0.681248 Jul 14 15:01:04.653614 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2140/4141] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:03 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1508 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:04.661546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:04.662687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:04.675746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.677102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:04.678669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:04.680154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.690357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:01:05.692240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:01:05.693541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:01:05.694803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:01:05.695858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:01:05.735402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.737007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.739568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.740915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.780687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Getting quotas for project b9ea059a2cd047c0b59f066f38b01d27. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:01:05.803111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Getting quotas for user b128110e3c7f4e2bb93292b8a6f0ea8b and project b9ea059a2cd047c0b59f066f38b01d27. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:01:05.844996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:01:05.849724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:01:05.961240 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eecb8136-4cd5-44d1-b783-e5dc760193fb tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.187203 Jul 14 15:01:05.962047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2002/4142] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:02 2022] POST /compute/v2.1/servers => generated 409 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:01:05.972242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:05.974426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:05.988904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.992311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:05.997980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:05.998614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:06.082180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:06.104396 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38fb4a32-e77e-4f10-9cc7-20668a4fc8a2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.448895 Jul 14 15:01:06.107242 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2141/4143] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:04 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:06.120654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe33144a-2b9f-4cb5-b658-f951723aca82 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:06.125703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fe33144a-2b9f-4cb5-b658-f951723aca82 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:06.314261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fe33144a-2b9f-4cb5-b658-f951723aca82 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:06.325217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe33144a-2b9f-4cb5-b658-f951723aca82 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1226 microversion: 2.1 time: 0.216301 Jul 14 15:01:06.331648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2142/4144] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:06 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1226 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:06.342946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:06.354045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:06.379532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:06.380020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:06.382241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:06.382738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:06.677168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:06.704324 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47b1e539-f2a2-44df-a711-5b4713105454 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.369375 Jul 14 15:01:06.707936 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2143/4145] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:06 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:01:06.736140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:06.737441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:06.764989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:06.765444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:06.768618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:06.769106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.167916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:07.185393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b0f3f5b-2f52-4d32-bb35-cd0f1e3cc5aa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1671 microversion: 2.1 time: 0.466173 Jul 14 15:01:07.186521 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2144/4146] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:06 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1671 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:07.203066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-867e5574-3745-4cac-b5c4-d045ebb1b936 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-110920944", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-867e5574-3745-4cac-b5c4-d045ebb1b936 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 234 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-110920944", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-110920944', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 240, in check Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = func(instance) Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/_format.py", line 210, in is_ipv6 Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return socket.inet_pton(socket.AF_INET6, instance) Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi OSError: illegal IP address string passed to inet_pton Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'notvalid' Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:07.225711 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Jul 14 15:01:07.230615 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:07.233608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-867e5574-3745-4cac-b5c4-d045ebb1b936 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:07.240355 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-867e5574-3745-4cac-b5c4-d045ebb1b936 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.047182 Jul 14 15:01:07.243856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2145/4147] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:07 2022] POST /compute/v2.1/servers => generated 133 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:07.271644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:07.272446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:07.311181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:07.315308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.319035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:07.320625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:07.910185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:07.920508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-181b0aa4-db25-45d3-9328-b454015c54ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1529 microversion: 2.1 time: 1.956856 Jul 14 15:01:07.925543 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2003/4148] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:05 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1529 bytes in 1963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:07.942334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-add508c9-bb3e-482c-8f0f-b5437ef45ece tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:07.942671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-add508c9-bb3e-482c-8f0f-b5437ef45ece tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:07.988138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:08.000243 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5836749a-0949-4a05-97fb-337d105ecb64 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.750058 Jul 14 15:01:08.012677 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2146/4149] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:07 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:08.040731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:08.045863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:08.082573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.091682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:08.092862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.098591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:08.459973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-add508c9-bb3e-482c-8f0f-b5437ef45ece tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:08.535213 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-add508c9-bb3e-482c-8f0f-b5437ef45ece tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1226 microversion: 2.1 time: 0.607869 Jul 14 15:01:08.539769 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2004/4150] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:07 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1226 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:08.583121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:08.587837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:08.634471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.640488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:08.645940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:08.647913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.235498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:09.269111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f844349-5a6d-4999-996d-e3d453f01aa9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1671 microversion: 2.1 time: 0.727440 Jul 14 15:01:09.278911 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2005/4151] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:08 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1671 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:09.282507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:09.302662 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a1c1821-16d8-421f-8c4b-97c11630367b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.275740 Jul 14 15:01:09.308734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.310403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.310591 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2147/4152] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:08 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:09.342270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.344921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7bef4c-5039-4f9f-87eb-bf34b2c31444 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:09.345097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de7bef4c-5039-4f9f-87eb-bf34b2c31444 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 6da7e794-961a-4dc5-a329-02011fb43ea5] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.346354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.351155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.352268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.366277 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-de7bef4c-5039-4f9f-87eb-bf34b2c31444 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 6da7e794-961a-4dc5-a329-02011fb43ea5 could not be found. Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7bef4c-5039-4f9f-87eb-bf34b2c31444 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/6da7e794-961a-4dc5-a329-02011fb43ea5/action HTTP/1.1 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 13 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: {"pause": {}} Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6da7e794-961a-4dc5-a329-02011fb43ea5 could not be found. Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6da7e794-961a-4dc5-a329-02011fb43ea5', 'body': {'pause': {}}} Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6da7e794-961a-4dc5-a329-02011fb43ea5 could not be found. Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6da7e794-961a-4dc5-a329-02011fb43ea5 could not be found. Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:09.382504 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6da7e794-961a-4dc5-a329-02011fb43ea5 could not be found. Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7bef4c-5039-4f9f-87eb-bf34b2c31444 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 6da7e794-961a-4dc5-a329-02011fb43ea5 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de7bef4c-5039-4f9f-87eb-bf34b2c31444 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/6da7e794-961a-4dc5-a329-02011fb43ea5/action" status: 404 len: 111 microversion: 2.1 time: 0.046988 Jul 14 15:01:09.394635 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2148/4153] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:09 2022] POST /compute/v2.1/servers/6da7e794-961a-4dc5-a329-02011fb43ea5/action => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:01:09.418609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.419357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.446526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.447211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.448140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.448687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.775055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:09.788968 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05a97360-0f1b-45ff-b38c-3639f6c8d56d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.504030 Jul 14 15:01:09.791298 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2006/4154] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:09.811380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:09.813437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:09.838527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.845091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:09.847484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:09.848010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:10.403799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:10.438909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7522795d-01ac-4e25-aea4-42bd8d658552 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1286 microversion: 2.1 time: 0.645828 Jul 14 15:01:10.443693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2007/4155] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1286 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:10.470322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:10.476663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:10.502635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:10.503938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:10.506845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:10.516230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.264904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:11.286421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd77611b-f59a-4741-affe-6784763123e5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.882757 Jul 14 15:01:11.300954 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2149/4156] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:09 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:11.325889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:11.329151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:11.345721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.347160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.350485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.351836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.635404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:11.639198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:11.678766 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e2cbece-66ac-45ec-afa6-69b23ac03f5d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1671 microversion: 2.1 time: 1.232449 Jul 14 15:01:11.699658 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2008/4157] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:10 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1671 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:11.713887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-06ee0ddb-eb25-48b4-af1c-14be2446bece req-caafdf65-31a4-4bcb-9562-0f207f377262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b31260-a777-4511-a2cc-29a79bc4b3dd", "name": "network-vif-plugged", "status": "completed", "tag": "12fcf23b-e275-4e56-8629-133e6d808dee"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:11.742791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-06ee0ddb-eb25-48b4-af1c-14be2446bece req-caafdf65-31a4-4bcb-9562-0f207f377262 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.744733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-06ee0ddb-eb25-48b4-af1c-14be2446bece req-caafdf65-31a4-4bcb-9562-0f207f377262 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.785741 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-06ee0ddb-eb25-48b4-af1c-14be2446bece req-caafdf65-31a4-4bcb-9562-0f207f377262 service nova] Creating event network-vif-plugged:12fcf23b-e275-4e56-8629-133e6d808dee for instance f2b31260-a777-4511-a2cc-29a79bc4b3dd on n-h2-768852-23 Jul 14 15:01:11.801178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-06ee0ddb-eb25-48b4-af1c-14be2446bece req-caafdf65-31a4-4bcb-9562-0f207f377262 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096299 Jul 14 15:01:11.804736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2009/4158] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:11.824009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:11.828510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:11.850462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.859862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:11.862123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:11.863104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.588176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:12.607982 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74f3b30f-5cd1-4269-87d9-a15fbbe6f4d9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 1.305156 Jul 14 15:01:12.617821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2150/4159] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:11 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:12.634712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:12.640218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:12.659135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:12.663656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.665709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.668555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.670210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.832216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:12.869977 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7910b021-9d7a-45b1-b0aa-950d97140e54 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.062755 Jul 14 15:01:12.873479 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2010/4160] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:11 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:12.888812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:12.901699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:12.923766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.924718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:12.926522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:12.927449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:13.010498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:13.024540 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-19e89abe-b2ce-49ac-b089-55df3a875c7b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1284 microversion: 2.1 time: 0.404002 Jul 14 15:01:13.029001 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2151/4161] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:12 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1284 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:13.046530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:13.051187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:13.073904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:13.075201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:13.079308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:13.081036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:13.321736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fbcefdc-147a-4ff1-a320-32ed53c8e1a4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 202 len: 0 microversion: 2.1 time: 0.289635 Jul 14 15:01:13.330256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2152/4162] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:13 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:01:13.339489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:13.341275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:13.356318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:13.357157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:13.358598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:13.359704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:13.928617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:13.980046 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-983b1a34-8c10-4531-a959-f6f2b29082ea tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1676 microversion: 2.1 time: 1.088158 Jul 14 15:01:13.982771 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2011/4163] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:12 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1676 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:14.012801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:14.028707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:14.063844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:14.064830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:14.069994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:14.071013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:14.739209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:14.751931 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d65f3150-164a-4278-8d19-adf129dfead3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1511 microversion: 2.1 time: 1.419040 Jul 14 15:01:14.756098 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2153/4164] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:13 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1511 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:14.772602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:14.773363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:14.786780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:14.793653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:14.794668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:14.795134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.053160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:15.067318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b52b026-51e1-4ae3-abd9-10f31efa3e72 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1284 microversion: 2.1 time: 0.309702 Jul 14 15:01:15.070932 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2154/4165] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:14 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1284 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:15.081182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:15.089665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:15.108331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.110710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.114526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.115296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.119380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:15.158050 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-47d252cf-475c-4a8e-ac50-872a4af50253 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 1.171408 Jul 14 15:01:15.182834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2012/4166] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:13 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:15.785499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:15.786162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:15.809524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:15.816937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.825927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:15.826912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:15.835385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.182927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:16.217294 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3487a4fa-723c-4ee9-8db5-103f39183564 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1676 microversion: 2.1 time: 1.143732 Jul 14 15:01:16.254045 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2155/4167] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:15 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1676 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:16.281402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:16.282907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:16.322716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.323542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.324988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.325772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.326765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:16.780049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:16.810632 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fd69fac7-0452-4f7b-9188-e179619573d7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1491 microversion: 2.1 time: 1.031227 Jul 14 15:01:16.820965 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2013/4168] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:15 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1491 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:16.827742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:16.829601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:16.840577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.841516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:16.842634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:16.843410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.351550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:17.378471 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d0a1929-caa8-42b0-8d8e-d8d649b3bad3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 1.122509 Jul 14 15:01:17.379967 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2156/4169] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:16 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:17.448389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:17.449568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:17.495665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.496751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.498408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.499459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.579196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'pause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state paused Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 13 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: {"pause": {}} Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'pause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state paused Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'pause': {}}} Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state paused. Cannot pause while the instance is in this state. Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state paused Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:17.583571 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:17.590920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:17.590920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:17.590920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:17.590920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state paused Jul 14 15:01:17.590920 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:17.596483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'pause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state paused {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:17.598468 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3d69762-fae5-4a11-9801-c061e4c07f7a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 143 microversion: 2.1 time: 0.216542 Jul 14 15:01:17.599699 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2157/4170] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:17 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 143 bytes in 219 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:01:17.608421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:17.610087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:17.630316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.631716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:17.633586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:17.634706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.485498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:18.674458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:18.739425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e17e2c3e-bdf8-4d65-98a0-2939c2710d53 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 1.915550 Jul 14 15:01:18.753151 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2014/4171] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:16 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 1931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:18.818780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:18.819676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:18.827579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.829344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:18.830511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:18.832768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:19.170500 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8bf8d34d-c11c-4701-bc7d-7a20a51577aa tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 202 len: 0 microversion: 2.1 time: 0.413552 Jul 14 15:01:19.197645 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2015/4172] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:18 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:01:19.211175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:19.224240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:19.261033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:19.262773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:19.278567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:19.280305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.229850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:20.269996 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b270eeb2-e60e-4ade-b29e-a7954ffa6a75 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 1.067383 Jul 14 15:01:20.273955 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2016/4173] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:19 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:20.297487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:20.299542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:20.332126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.339321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.341335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.342549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.893241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:20.921644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61b6639d-b3da-4ff2-bd91-b82665bfc3f3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 3.319829 Jul 14 15:01:20.925506 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2158/4174] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:17 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 3325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:20.943166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:20.944425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:20.972644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.973491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:20.978606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:20.979796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:21.975804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:22.008433 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b10f9811-7410-4b68-9b3e-2c84ee8a0df6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.730247 Jul 14 15:01:22.044698 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2017/4175] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:20 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:22.061682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ac1494e2-3d7a-4cd1-8bbf-132533388b58 req-25697e09-1d4c-4c39-afec-93d4e529298b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c208b5-0fe0-4c39-9d39-6acca3027c91", "tag": "3c180665-7e4a-4af8-89c7-460f8137a22e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:22.080363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ac1494e2-3d7a-4cd1-8bbf-132533388b58 req-25697e09-1d4c-4c39-afec-93d4e529298b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:22.085224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ac1494e2-3d7a-4cd1-8bbf-132533388b58 req-25697e09-1d4c-4c39-afec-93d4e529298b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:22.113889 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ac1494e2-3d7a-4cd1-8bbf-132533388b58 req-25697e09-1d4c-4c39-afec-93d4e529298b service nova] Creating event network-changed:3c180665-7e4a-4af8-89c7-460f8137a22e for instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 on n-h1-768852-23 Jul 14 15:01:22.127459 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ac1494e2-3d7a-4cd1-8bbf-132533388b58 req-25697e09-1d4c-4c39-afec-93d4e529298b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078144 Jul 14 15:01:22.138645 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2018/4176] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:22.152326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:22.153758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:22.165957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:22.167401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:22.168546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:22.169463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:22.680955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:22.691985 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-59206803-c6fd-446b-bb82-8cef350cca74 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.549735 Jul 14 15:01:22.704635 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2019/4177] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:22 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:22.710778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:22.711736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:22.720359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:22.721226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:22.722199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:22.722808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:22.831161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:22.846288 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c4ce310e-5d25-4526-a628-4f7dd2ffc53d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 1.917340 Jul 14 15:01:22.857404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2159/4178] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:20 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 1930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:23.021502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:23.073283 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4d93a60-4311-470b-8fd0-3e881ba0a275 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.359226 Jul 14 15:01:23.090177 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2020/4179] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:22 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:23.099144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:23.100965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:23.131362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.134333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.135597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.148619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.188739 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f/action HTTP/1.1 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 28 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: {"reboot": {"type": "SOFT"}} Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '68afe110-fdf0-41d5-9cd1-e78627d0c73f', 'body': {'reboot': {'type': 'SOFT'}}} Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1033, in _action_reboot Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:23.193243 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:23.197683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:23.208227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:23.209509 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-59da06e8-cc89-499a-8f31-9b5c9c07b19f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f/action" status: 404 len: 111 microversion: 2.1 time: 0.116343 Jul 14 15:01:23.214781 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2160/4180] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:23 2022] POST /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f/action => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:23.224654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:23.231722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:23.301710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.302506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.304014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.304788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.712140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:23.713231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:23.726715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.731535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:23.735071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:23.739556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:24.647133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:24.660524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8da2c299-8aa3-4a44-94b6-017a6ccaef62 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.444045 Jul 14 15:01:24.672789 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2021/4181] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:23 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:24.689937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:24.690141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:24.707089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:24.707089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:24.711746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:24.712551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:24.897339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:24.909387 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15c9519e-fef5-4f21-8b7c-ef08bf3b14b7 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 1.201821 Jul 14 15:01:24.910002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2161/4182] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:23 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:24.921252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:24.922861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:24.933751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:24.934669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:24.935792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:24.936406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:24.987430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:25.272806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:25.284267 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ce63fd80-9996-4b7c-a6c4-b06701bf4ea7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.610032 Jul 14 15:01:25.285372 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2022/4183] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:24 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:25.940531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:25.947040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:25.979817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:25.981045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:25.982411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:25.983300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:26.554840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:26.569676 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f161bbb6-ca8f-4f7a-8bb4-47c0ef82476d tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.635377 Jul 14 15:01:26.570667 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2023/4184] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:25 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:26.578322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:26.579234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:26.589249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:26.590326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:26.591360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:26.592278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:26.795648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:26.813889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e4778bd-da83-4046-9b69-afc08590565a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.892735 Jul 14 15:01:26.815416 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2162/4185] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:24 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:26.842092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39307a9a-8435-4faa-aec5-2e04a8ce3b7c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:26.843564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39307a9a-8435-4faa-aec5-2e04a8ce3b7c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 8bbcb78c-2097-41c7-8695-642a6dbff93e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:26.880072 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-39307a9a-8435-4faa-aec5-2e04a8ce3b7c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 8bbcb78c-2097-41c7-8695-642a6dbff93e could not be found. Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39307a9a-8435-4faa-aec5-2e04a8ce3b7c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/8bbcb78c-2097-41c7-8695-642a6dbff93e/action HTTP/1.1 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 28 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: {"reboot": {"type": "SOFT"}} Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 8bbcb78c-2097-41c7-8695-642a6dbff93e could not be found. Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '8bbcb78c-2097-41c7-8695-642a6dbff93e', 'body': {'reboot': {'type': 'SOFT'}}} Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bbcb78c-2097-41c7-8695-642a6dbff93e could not be found. Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1033, in _action_reboot Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bbcb78c-2097-41c7-8695-642a6dbff93e could not be found. Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:26.882259 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bbcb78c-2097-41c7-8695-642a6dbff93e could not be found. Jul 14 15:01:26.886508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:26.897388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39307a9a-8435-4faa-aec5-2e04a8ce3b7c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 8bbcb78c-2097-41c7-8695-642a6dbff93e could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:26.898450 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39307a9a-8435-4faa-aec5-2e04a8ce3b7c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/8bbcb78c-2097-41c7-8695-642a6dbff93e/action" status: 404 len: 111 microversion: 2.1 time: 0.069000 Jul 14 15:01:26.909276 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2163/4186] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:26 2022] POST /compute/v2.1/servers/8bbcb78c-2097-41c7-8695-642a6dbff93e/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:26.929730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:26.930367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:26.957161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:26.957622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:26.958445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:26.958963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:27.029889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:27.042979 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d24f879-4ac3-4b89-8270-2d06c4f579e9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.469592 Jul 14 15:01:27.044032 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2024/4187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:26 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:27.411831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:27.422974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad74895f-7e2b-4257-84cc-d808108d26d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.512458 Jul 14 15:01:27.426059 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2164/4188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:26 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:27.444423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:27.445055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:27.464388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:27.467418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:27.467988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:27.475263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:27.475953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:27.588617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:27.589748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:27.602851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:27.607145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:27.607904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:27.613250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.068835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:28.082773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:28.087952 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d15b8d61-0aec-487b-b6f9-5a16d0dbbe3d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.647795 Jul 14 15:01:28.089432 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2025/4189] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:27 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:28.102299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:28.103861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:28.133028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:28.134204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.138136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:28.146934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.354108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:28.379708 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47415c66-9a03-4aa7-bcfc-18799a11b919 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.791301 Jul 14 15:01:28.380893 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2165/4190] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:27 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:28.420187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:28.428377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:28.450825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:28.463407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.465023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:28.474843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.560346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f/action HTTP/1.1 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 65 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '68afe110-fdf0-41d5-9cd1-e78627d0c73f', 'body': {'rebuild': {'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4'}}} Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 14 15:01:28.570736 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_rebuild Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:28.574956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:28.580100 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d13d356b-a418-456c-a8cc-41d336066f32 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f/action" status: 404 len: 111 microversion: 2.1 time: 0.168591 Jul 14 15:01:28.585284 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2166/4191] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:28 2022] POST /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f/action => generated 111 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:28.608042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:28.610125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:28.652057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:28.658898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.667547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:28.670698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:28.672886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:28.691214 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0e5a6a0-fb54-416f-9f30-f98728997227 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.594063 Jul 14 15:01:28.693663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2026/4192] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:28 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:29.415032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:29.417423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:29.461983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.467550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.475178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.476410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.809839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:29.826769 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8bbcfdb-3056-4e8f-9489-47bed0125477 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.418744 Jul 14 15:01:29.839325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2027/4193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:29 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:29.839325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:29.839325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:29.851497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.852513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:29.854118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:29.854966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.280243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:30.325909 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98ae612b-7f9f-4af6-b9e6-0a8c2467ea81 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.495571 Jul 14 15:01:30.332459 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2028/4194] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:29 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:30.436740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:30.455297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9338d0f3-38a8-4c0f-b18e-7524b1899dac tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.865087 Jul 14 15:01:30.465237 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2167/4195] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:28 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:30.490787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:30.494253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:30.531566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.540349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.542448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.543771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.874540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:30.877734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:30.909667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.911536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:30.914650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:30.917626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:31.522849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:31.555895 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-09b63ebb-1084-4956-a5bf-99ac428b5cd8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.073892 Jul 14 15:01:31.557103 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2029/4196] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:30 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:31.602685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:31.604625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:31.634574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:31.635591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:31.636895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:31.637703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:31.678802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:31.699738 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a9440b8-f793-4aa1-8589-edc902118862 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.846037 Jul 14 15:01:31.701868 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2168/4197] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:30 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:31.714454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b730d712-8fea-45c2-b28b-4875c0be8f48 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:31.720200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b730d712-8fea-45c2-b28b-4875c0be8f48 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 839e6621-047f-4c77-bdb6-b948145934b4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:31.739463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b730d712-8fea-45c2-b28b-4875c0be8f48 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 839e6621-047f-4c77-bdb6-b948145934b4 could not be found. Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b730d712-8fea-45c2-b28b-4875c0be8f48 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/839e6621-047f-4c77-bdb6-b948145934b4/action HTTP/1.1 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 65 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 839e6621-047f-4c77-bdb6-b948145934b4 could not be found. Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '839e6621-047f-4c77-bdb6-b948145934b4', 'body': {'rebuild': {'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4'}}} Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839e6621-047f-4c77-bdb6-b948145934b4 could not be found. Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1162, in _action_rebuild Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Jul 14 15:01:31.745475 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839e6621-047f-4c77-bdb6-b948145934b4 could not be found. Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839e6621-047f-4c77-bdb6-b948145934b4 could not be found. Jul 14 15:01:31.756874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:31.760289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b730d712-8fea-45c2-b28b-4875c0be8f48 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 839e6621-047f-4c77-bdb6-b948145934b4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:31.766156 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b730d712-8fea-45c2-b28b-4875c0be8f48 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/839e6621-047f-4c77-bdb6-b948145934b4/action" status: 404 len: 111 microversion: 2.1 time: 0.059306 Jul 14 15:01:31.769481 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2169/4198] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:31 2022] POST /compute/v2.1/servers/839e6621-047f-4c77-bdb6-b948145934b4/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:31.813484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:31.827424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:31.852959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:31.853768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:31.855209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:31.856046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:32.276320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:32.305720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19a0e590-8620-43e1-a8b1-dbced7c87194 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.732315 Jul 14 15:01:32.320464 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2030/4199] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:31 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:32.732919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:32.734505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:32.753207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:32.753960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:32.755376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:32.758086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:32.942468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:32.976897 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cf019aa6-f97a-44cb-b4a9-7babdd4358cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.192499 Jul 14 15:01:32.994677 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2170/4200] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:31 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:33.006399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:33.008166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:33.031733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:33.036437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:33.040586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:33.043418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:33.497796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:33.579826 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26c77128-b667-4cc4-b587-872824bd24bf tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.835517 Jul 14 15:01:33.583408 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2031/4201] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:32 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:33.632289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:33.641324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:33.686028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:33.687365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:33.711522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:33.712764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:34.065657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:34.082853 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-efdb60fd-fd6c-4bd9-9f08-152b3a9b0adf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.086666 Jul 14 15:01:34.095585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2171/4202] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:32 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:34.591783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-94307893-55d2-4e70-a005-4a51bcf97e60 req-10743cfc-34e2-415e-b75c-8bffef870d8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c208b5-0fe0-4c39-9d39-6acca3027c91", "name": "network-vif-plugged", "status": "completed", "tag": "3c180665-7e4a-4af8-89c7-460f8137a22e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:34.616514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94307893-55d2-4e70-a005-4a51bcf97e60 req-10743cfc-34e2-415e-b75c-8bffef870d8c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:34.617036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94307893-55d2-4e70-a005-4a51bcf97e60 req-10743cfc-34e2-415e-b75c-8bffef870d8c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:34.645968 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-94307893-55d2-4e70-a005-4a51bcf97e60 req-10743cfc-34e2-415e-b75c-8bffef870d8c service nova] Creating event network-vif-plugged:3c180665-7e4a-4af8-89c7-460f8137a22e for instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 on n-h1-768852-23 Jul 14 15:01:34.677159 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-94307893-55d2-4e70-a005-4a51bcf97e60 req-10743cfc-34e2-415e-b75c-8bffef870d8c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.579670 Jul 14 15:01:34.677777 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2172/4203] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:34.705773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5f388c-c424-4050-a159-bbd0f59f8e35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:34.706419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fd5f388c-c424-4050-a159-bbd0f59f8e35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 46d3389a-d417-4f6f-9def-c7f74adf9943] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:34.721497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-fd5f388c-c424-4050-a159-bbd0f59f8e35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 46d3389a-d417-4f6f-9def-c7f74adf9943 could not be found. Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5f388c-c424-4050-a159-bbd0f59f8e35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/46d3389a-d417-4f6f-9def-c7f74adf9943/action HTTP/1.1 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 15 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: {"restore": {}} Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 46d3389a-d417-4f6f-9def-c7f74adf9943 could not be found. Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '46d3389a-d417-4f6f-9def-c7f74adf9943', 'body': {'restore': {}}} Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46d3389a-d417-4f6f-9def-c7f74adf9943 could not be found. Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46d3389a-d417-4f6f-9def-c7f74adf9943 could not be found. Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:34.723772 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:34.736550 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:34.736550 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:34.736550 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46d3389a-d417-4f6f-9def-c7f74adf9943 could not be found. Jul 14 15:01:34.736550 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:34.736550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5f388c-c424-4050-a159-bbd0f59f8e35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 46d3389a-d417-4f6f-9def-c7f74adf9943 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:34.739815 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd5f388c-c424-4050-a159-bbd0f59f8e35 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/46d3389a-d417-4f6f-9def-c7f74adf9943/action" status: 404 len: 111 microversion: 2.1 time: 0.051230 Jul 14 15:01:34.739815 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2173/4204] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:34 2022] POST /compute/v2.1/servers/46d3389a-d417-4f6f-9def-c7f74adf9943/action => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:34.752559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:34.753185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:34.789861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:34.790304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:34.791121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:34.791597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:34.816145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:34.849133 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9cd9b0a-92f9-4670-b0d5-e2e90bee7865 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 1.261694 Jul 14 15:01:34.850179 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2032/4205] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:33 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:34.882798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:34.895927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:34.947514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:34.948609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:34.955032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:34.956314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:35.638959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:35.707776 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d939baf-b138-4bad-a4c5-91d311d727b9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.959734 Jul 14 15:01:35.722172 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2174/4206] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:34 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:35.873096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:35.882908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:35.926216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:35.928675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:35.931073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:35.935988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:35.937575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.006510 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c6393e2-c5d4-4e70-8ce5-55370bd8ca68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.147413 Jul 14 15:01:36.018534 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2033/4207] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:34 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:36.061664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:36.062959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:36.116132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.125137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:36.139969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:36.141983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.121275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:37.156150 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70918e0c-a057-49dc-8d3b-83a810518947 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.125496 Jul 14 15:01:37.172991 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2034/4208] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:36 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:37.181770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:37.188881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:37.223071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.223981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.225644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.229810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.359837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:37.398364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dffb01eb-d735-4f59-8484-dd68c2c9cc89 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 1.535250 Jul 14 15:01:37.420076 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2175/4209] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:35 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:37.455410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:37.456268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:37.503623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.505051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.508956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.512232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.589804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'restore' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 15 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: {"restore": {}} Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'restore' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'restore': {}}} Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state active. Cannot restore while the instance is in this state. Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:37.593978 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:37.606378 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:37.606378 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:37.606378 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:37.606378 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:37.606378 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:37.610994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'restore' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:37.613079 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7653be8b-00fd-4c33-9d5d-937056072582 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 145 microversion: 2.1 time: 0.190321 Jul 14 15:01:37.614837 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2176/4210] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:37 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 145 bytes in 194 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:01:37.642538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:37.643727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:37.655407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.656757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:37.658264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:37.658967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:38.031444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:38.052199 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03ea2c34-bdc0-4cbf-a143-b9b044349d0b tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1352 microversion: 2.1 time: 0.876885 Jul 14 15:01:38.061066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2035/4211] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:37 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1352 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:38.437698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:38.442196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:38.493332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:38.494369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:38.499025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:38.512408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:38.861395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:38.898944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b1210e75-321b-4ba1-8714-6023d185151e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.275596 Jul 14 15:01:38.903926 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2177/4212] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:37 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:38.940552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:38.942130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:38.980231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:38.981765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:38.985508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:38.986282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:39.169964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:39.203994 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-061d75c4-8c27-4bac-ad20-a3e459b6231d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.786963 Jul 14 15:01:39.208343 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2036/4213] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:38 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:39.226323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:39.231876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:39.255425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:39.260635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:39.266355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:39.274966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:39.721540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:39.776558 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8768f5a9-605c-448e-b76c-c7109b4a4cca tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.843321 Jul 14 15:01:39.777686 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2178/4214] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:38 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:39.801369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df8b974b-f988-44c1-a9ff-72c1d1616b68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:39.801662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:39.803508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df8b974b-f988-44c1-a9ff-72c1d1616b68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 3f31243a-5e3a-4799-be08-2bb8aa95d817] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:39.819184 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-df8b974b-f988-44c1-a9ff-72c1d1616b68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 3f31243a-5e3a-4799-be08-2bb8aa95d817 could not be found. Jul 14 15:01:39.819850 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1ba1a55-efef-4563-bfd1-46a6c4c10b65 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1541 microversion: 2.1 time: 0.607355 Jul 14 15:01:39.823009 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2037/4215] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:39 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1541 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df8b974b-f988-44c1-a9ff-72c1d1616b68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/3f31243a-5e3a-4799-be08-2bb8aa95d817/action HTTP/1.1 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 14 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: {"resume": {}} Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 3f31243a-5e3a-4799-be08-2bb8aa95d817 could not be found. Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '3f31243a-5e3a-4799-be08-2bb8aa95d817', 'body': {'resume': {}}} Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f31243a-5e3a-4799-be08-2bb8aa95d817 could not be found. Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f31243a-5e3a-4799-be08-2bb8aa95d817 could not be found. Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:39.828407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:39.837429 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:39.837429 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:39.837429 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f31243a-5e3a-4799-be08-2bb8aa95d817 could not be found. Jul 14 15:01:39.837429 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:39.842902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:39.843623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:39.844610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df8b974b-f988-44c1-a9ff-72c1d1616b68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 3f31243a-5e3a-4799-be08-2bb8aa95d817 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:39.847452 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df8b974b-f988-44c1-a9ff-72c1d1616b68 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/3f31243a-5e3a-4799-be08-2bb8aa95d817/action" status: 404 len: 111 microversion: 2.1 time: 0.054883 Jul 14 15:01:39.850977 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2179/4216] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:39 2022] POST /compute/v2.1/servers/3f31243a-5e3a-4799-be08-2bb8aa95d817/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:39.870136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:39.870783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:39.871602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:39.872055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:39.872241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:39.874980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:39.905816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:39.910316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:39.916129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:39.920674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:40.126217 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01859790-d259-4430-8d08-338c084b971f tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.288022 Jul 14 15:01:40.127528 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2038/4217] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:01:39 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91/os-interface => generated 284 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:01:40.232412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:40.235400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:40.283975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:40.286148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:40.288037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:40.289331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:40.901101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:40.912163 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ebe52ca8-9e4a-4943-84fc-08bc8f35bad8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.052418 Jul 14 15:01:40.939655 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2180/4218] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:39 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:40.952335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:40.953005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:40.970310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:40.970760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:40.971740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:40.972191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:41.973145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:42.006285 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-865397fe-1eec-4829-aeb8-d5065829b208 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.063265 Jul 14 15:01:42.013826 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2181/4219] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:40 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:42.039212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:42.056643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:42.111426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:42.113974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:42.116313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:42.117547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:42.225291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:42.238058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'resume' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 14 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: {"resume": {}} Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'resume' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'resume': {}}} Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state active. Cannot resume while the instance is in this state. Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:42.242963 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:42.249951 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:42.249951 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:42.249951 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:42.249951 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:01:42.249951 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:42.256842 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d41265e-154a-463f-8a31-39776c5825ac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 2.021901 Jul 14 15:01:42.258444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'resume' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:42.259578 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2039/4220] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:40 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 2038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:42.260584 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e179440a-dd1d-45f4-9cdb-01009fd3ea9d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 144 microversion: 2.1 time: 0.231402 Jul 14 15:01:42.265896 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2182/4221] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:42 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 144 bytes in 238 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:01:42.280500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:42.287861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:42.320033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:42.325028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:42.329249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:42.332561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:43.278893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:43.283922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:43.302515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=64 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:43.317556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:43.318491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:43.322930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:43.329392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:43.420589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:43.475775 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2f929e7a-d895-4669-83f1-15df09e1e137 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.197825 Jul 14 15:01:43.477820 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2040/4222] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:42 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:43.505199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:43.507332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:43.535758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:43.536818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:43.538290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:43.539212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:44.088194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:44.110564 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af7c07ed-5e44-4cf8-b695-9c71da436a41 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1524 microversion: 2.1 time: 0.833114 Jul 14 15:01:44.111930 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2183/4223] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:43 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1524 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:44.565943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:44.588234 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fba2f8cc-406b-464d-8f5a-ce8508abe32d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.091445 Jul 14 15:01:44.592944 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2041/4224] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:43 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:45.132499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:45.133741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:45.159824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:45.170534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:45.172647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:45.173478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:45.202082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd7f9095-fcce-4cdd-a66c-2bfd0818dbab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd7f9095-fcce-4cdd-a66c-2bfd0818dbab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 160 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c59b259a-1165-406c-b959-1fabb0fd999d"}]}} Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'body': {'server': {'name': '', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'networks': [{'uuid': 'c59b259a-1165-406c-b959-1fabb0fd999d'}]}}} Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '' Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:01:45.214653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 15:01:45.225588 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:01:45.230733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd7f9095-fcce-4cdd-a66c-2bfd0818dbab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:45.233294 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd7f9095-fcce-4cdd-a66c-2bfd0818dbab tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.049322 Jul 14 15:01:45.236936 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2042/4225] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:45 2022] POST /compute/v2.1/servers => generated 108 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:01:45.263459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:45.265411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:45.316425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:45.317178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:45.320111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:45.321277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:46.034873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:46.106060 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94a55402-8f8e-4b36-a5d8-24d9699a86c9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1506 microversion: 2.1 time: 0.977191 Jul 14 15:01:46.118128 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2184/4226] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:45 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1506 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:46.155247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d48f7a19-5b76-496b-8203-1bd5bba26bd6 req-a879570c-2a21-4a9e-91d3-37c41be78646 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b31260-a777-4511-a2cc-29a79bc4b3dd", "name": "network-vif-unplugged", "status": "completed", "tag": "12fcf23b-e275-4e56-8629-133e6d808dee"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:46.207754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d48f7a19-5b76-496b-8203-1bd5bba26bd6 req-a879570c-2a21-4a9e-91d3-37c41be78646 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:46.209365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d48f7a19-5b76-496b-8203-1bd5bba26bd6 req-a879570c-2a21-4a9e-91d3-37c41be78646 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:46.266503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:46.276605 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d48f7a19-5b76-496b-8203-1bd5bba26bd6 req-a879570c-2a21-4a9e-91d3-37c41be78646 service nova] Creating event network-vif-unplugged:12fcf23b-e275-4e56-8629-133e6d808dee for instance f2b31260-a777-4511-a2cc-29a79bc4b3dd on n-h2-768852-23 Jul 14 15:01:46.297772 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d48f7a19-5b76-496b-8203-1bd5bba26bd6 req-a879570c-2a21-4a9e-91d3-37c41be78646 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173048 Jul 14 15:01:46.301031 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2185/4227] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:46.420193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:46.423562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:46.441853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:46.454938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:46.456961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:46.458184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:46.544766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:46.564672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:46.571620 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a98eb697-0f44-4fdc-bc27-9d6c663381c9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.325924 Jul 14 15:01:46.589822 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2043/4228] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:45 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:46.623700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:46.625204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:46.653268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:46.653999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:46.684350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:46.684350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:46.964920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:46.981943 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f19f7dee-9160-42e0-8c48-d1c7e48415d8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.585335 Jul 14 15:01:46.995487 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2186/4229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:46 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:47.341372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0865f0f8-9cad-4419-abcf-43ad974a4912 req-d9696720-f501-4718-b3f1-51be4cc5153f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0c208b5-0fe0-4c39-9d39-6acca3027c91", "tag": "3c180665-7e4a-4af8-89c7-460f8137a22e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:47.355318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0865f0f8-9cad-4419-abcf-43ad974a4912 req-d9696720-f501-4718-b3f1-51be4cc5153f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.356022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0865f0f8-9cad-4419-abcf-43ad974a4912 req-d9696720-f501-4718-b3f1-51be4cc5153f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.376994 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0865f0f8-9cad-4419-abcf-43ad974a4912 req-d9696720-f501-4718-b3f1-51be4cc5153f service nova] Creating event network-changed:3c180665-7e4a-4af8-89c7-460f8137a22e for instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 on n-h1-768852-23 Jul 14 15:01:47.392521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0865f0f8-9cad-4419-abcf-43ad974a4912 req-d9696720-f501-4718-b3f1-51be4cc5153f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.394942 Jul 14 15:01:47.393787 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2187/4230] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:01:47.400270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:47.401413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:47.411459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.412169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.413855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.414585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.563901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:47.588828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af358ffb-5d7f-4379-b25a-2f2028d7bf36 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.988017 Jul 14 15:01:47.603382 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2044/4231] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:46 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:47.612583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:47.613067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:47.629309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.636007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.637456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:47.638076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:47.928108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:47.952217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21297d9c-8026-461a-a12f-47015736ffa1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.556421 Jul 14 15:01:47.953525 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2188/4232] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:47 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:47.970433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c61426ef-abf0-4825-a75f-68398ee1dcf7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:47.971585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c61426ef-abf0-4825-a75f-68398ee1dcf7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: b75c5391-c666-4179-9261-d58b8e850ab2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:47.980431 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c61426ef-abf0-4825-a75f-68398ee1dcf7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance b75c5391-c666-4179-9261-d58b8e850ab2 could not be found. Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c61426ef-abf0-4825-a75f-68398ee1dcf7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/b75c5391-c666-4179-9261-d58b8e850ab2/action HTTP/1.1 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 14 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: {"shelve": {}} Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b75c5391-c666-4179-9261-d58b8e850ab2 could not be found. Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b75c5391-c666-4179-9261-d58b8e850ab2', 'body': {'shelve': {}}} Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b75c5391-c666-4179-9261-d58b8e850ab2 could not be found. Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b75c5391-c666-4179-9261-d58b8e850ab2 could not be found. Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:47.988122 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:47.992253 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:47.992253 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b75c5391-c666-4179-9261-d58b8e850ab2 could not be found. Jul 14 15:01:47.992253 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:47.995483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c61426ef-abf0-4825-a75f-68398ee1dcf7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance b75c5391-c666-4179-9261-d58b8e850ab2 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:47.996815 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c61426ef-abf0-4825-a75f-68398ee1dcf7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/b75c5391-c666-4179-9261-d58b8e850ab2/action" status: 404 len: 111 microversion: 2.1 time: 0.041990 Jul 14 15:01:47.997734 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2189/4233] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:47 2022] POST /compute/v2.1/servers/b75c5391-c666-4179-9261-d58b8e850ab2/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:48.003159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:48.004597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:48.012660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.013219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.014461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.015169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.363723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:48.374087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-10ce42f9-9b28-4592-b7a8-6bdc3d567659 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1506 microversion: 2.1 time: 0.775521 Jul 14 15:01:48.375114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2045/4234] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:47 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:48.382111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:48.383117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:48.393292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.394084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.395166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.396024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.534656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:48.545358 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bda14290-b760-4220-9717-45608f7d69d4 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.546116 Jul 14 15:01:48.552746 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2190/4235] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:47 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:48.567439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:48.568534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:48.590411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.591249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.592402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.593627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.805593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:48.826655 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7efbe980-992f-4951-a119-0018e6fc368c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.441753 Jul 14 15:01:48.833527 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2046/4236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:48 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:48.866507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:48.868136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:48.882457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.886585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.889430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:48.893859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:48.896032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:48.908250 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65aa9238-2570-4521-901c-b8bd818d6b77 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.348096 Jul 14 15:01:48.909166 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2191/4237] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:48 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:49.357453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1189100805", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "4c9ebcf6-34f2-4c45-b411-0023bc6fae9d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:49.451711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:49.467048 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41984c7d-0570-4582-a035-d38e5d39909a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.606210 Jul 14 15:01:49.470813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2047/4238] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:48 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:49.490431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:49.491554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:49.507336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:49.509619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:49.509619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:49.509619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:49.561934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] validate_networks() for [('4c9ebcf6-34f2-4c45-b411-0023bc6fae9d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:01:49.941449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:49.955818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f2756386-956e-49c5-882f-75e0da58428b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 200 len: 1509 microversion: 2.1 time: 0.479875 Jul 14 15:01:49.956617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2048/4239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:49 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 1509 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:49.984584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:49.990161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:50.013728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:50.014506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:50.015926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:50.016613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:50.079063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lazy-loading 'flavor' on Instance uuid 08db0802-63ba-402b-bb7d-d3f69d1d9a18 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:01:50.784570 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0ac3efc-69a8-4cdf-ad08-1943a8fb748d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 202 len: 0 microversion: 2.1 time: 0.825056 Jul 14 15:01:50.786942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2049/4240] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:01:49 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 0 bytes in 830 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:01:50.821924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:50.824302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:50.838478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:50.839678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:50.841174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:50.841997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:50.923001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:01:50.942897 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Working on deleting snapshot 838f589b-66e9-4b4d-9a63-6b98eb9dbff0 from shelved instance... Jul 14 15:01:52.528831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:01:52.532904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:01:52.534144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:01:52.535079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:01:52.540777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:01:52.586097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:52.589510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:52.597733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:52.601034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:52.676727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:01:52.694102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for user 4813aa5acf744a8dac42de00d7e5a519 and project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:01:52.737228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:01:52.743657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:01:52.896393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93a64d7f-9208-429e-a2aa-521c738c4b69 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.537532 Jul 14 15:01:52.900278 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2192/4241] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:01:52.923377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:52.933061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:52.966990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:52.982167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:52.985436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:52.992063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:53.171436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Doing local delete in cell 851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=125966) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 14 15:01:53.175587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:53.181986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:53.182975 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 14 15:01:53.198198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] deallocate_for_instance() {{(pid=125966) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 14 15:01:53.563101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:53.578658 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-279c94fa-8939-4dc6-b9df-8e2a5e42e9e0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.675314 Jul 14 15:01:53.595042 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2193/4242] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:52 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:53.607384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33050cc1-0d25-4996-a560-90afc2334aed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:53.608729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33050cc1-0d25-4996-a560-90afc2334aed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:53.788342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33050cc1-0d25-4996-a560-90afc2334aed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:53.803900 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33050cc1-0d25-4996-a560-90afc2334aed tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1215 microversion: 2.1 time: 0.207171 Jul 14 15:01:53.823256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2194/4243] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:53 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1215 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:54.597434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:54.598473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:54.628728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:54.629184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:54.630065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:54.634907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:55.268670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:55.286646 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0006264b-1c07-4d50-a5ef-400e18235650 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.694186 Jul 14 15:01:55.287255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2195/4244] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:54 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:55.300311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:55.301283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:55.331479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:55.332301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:55.333750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:55.335361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:55.473597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Updating instance_info_cache with network_info: [] {{(pid=125966) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 15:01:55.658616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:55.676683 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e5753c9-3b9f-48bc-a282-74e0660c61e0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1267 microversion: 2.1 time: 0.387920 Jul 14 15:01:55.681054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2196/4245] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:55 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1267 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:55.714477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e6b49b00-99db-406b-9356-c7e6f0373e3f req-bc7b3072-af10-4b7a-8dbd-de3c9817fdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2b31260-a777-4511-a2cc-29a79bc4b3dd", "name": "network-vif-deleted", "tag": "12fcf23b-e275-4e56-8629-133e6d808dee"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:55.749647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e6b49b00-99db-406b-9356-c7e6f0373e3f req-bc7b3072-af10-4b7a-8dbd-de3c9817fdcc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:55.750806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e6b49b00-99db-406b-9356-c7e6f0373e3f req-bc7b3072-af10-4b7a-8dbd-de3c9817fdcc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:55.807591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.compute.server_external_events [req-e6b49b00-99db-406b-9356-c7e6f0373e3f req-bc7b3072-af10-4b7a-8dbd-de3c9817fdcc service nova] Unable to find a host for instance f2b31260-a777-4511-a2cc-29a79bc4b3dd. Dropping event network-vif-deleted {{(pid=125965) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 15:01:55.808964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e6b49b00-99db-406b-9356-c7e6f0373e3f req-bc7b3072-af10-4b7a-8dbd-de3c9817fdcc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.126296 Jul 14 15:01:55.818741 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2197/4246] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 137 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 15:01:56.317738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:56.320685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:56.343860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.346838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.351648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.355138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.767490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:56.788676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1cf54273-3d9b-4ca7-948a-b1cf08a283ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.478280 Jul 14 15:01:56.791308 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2198/4247] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:56 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:01:56.809382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:56.813120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:56.837867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.838938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:56.840700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:56.841855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:57.090903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:57.113133 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2d89944e-86fa-40a6-bdae-4de9afa39d16 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1273 microversion: 2.1 time: 0.312634 Jul 14 15:01:57.140374 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2199/4248] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:56 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1273 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:57.153595 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d94eaf78-f2f8-4a09-8503-23d32fbf88d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 204 len: 0 microversion: 2.1 time: 6.350386 Jul 14 15:01:57.158288 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2050/4249] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:01:50 2022] DELETE /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 0 bytes in 6371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:01:57.173089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:57.174923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:57.189987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:57.191016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:57.192718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:57.193771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:57.231476 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd HTTP/1.1 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f2b31260-a777-4511-a2cc-29a79bc4b3dd'} Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:01:57.236683 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:01:57.245651 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:01:57.257742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:01:57.260832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c9526545-e759-4f48-9ef6-a45a244f673b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 404 len: 111 microversion: 2.1 time: 0.095202 Jul 14 15:01:57.275703 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2200/4250] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:57 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:01:57.762295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1499044040", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:01:57.797003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:01:57.825653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:57.828667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:57.864824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:57.874787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:57.876588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:57.883467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:57.944190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:01:58.533388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:58.553345 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f95676d-7ead-48e1-af59-3cb1474ea981 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.738871 Jul 14 15:01:58.556240 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2201/4251] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:57 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:58.570391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:58.572681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:58.584355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:58.585103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:58.586092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:58.587617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:58.687026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:01:58.700288 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c7a4404-8fde-4585-a933-4d40442cd374 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1273 microversion: 2.1 time: 0.141786 Jul 14 15:01:58.703570 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2202/4252] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:58 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1273 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:01:59.573629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:01:59.574666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:01:59.582338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.582787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.583860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.584472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.802144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:01:59.802955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:01:59.803490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:01:59.804112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:01:59.804635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:01:59.825915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.828081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.830412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:01:59.831178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:01:59.888290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:01:59.901203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:01:59.935668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:01:59.942642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:02:00.087524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9703843-0367-4fee-9192-ae7c77e73a65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.340533 Jul 14 15:02:00.089923 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2051/4253] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:01:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 2347 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:02:00.113279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:00.121980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:00.170360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:00.173078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:00.176786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:00.182457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:00.290801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:00.300010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38dffbec-6d2d-4f86-b06d-b37e48e1ca34 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.730578 Jul 14 15:02:00.307959 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2203/4254] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:01:59 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:00.319170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ec83969-c30e-43dc-b57f-ddd7feff1cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:00.323660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ec83969-c30e-43dc-b57f-ddd7feff1cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:00.616550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:00.623598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=18,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:00.631155 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bb49deef-0197-480a-bac1-213f4d030899 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 0.536469 Jul 14 15:02:00.631640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5ec83969-c30e-43dc-b57f-ddd7feff1cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:00.632500 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2052/4255] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:00 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:00.658113 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ec83969-c30e-43dc-b57f-ddd7feff1cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1215 microversion: 2.1 time: 0.348683 Jul 14 15:02:00.658738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2204/4256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:00 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:01.324144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:01.326178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:01.365862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.369357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:01.376964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.379173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:01.604459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9e4f3a2c-f0a5-4245-8b47-dc554bdedbf5 req-50525a0c-4ecf-46ec-9afa-f6ad557b17cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006dc350-9459-42ce-9768-5415a0b2ea0d", "tag": "ccd9c588-2727-4e33-b879-db764864f8bc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:01.665268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e4f3a2c-f0a5-4245-8b47-dc554bdedbf5 req-50525a0c-4ecf-46ec-9afa-f6ad557b17cc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.668363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e4f3a2c-f0a5-4245-8b47-dc554bdedbf5 req-50525a0c-4ecf-46ec-9afa-f6ad557b17cc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:01.728372 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9e4f3a2c-f0a5-4245-8b47-dc554bdedbf5 req-50525a0c-4ecf-46ec-9afa-f6ad557b17cc service nova] Creating event network-changed:ccd9c588-2727-4e33-b879-db764864f8bc for instance 006dc350-9459-42ce-9768-5415a0b2ea0d on n-h2-768852-23 Jul 14 15:02:01.745174 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9e4f3a2c-f0a5-4245-8b47-dc554bdedbf5 req-50525a0c-4ecf-46ec-9afa-f6ad557b17cc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145798 Jul 14 15:02:01.746232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2205/4257] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:01.773851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:01.778772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:01.817588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.818696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:01.821366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:01.821366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:02.280794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:02.299440 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db9c951f-daae-4973-90fd-14553833707e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 0.545284 Jul 14 15:02:02.300171 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2206/4258] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:01 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:02.305328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:02.312845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:02.327494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:02.328223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:02.329374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:02.332332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:02.495234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:02.517315 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f4f53ae-4526-4e5c-92d7-2837ff00bf36 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1285 microversion: 2.1 time: 0.213631 Jul 14 15:02:02.542456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2207/4259] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:02 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1285 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:02.621601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:02.633743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ea0e08b-417a-48df-8ec5-8799e0981b8d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1533 microversion: 2.1 time: 1.315717 Jul 14 15:02:02.639423 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2053/4260] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:01 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1533 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:03.323440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:03.324602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:03.337594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:03.356619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.357404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.358915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.373306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.551421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:03.556917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:03.582517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.583388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.587681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.588745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.804713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:03.817012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:03.840536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c7a3b44-cd28-4cca-8720-84a74d4e8a95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 0.525398 Jul 14 15:02:03.841196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2208/4261] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:03 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:03.849325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:03.850614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:03.860622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.861878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:03.863434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:03.864470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:04.220762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:04.240639 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25d217d6-1e65-4d68-b18d-7e57e8a2d3bc tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1273 microversion: 2.1 time: 0.696881 Jul 14 15:02:04.254647 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2054/4262] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:03 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1273 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:04.420290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:04.447420 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-09fc0d0f-6fd9-4c75-a25a-4e000310302f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1533 microversion: 2.1 time: 0.602112 Jul 14 15:02:04.448413 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2209/4263] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:03 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1533 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:04.870571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:04.871389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:04.885692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:04.885812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:04.886627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:04.893051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.269393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:05.271843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:05.318520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.319295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.320360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.321251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.778599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:05.814037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-419d0af7-49da-4670-8970-b752507d73dd tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1273 microversion: 2.1 time: 0.552376 Jul 14 15:02:05.819553 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2210/4264] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:05 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1273 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:05.844974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:05.846113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:05.873917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.874591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.879593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:05.881549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:05.882126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:05.913941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c05e0aaf-dd1e-4c81-aba2-7685ea394956 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 1.047932 Jul 14 15:02:05.947119 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2055/4265] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:04 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:06.832466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:06.833102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:06.857514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:06.858069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:06.859422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:06.859874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:07.616449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:07.659693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8aa3442e-f911-46b4-80f8-964aa39144c7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 0.827957 Jul 14 15:02:07.661355 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2056/4266] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:06 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:07.681121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:07.683199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:07.702873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:07.703971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:07.706082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:07.707525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:08.249874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:08.264524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-627cb57e-417d-45c1-b424-11d9a5150186 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 0.599125 Jul 14 15:02:08.275938 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2057/4267] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:07 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:08.679441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:08.680372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:08.693355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:08.696215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:08.698098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:08.703021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:08.872240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:08.888661 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53d53a99-a51f-40b6-9613-8938b9e6272a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 3.067422 Jul 14 15:02:08.889963 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2211/4268] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:05 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 3070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:09.182518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-31f019a3-4ffc-4100-9d27-ce4d5c08382d req-2bbf75a3-dcea-4dc4-aee4-90cf92750377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "name": "network-vif-plugged", "status": "completed", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:09.214194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31f019a3-4ffc-4100-9d27-ce4d5c08382d req-2bbf75a3-dcea-4dc4-aee4-90cf92750377 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:09.214750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31f019a3-4ffc-4100-9d27-ce4d5c08382d req-2bbf75a3-dcea-4dc4-aee4-90cf92750377 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:09.288455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-31f019a3-4ffc-4100-9d27-ce4d5c08382d req-2bbf75a3-dcea-4dc4-aee4-90cf92750377 service nova] Creating event network-vif-plugged:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h2-768852-23 Jul 14 15:02:09.315989 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-31f019a3-4ffc-4100-9d27-ce4d5c08382d req-2bbf75a3-dcea-4dc4-aee4-90cf92750377 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131723 Jul 14 15:02:09.324844 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2212/4269] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:09.342377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:09.346519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:09.384023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:09.390739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:09.393744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:09.399148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:09.597145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:09.619109 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a20df822-f629-438b-938f-e581f237592a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 0.942433 Jul 14 15:02:09.635305 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2058/4270] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:08 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:09.906889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:09.907765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:09.911342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:09.921283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:09.922311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:09.923690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:09.925211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:09.927209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:10.588059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:10.619324 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-833e0d22-892b-43ec-bb83-0938e0913bda tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 1.292599 Jul 14 15:02:10.621017 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2213/4271] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:09 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:10.634401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-10bae9f5-63e5-4480-9ae6-b520906596c7 req-0d5856d7-c2fd-4824-b620-bc432324c6df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aff48218-e3d8-4af5-98f1-1ecb8beda66b", "tag": "6c0e4ae9-3be8-48ad-ba78-bc9a3cfa2f7a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:10.671131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:10.676313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-10bae9f5-63e5-4480-9ae6-b520906596c7 req-0d5856d7-c2fd-4824-b620-bc432324c6df service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:10.678010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-10bae9f5-63e5-4480-9ae6-b520906596c7 req-0d5856d7-c2fd-4824-b620-bc432324c6df service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:10.722054 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-10bae9f5-63e5-4480-9ae6-b520906596c7 req-0d5856d7-c2fd-4824-b620-bc432324c6df service nova] Creating event network-changed:6c0e4ae9-3be8-48ad-ba78-bc9a3cfa2f7a for instance aff48218-e3d8-4af5-98f1-1ecb8beda66b on n-h2-768852-23 Jul 14 15:02:10.753988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-10bae9f5-63e5-4480-9ae6-b520906596c7 req-0d5856d7-c2fd-4824-b620-bc432324c6df service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130761 Jul 14 15:02:10.755754 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2214/4272] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:10.768056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:10.771161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:10.817284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:10.818463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:10.822402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:10.827150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:11.016678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:11.031154 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c90d9f29-6b87-4a58-91c6-27f9e7de4ee6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.128862 Jul 14 15:02:11.034008 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2059/4273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:09 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:11.313123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:11.326368 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcb2fa04-343c-459b-8ca1-c468d14aad90 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 0.567789 Jul 14 15:02:11.340176 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2215/4274] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:10 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:11.642166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:11.644313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:11.674241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:11.674969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:11.678339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:11.679256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:12.051208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:12.051854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:12.066387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:12.077696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:12.078798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:12.079264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:12.397054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:12.415545 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17cc1705-5337-46bf-9b2f-bf472bca68e6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 0.778771 Jul 14 15:02:12.418876 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2060/4275] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:11 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:12.432170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:12.436594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:12.463729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:12.469468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:12.473617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:12.474603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:12.805086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:12.856931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f86e08c6-f91a-499f-88dc-e451ead9d878 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 0.435862 Jul 14 15:02:12.862862 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2061/4276] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:12 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:13.442488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:13.443439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:13.494039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:13.501433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:13.503020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:13.513469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:14.177252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:14.195650 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9437c788-55c5-4521-a45e-c8d0ae4dce4f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 0.754424 Jul 14 15:02:14.199861 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2062/4277] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:13 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:14.254808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c5e3000c-a53d-4922-b50e-fed9637fe1ae req-e32e76c1-60f6-431a-87b3-e7b667186fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006dc350-9459-42ce-9768-5415a0b2ea0d", "name": "network-vif-plugged", "status": "completed", "tag": "ccd9c588-2727-4e33-b879-db764864f8bc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:14.305148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:14.335474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c5e3000c-a53d-4922-b50e-fed9637fe1ae req-e32e76c1-60f6-431a-87b3-e7b667186fe1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:14.336523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c5e3000c-a53d-4922-b50e-fed9637fe1ae req-e32e76c1-60f6-431a-87b3-e7b667186fe1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:14.353302 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c5e3000c-a53d-4922-b50e-fed9637fe1ae req-e32e76c1-60f6-431a-87b3-e7b667186fe1 service nova] Creating event network-vif-plugged:ccd9c588-2727-4e33-b879-db764864f8bc for instance 006dc350-9459-42ce-9768-5415a0b2ea0d on n-h2-768852-23 Jul 14 15:02:14.366690 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c5e3000c-a53d-4922-b50e-fed9637fe1ae req-e32e76c1-60f6-431a-87b3-e7b667186fe1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163073 Jul 14 15:02:14.368202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2063/4278] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:14.378249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:14.386363 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f9e69dc-1170-4921-8797-b5e68bf5d994 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 2.324085 Jul 14 15:02:14.390408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:14.395555 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2216/4279] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:12 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 2349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:14.401057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:14.401431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:14.402611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:14.403237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:14.455332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:14.473479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:14.544534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:14.590134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:14.596847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:14.600651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:14.608566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:14.805193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:02:15.342997 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-541e9f77-e88b-43a7-afdf-0379c45f6495 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 204 len: 0 microversion: 2.1 time: 0.923057 Jul 14 15:02:15.347429 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2217/4280] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:02:14 2022] DELETE /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 0 bytes in 951 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:02:15.418047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:15.422744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:15.463360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:15.468487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:15.469567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:15.477078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:15.895361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:15.956887 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe87f2db-b1be-48c3-878b-731f103b9704 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 1.586234 Jul 14 15:02:15.959503 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2064/4281] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:14 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 1590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:16.028495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:16.059933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:16.098892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.100562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.105991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.113077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.782280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:16.797793 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9be93b28-37cd-4f28-9aac-ee50721e212a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1315 microversion: 2.1 time: 1.427712 Jul 14 15:02:16.814381 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2218/4282] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:15 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1315 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:16.822673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:16.823591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:16.838809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.845235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:16.846560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:16.847151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:17.019946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:17.030359 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cb1ec36-3e59-4a51-a2da-a916d76a30a3 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1666 microversion: 2.1 time: 1.068055 Jul 14 15:02:17.034006 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2065/4283] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:15 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1666 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:17.054916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:17.056127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:17.083436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:17.090394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:17.093948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:17.095108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:17.967805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:17.980961 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9dfea2e9-bd32-4703-9d2a-fadee5ddf570 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.164963 Jul 14 15:02:17.981614 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2219/4284] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:16 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:17.998195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:18.000012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:18.021367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:18.021900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:18.022768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:18.023852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:18.843056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:18.896952 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b267a80f-fdf1-4b5d-b142-fb2e3bf83607 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 1.857391 Jul 14 15:02:18.908500 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2066/4285] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:17 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 1870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:18.939213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:18.940360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:18.989324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.005557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.022597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:19.023253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.023882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.039742 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db1ca2e2-a8b8-4c91-84d0-c0f5064ce425 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1501 microversion: 2.1 time: 1.055555 Jul 14 15:02:19.043995 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2220/4286] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:17 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1501 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:19.060849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:19.062295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:19.074986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.079715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.080586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.089551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.325517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:19.339018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3fade33-e55b-4f00-83c7-f29cc351d8dc tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1598 microversion: 2.1 time: 0.424099 Jul 14 15:02:19.359438 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2067/4287] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:18 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1598 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:19.365097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:19.365935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:19.388125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.388583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.389448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:19.389998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:19.832360 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.network.security_group_api [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Removing security group 8dbac947-9fe7-497f-bf8a-f129e7df15ca from port ccd9c588-2727-4e33-b879-db764864f8bc Jul 14 15:02:20.146205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:20.178876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a9e2a7b3-0302-4fb4-b168-0c388da027b2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.130730 Jul 14 15:02:20.192013 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2221/4288] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:19 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:20.249977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:20.251394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:20.279050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.281920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.286965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.290991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.736361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:20.753395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed2f75a5-3b1c-402a-9f62-4f4775fbe76e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 0.556162 Jul 14 15:02:20.755153 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2222/4289] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:20 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:20.768406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:20.773710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:20.788130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.790263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.792845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:20.796378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:20.977142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b128110e3c7f4e2bb93292b8a6f0ea8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ea059a2cd047c0b59f066f38b01d27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:20.987536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dfa0f554-b38e-4086-b200-2c349b5bd2ef tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 200 len: 1598 microversion: 2.1 time: 0.230741 Jul 14 15:02:21.005090 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2223/4290] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:20 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 1598 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:21.208670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:21.209607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:21.225466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:21.230666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:21.231897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:21.233225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.194473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7fb8fa9-4fb6-47c3-ba20-a89a212ce22d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d/action" status: 202 len: 0 microversion: 2.1 time: 2.833075 Jul 14 15:02:22.200811 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2068/4291] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:02:19 2022] POST /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d/action => generated 0 bytes in 2840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:02:22.223854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d3b0e65e-70ab-42b9-9fa8-504463313b3f req-b293ada5-4900-4478-ae44-63ee516a58c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0c208b5-0fe0-4c39-9d39-6acca3027c91", "name": "network-vif-deleted", "tag": "3c180665-7e4a-4af8-89c7-460f8137a22e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:22.278422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d3b0e65e-70ab-42b9-9fa8-504463313b3f req-b293ada5-4900-4478-ae44-63ee516a58c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.279179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d3b0e65e-70ab-42b9-9fa8-504463313b3f req-b293ada5-4900-4478-ae44-63ee516a58c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.331046 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d3b0e65e-70ab-42b9-9fa8-504463313b3f req-b293ada5-4900-4478-ae44-63ee516a58c8 service nova] Creating event network-vif-deleted:3c180665-7e4a-4af8-89c7-460f8137a22e for instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 on n-h1-768852-23 Jul 14 15:02:22.358947 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d3b0e65e-70ab-42b9-9fa8-504463313b3f req-b293ada5-4900-4478-ae44-63ee516a58c8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155221 Jul 14 15:02:22.360482 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2069/4292] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:22.378235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:22.387124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:22.387771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:22.399067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea989fd2-da8e-465c-8e23-df316f7e7c0a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.194252 Jul 14 15:02:22.401857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.404929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.410999 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2224/4293] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:21 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:22.413100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.414188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.442866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:22.443741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] [instance: d0c208b5-0fe0-4c39-9d39-6acca3027c91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:22.470427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.471096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.471998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.472447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.502584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:22.509052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] HTTP exception thrown: Instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 could not be found. Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Request method failure captured: Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 HTTP/1.1 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C-nz-uXT2q0zrzcOa47sqqgRhai6D3USwNNMf1B3Dlw-SWKRLLAJesxuhjOHuKJH3juQJPsMOSzeGGBjSaU-B1Fs-mjKaGN_ccB05w1YghV2PyCaTuwElO3SnWE2zoy12tNXpKrkv5a6D-GLEYPgz2257Zvvi_Sscueh30qekVnnW0 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b9ea059a2cd047c0b59f066f38b01d27 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestFqdnHostnames-335230875 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b9ea059a2cd047c0b59f066f38b01d27"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b9ea059a2cd047c0b59f066f38b01d27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b9ea059a2cd047c0b59f066f38b01d27"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b9ea059a2cd047c0b59f066f38b01d27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestFqdnHostnames-335230875 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b9ea059a2cd047c0b59f066f38b01d27 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-335230875 Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestFqdnHostnames-335230875-project Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: b128110e3c7f4e2bb93292b8a6f0ea8b Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestFqdnHostnames-335230875-project Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 could not be found. Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'd0c208b5-0fe0-4c39-9d39-6acca3027c91'} Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 could not be found. Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 could not be found. Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:22.510859 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 could not be found. Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Returning 404 to user: Instance d0c208b5-0fe0-4c39-9d39-6acca3027c91 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:22.516813 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be19c3cb-98c1-4bed-85e1-a7640f37e365 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91" status: 404 len: 111 microversion: 2.1 time: 0.100138 Jul 14 15:02:22.518331 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2225/4294] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:22 2022] GET /compute/v2.1/servers/d0c208b5-0fe0-4c39-9d39-6acca3027c91 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:02:22.527538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:22.528112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:22.555989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.563650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.565788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.566523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.817883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:22.832959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a33bc12d-cdc1-4491-9cc7-084d3c8310eb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1459 microversion: 2.1 time: 0.313355 Jul 14 15:02:22.835569 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2226/4295] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:22 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1459 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:22.853220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86c71973-a6ed-461d-8b77-5d8ee5b202a9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] Calling method '.version_select at 0x7fdbf1bade50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:22.901194 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86c71973-a6ed-461d-8b77-5d8ee5b202a9 tempest-ServersTestFqdnHostnames-335230875 tempest-ServersTestFqdnHostnames-335230875-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617915274" status: 202 len: 0 microversion: 2.1 time: 0.059834 Jul 14 15:02:22.906422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2227/4296] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617915274 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:02:22.923576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:22.925448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:22.943655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.945980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:22.947292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:22.949986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.092145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:23.118130 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2fa6e0b9-832c-4d2e-b9aa-756c9e335768 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 0.755401 Jul 14 15:02:23.131796 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2070/4297] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:22 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:23.239434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5ab52f30-eaf1-4f47-9d74-49067b5b235c req-b30cb025-ce88-46c9-a3a0-f4f8ab5f87f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff48218-e3d8-4af5-98f1-1ecb8beda66b", "name": "network-vif-plugged", "status": "completed", "tag": "6c0e4ae9-3be8-48ad-ba78-bc9a3cfa2f7a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:23.274071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5ab52f30-eaf1-4f47-9d74-49067b5b235c req-b30cb025-ce88-46c9-a3a0-f4f8ab5f87f2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.280602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5ab52f30-eaf1-4f47-9d74-49067b5b235c req-b30cb025-ce88-46c9-a3a0-f4f8ab5f87f2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.324654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:23.332950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5ab52f30-eaf1-4f47-9d74-49067b5b235c req-b30cb025-ce88-46c9-a3a0-f4f8ab5f87f2 service nova] Creating event network-vif-plugged:6c0e4ae9-3be8-48ad-ba78-bc9a3cfa2f7a for instance aff48218-e3d8-4af5-98f1-1ecb8beda66b on n-h2-768852-23 Jul 14 15:02:23.362822 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5ab52f30-eaf1-4f47-9d74-49067b5b235c req-b30cb025-ce88-46c9-a3a0-f4f8ab5f87f2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129686 Jul 14 15:02:23.364509 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2071/4298] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:02:23.443899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.455172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:23.467095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.480529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.482965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.484085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.565145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:23.583251 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e7d7639-713a-4f32-9b06-f62ad2c4cb71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.676669 Jul 14 15:02:23.583909 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2228/4299] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:22 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:23.632788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:23.633901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:23.655301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.659705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:23.661048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:23.666772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:24.369720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:24.396385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2bd77e0-896d-4ee3-9ec5-9ae73401dad3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.770992 Jul 14 15:02:24.401106 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2229/4300] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:25.045921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:25.049898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:25.050997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:25.075220 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c103ac2-c976-454e-90d3-161430ec1f3a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.639220 Jul 14 15:02:25.079048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.079667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:25.083147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.083781 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2072/4301] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:23 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:25.086000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:25.100576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:25.108625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:25.122057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.124144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:25.126092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:25.127248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.312542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:26.370493 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6680d0a5-5e95-4755-be12-3e422b9dcb95 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.284434 Jul 14 15:02:26.396681 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2073/4302] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:25 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:26.429129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7350e4e4-d5d0-4dc2-97d9-2d805eb5c2c2 req-1d0d07ae-0f56-41fe-b2df-c188f77b3b3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "006dc350-9459-42ce-9768-5415a0b2ea0d", "tag": "ccd9c588-2727-4e33-b879-db764864f8bc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:26.475602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7350e4e4-d5d0-4dc2-97d9-2d805eb5c2c2 req-1d0d07ae-0f56-41fe-b2df-c188f77b3b3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.476633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7350e4e4-d5d0-4dc2-97d9-2d805eb5c2c2 req-1d0d07ae-0f56-41fe-b2df-c188f77b3b3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.506344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7350e4e4-d5d0-4dc2-97d9-2d805eb5c2c2 req-1d0d07ae-0f56-41fe-b2df-c188f77b3b3f service nova] Creating event network-changed:ccd9c588-2727-4e33-b879-db764864f8bc for instance 006dc350-9459-42ce-9768-5415a0b2ea0d on n-h2-768852-23 Jul 14 15:02:26.516338 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7350e4e4-d5d0-4dc2-97d9-2d805eb5c2c2 req-1d0d07ae-0f56-41fe-b2df-c188f77b3b3f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116356 Jul 14 15:02:26.518202 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2074/4303] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:26.527318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:26.528459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:26.539554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.540318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.554381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.560173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.652153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:26.662566 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca724597-416f-4fd0-bde2-2605ea6c4d57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1315 microversion: 2.1 time: 2.259347 Jul 14 15:02:26.675152 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2230/4304] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:24 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1315 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:26.688509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:26.692915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:26.702660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.703622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:26.706323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:26.707159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:27.812474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:27.848170 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-09d99544-b478-4c88-bcde-3e639b0ae85c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.327765 Jul 14 15:02:27.864240 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2075/4305] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:26 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:27.871542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:27.872850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:27.881591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:27.885030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:27.886020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:27.887201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:27.889048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:28.146428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:28.162522 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ccc2cb76-64e2-4473-af17-09f534069dd1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.484459 Jul 14 15:02:28.163985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2231/4306] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:26 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:28.331454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1290817122", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "4c9ebcf6-34f2-4c45-b411-0023bc6fae9d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:28.422916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] validate_networks() for [('4c9ebcf6-34f2-4c45-b411-0023bc6fae9d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:02:28.611109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:28.671389 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f3faf4e-9d84-4238-83c1-5c79eed8eb2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1501 microversion: 2.1 time: 0.801432 Jul 14 15:02:28.676841 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2076/4307] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:27 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1501 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:28.715815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f36ae3d6-21e3-4633-a68c-87c3dffcd5e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:28.736272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f36ae3d6-21e3-4633-a68c-87c3dffcd5e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:28.736584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f36ae3d6-21e3-4633-a68c-87c3dffcd5e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:28.852487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f36ae3d6-21e3-4633-a68c-87c3dffcd5e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:02:28.964800 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f36ae3d6-21e3-4633-a68c-87c3dffcd5e0 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b/action" status: 202 len: 0 microversion: 2.1 time: 0.266059 Jul 14 15:02:28.967584 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2077/4308] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:02:28 2022] POST /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:02:28.994894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:29.005569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:29.040289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:29.040743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:29.041562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:29.041986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:29.506847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:29.550612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9fe3f87-8004-42c3-ac2e-033972a0a550 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 0.579070 Jul 14 15:02:29.555419 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2078/4309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:28 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:29.579059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:29.583696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:29.626673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:29.630595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:29.637560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:29.640533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.675870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:30.703524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fb90bc64-dc76-4b52-bf3f-cc1aa3e1b158 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 1.142706 Jul 14 15:02:30.711733 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2079/4310] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:29 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 1148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:30.728305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:30.729800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:30.762096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:30.763568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.765100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:30.765780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.859996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:02:30.861384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:02:30.862550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:02:30.863537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:02:30.864574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:02:30.914845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:30.915317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.917955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:30.923109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:30.983476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:02:30.997491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Getting quotas for user 4813aa5acf744a8dac42de00d7e5a519 and project 95bb8113735e4903aa5919ec567b0b5c. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:02:31.061763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:02:31.072720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:02:31.231413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e212051d-b6af-449e-b55f-1dca7ae94627 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.904586 Jul 14 15:02:31.232985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2232/4311] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:02:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:02:31.253085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6029e8a4-19ad-4a97-bd12-6457262d13d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:31.273173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6029e8a4-19ad-4a97-bd12-6457262d13d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:31.410195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6029e8a4-19ad-4a97-bd12-6457262d13d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:31.426457 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6029e8a4-19ad-4a97-bd12-6457262d13d1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1215 microversion: 2.1 time: 0.177655 Jul 14 15:02:31.427049 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2233/4312] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:31 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1215 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:31.476697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:31.493461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-000a83ad-f56a-4c1a-a6a1-503ab97a8b56 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 0.779682 Jul 14 15:02:31.503675 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2080/4313] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:30 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:31.735904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:31.736818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:31.754555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.754873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:31.759610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:31.765787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:32.444176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2bd31cbe-7cd6-4f46-b96b-014fb17ac3b0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:32.444917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2bd31cbe-7cd6-4f46-b96b-014fb17ac3b0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:33.087783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2bd31cbe-7cd6-4f46-b96b-014fb17ac3b0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:33.096120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2bd31cbe-7cd6-4f46-b96b-014fb17ac3b0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1215 microversion: 2.1 time: 0.655806 Jul 14 15:02:33.110394 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2081/4314] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:32 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1215 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:33.115850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:33.116751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:33.125790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:33.126630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:33.127756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:33.128400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:33.232361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:33.269408 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-365711a6-90ff-46fc-8bdd-e4d0871f2a1e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 1.538732 Jul 14 15:02:33.280299 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2234/4315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:31 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 1542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:34.118229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:34.119314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:34.133465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:34.134268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:34.137598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:34.138343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:34.139523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:34.156105 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5266575e-8202-4d53-892b-950d1e4d4bb2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.044045 Jul 14 15:02:34.156998 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2082/4316] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:33 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:34.291925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:34.292862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:34.311759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:34.312547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:34.313684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:34.314335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:34.520025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:34.540780 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ae054b7-0027-422a-b18b-91a56dd5d41d tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1285 microversion: 2.1 time: 0.426806 Jul 14 15:02:34.541889 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2235/4317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:34 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1285 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:34.961854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:34.997061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43511765-2498-4ba2-9a7a-36672d4906f9 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 0.711969 Jul 14 15:02:35.005647 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2083/4318] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:34 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:35.184644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:35.186346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:35.215933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.217389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.221950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.223854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.578467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:35.582748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:35.619199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.620670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.632013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:35.633198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:35.884583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:35.920823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45aa463b-b25e-4e1f-ad60-bdfb8a2e907b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1273 microversion: 2.1 time: 0.349060 Jul 14 15:02:35.922214 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2084/4319] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:35 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1273 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:36.063717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:36.080191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:36.092503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.099569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.104566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.105770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.554526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:36.587988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2c511d8-a473-475c-81e6-019667a9e12c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.410846 Jul 14 15:02:36.591220 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2236/4320] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:35 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:36.942735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:36.943435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:36.973900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.978348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:36.980018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:36.984213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:37.317361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:37.343522 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-424e957f-cb8b-4ab2-9c62-0e1cd5dcad70 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 1.312505 Jul 14 15:02:37.346797 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2085/4321] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:36 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:37.488304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:37.497337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c749d9d-b29a-4446-a433-8438125bc8cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 0.561276 Jul 14 15:02:37.506468 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2237/4322] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:36 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:37.618868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:37.620650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:37.661500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:37.668739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:37.671768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:37.675458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:38.379933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:38.381006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:38.408659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:38.415629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:38.417409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:38.426402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:38.692824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:38.706467 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22f60e1b-089c-4ded-9c22-070254825ba5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1528 microversion: 2.1 time: 1.101405 Jul 14 15:02:38.707899 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2086/4323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:37 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1528 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:38.714836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:38.715838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:38.724984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:38.725790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:38.726936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:38.727642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:39.508981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:39.533670 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32687a52-bc1c-4a75-824c-fc1e434381cf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 0.823198 Jul 14 15:02:39.558826 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2087/4324] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:38 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:39.632095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:39.656942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38c36fa8-edb7-418a-b661-2c4fc37e9a06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 1.283846 Jul 14 15:02:39.657772 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2238/4325] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:38 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:39.733460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:39.734383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:39.749170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:39.749632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:39.750443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:39.750895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.334621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:40.348175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1055632-e8dd-4f63-a3dd-6ee521f721b3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1510 microversion: 2.1 time: 0.626842 Jul 14 15:02:40.349690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2088/4326] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:39 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1510 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:40.570272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:40.571656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:40.598895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:40.607226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.609162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:40.610491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.693481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:40.694442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:40.719662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:40.720666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.721730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:40.723793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:40.732578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:40.957340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:41.323826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:41.346229 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9db5199f-4950-47ff-bc98-86e07b1ffd8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 0.664335 Jul 14 15:02:41.348472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2089/4327] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:40 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:41.360067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3665d9a5-23ba-49d5-91ed-31af17d9db18 req-54d0c5f0-ae68-4417-8c86-c407e9e76c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "name": "network-vif-unplugged", "status": "completed", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:41.404112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3665d9a5-23ba-49d5-91ed-31af17d9db18 req-54d0c5f0-ae68-4417-8c86-c407e9e76c4d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:41.404995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3665d9a5-23ba-49d5-91ed-31af17d9db18 req-54d0c5f0-ae68-4417-8c86-c407e9e76c4d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:41.415708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:41.468233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3665d9a5-23ba-49d5-91ed-31af17d9db18 req-54d0c5f0-ae68-4417-8c86-c407e9e76c4d service nova] Creating event network-vif-unplugged:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h2-768852-23 Jul 14 15:02:41.488499 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3665d9a5-23ba-49d5-91ed-31af17d9db18 req-54d0c5f0-ae68-4417-8c86-c407e9e76c4d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137542 Jul 14 15:02:41.496118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2090/4328] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:41.540027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:41.544315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:41.575515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:41.576334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:41.577825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:41.578688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:41.807681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:41.830754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c20219b-f12c-4343-a554-ba7149682eb2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 1.267718 Jul 14 15:02:41.842037 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2239/4329] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:40 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:41.851039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-0c20ac8a-9693-4e8d-9f8f-af42d9f09e7d req-4e86eb06-bd16-4bd4-bf78-5ef26eba1cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ea39b46-63af-47dd-9418-da1c52b398dc", "tag": "09e680a6-ed0c-4c35-985a-f96d1bb20796"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:41.890203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0c20ac8a-9693-4e8d-9f8f-af42d9f09e7d req-4e86eb06-bd16-4bd4-bf78-5ef26eba1cee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:41.891044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-0c20ac8a-9693-4e8d-9f8f-af42d9f09e7d req-4e86eb06-bd16-4bd4-bf78-5ef26eba1cee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:41.942394 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-0c20ac8a-9693-4e8d-9f8f-af42d9f09e7d req-4e86eb06-bd16-4bd4-bf78-5ef26eba1cee service nova] Creating event network-changed:09e680a6-ed0c-4c35-985a-f96d1bb20796 for instance 0ea39b46-63af-47dd-9418-da1c52b398dc on n-h1-768852-23 Jul 14 15:02:41.980457 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-0c20ac8a-9693-4e8d-9f8f-af42d9f09e7d req-4e86eb06-bd16-4bd4-bf78-5ef26eba1cee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135138 Jul 14 15:02:41.982101 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2240/4330] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:42.383760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:42.394643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:42.412312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:42.417743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:42.422196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:42.423413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:43.096398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:43.122571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:43.153257 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-590f2134-cefe-4330-8d35-8ffc7baf676b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1510 microversion: 2.1 time: 1.654693 Jul 14 15:02:43.164831 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2091/4331] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:41 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1510 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:43.198119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:43.199444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:43.225501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:43.236495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:43.237768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:43.238443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:43.725429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:43.756137 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91f18924-5486-4268-8378-7f5d65c8c78f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 1.377900 Jul 14 15:02:43.762316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:43.768098 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2241/4332] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:42 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 1397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:43.770763 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-765697b5-402a-42df-a484-217205adbe5b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 0.604061 Jul 14 15:02:43.771630 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2092/4333] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:43 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:44.175795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:44.176620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:44.190584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.192370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.194561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.195258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.776763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:44.777329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:44.795871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.796329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:44.800201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:44.800670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:45.248422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:45.259515 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1077e7bc-0a2b-4135-b204-0aff0c98ec23 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1453 microversion: 2.1 time: 1.087668 Jul 14 15:02:45.260298 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2242/4334] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:44 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1453 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:45.276010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:45.277171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:45.281559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:45.288206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:45.288655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:45.289456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:45.289889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:45.309525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:45.332511 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01df3134-bad0-4263-b495-72daaf06629c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 0.561722 Jul 14 15:02:45.335592 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2093/4335] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:44 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:45.351702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:45.353469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:45.366227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:45.367157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:45.369021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:45.369983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:45.955345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:45.985226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1f8b07c-2014-41a9-8aec-2f299dfac230 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 0.708329 Jul 14 15:02:46.000846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2243/4336] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:45 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:46.041071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:46.098514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd1b4073-4f46-476a-9508-509b1bace62a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1453 microversion: 2.1 time: 0.759301 Jul 14 15:02:46.099719 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2094/4337] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:45 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1453 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:46.177522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:46.178472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:46.196177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.197494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.199632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.201516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.255744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lazy-loading 'flavor' on Instance uuid 08db0802-63ba-402b-bb7d-d3f69d1d9a18 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:02:46.284020 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'shelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state shelved_offloaded Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 14 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: {"shelve": {}} Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'shelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state shelved_offloaded Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'shelve': {}}} Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Jul 14 15:02:46.289115 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state shelved_offloaded Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state shelved_offloaded Jul 14 15:02:46.297406 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:02:46.299477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'shelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state shelved_offloaded {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:02:46.300803 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a096ac93-df30-477b-a233-06eecbb8d8d5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 155 microversion: 2.1 time: 0.132496 Jul 14 15:02:46.311580 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2244/4338] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:02:46 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 155 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:02:46.321583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:46.323243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:46.358070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:46.359228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:46.363056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.363925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.365458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.366252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.395990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.396948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.398365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:46.399143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:46.625301 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-422eb3df-e237-4623-8e0e-cf44889858fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 202 len: 0 microversion: 2.1 time: 0.311041 Jul 14 15:02:46.634056 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2095/4339] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:02:46 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:02:47.084130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Calling method '.version_select at 0x7fdbf29861f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:47.085740 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:02:47.085740 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:02:47.088447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.090384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.135865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.136440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.167971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.169673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.182406 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7e1642ad-a750-4fa4-81dc-08291503bf3e tempest-PortsAdminExtendedAttrsTestJSON-2083196357 tempest-PortsAdminExtendedAttrsTestJSON-2083196357-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.546108 Jul 14 15:02:47.183755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2096/4340] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 15:02:46 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:47.190914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:47.192136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:47.199753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.201275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.202371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.203017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.370315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:47.376322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:47.416479 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f16f2aa5-937a-42ed-b5b7-0ae3563da26b tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 1.066265 Jul 14 15:02:47.431542 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2245/4341] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:46 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:47.431542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:47.448350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:47.485670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.488258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.491652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:47.492367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:47.912229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:47.939875 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-40db9c79-bead-47be-87c7-5597e1ecda37 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1461 microversion: 2.1 time: 0.754743 Jul 14 15:02:47.945250 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2097/4342] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:47 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1461 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:48.004902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:48.026249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e67dbca-9d48-4f40-9edf-c06fb3a69688 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 0.602109 Jul 14 15:02:48.034529 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2246/4343] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:47 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:48.440223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:48.440867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:48.451337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:48.456822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:48.458382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:48.458719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:48.971520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:48.986604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:49.026838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:49.029486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:49.032910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:49.033875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:49.937380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:49.967934 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53a6510d-5160-482a-8f5c-c35bd61950bd tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1461 microversion: 2.1 time: 1.001702 Jul 14 15:02:49.972514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2247/4344] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:48 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1461 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:50.005598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:50.006363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:50.050685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:50.051558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:50.053032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:50.059622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:50.928294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:50.978087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6599331e-8293-4182-a77d-6fcb51dbd3ad tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 2.542384 Jul 14 15:02:50.986766 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2098/4345] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:48 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 2551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:51.006765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:51.011693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:51.037940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:51.038741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:51.039760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:51.041195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:51.048738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:51.053143 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47112d66-17d6-409f-a1d5-5504179e8681 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 1.077741 Jul 14 15:02:51.061610 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2248/4346] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:49 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:51.090060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-55d21fb4-6f9d-4093-96ce-5d21b6646413 req-09d9ec8a-0803-4fb6-9f18-2ed8e585da7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea39b46-63af-47dd-9418-da1c52b398dc", "name": "network-vif-plugged", "status": "completed", "tag": "09e680a6-ed0c-4c35-985a-f96d1bb20796"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:51.115733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-55d21fb4-6f9d-4093-96ce-5d21b6646413 req-09d9ec8a-0803-4fb6-9f18-2ed8e585da7e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:51.116185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-55d21fb4-6f9d-4093-96ce-5d21b6646413 req-09d9ec8a-0803-4fb6-9f18-2ed8e585da7e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:51.176995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-55d21fb4-6f9d-4093-96ce-5d21b6646413 req-09d9ec8a-0803-4fb6-9f18-2ed8e585da7e service nova] Creating event network-vif-plugged:09e680a6-ed0c-4c35-985a-f96d1bb20796 for instance 0ea39b46-63af-47dd-9418-da1c52b398dc on n-h1-768852-23 Jul 14 15:02:51.194019 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-55d21fb4-6f9d-4093-96ce-5d21b6646413 req-09d9ec8a-0803-4fb6-9f18-2ed8e585da7e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130374 Jul 14 15:02:51.197322 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2249/4347] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:51.837660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:51.854616 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d552583e-84a5-4866-a53b-25a5988dcfff tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.852232 Jul 14 15:02:51.856062 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2099/4348] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:50 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:52.021922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:52.024292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:52.063360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.064154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.067051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.069359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.083541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:52.091216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:52.138583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.146210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.152520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.154713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.636714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:52.656357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c946d70-50d7-4ff8-a3c5-53634ddf50d6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 0.641854 Jul 14 15:02:52.659619 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2250/4349] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:52 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:52.877985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:52.879088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:52.890607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.891468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:52.892507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:52.893152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:53.519556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:53.551355 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02f4f88d-65d8-481d-a064-1772b866f1c7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1315 microversion: 2.1 time: 1.475198 Jul 14 15:02:53.553096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2100/4350] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:52 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:53.701756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:53.715187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:53.723583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:53.736948 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d229b8eb-5836-4776-9d5c-8be55dd7b77c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.867008 Jul 14 15:02:53.746826 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2251/4351] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:52 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:53.747118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:53.747118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:53.751022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:53.759957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.573684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:54.579393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:54.594648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:54.595291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.596466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:54.597319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.623368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:54.655575 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60e11774-9386-4415-9a94-e7191a180c5f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1511 microversion: 2.1 time: 0.972030 Jul 14 15:02:54.657467 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2101/4352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:53 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1511 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:54.759623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:54.761285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:54.775109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:54.776405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.778138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:54.779243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.898081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:54.917077 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9899dfc5-4284-434e-b04a-8c870c1aa39a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1501 microversion: 2.1 time: 0.350899 Jul 14 15:02:54.921417 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2252/4353] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:54 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1501 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:54.960489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:54.965261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:54.987332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:54.989065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:54.990529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:54.991660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.280792 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8881fb9b-6b19-4f28-bccd-b4d15d574bbd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc/action" status: 202 len: 0 microversion: 2.1 time: 0.342815 Jul 14 15:02:55.283620 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2253/4354] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:02:54 2022] POST /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:02:55.298656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:55.300142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:55.319546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.320183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.321289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.330603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.686560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:55.723462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:55.728323 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71e2442b-67fe-441d-aee4-1be8b14280ad tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.970951 Jul 14 15:02:55.731401 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2102/4355] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:54 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:55.745550 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef72d122-09a5-4983-8f99-c6d33370484b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1506 microversion: 2.1 time: 0.455556 Jul 14 15:02:55.748276 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2254/4356] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:55 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1506 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:55.753741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:55.759607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:55.795962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.797431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:55.799397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:55.803483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:56.746858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:56.748952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:56.766308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:56.766993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:56.770476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:56.771575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.118997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:57.140301 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-982194b1-d98a-4942-95bb-2e2ef8cff464 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.397621 Jul 14 15:02:57.140934 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2255/4357] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:56 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:02:57.168838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:57.169332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:57.193842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:57.194159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.195019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:57.195760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.641851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:57.670545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b308766-e666-409b-a666-094bbd340ec2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1486 microversion: 2.1 time: 0.517207 Jul 14 15:02:57.672694 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2256/4358] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:57 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1486 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:57.682850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-30b3c501-0549-4704-b2b8-a5e5cbc2c123 req-e922e1e0-629d-45ee-a7dc-51eec3c3222b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:57.707796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-30b3c501-0549-4704-b2b8-a5e5cbc2c123 req-e922e1e0-629d-45ee-a7dc-51eec3c3222b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:57.708979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-30b3c501-0549-4704-b2b8-a5e5cbc2c123 req-e922e1e0-629d-45ee-a7dc-51eec3c3222b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.737615 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-30b3c501-0549-4704-b2b8-a5e5cbc2c123 req-e922e1e0-629d-45ee-a7dc-51eec3c3222b service nova] Creating event network-changed:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h1-768852-23 Jul 14 15:02:57.754574 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-30b3c501-0549-4704-b2b8-a5e5cbc2c123 req-e922e1e0-629d-45ee-a7dc-51eec3c3222b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079330 Jul 14 15:02:57.756875 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2257/4359] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:02:57.780060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:02:57.798409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:57.815782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:57.824577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.827145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:57.828293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:57.897247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lazy-loading 'flavor' on Instance uuid 0ea39b46-63af-47dd-9418-da1c52b398dc {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:02:58.460776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:58.487039 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e90c605b-1fab-47df-9198-f446ae0bf874 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1488 microversion: 2.1 time: 2.752606 Jul 14 15:02:58.503313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2103/4360] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:55 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1488 bytes in 2760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:58.507890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:58.509080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:58.511718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=62 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:58.525793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.528301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.532413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.533539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.828430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec0aa51f-41e6-47d4-a1ce-9d0f48c7523c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc/action" status: 202 len: 0 microversion: 2.1 time: 1.067325 Jul 14 15:02:58.836940 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2258/4361] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:02:57 2022] POST /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc/action => generated 0 bytes in 1079 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:02:58.869560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:58.904983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:58.937182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.938116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:58.944471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:58.946328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.059070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:02:59.120564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:02:59.271021 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a58bbabd-d0d3-4c1d-80fd-cb8baefc4cb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 204 len: 0 microversion: 2.1 time: 0.425086 Jul 14 15:02:59.271902 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2259/4362] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:02:58 2022] DELETE /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:02:59.283656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:59.303477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:59.317409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.318435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.320273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.321281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.583920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:02:59.595412 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8827e1f-226a-48d1-9224-4994b082ae8c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.100100 Jul 14 15:02:59.596709 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2104/4363] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:58 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:02:59.620456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:02:59.621613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:02:59.645991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.646816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.647944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:02:59.648740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:02:59.702451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:00.348173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:00.365146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-423e6ec3-6de8-4a6e-8863-4a3912145996 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1494 microversion: 2.1 time: 0.755140 Jul 14 15:03:00.367042 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2105/4364] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:59 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1494 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:00.618972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:00.620843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:00.630894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:00.631772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:00.632838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:00.633666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:00.917134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:00.936051 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f8092866-f1ed-4450-bc87-8c3a2d3584ef tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1492 microversion: 2.1 time: 1.662397 Jul 14 15:03:00.936643 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2260/4365] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:02:59 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1492 bytes in 1664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:01.402768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:01.408142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:01.433905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:01.460418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:01.461079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:01.461588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:01.625332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:01.685564 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b29b4f0-e1d4-4a8b-86bc-ebf4b3e84b6c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.069926 Jul 14 15:03:01.701613 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2106/4366] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:00 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:01.980658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:01.989271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:02.023983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.024991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.026448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.027749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.400987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:02.453664 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06e835dc-a045-45f1-813f-e8266423163c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1494 microversion: 2.1 time: 1.061453 Jul 14 15:03:02.455448 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2261/4367] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:01 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1494 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:02.716063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:02.720282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:02.773042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.775734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:02.779001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:02.780390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:03.078782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:03.117264 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-975e6cc6-c1ac-4a9e-8194-d93aad1c3de0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 1.148597 Jul 14 15:03:03.143838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2107/4368] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:01 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:03.487526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:03.495433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:03.542560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:03.549377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:03.552940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:03.554338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:04.522400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:04.542433 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26a19fc4-8bef-491c-90f1-21231c477fc5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.834982 Jul 14 15:03:04.565646 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2262/4369] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:02 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:04.571291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:04.575554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:04.583296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:04.584055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:04.585026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:04.585638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:06.077438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:06.091641 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dade0af6-3e4b-430d-b515-23b5e0caae08 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 200 len: 1494 microversion: 2.1 time: 2.617413 Jul 14 15:03:06.100745 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2108/4370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:03 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 1494 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:06.113119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:06.114156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:06.147421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:06.148503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:06.152744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:06.162332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:07.000621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:07.025678 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd067895-f283-485f-92e4-e92cb549de97 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 2.454395 Jul 14 15:03:07.029091 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2263/4371] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:04 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 2463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:07.058825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9c9d99fd-a3ec-43a5-87b0-30088bbf293b req-9350b676-0f4d-45f2-9430-81b31755dc96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aff48218-e3d8-4af5-98f1-1ecb8beda66b", "name": "network-vif-deleted", "tag": "6c0e4ae9-3be8-48ad-ba78-bc9a3cfa2f7a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:07.125215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9c9d99fd-a3ec-43a5-87b0-30088bbf293b req-9350b676-0f4d-45f2-9430-81b31755dc96 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:07.125681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9c9d99fd-a3ec-43a5-87b0-30088bbf293b req-9350b676-0f4d-45f2-9430-81b31755dc96 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:07.148455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9c9d99fd-a3ec-43a5-87b0-30088bbf293b req-9350b676-0f4d-45f2-9430-81b31755dc96 service nova] Creating event network-vif-deleted:6c0e4ae9-3be8-48ad-ba78-bc9a3cfa2f7a for instance aff48218-e3d8-4af5-98f1-1ecb8beda66b on n-h2-768852-23 Jul 14 15:03:07.155057 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9c9d99fd-a3ec-43a5-87b0-30088bbf293b req-9350b676-0f4d-45f2-9430-81b31755dc96 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123798 Jul 14 15:03:07.156449 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2264/4372] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:07.162116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:07.163192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:07.173205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:07.173951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:07.175024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:07.175686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:07.193778 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b HTTP/1.1 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'aff48218-e3d8-4af5-98f1-1ecb8beda66b'} Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:07.196203 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:03:07.202013 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:07.204224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:07.205278 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5c57e0d-7fb2-47bc-8528-ee1d23bcfc7a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 404 len: 111 microversion: 2.1 time: 0.047533 Jul 14 15:03:07.206012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2265/4373] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:07 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:07.403834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-734438789", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "a49d0868-5165-43f9-b976-e136926e5f12"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:08.585388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:08.597514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d207ebe8-dc0a-4427-9e16-7f5cdfbca9cf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 2.495217 Jul 14 15:03:08.612558 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2109/4374] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:06 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 2511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:08.640202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a0e53aeb-c7df-44e3-8e42-3edf3245c1be req-22d09cd4-2513-4e81-bd82-e93068b57083 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea39b46-63af-47dd-9418-da1c52b398dc", "name": "network-vif-plugged", "status": "completed", "tag": "09e680a6-ed0c-4c35-985a-f96d1bb20796"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:08.693973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a0e53aeb-c7df-44e3-8e42-3edf3245c1be req-22d09cd4-2513-4e81-bd82-e93068b57083 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:08.701453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a0e53aeb-c7df-44e3-8e42-3edf3245c1be req-22d09cd4-2513-4e81-bd82-e93068b57083 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:08.764011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a0e53aeb-c7df-44e3-8e42-3edf3245c1be req-22d09cd4-2513-4e81-bd82-e93068b57083 service nova] Creating event network-vif-plugged:09e680a6-ed0c-4c35-985a-f96d1bb20796 for instance 0ea39b46-63af-47dd-9418-da1c52b398dc on n-h1-768852-23 Jul 14 15:03:08.783789 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a0e53aeb-c7df-44e3-8e42-3edf3245c1be req-22d09cd4-2513-4e81-bd82-e93068b57083 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162696 Jul 14 15:03:08.788231 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2110/4375] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:08.806195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:08.820773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:08.852152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:08.857594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:08.862474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:08.863576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:10.732764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:10.760669 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b602f60b-53cf-449b-a7cd-81ac61f788b3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 1.958305 Jul 14 15:03:10.763330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2111/4376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:08 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 1972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:10.895942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:10.896897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:10.907861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:10.909406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:10.913098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:10.913831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:11.819344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:11.867595 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79807d4b-4d2c-4dd4-967b-dce458f235e3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.100313 Jul 14 15:03:11.890745 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2112/4377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:10 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:11.916343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:11.917504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:11.964791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:11.973724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:11.975261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:11.979792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:13.334831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:13.388973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6c53ee4-b71f-4c9b-b991-0d2ea5c8ba8a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 1.485181 Jul 14 15:03:13.393760 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2113/4378] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:11 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:13.422488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:13.462877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:13.502926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:13.518444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:13.520269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:13.521089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:14.582286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:14.595491 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5269e570-a55a-46de-9c79-e5221a3af509 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.198433 Jul 14 15:03:14.607663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2114/4379] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:13 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:14.615748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:14.616795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:14.638651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:14.642461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:14.652091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:14.654762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:15.526527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:15.538428 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99fd6435-8186-4e03-baf2-d9d00a05a4a7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 0.929249 Jul 14 15:03:15.539052 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2115/4380] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:14 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:15.627814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:15.628428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:15.664304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:15.665677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:15.671900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:15.673151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:16.936360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:16.962433 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-703e1e6b-acf4-48f8-99b6-9b3e4bd1ec7e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.336744 Jul 14 15:03:16.983667 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2116/4381] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:15 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:17.001337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:17.011372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:17.038657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:17.039225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:17.044433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:17.046390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:17.183595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=32,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:17.425230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:18.174650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:18.191742 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5801353d-4952-42f1-9c94-3f4cd5373252 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 1.204067 Jul 14 15:03:18.192471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2117/4382] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:16 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:18.233278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:18.248229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:18.280937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:18.281737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:18.290272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:18.292080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:19.293756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:19.305323 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e891a198-8a69-446e-a9b4-5face99e04d0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.097289 Jul 14 15:03:19.311975 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2118/4383] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:18 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:19.324038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:19.327058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:19.349465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:19.365063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:19.373488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:19.376184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:20.640077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:20.674829 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4186d2c3-5eff-4ea2-9328-588b2c80718c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 1.355554 Jul 14 15:03:20.694043 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2119/4384] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:19 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:20.725880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:20.732039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:20.766630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:20.767499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:20.768854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:20.770575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:22.509327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:22.538693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-929b37ca-42a0-4453-9ae8-2c5a71fd1dc8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.827452 Jul 14 15:03:22.538693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2120/4385] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:20 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:22.554522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:22.555411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:22.599830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:22.600595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:22.602667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:22.608982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:23.490548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:23.509137 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-218f41f5-1ec9-4fb4-920a-095150bc9fdd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 0.965878 Jul 14 15:03:23.509857 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2121/4386] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:22 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:23.558539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:23.560937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:23.575637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:23.583587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:23.588083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:23.593731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:24.022017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:24.025144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:24.036061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2833393-abc6-4b8e-9161-29e213f136e8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.482347 Jul 14 15:03:24.040433 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2122/4387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:23 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:24.535358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:24.539106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:24.579023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:24.580933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:24.583286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:24.583742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:25.227657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:25.244927 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26f39709-7d11-4b5a-a23a-dafba70a776a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 0.716726 Jul 14 15:03:25.252379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2123/4388] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:24 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:25.267368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:25.267368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:25.280510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:25.280969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:25.281772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:25.282217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:25.884994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:25.906567 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eb5ac28c-c5ba-4265-be30-2f3eec900686 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.640830 Jul 14 15:03:25.909880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2124/4389] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:25 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:26.263327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:26.264727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:26.301680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:26.302526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:26.304071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:26.317600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:27.152032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:27.175725 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9887cf33-579a-48d1-aa13-36aa7dff71f7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 0.910021 Jul 14 15:03:27.180613 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2125/4390] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:26 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:27.194431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:27.198814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:27.222893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:27.225521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:27.226781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:27.233706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.284050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:28.302983 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04dee8dc-efcb-4895-bf87-9a7178d7eae9 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.120408 Jul 14 15:03:28.308885 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2126/4391] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:27 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:28.328845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:28.329802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:28.337387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.338511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.339953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:28.341121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:28.758451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:28.779604 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af5a6fdd-6b0e-4b03-805b-9b1d4eabaaf0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1508 microversion: 2.1 time: 0.463391 Jul 14 15:03:28.815440 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2127/4392] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:28 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1508 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:29.328477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:29.329270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:29.340888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=48 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:29.350612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:29.351069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:29.362766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:29.363859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:29.399046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] validate_networks() for [('a49d0868-5165-43f9-b976-e136926e5f12', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:03:31.379523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:31.397211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8308c2cf-27eb-4c6a-befe-bbd764e95b5d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 2.066816 Jul 14 15:03:31.407508 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2128/4393] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:29 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 2079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:31.428354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:31.445869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:31.474313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:31.476149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:31.479031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:31.484163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.567935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:32.606108 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eb46daa3-f786-4087-b62e-aedc588af185 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1505 microversion: 2.1 time: 1.200224 Jul 14 15:03:32.608890 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2129/4394] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:31 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1505 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:32.633009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:32.638160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:32.662943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.663727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:32.665143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:32.665890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:33.812116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:33.852727 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cdc20587-1c11-422d-b12b-ad1021c92944 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.238221 Jul 14 15:03:33.855424 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2130/4395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:32 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:33.866425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:33.868951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:33.882094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:33.883442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:33.885452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:33.888507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:34.618556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:03:34.620189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:03:34.620956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:03:34.622316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:03:34.622995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:03:34.645260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:34.649432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:34.653382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:34.653974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:34.726343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:03:34.736857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Getting quotas for user 520cc191a5b24d52b73ad4c0c5d4e9a6 and project b25ee6783ea3416dbef5c8ae62244367. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:03:34.817615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:03:34.844671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:03:35.038440 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-19de76a4-04da-4a9a-be65-395b2a533ca4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 27.640173 Jul 14 15:03:35.041655 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2266/4396] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:03:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 27644 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:03:35.054740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:35.056894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:35.081007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.082445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:35.085714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.086775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:35.645010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:35.674973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9805b930-ef77-49c6-8b7e-9e7a2f7fc5ee tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1505 microversion: 2.1 time: 1.815940 Jul 14 15:03:35.687854 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2131/4397] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:33 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1505 bytes in 1831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:35.703356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:35.712939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:35.735122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.736336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:35.740307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:35.752548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:36.071559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:36.102788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3cba05b-0557-42f3-b528-9a685a733730 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1218 microversion: 2.1 time: 0.405502 Jul 14 15:03:36.105473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2132/4398] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:35 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1218 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:36.121113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9aea53d4-ed35-4e10-8347-f9f07f7672d7 req-41dd1ad5-0421-47b4-b317-b72e6af74e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea39b46-63af-47dd-9418-da1c52b398dc", "name": "network-vif-unplugged", "status": "completed", "tag": "09e680a6-ed0c-4c35-985a-f96d1bb20796"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:36.146122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9aea53d4-ed35-4e10-8347-f9f07f7672d7 req-41dd1ad5-0421-47b4-b317-b72e6af74e9b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:36.152405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9aea53d4-ed35-4e10-8347-f9f07f7672d7 req-41dd1ad5-0421-47b4-b317-b72e6af74e9b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:36.185919 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9aea53d4-ed35-4e10-8347-f9f07f7672d7 req-41dd1ad5-0421-47b4-b317-b72e6af74e9b service nova] Creating event network-vif-unplugged:09e680a6-ed0c-4c35-985a-f96d1bb20796 for instance 0ea39b46-63af-47dd-9418-da1c52b398dc on n-h1-768852-23 Jul 14 15:03:36.197950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9aea53d4-ed35-4e10-8347-f9f07f7672d7 req-41dd1ad5-0421-47b4-b317-b72e6af74e9b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087791 Jul 14 15:03:36.200465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:36.202347 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2133/4399] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:36.214482 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad2afe7b-8592-497e-87cb-0fd6274b8cba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.165669 Jul 14 15:03:36.215210 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2267/4400] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:35 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:36.721254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:36.722771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:36.742186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:36.742925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:36.744002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:36.744650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:37.141162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:37.143257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:37.173278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:37.174576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:37.176353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:37.181281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:37.475098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:37.489095 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8d8bafa-9bb2-48e3-9a00-b1cbff33fa71 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1505 microversion: 2.1 time: 0.773795 Jul 14 15:03:37.490481 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2134/4401] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:36 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1505 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:37.499789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:37.500851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:37.512679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:37.514590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:37.516333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:37.517141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:37.579203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:37.604734 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25379c28-c0b5-46d8-ba0b-8a6bb3d53dfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1272 microversion: 2.1 time: 0.473001 Jul 14 15:03:37.605782 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2268/4402] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:37 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1272 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:38.282125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:38.326922 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dac383ab-daed-473a-9cc5-60a2d9b34b3f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.834147 Jul 14 15:03:38.342995 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2135/4403] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:37 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:38.527133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:38.529615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:38.548425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:38.549679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:38.553163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:38.554336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:38.636522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:38.638205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:38.650663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:38.651311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:38.652311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:38.653007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:38.865459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:38.880288 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-47a8bd2d-1a01-4d83-b915-301fb77378b3 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1272 microversion: 2.1 time: 0.247603 Jul 14 15:03:38.894419 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2136/4404] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:38 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1272 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:39.363647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:39.365205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:39.374770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:39.378491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:39.379818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:39.380529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:40.049291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:40.068393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:40.078479 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37c019ad-b63a-4f3f-8712-232d7e76f937 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.718999 Jul 14 15:03:40.085200 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2137/4405] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:39 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:40.102049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:40.103537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:40.116699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:40.117459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:40.118471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:40.122271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:40.122584 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-140a4fd9-54d3-4016-a6d5-9c3aa95498f8 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1505 microversion: 2.1 time: 1.603237 Jul 14 15:03:40.143379 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2269/4406] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:38 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1505 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:40.365304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:40.373879 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f39e2c1-97e4-4550-91c7-dc5005a87480 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1272 microversion: 2.1 time: 0.287164 Jul 14 15:03:40.381512 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2138/4407] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:40 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1272 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:41.104259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:41.105087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:41.127086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:41.128806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:41.131649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:41.132171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:41.144099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:41.144731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:41.171607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:41.173001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:41.174126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:41.180162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:42.046594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:42.064746 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1577fead-8c43-4336-8cad-82bd3697fd1d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.964708 Jul 14 15:03:42.068188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2270/4408] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:41 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:42.088835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:42.089584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:42.126044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:42.129221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:42.132130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:42.134182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:42.547818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:42.574618 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98e72331-7025-4b06-ad71-5234e01efc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 200 len: 1448 microversion: 2.1 time: 1.430890 Jul 14 15:03:42.577084 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2139/4409] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:41 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 1448 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:42.598012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-dc555f66-e3ec-41c9-925d-028cca6975e8 req-08ff9ba3-e12c-4b29-9ab3-0fa6ecc66e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "name": "network-vif-plugged", "status": "completed", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:42.623342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dc555f66-e3ec-41c9-925d-028cca6975e8 req-08ff9ba3-e12c-4b29-9ab3-0fa6ecc66e3e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:42.628532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dc555f66-e3ec-41c9-925d-028cca6975e8 req-08ff9ba3-e12c-4b29-9ab3-0fa6ecc66e3e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:42.647121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:42.688699 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-dc555f66-e3ec-41c9-925d-028cca6975e8 req-08ff9ba3-e12c-4b29-9ab3-0fa6ecc66e3e service nova] Creating event network-vif-plugged:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h1-768852-23 Jul 14 15:03:42.703716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-dc555f66-e3ec-41c9-925d-028cca6975e8 req-08ff9ba3-e12c-4b29-9ab3-0fa6ecc66e3e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123684 Jul 14 15:03:42.705398 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2140/4410] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:42.724758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:42.728183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:42.772227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:42.772692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:42.773801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:42.774413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:43.079107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:43.113722 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a9d8fc7-0ee5-4580-9dff-f2078cd81242 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 1.033572 Jul 14 15:03:43.114764 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2271/4411] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:42 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:43.121951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:43.123748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:43.135209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:43.138169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:43.139495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:43.140392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:43.473047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:43.499323 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8095f16e-49e9-4e79-935b-3777879f7b6e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.791604 Jul 14 15:03:43.500004 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2141/4412] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:42 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:43.538811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:43.539405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:43.548910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:43.551361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:43.552607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:43.553274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:44.046504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:44.070924 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2dff5b1b-ad16-4eba-9e24-570a23ad3666 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 0.954605 Jul 14 15:03:44.092110 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2272/4413] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:43 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:44.143141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:44.144089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:44.158043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:44.159069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:44.160683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:44.163211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:44.317698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:44.348977 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5846a19f-be73-418e-baad-c00da55d99c9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.814277 Jul 14 15:03:44.350121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2142/4414] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:43 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:44.383445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:44.384924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:44.405337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:44.406609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:44.408368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:44.409511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:44.681120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:44.757960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:44.899347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:44.917730 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a9e3481e-de1d-4596-a600-2294329a1c0a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 0.789027 Jul 14 15:03:44.919811 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2273/4415] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:44 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:45.110062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:45.110997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:45.124215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.125253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:45.126329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.133096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:45.408960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:45.422759 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07956da1-df49-4578-9d4d-074bab95541f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.046768 Jul 14 15:03:45.427647 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2143/4416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:44 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:45.454020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:45.455346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:45.468119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.472078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:45.473403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:45.474080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.162676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:46.191727 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3a3f164-9535-4e91-b50f-2e84f0ca81b5 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 1.086406 Jul 14 15:03:46.200651 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2274/4417] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:45 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:46.212945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:46.215852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:46.227738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:46.229010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.236189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:46.237557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:46.925516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:46.942253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-919d5c7b-1b38-4853-b52d-a8f78962d31c tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 0.739739 Jul 14 15:03:46.943337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2275/4418] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:46 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:47.162736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:47.193747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9012270c-6f1e-40ad-841e-fad4c913ecb3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.744345 Jul 14 15:03:47.205000 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2144/4419] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:45 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:47.237564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f48bb74-4973-421a-a0d0-eac42d631305 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:47.279317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:47.281640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:47.308598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f48bb74-4973-421a-a0d0-eac42d631305 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:47.323122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:47.324047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f48bb74-4973-421a-a0d0-eac42d631305 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:47.326154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:47.334826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:47.336655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:47.398978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6f48bb74-4973-421a-a0d0-eac42d631305 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Going to try to stop instance {{(pid=125965) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:03:47.661362 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f48bb74-4973-421a-a0d0-eac42d631305 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.445953 Jul 14 15:03:47.662401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2276/4420] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:03:47 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:03:47.677174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8a3599fb-2b4f-4a1b-a974-1e379faaef4e req-b2bf6aa4-8990-4094-a7c3-6eb8b0c1e263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51557a8c-2075-4079-9f26-fd2410f3565b", "tag": "26c4bb8b-39e5-4495-a2eb-c11bec7c032d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:47.710079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8a3599fb-2b4f-4a1b-a974-1e379faaef4e req-b2bf6aa4-8990-4094-a7c3-6eb8b0c1e263 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:47.710765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8a3599fb-2b4f-4a1b-a974-1e379faaef4e req-b2bf6aa4-8990-4094-a7c3-6eb8b0c1e263 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:47.751154 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8a3599fb-2b4f-4a1b-a974-1e379faaef4e req-b2bf6aa4-8990-4094-a7c3-6eb8b0c1e263 service nova] Creating event network-changed:26c4bb8b-39e5-4495-a2eb-c11bec7c032d for instance 51557a8c-2075-4079-9f26-fd2410f3565b on n-h2-768852-23 Jul 14 15:03:47.767574 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8a3599fb-2b4f-4a1b-a974-1e379faaef4e req-b2bf6aa4-8990-4094-a7c3-6eb8b0c1e263 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099270 Jul 14 15:03:47.768534 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2277/4421] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:03:47.786816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:47.795800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:47.823225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:47.829190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:47.830914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:47.843458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:48.695721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:48.717303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74d51bf5-a175-4b86-95c4-dd03722677fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 0.945310 Jul 14 15:03:48.718519 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2278/4422] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:47 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:48.756188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:48.758013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:48.784820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:48.789778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:48.793556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:48.806467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:49.988561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:50.003809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69a03c8d-50bc-4c86-b935-22ebd178a849 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 1.269577 Jul 14 15:03:50.015821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2279/4423] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:48 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:50.033546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:50.035538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:50.058034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:50.059793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:50.061536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:50.062676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:50.429916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:50.448465 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-278d8cd7-fa21-4265-830f-d65267b016ee tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1519 microversion: 2.1 time: 3.227571 Jul 14 15:03:50.452001 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2145/4424] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:47 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1519 bytes in 3234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:50.849704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:50.873927 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a205aa0-e859-4fa3-ab7c-a369011b39be tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 0.848711 Jul 14 15:03:50.882561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2280/4425] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:50 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:51.059097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:51.059780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:51.078796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:51.082130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:51.086558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:51.089986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:51.481083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:51.482410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:51.499247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:51.500133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:51.501292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:51.501915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:51.842040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:51.863777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1bb3e0c-0ec7-4eee-89b9-a3e7dbdaeeb4 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 0.826473 Jul 14 15:03:51.865126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2146/4426] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:51 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:51.897955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:51.899477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:51.919164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:51.920422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:51.925289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:51.926458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:52.408660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:52.441611 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea68b5cd-3220-4108-b370-ebfb58439893 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.965007 Jul 14 15:03:52.448841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2281/4427] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:51 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:52.493035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:52.503330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:52.533785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:52.536603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:52.537443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:52.539192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:52.540328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:52.554745 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-39eb6de4-29ff-409f-a428-bb31e8e328dd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 0.664671 Jul 14 15:03:52.573775 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2147/4428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:51 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:03:52.895938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:52.897583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:52.928606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:52.930137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:52.931406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:52.932106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:53.518246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:53.522929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:53.540964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-252e5f0d-a368-4554-9d11-ad94ca24f6e7 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.073475 Jul 14 15:03:53.550060 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2282/4429] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:52 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:53.584105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:53.586444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:53.614459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:53.615464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:53.616965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:53.618709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:54.047137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:54.088146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7ac0353-a7f2-4ce2-93f2-2398c1d02255 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 1.197120 Jul 14 15:03:54.100820 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2148/4430] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:52 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:54.122968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:54.143998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:54.158618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:54.169573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:54.172346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:54.173830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.278779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:55.311089 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8823664-c962-4ca3-8c1d-960a897b83d6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 1.728721 Jul 14 15:03:55.328124 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2283/4431] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:53 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 1749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:55.348121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:55.349612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:55.359933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.361292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.362534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.363936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.473456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:55.489057 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43779775-ad9a-469a-a68b-4924c799214c tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.392108 Jul 14 15:03:55.489683 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2149/4432] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:54 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:55.515846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a017918-a7f7-4fa6-9993-1a76ce5b2c78 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:55.529555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0a017918-a7f7-4fa6-9993-1a76ce5b2c78 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 76c426f1-0f89-4315-9b77-25c94b56237d has no mapping to a cell. Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a017918-a7f7-4fa6-9993-1a76ce5b2c78 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/76c426f1-0f89-4315-9b77-25c94b56237d/action HTTP/1.1 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 15 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: {"os-stop": {}} Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 76c426f1-0f89-4315-9b77-25c94b56237d has no mapping to a cell. Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '76c426f1-0f89-4315-9b77-25c94b56237d', 'body': {'os-stop': {}}} Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1410, in _get_instance Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 76c426f1-0f89-4315-9b77-25c94b56237d has no mapping to a cell. Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1443, in _stop_server Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1417, in _get_instance Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:55.546001 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76c426f1-0f89-4315-9b77-25c94b56237d has no mapping to a cell. Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76c426f1-0f89-4315-9b77-25c94b56237d has no mapping to a cell. Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a017918-a7f7-4fa6-9993-1a76ce5b2c78 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 76c426f1-0f89-4315-9b77-25c94b56237d has no mapping to a cell. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:55.554557 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0a017918-a7f7-4fa6-9993-1a76ce5b2c78 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/76c426f1-0f89-4315-9b77-25c94b56237d/action" status: 404 len: 117 microversion: 2.1 time: 0.041319 Jul 14 15:03:55.557485 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2150/4433] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:03:55 2022] POST /compute/v2.1/servers/76c426f1-0f89-4315-9b77-25c94b56237d/action => generated 117 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:55.562915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:55.568145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:55.587803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.588252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:55.592997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:55.593724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:56.090449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:56.102045 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cae0eb40-5f9c-4639-b7eb-6aa314fd5aa1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 0.771123 Jul 14 15:03:56.102678 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2284/4434] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:55 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:56.349733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:56.351229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:56.360250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:56.361018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:56.362650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:56.363328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:57.187062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:57.225195 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aefbf30a-6636-49ca-a28b-790adc815851 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.668357 Jul 14 15:03:57.226960 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2151/4435] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:55 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:57.278309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:57.279837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:57.304902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:57.305697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:57.307213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:57.312860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:57.461623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:57.475245 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28822e76-a7ad-444f-a87a-b966c1a6d7cb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1679 microversion: 2.1 time: 1.134244 Jul 14 15:03:57.497312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2285/4436] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:56 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1679 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:57.513356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:57.516729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:57.522880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:57.542041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:57.545417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:57.550682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:57.551721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.351306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:59.390474 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da19974a-0d80-4309-a505-a18231e5af8e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 2.158707 Jul 14 15:03:59.400569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2152/4437] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:57 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 2170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:59.425090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:59.429098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:59.466818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=50 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:03:59.484974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:59.491582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.493309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:59.494110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.638873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:03:59.676338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7fe78af7-9977-4713-bcc0-06f01abe4d3b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 2.176976 Jul 14 15:03:59.686580 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2286/4438] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:57 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 2188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:03:59.763699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-761e7ded-0b8a-41e0-b853-7e3e0d8a0b1b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:03:59.764687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-761e7ded-0b8a-41e0-b853-7e3e0d8a0b1b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 508a657f-0d05-4a56-b432-922a6cff7da4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:59.794193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-761e7ded-0b8a-41e0-b853-7e3e0d8a0b1b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 508a657f-0d05-4a56-b432-922a6cff7da4 could not be found. Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-761e7ded-0b8a-41e0-b853-7e3e0d8a0b1b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/508a657f-0d05-4a56-b432-922a6cff7da4/action HTTP/1.1 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 15 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: {"suspend": {}} Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 508a657f-0d05-4a56-b432-922a6cff7da4 could not be found. Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '508a657f-0d05-4a56-b432-922a6cff7da4', 'body': {'suspend': {}}} Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 508a657f-0d05-4a56-b432-922a6cff7da4 could not be found. Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 508a657f-0d05-4a56-b432-922a6cff7da4 could not be found. Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:03:59.799738 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:03:59.812275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:03:59.812275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:03:59.812275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 508a657f-0d05-4a56-b432-922a6cff7da4 could not be found. Jul 14 15:03:59.812275 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:03:59.817146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-761e7ded-0b8a-41e0-b853-7e3e0d8a0b1b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 508a657f-0d05-4a56-b432-922a6cff7da4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:03:59.818844 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-761e7ded-0b8a-41e0-b853-7e3e0d8a0b1b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/508a657f-0d05-4a56-b432-922a6cff7da4/action" status: 404 len: 111 microversion: 2.1 time: 0.097198 Jul 14 15:03:59.820885 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2287/4439] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:03:59 2022] POST /compute/v2.1/servers/508a657f-0d05-4a56-b432-922a6cff7da4/action => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:03:59.848351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:03:59.850481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:03:59.893907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:59.894710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:03:59.895863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:03:59.896515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:00.937985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:00.947184 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-993afeae-34d4-4f14-b6eb-b9b63c0d56da tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1656 microversion: 2.1 time: 1.544669 Jul 14 15:04:00.954081 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2153/4440] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:59 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1656 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:00.988302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:00.989955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:01.004963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:01.006470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:01.038895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:01.045754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:01.729105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:01.793089 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d91fec1d-391b-4968-8e43-433b90545a63 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.964216 Jul 14 15:04:01.795706 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2288/4441] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:03:59 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:01.819109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb0509af-e198-4cb3-84d4-2e4ed98b50f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:01.837217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb0509af-e198-4cb3-84d4-2e4ed98b50f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:01.838434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb0509af-e198-4cb3-84d4-2e4ed98b50f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:01.985560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb0509af-e198-4cb3-84d4-2e4ed98b50f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Going to try to start instance {{(pid=125965) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:04:02.137107 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb0509af-e198-4cb3-84d4-2e4ed98b50f6 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.325161 Jul 14 15:04:02.139064 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2289/4442] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:01 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:04:02.162729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:02.164366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:02.191030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:02.192041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:02.193071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:02.193744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:02.627696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:02.645060 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8471ea7-b181-47bd-8175-f1c7d91333a6 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 1.688517 Jul 14 15:04:02.646151 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2154/4443] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:00 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 1691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:02.684270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:02.696321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:02.718882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:02.720407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:02.722398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:02.724557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:02.910419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:02.928217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b25792f-5442-4d43-bb8a-c49a9d494578 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.787476 Jul 14 15:04:02.928846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2290/4444] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:02 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:02.949871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:02.950422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:02.965319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:02.966065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:02.967097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:02.967748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.028383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lazy-loading 'flavor' on Instance uuid 08db0802-63ba-402b-bb7d-d3f69d1d9a18 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:03.119935 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b1f33fc1-c126-4924-b362-5528b9eae10a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 202 len: 0 microversion: 2.1 time: 0.174669 Jul 14 15:04:03.121872 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2291/4445] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:02 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:04:03.133432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:03.134588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:03.146971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.148128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.150212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.151241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.580284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:03.593777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7bd4d965-ce36-46c1-ae32-36fa81fb6a64 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1665 microversion: 2.1 time: 0.916420 Jul 14 15:04:03.604999 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2155/4446] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:02 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1665 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:03.615101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0bb795f9-9460-4ff0-8be8-b6192d70c312 req-c904868a-1ae0-4881-a251-68d1c2a1f715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51557a8c-2075-4079-9f26-fd2410f3565b", "name": "network-vif-plugged", "status": "completed", "tag": "26c4bb8b-39e5-4495-a2eb-c11bec7c032d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:03.632408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0bb795f9-9460-4ff0-8be8-b6192d70c312 req-c904868a-1ae0-4881-a251-68d1c2a1f715 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.633666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0bb795f9-9460-4ff0-8be8-b6192d70c312 req-c904868a-1ae0-4881-a251-68d1c2a1f715 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.649293 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0bb795f9-9460-4ff0-8be8-b6192d70c312 req-c904868a-1ae0-4881-a251-68d1c2a1f715 service nova] Creating event network-vif-plugged:26c4bb8b-39e5-4495-a2eb-c11bec7c032d for instance 51557a8c-2075-4079-9f26-fd2410f3565b on n-h2-768852-23 Jul 14 15:04:03.655682 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0bb795f9-9460-4ff0-8be8-b6192d70c312 req-c904868a-1ae0-4881-a251-68d1c2a1f715 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047972 Jul 14 15:04:03.657276 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2156/4447] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:03.682419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:03.690963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:03.702543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.702994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.706772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:03.710064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:03.921787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:03.947174 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c74e277-f197-4b30-ad8c-a8fbe0dff214 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1514 microversion: 2.1 time: 0.817935 Jul 14 15:04:03.952465 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2292/4448] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:03 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1514 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:04.269087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:04.381315 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25468da5-3113-41c6-8757-06ae82bd846e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 0.696265 Jul 14 15:04:04.390898 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2157/4449] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:03 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:04.616181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:04.617291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:04.645248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:04.646025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:04.647343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:04.648073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:04.978942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:04.992468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:05.005766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:05.016702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:05.018148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:05.019102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:05.634122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:05.650350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c0c2fd50-1948-4a83-805b-75adab9294c8 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1497 microversion: 2.1 time: 0.678127 Jul 14 15:04:05.650981 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2158/4450] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:04 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1497 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:05.661413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:05.662049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:05.677407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:05.677908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:05.678954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:05.679504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:05.687461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:05.944345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:05.954755 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52b51467-7184-4e8e-8050-07935ccaaafa tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1665 microversion: 2.1 time: 1.345766 Jul 14 15:04:05.971250 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2293/4451] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:04 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1665 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:05.978387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:05.979543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:06.001423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.003797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:06.007614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.009889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:06.064806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lazy-loading 'flavor' on Instance uuid 08db0802-63ba-402b-bb7d-d3f69d1d9a18 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:06.093272 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'suspend' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state suspended Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 15 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: {"suspend": {}} Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'suspend' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state suspended Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'suspend': {}}} Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state suspended. Cannot suspend while the instance is in this state. Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Jul 14 15:04:06.095523 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state suspended Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state suspended Jul 14 15:04:06.100599 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:06.103926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'suspend' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state suspended {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:06.108963 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b0b92e8c-b4da-42ca-be43-afe952466c4f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 148 microversion: 2.1 time: 0.132258 Jul 14 15:04:06.110858 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2294/4452] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:05 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 148 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:04:06.131868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:06.133661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:06.147595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.148894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:06.153124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.153969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:06.458238 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-629bc8aa-b2a0-4f3d-a6b8-8e57b09b3858 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 202 len: 0 microversion: 2.1 time: 0.339787 Jul 14 15:04:06.460157 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2295/4453] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:06 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:04:06.479420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:06.484015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:06.500928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.501825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:06.502986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:06.503691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:07.195311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:07.205480 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-52cd4e06-5c06-45f9-9453-806619a44cfb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1314 microversion: 2.1 time: 1.553304 Jul 14 15:04:07.214105 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2159/4454] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:05 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1314 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:07.229297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:07.237994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:07.268557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:07.269019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:07.269890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:07.270342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:08.134723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:08.156254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:08.160733 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c71b60a6-3c98-4b48-bca4-805fed7ac038 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1503 microversion: 2.1 time: 1.694916 Jul 14 15:04:08.162456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2296/4455] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:06 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1503 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:08.241892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:08.245222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:08.268207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:08.302223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:08.325760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:08.332432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:08.334113 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41a5821f-b20d-4262-aa1d-a2fefb916d92 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1665 microversion: 2.1 time: 1.114938 Jul 14 15:04:08.347537 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2160/4456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:07 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1665 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:08.347804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.183094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:09.183777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:09.196318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.197102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.198094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.199252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.446649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:09.501515 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ed39d93-3ca3-4234-a530-6d47fc18c43f tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1501 microversion: 2.1 time: 1.266366 Jul 14 15:04:09.510269 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2297/4457] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:08 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1501 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:09.544802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:09.548526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:09.581805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.583808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.585307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.586419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.947301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:09.967027 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3b66748-fa43-4427-a560-d2026d7637d1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1503 microversion: 2.1 time: 0.788117 Jul 14 15:04:09.968431 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2161/4458] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:09 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1503 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:09.985141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:09.986020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:09.997022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.997829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:09.998855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:09.999571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:10.046342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'flavor' on Instance uuid 51557a8c-2075-4079-9f26-fd2410f3565b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:10.306445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2bf164d7-4cf8-4bc8-af51-dda3744ab0f1 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "POST /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b/action" status: 202 len: 0 microversion: 2.1 time: 0.335999 Jul 14 15:04:10.324786 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2162/4459] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:09 2022] POST /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:04:10.352955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:10.356205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:10.369730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:10.373904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:10.374885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:10.375495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:10.491911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:10.509949 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29b8c3a1-3fbd-466f-982a-43cdd66b167f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.996650 Jul 14 15:04:10.512912 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2298/4460] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:09 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:10.548473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:10.558116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:10.584632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:10.585736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:10.587624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:10.588986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:11.092241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:11.117336 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4f2972a3-f4fa-4d92-bd17-4745597a67ac tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.578073 Jul 14 15:04:11.118463 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2299/4461] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:10 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:11.128760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:11.130278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:11.149663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:11.150809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:11.160986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:11.171110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:11.555483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:11.572231 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d32ce6c3-15cb-4916-8b39-666f06e0954a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1509 microversion: 2.1 time: 1.239797 Jul 14 15:04:11.589959 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2163/4462] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:10 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1509 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:11.589959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:11.589959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:11.598388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:11.598849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:11.599684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:11.600127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:11.850781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:11.874840 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7a7f17ad-bd72-4935-8363-09d393903998 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1503 microversion: 2.1 time: 0.753595 Jul 14 15:04:11.876845 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2300/4463] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:11 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1503 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:12.456552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:12.471561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62eb78e0-0c7e-4f21-a17f-9013ad67a911 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.892744 Jul 14 15:04:12.472661 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2164/4464] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:11 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:12.506649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:12.516406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:12.534685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:12.536017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:12.537678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:12.542046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:12.602661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:12.604652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:12.636695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:12.637816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:12.640440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:12.641525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:12.965596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:12.978859 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07354889-c0a7-4ad9-bb56-e1141b27f18c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.478193 Jul 14 15:04:12.981828 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2301/4465] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:12 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:13.005621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:13.010900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:13.037117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.038168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.039382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.040059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.655480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:13.669036 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5dd47465-eff9-43aa-b399-7ec975f686d4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.685025 Jul 14 15:04:13.675182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2302/4466] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:12 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:13.856802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:13.932371 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ddf90584-e810-4d6d-8ca8-8b736b7fd1b8 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1492 microversion: 2.1 time: 1.335688 Jul 14 15:04:13.959388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2165/4467] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:12 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1492 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:13.974144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:13.976115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:13.988838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.992943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:13.994873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:13.996324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:14.662009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:14.672783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:14.692771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:14.693559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:14.695781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:14.696243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:14.929469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:14.947077 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-552f1065-49d7-4b48-be45-19203798dd83 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.985585 Jul 14 15:04:14.947884 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2166/4468] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:13 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:14.960349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:14.960349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:14.976296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:14.976787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:14.977618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:14.978323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.046107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:15.234603 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-baef23e9-ac44-498c-811e-b7969838f24d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 204 len: 0 microversion: 2.1 time: 0.285174 Jul 14 15:04:15.238259 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2167/4469] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:14 2022] DELETE /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:04:15.252192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90f67172-79c5-45cf-a93b-04180292799d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:15.252922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-90f67172-79c5-45cf-a93b-04180292799d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: c26ed397-513c-4743-a61e-395ca8677eb4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:15.272596 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-90f67172-79c5-45cf-a93b-04180292799d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance c26ed397-513c-4743-a61e-395ca8677eb4 could not be found. Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90f67172-79c5-45cf-a93b-04180292799d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/c26ed397-513c-4743-a61e-395ca8677eb4/action HTTP/1.1 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 15 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: {"unpause": {}} Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c26ed397-513c-4743-a61e-395ca8677eb4 could not be found. Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c26ed397-513c-4743-a61e-395ca8677eb4', 'body': {'unpause': {}}} Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c26ed397-513c-4743-a61e-395ca8677eb4 could not be found. Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c26ed397-513c-4743-a61e-395ca8677eb4 could not be found. Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:15.274771 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:15.281013 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:15.281013 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:15.281013 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c26ed397-513c-4743-a61e-395ca8677eb4 could not be found. Jul 14 15:04:15.281013 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:15.281013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90f67172-79c5-45cf-a93b-04180292799d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance c26ed397-513c-4743-a61e-395ca8677eb4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:15.281013 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-90f67172-79c5-45cf-a93b-04180292799d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/c26ed397-513c-4743-a61e-395ca8677eb4/action" status: 404 len: 111 microversion: 2.1 time: 0.039529 Jul 14 15:04:15.283723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2168/4470] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:15 2022] POST /compute/v2.1/servers/c26ed397-513c-4743-a61e-395ca8677eb4/action => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:15.295744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:15.296382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:15.314625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:15.315090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.315950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:15.316697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.769051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:15.782448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a434030-4e0e-4525-9477-690ee7b2ee57 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1498 microversion: 2.1 time: 0.497487 Jul 14 15:04:15.783387 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2169/4471] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:15 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1498 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:15.790766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:15.791950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:15.809938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:15.810984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:15.815929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:15.821880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.291423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:16.323493 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-84460407-5f0c-42b3-a4df-05f642080413 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.536339 Jul 14 15:04:16.327251 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2170/4472] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:15 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:16.359394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:16.364281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:16.380969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.382169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.389707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.391026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.833267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:16.879865 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-995f7bbf-bef5-464e-a697-cf4103ce2f1e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 3.202977 Jul 14 15:04:16.895367 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2303/4473] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:13 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 3209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:16.895367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:16.895367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:16.920215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.920868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:16.923088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:16.927471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.589872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:17.628305 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6821229a-8a19-4c2a-bea1-a6103b5c9ea1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.280809 Jul 14 15:04:17.647765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2171/4474] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:16 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:17.677186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:17.678629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:17.705733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.710541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.716265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.717122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.750500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:17.781004 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25c584ae-76ff-44b6-927f-20398e556119 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1498 microversion: 2.1 time: 0.887191 Jul 14 15:04:17.784076 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2304/4475] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:16 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1498 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:17.809092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:17.810169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:17.832305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lazy-loading 'flavor' on Instance uuid 17571f24-33af-4696-bb50-4e9f14a6cc96 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:17.843575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.847037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.851867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:17.854403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:17.939065 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'unpause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 15 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: {"unpause": {}} Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'unpause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'unpause': {}}} Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state active. Cannot unpause while the instance is in this state. Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:17.944242 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:17.956364 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:17.956364 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:17.956364 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:17.956364 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:17.956364 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:17.956364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'unpause' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:17.959418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee08550b-c3c3-403e-8187-d728161850bf tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 145 microversion: 2.1 time: 0.173327 Jul 14 15:04:17.962833 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2305/4476] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:17 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 145 bytes in 178 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:04:17.980945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:17.988604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:18.002772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:18.004560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:18.007797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:18.009142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:18.012997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:18.062861 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2ffb76c1-58a0-451d-99eb-03a10dc778a0 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.404696 Jul 14 15:04:18.065603 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2172/4477] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:17 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:04:18.083096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:18.085962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:18.106562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:18.112474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:18.116349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:18.117794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:18.886207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:18.933983 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-84b99ed5-b845-47cf-b731-78df267f1e49 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1677 microversion: 2.1 time: 0.857967 Jul 14 15:04:18.942486 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2173/4478] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:18 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1677 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:18.981178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:18.992412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:19.020611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:19.021793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:19.023448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:19.025690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:19.364642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:19.379165 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ae152e4-073a-404c-b2a9-b3f5fe33132d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.410073 Jul 14 15:04:19.402115 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2306/4479] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:17 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:19.438721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:19.445275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:19.466943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:19.472470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:19.474496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:19.478309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.180224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:20.197277 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68c39889-d58f-418d-b29f-cc967c0b9d2e tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1498 microversion: 2.1 time: 1.248724 Jul 14 15:04:20.197892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2174/4480] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:18 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1498 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:20.214843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:20.222748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:20.262754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.263520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.264589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.265236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.645235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:20.662098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac2d32e3-3993-401b-a661-4165e707d41d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.230566 Jul 14 15:04:20.663436 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2307/4481] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:19 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:20.693442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a43eee1-b2e8-4c6e-8786-b8b916375fe4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:20.694614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a43eee1-b2e8-4c6e-8786-b8b916375fe4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: b94320ac-be38-4aa7-ba84-4c609e930a6f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:20.709681 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-9a43eee1-b2e8-4c6e-8786-b8b916375fe4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance b94320ac-be38-4aa7-ba84-4c609e930a6f could not be found. Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a43eee1-b2e8-4c6e-8786-b8b916375fe4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/b94320ac-be38-4aa7-ba84-4c609e930a6f/action HTTP/1.1 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 18 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: {"unshelve": null} Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b94320ac-be38-4aa7-ba84-4c609e930a6f could not be found. Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b94320ac-be38-4aa7-ba84-4c609e930a6f', 'body': {'unshelve': None}} Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b94320ac-be38-4aa7-ba84-4c609e930a6f could not be found. Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 94, in _unshelve Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b94320ac-be38-4aa7-ba84-4c609e930a6f could not be found. Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:20.712826 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:20.718008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:20.718008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:20.718008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:20.718008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b94320ac-be38-4aa7-ba84-4c609e930a6f could not be found. Jul 14 15:04:20.718008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:20.723309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a43eee1-b2e8-4c6e-8786-b8b916375fe4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance b94320ac-be38-4aa7-ba84-4c609e930a6f could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:20.724537 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a43eee1-b2e8-4c6e-8786-b8b916375fe4 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/b94320ac-be38-4aa7-ba84-4c609e930a6f/action" status: 404 len: 111 microversion: 2.1 time: 0.035766 Jul 14 15:04:20.725740 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2308/4482] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:20 2022] POST /compute/v2.1/servers/b94320ac-be38-4aa7-ba84-4c609e930a6f/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:20.736803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:20.737860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:20.758618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.763111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:20.764550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:20.767536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.133758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:21.147944 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c43d483-02d1-4e2c-9032-228d6cacfeba tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1660 microversion: 2.1 time: 0.937785 Jul 14 15:04:21.164347 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2175/4483] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:20 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1660 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:21.170162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6a3056f4-651c-4260-929f-4b6f37aed0fd req-58a29b12-abd1-42f6-b2bc-3812ea3fe8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51557a8c-2075-4079-9f26-fd2410f3565b", "name": "network-vif-deleted", "tag": "26c4bb8b-39e5-4495-a2eb-c11bec7c032d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:21.213277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a3056f4-651c-4260-929f-4b6f37aed0fd req-58a29b12-abd1-42f6-b2bc-3812ea3fe8b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.214051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a3056f4-651c-4260-929f-4b6f37aed0fd req-58a29b12-abd1-42f6-b2bc-3812ea3fe8b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.251326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6a3056f4-651c-4260-929f-4b6f37aed0fd req-58a29b12-abd1-42f6-b2bc-3812ea3fe8b1 service nova] Creating event network-vif-deleted:26c4bb8b-39e5-4495-a2eb-c11bec7c032d for instance 51557a8c-2075-4079-9f26-fd2410f3565b on n-h2-768852-23 Jul 14 15:04:21.259205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6a3056f4-651c-4260-929f-4b6f37aed0fd req-58a29b12-abd1-42f6-b2bc-3812ea3fe8b1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093411 Jul 14 15:04:21.267304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2176/4484] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:21.280053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:21.281212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:21.298593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.299069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.302013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.309431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.488891 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-58a21db3-75e1-46d9-8141-7f4c0e4995bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action" status: 202 len: 0 microversion: 2.1 time: 0.217173 Jul 14 15:04:21.490430 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2177/4485] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:21 2022] POST /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:04:21.510817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:21.523058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:21.544620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.547144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.548018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.550586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.593691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:21.598264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:21.599884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lazy-loading 'fault' on Instance uuid 51557a8c-2075-4079-9f26-fd2410f3565b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:22.116412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:22.169583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '520cc191a5b24d52b73ad4c0c5d4e9a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b25ee6783ea3416dbef5c8ae62244367', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:22.215754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-673f3e4a-3008-404d-a2a3-874245ead19b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.469120 Jul 14 15:04:22.224199 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80142dde-5d46-41b9-9b1d-87e7a95cfddb tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 200 len: 1304 microversion: 2.1 time: 0.722224 Jul 14 15:04:22.225757 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2309/4486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:20 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:22.227447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2178/4487] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:21 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 1304 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:22.255615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:22.259889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:22.262004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:22.263176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:22.280097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.280557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.281366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.281806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.291130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.292170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:22.294406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:22.296801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.111086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:23.151011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4276dc2a-80f9-4fa3-976e-364982104a60 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1666 microversion: 2.1 time: 0.921734 Jul 14 15:04:23.177728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2310/4488] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:22 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1666 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:23.235848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:23.256618 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ce56d503-f2ab-478b-bcb2-c22bdcf1209f tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.004279 Jul 14 15:04:23.257324 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2179/4489] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:22 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:23.265695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.267062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.295876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:23.298101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.306677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.308922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.310719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.316238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.316702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.317884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.318848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.319335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.378115 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Cannot 'unshelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:23.381336 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b HTTP/1.1 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '51557a8c-2075-4079-9f26-fd2410f3565b'} Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.389851 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.397496 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action HTTP/1.1 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 18 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: {"unshelve": null} Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot 'unshelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'unshelve': None}} Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 105, in _unshelve Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve(context, instance, new_az=new_az) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 in vm_state active. Cannot unshelve while the instance is in this state. Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 111, in _unshelve Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:23.398439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 409 to user: Cannot 'unshelve' instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 while it is in vm_state active {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e317a116-c8a2-483d-b187-2a65bd41fad6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action" status: 409 len: 146 microversion: 2.1 time: 0.110589 Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2180/4490] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:04:23 2022] POST /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18/action => generated 146 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.409032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.415375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:23.415375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-273158fb-013a-4aec-a3ed-cf627daf9188 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 404 len: 111 microversion: 2.1 time: 0.170820 Jul 14 15:04:23.418987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.419475 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2311/4491] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:23 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 111 bytes in 177 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:23.419670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.428361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.428827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.437639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.442019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.491693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.493289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.502587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.508615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.601967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b HTTP/1.1 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '51557a8c-2075-4079-9f26-fd2410f3565b'} Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:23.614170 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.621897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:23.624495 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b83791e8-2eab-4cbb-b14e-26081c5a481d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 404 len: 111 microversion: 2.1 time: 0.185451 Jul 14 15:04:23.627927 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2312/4492] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:23 2022] DELETE /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:23.633614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.638235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 51557a8c-2075-4079-9f26-fd2410f3565b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.659139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.659139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.666718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.667813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.705385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b HTTP/1.1 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '51557a8c-2075-4079-9f26-fd2410f3565b'} Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.707034 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 51557a8c-2075-4079-9f26-fd2410f3565b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-18c79b75-5c60-4313-9cbc-b7df34c80499 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b" status: 404 len: 111 microversion: 2.1 time: 0.079680 Jul 14 15:04:23.711183 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2313/4493] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:23 2022] GET /compute/v2.1/servers/51557a8c-2075-4079-9f26-fd2410f3565b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:23.723381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.723893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.768592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.769722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.782250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.793953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.825995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b HTTP/1.1 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'aff48218-e3d8-4af5-98f1-1ecb8beda66b'} Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:23.827759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21482311-825f-4595-9dc0-5474f7216ec7 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 404 len: 111 microversion: 2.1 time: 0.110145 Jul 14 15:04:23.836175 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2314/4494] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:23 2022] DELETE /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:23.842220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.842859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: aff48218-e3d8-4af5-98f1-1ecb8beda66b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.867009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.867761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.868983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.869803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.905773 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b HTTP/1.1 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'aff48218-e3d8-4af5-98f1-1ecb8beda66b'} Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:23.908141 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. Jul 14 15:04:23.912947 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:23.914421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance aff48218-e3d8-4af5-98f1-1ecb8beda66b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:23.915556 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37fff3bf-9c85-4a59-8e2a-b279c2b91f02 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b" status: 404 len: 111 microversion: 2.1 time: 0.078469 Jul 14 15:04:23.916638 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2315/4495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:23 2022] GET /compute/v2.1/servers/aff48218-e3d8-4af5-98f1-1ecb8beda66b => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:23.937698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:23.945167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:23.981583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.984346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:23.991724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:23.996620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.038771 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd HTTP/1.1 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f2b31260-a777-4511-a2cc-29a79bc4b3dd'} Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:24.040592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f093a11c-bd99-46d4-83ba-95e29c66f2fe tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 404 len: 111 microversion: 2.1 time: 0.117534 Jul 14 15:04:24.051837 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2316/4496] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:23 2022] DELETE /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:24.063664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.064560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: f2b31260-a777-4511-a2cc-29a79bc4b3dd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.072532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.072980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.079961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.081879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.121760 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd HTTP/1.1 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f2b31260-a777-4511-a2cc-29a79bc4b3dd'} Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.132400 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance f2b31260-a777-4511-a2cc-29a79bc4b3dd could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69c637e6-5c91-459f-a53b-a6191f3cec8d tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd" status: 404 len: 111 microversion: 2.1 time: 0.083724 Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2317/4497] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/f2b31260-a777-4511-a2cc-29a79bc4b3dd => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.147455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.197718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.204639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.207418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.208672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.287061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 HTTP/1.1 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c372e22e-af4d-4781-9aae-f08c221d7430'} Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:24.293247 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:24.305150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29fa3b62-cdf5-4226-9928-ea9d22245cac tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 404 len: 111 microversion: 2.1 time: 0.163763 Jul 14 15:04:24.310174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2318/4498] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:24 2022] DELETE /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:24.320247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.322150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.330569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.331339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.331921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:24.332767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.332767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.363149 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a95c9787-342e-4b8a-93f0-bf3d96db0940 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.962164 Jul 14 15:04:24.367473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2181/4499] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:23 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:24.378217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.381267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: c372e22e-af4d-4781-9aae-f08c221d7430] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.416935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.423008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.427159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.429188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.480571 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 HTTP/1.1 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'c372e22e-af4d-4781-9aae-f08c221d7430'} Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.487997 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance c372e22e-af4d-4781-9aae-f08c221d7430 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:24.492169 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4152884-c2e1-4def-86f4-6e511ef8de65 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430" status: 404 len: 111 microversion: 2.1 time: 0.121262 Jul 14 15:04:24.493043 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2182/4500] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/c372e22e-af4d-4781-9aae-f08c221d7430 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:24.509732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.515636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.532989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.534560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.536351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.537737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.702659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:24.723122 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02a4c540-545f-48ed-958c-f938c5d25989 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1666 microversion: 2.1 time: 0.411251 Jul 14 15:04:24.724717 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2319/4501] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1666 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:24.730754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.733281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.753524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.756523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.765902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.767308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.787725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:24.838306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 HTTP/1.1 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64111e67-b57b-4a66-9440-5befb8d66da4'} Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:24.842608 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:24.855753 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc51c8fd-b1eb-43ad-9584-e7aa2ee5df06 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4" status: 404 len: 111 microversion: 2.1 time: 0.125051 Jul 14 15:04:24.858615 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2320/4502] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:24 2022] DELETE /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:24.865715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:24.866593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 64111e67-b57b-4a66-9440-5befb8d66da4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:24.873736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.874308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.875200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:24.875809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:24.912626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 HTTP/1.1 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64111e67-b57b-4a66-9440-5befb8d66da4'} Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:24.920182 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 64111e67-b57b-4a66-9440-5befb8d66da4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:24.934369 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee2a22be-52fe-43f0-ba63-4c7e0778a717 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4" status: 404 len: 111 microversion: 2.1 time: 0.067064 Jul 14 15:04:24.936987 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2321/4503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/64111e67-b57b-4a66-9440-5befb8d66da4 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:25.760926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:25.762078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:25.798454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:25.799250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:25.811386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:25.813872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:26.057379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:26.077613 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f54a95cf-4f43-4686-a686-77ce6d7291fc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.582434 Jul 14 15:04:26.083126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2183/4504] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:24 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:26.103331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cfdd6dd-bdca-4b76-b42f-21fbf9e54663 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673739214_updated"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:26.114435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3cfdd6dd-bdca-4b76-b42f-21fbf9e54663 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 63b93801-b4e8-4d69-b2c8-ea8071700a20] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:26.136070 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3cfdd6dd-bdca-4b76-b42f-21fbf9e54663 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 63b93801-b4e8-4d69-b2c8-ea8071700a20 could not be found. Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cfdd6dd-bdca-4b76-b42f-21fbf9e54663 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/servers/63b93801-b4e8-4d69-b2c8-ea8071700a20 HTTP/1.1 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 81 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1673739214_updated"}} Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 63b93801-b4e8-4d69-b2c8-ea8071700a20 could not be found. Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '63b93801-b4e8-4d69-b2c8-ea8071700a20', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1673739214_updated'}}} Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63b93801-b4e8-4d69-b2c8-ea8071700a20 could not be found. Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 917, in update Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Jul 14 15:04:26.141410 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63b93801-b4e8-4d69-b2c8-ea8071700a20 could not be found. Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63b93801-b4e8-4d69-b2c8-ea8071700a20 could not be found. Jul 14 15:04:26.145812 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:26.149415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cfdd6dd-bdca-4b76-b42f-21fbf9e54663 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 63b93801-b4e8-4d69-b2c8-ea8071700a20 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:26.152178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3cfdd6dd-bdca-4b76-b42f-21fbf9e54663 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "PUT /compute/v2.1/servers/63b93801-b4e8-4d69-b2c8-ea8071700a20" status: 404 len: 111 microversion: 2.1 time: 0.057781 Jul 14 15:04:26.158486 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2184/4505] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 15:04:26 2022] PUT /compute/v2.1/servers/63b93801-b4e8-4d69-b2c8-ea8071700a20 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:26.174728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:26.175890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:26.198136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:26.198846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:26.200144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:26.202778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:26.902560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:26.922665 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7addc43b-666b-4058-bcb6-7858cd91db08 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 1.171762 Jul 14 15:04:26.924036 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2322/4506] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:25 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:26.954710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:26.955728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:26.973302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:26.975297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:26.982967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:26.983894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.094223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:27.119313 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d5321dc-8ce1-4422-8646-a42fcf697163 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.958635 Jul 14 15:04:27.138368 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2185/4507] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:26 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:27.163038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:27.170260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:27.196405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.197253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.198560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.207468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.738692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:27.753750 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4039a9a-5df7-4ffe-b2a9-1b6687d662fb tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1669 microversion: 2.1 time: 0.804060 Jul 14 15:04:27.757509 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2323/4508] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:26 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1669 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:27.788997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:27.790119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:27.794106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=76 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:27.813369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.815802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.816845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:27.820478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:27.890281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:27.915510 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.compute.api [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Working on deleting snapshot a6f05131-f2a4-4baa-bc7a-79d8b13239d7 from shelved instance... Jul 14 15:04:29.310517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:29.355429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8af6a261-1f03-4aae-adcb-3d5a362cea3e tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 2.201669 Jul 14 15:04:29.357110 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2186/4509] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:27 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 2206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:29.365839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Doing local delete in cell 851d78d8-3f11-4b86-a356-449411903277(cell1) {{(pid=125965) _delete /opt/stack/nova/nova/compute/api.py:2489}} Jul 14 15:04:29.366864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.368068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.369147 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.compute.api [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Jul 14 15:04:29.374575 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [c943a4f5-696c-4c72-ae35-41046e16efdf] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:04:29.380477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fa60f4ff-fe42-4823-b3e4-f0979097f929 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fa60f4ff-fe42-4823-b3e4-f0979097f929 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 HTTP/1.1 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 280 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:29.396025 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fa60f4ff-fe42-4823-b3e4-f0979097f929 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fa60f4ff-fe42-4823-b3e4-f0979097f929 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "PUT /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 400 len: 619 microversion: 2.1 time: 0.025845 Jul 14 15:04:29.404244 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2187/4510] 10.222.0.98 () {60 vars in 1256 bytes} [Thu Jul 14 15:04:29 2022] PUT /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:04:29.427821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:29.428995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:29.452236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.452955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:29.454448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:29.455237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:30.393934 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [c943a4f5-696c-4c72-ae35-41046e16efdf] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 59636. Jul 14 15:04:30.416725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] deallocate_for_instance() {{(pid=125965) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Jul 14 15:04:30.525539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:30.549066 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8f737bf1-a588-432d-bdb6-1d545087cc7b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.143386 Jul 14 15:04:30.555553 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2188/4511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:29 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:30.570084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:30.571041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:30.589466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:30.622319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:30.623766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:30.625695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:30.632568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:31.345090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:31.365015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b439873b-8b6f-4036-94bb-ecd25083431d tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 0.796327 Jul 14 15:04:31.367263 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2189/4512] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:30 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:31.405431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab440c80-5049-499b-8984-85c1670816ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab440c80-5049-499b-8984-85c1670816ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: request: PUT /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 HTTP/1.1 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 24 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: {"server": {"name": ""}} Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute name. Value: . '' is too short Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18', 'body': {'server': {'name': ''}}} Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '' Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:04:31.424803 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab440c80-5049-499b-8984-85c1670816ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:31.433372 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab440c80-5049-499b-8984-85c1670816ba tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "PUT /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 400 len: 108 microversion: 2.1 time: 0.049618 Jul 14 15:04:31.443834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2190/4513] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 15:04:31 2022] PUT /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 108 bytes in 65 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:04:31.464485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:31.468785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:31.499753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:31.501593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:31.503751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:31.512842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:32.461071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:32.465445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:32.476376 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a448ced-79e8-4958-89f8-4465d6531d0b tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1506 microversion: 2.1 time: 1.026681 Jul 14 15:04:32.491471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2191/4514] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:31 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1506 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:33.261956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:33.265576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:33.318974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.320904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.322443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Updating instance_info_cache with network_info: [] {{(pid=125965) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Jul 14 15:04:33.324639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.326981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.376677 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 HTTP/1.1 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69'} Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:33.385359 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.389631 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.392166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:33.393879 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3abec41-6a1d-458e-ac82-20d6af864a29 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 404 len: 111 microversion: 2.1 time: 0.138152 Jul 14 15:04:33.395964 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2192/4515] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:33 2022] DELETE /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:33.685728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5048cbe2-054b-411e-b3dd-d62c1f15cdf6 req-2a800f01-f9ce-4284-9393-fd2ae3909c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ea39b46-63af-47dd-9418-da1c52b398dc", "name": "network-vif-deleted", "tag": "09e680a6-ed0c-4c35-985a-f96d1bb20796"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:33.700251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5048cbe2-054b-411e-b3dd-d62c1f15cdf6 req-2a800f01-f9ce-4284-9393-fd2ae3909c48 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.709505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5048cbe2-054b-411e-b3dd-d62c1f15cdf6 req-2a800f01-f9ce-4284-9393-fd2ae3909c48 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.753882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.compute.server_external_events [req-5048cbe2-054b-411e-b3dd-d62c1f15cdf6 req-2a800f01-f9ce-4284-9393-fd2ae3909c48 service nova] Unable to find a host for instance 0ea39b46-63af-47dd-9418-da1c52b398dc. Dropping event network-vif-deleted {{(pid=125966) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 15:04:33.761483 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5048cbe2-054b-411e-b3dd-d62c1f15cdf6 req-2a800f01-f9ce-4284-9393-fd2ae3909c48 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.358216 Jul 14 15:04:33.763357 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2193/4516] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 367 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 15:04:33.781938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:33.786791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:33.808083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.813017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.816596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.817173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.872513 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 HTTP/1.1 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69'} Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:33.877873 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d59d5e2b-397e-448a-8317-dd72e0db007a tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69" status: 404 len: 111 microversion: 2.1 time: 0.114761 Jul 14 15:04:33.890628 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2194/4517] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:33 2022] GET /compute/v2.1/servers/b01ebbdb-ef49-4871-9d7c-c7d3c94f6b69 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:33.896308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:33.896813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:33.938004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.938573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:33.941675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:33.942217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.016495 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 HTTP/1.1 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '72b949c7-a5f4-4a10-8fa2-f66abc9711f6'} Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:34.029677 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.033943 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.041353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:34.050405 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a3c0326-6be5-49f7-a05c-abba30c55b64 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "DELETE /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 404 len: 111 microversion: 2.1 time: 0.158252 Jul 14 15:04:34.060209 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2195/4518] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:33 2022] DELETE /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:34.088317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:34.091230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] [instance: 72b949c7-a5f4-4a10-8fa2-f66abc9711f6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:34.136671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.137581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.139373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.147368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.203669 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] HTTP exception thrown: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Request method failure captured: Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 HTTP/1.1 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C7Rm-ALKGvUr38DQNzqKs9UsCBAD-vDVamL3Gj32OHgYBfi2bnr-RymCG9r0l29sGqSIcZWK6-18-PP13HWOUZXyg-Qzu0Pbm41wVO9m6Fy4PIyjGb1q3UEMECS7pG8oD6bKXMw3dt8rrori0KLW4I1SO2WmgsHje5o4IRNLyM3WV0 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b25ee6783ea3416dbef5c8ae62244367"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b25ee6783ea3416dbef5c8ae62244367 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1398926412 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 520cc191a5b24d52b73ad4c0c5d4e9a6 Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1398926412-project Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '72b949c7-a5f4-4a10-8fa2-f66abc9711f6'} Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:34.215325 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] Returning 404 to user: Instance 72b949c7-a5f4-4a10-8fa2-f66abc9711f6 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63e4b4e7-36a3-48f6-b382-d7499375f928 tempest-DeleteServersTestJSON-1398926412 tempest-DeleteServersTestJSON-1398926412-project] 10.222.0.98 "GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6" status: 404 len: 111 microversion: 2.1 time: 0.152279 Jul 14 15:04:34.224281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2196/4519] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:34 2022] GET /compute/v2.1/servers/72b949c7-a5f4-4a10-8fa2-f66abc9711f6 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:34.396350 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e80bd7d1-dd18-4bd4-bfcd-b0af1a708477 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 204 len: 0 microversion: 2.1 time: 6.612270 Jul 14 15:04:34.397383 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2324/4520] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:27 2022] DELETE /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 0 bytes in 6614 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:04:34.412332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:34.429320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 0ea39b46-63af-47dd-9418-da1c52b398dc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:34.491675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.492596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.493620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.494503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.540045 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] HTTP exception thrown: Instance 0ea39b46-63af-47dd-9418-da1c52b398dc could not be found. Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Request method failure captured: Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc HTTP/1.1 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C4ScudS3MixRmsrhjwF4cId0CghiVhli-wiEsml_Rpl-HBWvHt3Ni1QNIWwgCef49tNIWZCwwWsjSSRuw74Udi-GhpdeC_Blh_RvBRlJAXExZBwvrwvIFlIpi9lVZ_gCZC453Axfmt1BcQnZ1z0641qYJy0WHZfkJPu0Kk-ivoHM9w Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 4813aa5acf744a8dac42de00d7e5a519 Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 0ea39b46-63af-47dd-9418-da1c52b398dc could not be found. Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0ea39b46-63af-47dd-9418-da1c52b398dc'} Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ea39b46-63af-47dd-9418-da1c52b398dc could not be found. Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ea39b46-63af-47dd-9418-da1c52b398dc could not be found. Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:34.544875 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ea39b46-63af-47dd-9418-da1c52b398dc could not be found. Jul 14 15:04:34.549876 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:34.552898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Returning 404 to user: Instance 0ea39b46-63af-47dd-9418-da1c52b398dc could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:34.558989 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62075070-476c-4cb6-9a46-339d661a3a83 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc" status: 404 len: 111 microversion: 2.1 time: 0.151010 Jul 14 15:04:34.561387 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2197/4521] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:34 2022] GET /compute/v2.1/servers/0ea39b46-63af-47dd-9418-da1c52b398dc => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:34.574623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:34.575778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:34.599347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.602321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.603824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.605370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.683083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:34.858433 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7247eb4-5ab3-4321-8414-573def8cc4f9 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "DELETE /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 204 len: 0 microversion: 2.1 time: 0.290999 Jul 14 15:04:34.859584 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2325/4522] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:34 2022] DELETE /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:04:34.873531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:34.874216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:34.887591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.888077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:34.893411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:34.893997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:35.594459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:35.609628 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-34777360-b3f1-4945-9b20-96b154d3dc32 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1465 microversion: 2.1 time: 0.743279 Jul 14 15:04:35.614770 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2198/4523] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:34 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1465 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:36.645281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:36.646605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:36.670521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:36.670985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:36.671823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:36.681097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:37.039465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:37.050737 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7621c195-ea62-4331-ae62-3cec6a10a20c tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1465 microversion: 2.1 time: 0.410694 Jul 14 15:04:37.059235 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2326/4524] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:36 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1465 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:38.095444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:38.099026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:38.131123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:38.134840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:38.136459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:38.137797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.656407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-64f6e716-0c77-4be9-b2a7-950fc1f5081f req-9aca1da3-a92f-4e0e-a668-5ded07ac63f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006dc350-9459-42ce-9768-5415a0b2ea0d", "name": "network-vif-unplugged", "status": "completed", "tag": "ccd9c588-2727-4e33-b879-db764864f8bc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:39.681731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-64f6e716-0c77-4be9-b2a7-950fc1f5081f req-9aca1da3-a92f-4e0e-a668-5ded07ac63f1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:39.682726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-64f6e716-0c77-4be9-b2a7-950fc1f5081f req-9aca1da3-a92f-4e0e-a668-5ded07ac63f1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:39.716712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-64f6e716-0c77-4be9-b2a7-950fc1f5081f req-9aca1da3-a92f-4e0e-a668-5ded07ac63f1 service nova] Creating event network-vif-unplugged:ccd9c588-2727-4e33-b879-db764864f8bc for instance 006dc350-9459-42ce-9768-5415a0b2ea0d on n-h2-768852-23 Jul 14 15:04:39.721260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:39.734930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-64f6e716-0c77-4be9-b2a7-950fc1f5081f req-9aca1da3-a92f-4e0e-a668-5ded07ac63f1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082416 Jul 14 15:04:39.738502 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2327/4525] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:04:39.774668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a41b07c4-c49c-4a09-8de6-61440840be26 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1465 microversion: 2.1 time: 1.688903 Jul 14 15:04:39.804891 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2199/4526] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:38 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1465 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:40.812440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:40.813328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:40.846141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:40.849293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:40.850563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:40.853217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:41.196266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7a96f2a0-2966-40e8-aef8-fe5f8d00c884 req-d2b558c3-9321-41fe-b71b-e10e969a0ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "006dc350-9459-42ce-9768-5415a0b2ea0d", "name": "network-vif-deleted", "tag": "ccd9c588-2727-4e33-b879-db764864f8bc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:41.258014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7a96f2a0-2966-40e8-aef8-fe5f8d00c884 req-d2b558c3-9321-41fe-b71b-e10e969a0ae8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:41.258718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7a96f2a0-2966-40e8-aef8-fe5f8d00c884 req-d2b558c3-9321-41fe-b71b-e10e969a0ae8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:41.288550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:41.304405 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d9646f6-91f2-4ef5-82e2-d7fb9e070189 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 200 len: 1465 microversion: 2.1 time: 0.497054 Jul 14 15:04:41.318971 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2328/4527] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:40 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 1465 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:41.324592 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7a96f2a0-2966-40e8-aef8-fe5f8d00c884 req-d2b558c3-9321-41fe-b71b-e10e969a0ae8 service nova] Creating event network-vif-deleted:ccd9c588-2727-4e33-b879-db764864f8bc for instance 006dc350-9459-42ce-9768-5415a0b2ea0d on n-h2-768852-23 Jul 14 15:04:41.341971 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7a96f2a0-2966-40e8-aef8-fe5f8d00c884 req-d2b558c3-9321-41fe-b71b-e10e969a0ae8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149707 Jul 14 15:04:41.345522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2200/4528] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:04:42.355583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:42.357167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 006dc350-9459-42ce-9768-5415a0b2ea0d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:42.378085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.378985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:42.394716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.395780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:42.474220 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] HTTP exception thrown: Instance 006dc350-9459-42ce-9768-5415a0b2ea0d could not be found. Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Request method failure captured: Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d HTTP/1.1 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4ScudS3MixRmsrhjwF4cId0CghiVhli-wiEsml_Rpl-HBWvHt3Ni1QNIWwgCef49tNIWZCwwWsjSSRuw74Udi-GhpdeC_Blh_RvBRlJAXExZBwvrwvIFlIpi9lVZ_gCZC453Axfmt1BcQnZ1z0641qYJy0WHZfkJPu0Kk-ivoHM9w Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4813aa5acf744a8dac42de00d7e5a519 Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 006dc350-9459-42ce-9768-5415a0b2ea0d could not be found. Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '006dc350-9459-42ce-9768-5415a0b2ea0d'} Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 006dc350-9459-42ce-9768-5415a0b2ea0d could not be found. Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 006dc350-9459-42ce-9768-5415a0b2ea0d could not be found. Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:42.487101 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 006dc350-9459-42ce-9768-5415a0b2ea0d could not be found. Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Returning 404 to user: Instance 006dc350-9459-42ce-9768-5415a0b2ea0d could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:42.499468 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d8d55b71-4c56-42a4-959e-8b2179d14af1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d" status: 404 len: 111 microversion: 2.1 time: 0.155237 Jul 14 15:04:42.502476 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2329/4529] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:42 2022] GET /compute/v2.1/servers/006dc350-9459-42ce-9768-5415a0b2ea0d => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:42.517176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:42.521682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:42.543780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.546150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:42.552272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.553890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:42.647740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:42.926185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd14c42e-9f2d-498d-abbe-be0ff62e5ef7 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "DELETE /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 204 len: 0 microversion: 2.1 time: 0.420773 Jul 14 15:04:42.928180 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2201/4530] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:42 2022] DELETE /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:04:42.939882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:42.941530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:42.950461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.950920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:42.951852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:42.952668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.207060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:43.221527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:43.222889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:43.235743 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0fc0b119-345e-4c7e-bc63-9bf9b49c94ad tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1508 microversion: 2.1 time: 0.301639 Jul 14 15:04:43.237093 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2330/4531] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:42 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1508 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:43.247088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.247911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.248944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.249757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.283416 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f HTTP/1.1 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '68afe110-fdf0-41d5-9cd1-e78627d0c73f'} Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:43.286292 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.290637 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.293368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:43.295024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fdaac938-7c63-4c15-8102-4ca32add5fc3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "DELETE /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 404 len: 111 microversion: 2.1 time: 0.080765 Jul 14 15:04:43.296569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2202/4532] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:43 2022] DELETE /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:43.308868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:43.309520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 68afe110-fdf0-41d5-9cd1-e78627d0c73f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:43.319928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.320831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.322009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.322830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.358629 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f HTTP/1.1 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '68afe110-fdf0-41d5-9cd1-e78627d0c73f'} Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:43.361460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. Jul 14 15:04:43.365579 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:43.367910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 68afe110-fdf0-41d5-9cd1-e78627d0c73f could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:43.370562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd5865af-dd7b-48a7-990c-c42b40b58082 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f" status: 404 len: 111 microversion: 2.1 time: 0.069296 Jul 14 15:04:43.373202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2331/4533] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:43 2022] GET /compute/v2.1/servers/68afe110-fdf0-41d5-9cd1-e78627d0c73f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:43.383431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:43.384557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:43.394575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.395473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.396785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.397594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.474856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:43.645165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a158a2cf-a027-4354-bf8e-48895a385da3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "DELETE /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 204 len: 0 microversion: 2.1 time: 0.267364 Jul 14 15:04:43.649523 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2203/4534] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:43 2022] DELETE /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:04:43.658234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:43.658870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:43.678581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.679058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.680004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:43.680446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:43.687669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:43.955652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:43.974363 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e0e768f0-afc5-43de-bbe9-adf9e6d881f2 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.320051 Jul 14 15:04:43.985661 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2332/4535] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:43 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:44.273871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:44.274849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:44.283040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:44.283797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:44.285128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:44.285849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:44.998505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:44.999660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:45.030671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:45.031831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.033562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:45.034622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:45.528011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:45.547577 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3f7c90b-f405-4296-8065-969b29d151cc tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.558195 Jul 14 15:04:45.559495 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2333/4536] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:44 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:45.655771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:45.684451 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e4d7021-a927-411e-aadb-99a15852ee9e tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1508 microversion: 2.1 time: 1.419369 Jul 14 15:04:45.699809 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2204/4537] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:44 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1508 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:46.613843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:46.629154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:46.714658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:46.717333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:46.719161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:46.725016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:46.731393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:46.732704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:46.752108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:46.754000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:46.754803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:46.755288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:47.520907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:47.548925 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d81731f-195e-46e6-918a-b9fb362d2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 200 len: 1466 microversion: 2.1 time: 0.839530 Jul 14 15:04:47.553947 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2205/4538] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:46 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 1466 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:47.674674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:47.681758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2bef1c71-7d6a-4272-8f9f-5551aa4e9e1d req-930e1452-dccd-46c6-9489-0b63445622a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d91e9b2-7708-4bda-8487-40bfa4579781", "name": "network-vif-deleted", "tag": "1c4c4759-0bf7-4f43-bec4-1028577221fc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:47.698267 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f12a3ea5-28c7-464d-825a-ac5e47dd37d3 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 1.128316 Jul 14 15:04:47.699637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2334/4539] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:46 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:47.727131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2bef1c71-7d6a-4272-8f9f-5551aa4e9e1d req-930e1452-dccd-46c6-9489-0b63445622a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:47.727822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2bef1c71-7d6a-4272-8f9f-5551aa4e9e1d req-930e1452-dccd-46c6-9489-0b63445622a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:47.750508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2bef1c71-7d6a-4272-8f9f-5551aa4e9e1d req-930e1452-dccd-46c6-9489-0b63445622a8 service nova] Creating event network-vif-deleted:1c4c4759-0bf7-4f43-bec4-1028577221fc for instance 7d91e9b2-7708-4bda-8487-40bfa4579781 on n-h1-768852-23 Jul 14 15:04:47.756947 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2bef1c71-7d6a-4272-8f9f-5551aa4e9e1d req-930e1452-dccd-46c6-9489-0b63445622a8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080727 Jul 14 15:04:47.758452 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2206/4540] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:47.971315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-447b587a-0010-4447-9473-d409944a1e26 req-4cbbbf99-9ae1-4e95-bb8e-47787c909d36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "name": "network-vif-unplugged", "status": "completed", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:47.994196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-447b587a-0010-4447-9473-d409944a1e26 req-4cbbbf99-9ae1-4e95-bb8e-47787c909d36 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:47.994740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-447b587a-0010-4447-9473-d409944a1e26 req-4cbbbf99-9ae1-4e95-bb8e-47787c909d36 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.019674 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-447b587a-0010-4447-9473-d409944a1e26 req-4cbbbf99-9ae1-4e95-bb8e-47787c909d36 service nova] Creating event network-vif-unplugged:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h1-768852-23 Jul 14 15:04:48.028679 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-447b587a-0010-4447-9473-d409944a1e26 req-4cbbbf99-9ae1-4e95-bb8e-47787c909d36 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063142 Jul 14 15:04:48.031027 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2335/4541] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:48.601605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.603020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 7d91e9b2-7708-4bda-8487-40bfa4579781] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:48.624579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:48.626139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.661565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:48.666179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.718918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.720599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:48.754497 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] HTTP exception thrown: Instance 7d91e9b2-7708-4bda-8487-40bfa4579781 could not be found. Jul 14 15:04:48.766228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:48.767721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Request method failure captured: Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 HTTP/1.1 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C4ScudS3MixRmsrhjwF4cId0CghiVhli-wiEsml_Rpl-HBWvHt3Ni1QNIWwgCef49tNIWZCwwWsjSSRuw74Udi-GhpdeC_Blh_RvBRlJAXExZBwvrwvIFlIpi9lVZ_gCZC453Axfmt1BcQnZ1z0641qYJy0WHZfkJPu0Kk-ivoHM9w Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 4813aa5acf744a8dac42de00d7e5a519 Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 7d91e9b2-7708-4bda-8487-40bfa4579781 could not be found. Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '7d91e9b2-7708-4bda-8487-40bfa4579781'} Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d91e9b2-7708-4bda-8487-40bfa4579781 could not be found. Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d91e9b2-7708-4bda-8487-40bfa4579781 could not be found. Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:48.768975 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d91e9b2-7708-4bda-8487-40bfa4579781 could not be found. Jul 14 15:04:48.778299 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:48.781611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:48.781611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.785275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Returning 404 to user: Instance 7d91e9b2-7708-4bda-8487-40bfa4579781 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:48.787367 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5ec11d3-94bf-4384-a277-b442a3873306 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781" status: 404 len: 111 microversion: 2.1 time: 0.203679 Jul 14 15:04:48.792148 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2207/4542] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:48 2022] GET /compute/v2.1/servers/7d91e9b2-7708-4bda-8487-40bfa4579781 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:04:48.809352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:48.810715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:48.842027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:48.843580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.847081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:48.848918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:48.963553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:49.187641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:49.215412 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4909c415-1fe0-4599-8883-effd1487834a tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1512 microversion: 2.1 time: 0.501660 Jul 14 15:04:49.217232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2336/4543] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:48 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1512 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:49.283166 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-976add1b-a5e4-4765-9d01-5cad121ddefd tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "DELETE /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 204 len: 0 microversion: 2.1 time: 0.479082 Jul 14 15:04:49.284844 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2208/4544] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:48 2022] DELETE /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:04:49.296594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:49.297691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:49.309355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:49.312763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:49.314851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:49.316850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:49.871872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:49.895534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ba23b3d-b53b-4bbe-b615-a39f6e31c5c1 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1495 microversion: 2.1 time: 0.602575 Jul 14 15:04:49.896489 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2337/4545] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:49 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1495 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:50.236334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:50.237169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:50.256978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:50.258367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:50.262437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:50.269015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:50.926349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:50.927416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:50.941195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:50.941825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:50.951042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:50.952098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.351194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:51.387685 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36ec5b4e-06a1-46ba-850d-6db7074e3bb6 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1470 microversion: 2.1 time: 1.157300 Jul 14 15:04:51.400333 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2209/4546] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:50 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1470 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:04:51.424528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:51.448203 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4ae7825-a551-47d5-be15-f0387d3a2d6b tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1453 microversion: 2.1 time: 0.527264 Jul 14 15:04:51.450465 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2338/4547] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:50 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1453 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:51.724289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d5101f37-7288-44d7-bd57-8efd506cc73b req-c5dbed9f-e414-4b18-81d5-2c7c3d5b69bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "933f57d0-371d-4daf-bc96-5fb9f46f03c0", "name": "network-vif-deleted", "tag": "1a8c887f-d790-4589-a78f-69a05273e672"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:51.789706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d5101f37-7288-44d7-bd57-8efd506cc73b req-c5dbed9f-e414-4b18-81d5-2c7c3d5b69bf service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:51.790899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d5101f37-7288-44d7-bd57-8efd506cc73b req-c5dbed9f-e414-4b18-81d5-2c7c3d5b69bf service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:51.808577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:04:51.869531 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d5101f37-7288-44d7-bd57-8efd506cc73b req-c5dbed9f-e414-4b18-81d5-2c7c3d5b69bf service nova] Creating event network-vif-deleted:1a8c887f-d790-4589-a78f-69a05273e672 for instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 on n-h1-768852-23 Jul 14 15:04:51.885931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d5101f37-7288-44d7-bd57-8efd506cc73b req-c5dbed9f-e414-4b18-81d5-2c7c3d5b69bf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181979 Jul 14 15:04:51.888367 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2210/4548] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:52.356546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e6d44a0a-53d5-4240-a6a9-aa784ad0c7e8 req-a4b4111a-609b-4cc4-a8be-a230fc4f9930 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08db0802-63ba-402b-bb7d-d3f69d1d9a18", "name": "network-vif-deleted", "tag": "77dca01e-fb12-4b4c-a339-13d11aebcce3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:04:52.406942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e6d44a0a-53d5-4240-a6a9-aa784ad0c7e8 req-a4b4111a-609b-4cc4-a8be-a230fc4f9930 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:52.407422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e6d44a0a-53d5-4240-a6a9-aa784ad0c7e8 req-a4b4111a-609b-4cc4-a8be-a230fc4f9930 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:52.410943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:52.412367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:52.455089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:52.455446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:52.456530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:52.456873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:52.466992 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e6d44a0a-53d5-4240-a6a9-aa784ad0c7e8 req-a4b4111a-609b-4cc4-a8be-a230fc4f9930 service nova] Creating event network-vif-deleted:77dca01e-fb12-4b4c-a339-13d11aebcce3 for instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 on n-h1-768852-23 Jul 14 15:04:52.487221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e6d44a0a-53d5-4240-a6a9-aa784ad0c7e8 req-a4b4111a-609b-4cc4-a8be-a230fc4f9930 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137568 Jul 14 15:04:52.490302 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2339/4549] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:04:52.509071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:52.514322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:52.529764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:52.535156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:52.536386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:52.537037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:52.623616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:52.625195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:52.626099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lazy-loading 'fault' on Instance uuid 933f57d0-371d-4daf-bc96-5fb9f46f03c0 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:04:52.820951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a4b4998ca6479f85adc2b9c65e1e06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9a2c2bf376243c0ba8c572cc1bca54b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:52.833649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:52.837489 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f44fea2b-976f-4cd9-848f-2b41f69261c1 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 200 len: 1302 microversion: 2.1 time: 0.431076 Jul 14 15:04:52.851800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ffc2cd32-aea5-434f-9f8a-e7935054e833 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 200 len: 1305 microversion: 2.1 time: 0.359915 Jul 14 15:04:52.852403 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2211/4550] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:52 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 1302 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:52.856161 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2340/4551] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:52 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:53.857557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:53.858374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] [instance: 08db0802-63ba-402b-bb7d-d3f69d1d9a18] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:53.874655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:53.875555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 933f57d0-371d-4daf-bc96-5fb9f46f03c0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:53.889664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:53.890194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:53.891602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:53.900111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:53.901356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:53.901861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:53.907689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:53.908473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:53.966922 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] HTTP exception thrown: Instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 could not be found. Jul 14 15:04:53.967125 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] HTTP exception thrown: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 could not be found. Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Request method failure captured: Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 HTTP/1.1 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0C9E1CR_eDRKgc-9tI0jzw0aliEH9RvI5-Iu6i-DS-sWmXGjG2a-o-ht46Iw2cz_yYDP2-rHOMpScRzeOq18-ilFjGiSXzbc8B-7x864nLqHs_WMI-ZmdXek3ARlw_BPCeBaol4y7AvGcTmnBhanHb8Q2iOv6WRev7Zp5Oh099o-Pnw Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/c9a2c2bf376243c0ba8c572cc1bca54b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: c9a2c2bf376243c0ba8c572cc1bca54b Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-8053427 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c1a4b4998ca6479f85adc2b9c65e1e06 Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-8053427-project Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 could not be found. Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '08db0802-63ba-402b-bb7d-d3f69d1d9a18'} Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 could not be found. Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 could not be found. Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.971409 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 could not be found. Jul 14 15:04:53.981558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Request method failure captured: Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 HTTP/1.1 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4ScudS3MixRmsrhjwF4cId0CghiVhli-wiEsml_Rpl-HBWvHt3Ni1QNIWwgCef49tNIWZCwwWsjSSRuw74Udi-GhpdeC_Blh_RvBRlJAXExZBwvrwvIFlIpi9lVZ_gCZC453Axfmt1BcQnZ1z0641qYJy0WHZfkJPu0Kk-ivoHM9w Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4813aa5acf744a8dac42de00d7e5a519 Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 could not be found. Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '933f57d0-371d-4daf-bc96-5fb9f46f03c0'} Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 could not be found. Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 could not be found. Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:04:53.986128 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 could not be found. Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Returning 404 to user: Instance 933f57d0-371d-4daf-bc96-5fb9f46f03c0 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61031da7-4ed8-4760-bbe1-0411ce2a24a2 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0" status: 404 len: 111 microversion: 2.1 time: 0.108550 Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2341/4552] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:53 2022] GET /compute/v2.1/servers/933f57d0-371d-4daf-bc96-5fb9f46f03c0 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:53.998261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:54.001655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] Returning 404 to user: Instance 08db0802-63ba-402b-bb7d-d3f69d1d9a18 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:04:54.003349 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51771c3c-6d33-4647-bc80-aabae0e889a0 tempest-ServersNegativeTestJSON-8053427 tempest-ServersNegativeTestJSON-8053427-project] 10.222.0.98 "GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18" status: 404 len: 111 microversion: 2.1 time: 0.150764 Jul 14 15:04:54.007128 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2212/4553] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:53 2022] GET /compute/v2.1/servers/08db0802-63ba-402b-bb7d-d3f69d1d9a18 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:04:54.013516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:54.013516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:54.013990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:54.018256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:54.074387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:04:54.316583 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c0c4bf9-7573-4b7f-be08-545a2898f996 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "DELETE /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 204 len: 0 microversion: 2.1 time: 0.326457 Jul 14 15:04:54.319048 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2342/4554] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:04:53 2022] DELETE /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:04:54.341353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:54.342430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:54.393549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:54.394214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:54.408272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:54.409671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:55.447628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:55.468617 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-982a73d7-a99d-416a-b134-4b522ebf628a tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1675 microversion: 2.1 time: 1.144316 Jul 14 15:04:55.469361 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2213/4555] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:54 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1675 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:56.508338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:56.510519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:56.534792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:56.540501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:56.545290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:56.547871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:57.695718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:04:57.744799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-394e3f51-604f-42fd-b5a9-e317625e0880 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1675 microversion: 2.1 time: 1.247639 Jul 14 15:04:57.754289 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2343/4556] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:56 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1675 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:04:58.786538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:04:58.794242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:04:58.824526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:58.825539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:04:58.827134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:04:58.829989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:00.205140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:00.221066 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fde669a7-9c75-4287-b303-53c028ba8a9f tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1675 microversion: 2.1 time: 1.453450 Jul 14 15:05:00.222173 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2214/4557] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:04:58 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1675 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:01.242753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:01.245714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:01.272962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:01.285250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:01.285752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:01.289358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:01.294214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:01.670612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:01.692865 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-97e7959a-de59-4c4d-b908-7b07d059b4bf tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1608 microversion: 2.1 time: 0.455602 Jul 14 15:05:01.694724 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2344/4558] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:01 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1608 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:05:01.933897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-dd97d651-9343-4202-afa5-0ab45c6ed545 req-e1fd690e-8bdb-4afa-95d3-9134f88ec502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17571f24-33af-4696-bb50-4e9f14a6cc96", "name": "network-vif-deleted", "tag": "78685cef-25b0-4dd7-bbff-1d1d428fc7cd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:02.002909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:02.012271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dd97d651-9343-4202-afa5-0ab45c6ed545 req-e1fd690e-8bdb-4afa-95d3-9134f88ec502 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:02.015735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dd97d651-9343-4202-afa5-0ab45c6ed545 req-e1fd690e-8bdb-4afa-95d3-9134f88ec502 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:02.088772 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-dd97d651-9343-4202-afa5-0ab45c6ed545 req-e1fd690e-8bdb-4afa-95d3-9134f88ec502 service nova] Creating event network-vif-deleted:78685cef-25b0-4dd7-bbff-1d1d428fc7cd for instance 17571f24-33af-4696-bb50-4e9f14a6cc96 on n-h1-768852-23 Jul 14 15:05:02.116365 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-dd97d651-9343-4202-afa5-0ab45c6ed545 req-e1fd690e-8bdb-4afa-95d3-9134f88ec502 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186572 Jul 14 15:05:02.121114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2215/4559] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:05:02.729805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:02.735851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:02.772248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:02.773078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:02.774184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:02.777173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:02.873007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:02.878321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:02.880048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lazy-loading 'fault' on Instance uuid 17571f24-33af-4696-bb50-4e9f14a6cc96 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:05:03.416041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4813aa5acf744a8dac42de00d7e5a519', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95bb8113735e4903aa5919ec567b0b5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:03.435759 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ab5ceab-fc32-4e24-8595-72b75e8e6773 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 200 len: 1328 microversion: 2.1 time: 0.717384 Jul 14 15:05:03.437242 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2345/4560] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:02 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 1328 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:05:03.664111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-82c80861-f649-49b6-8675-f3e969d7a446 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Action: 'create', calling method: .version_select at 0x7fdbf1e0a310>, body: {"keypair": {"name": "tempest-keypair-1908813069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLh0f/iupD9HUxQluCn9sEL+9ZtMLVsgZmaAbpcfFYwzexloXt6DZ7KqXugkTyJ/E1GdFQw16vmpu4KERAEWflK+IlWwpxOxkGoGS4DP1jqy3YvrPFGCuBUyyLh8EuHw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:03.687252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-82c80861-f649-49b6-8675-f3e969d7a446 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Getting quotas for project e83a2d7967344e64aac0c62b4e1f3d94. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:05:03.700389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-82c80861-f649-49b6-8675-f3e969d7a446 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Getting quotas for user 515dbc74a0544243bba03ae2974c218c and project e83a2d7967344e64aac0c62b4e1f3d94. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:05:03.737111 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82c80861-f649-49b6-8675-f3e969d7a446 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [50677545-bed9-4d60-8e1a-46a41cb20dbc] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:05:04.455806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:04.456724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] [instance: 17571f24-33af-4696-bb50-4e9f14a6cc96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:04.472869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:04.473341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:04.481493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:04.482570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:04.527010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] HTTP exception thrown: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 could not be found. Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Request method failure captured: Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 HTTP/1.1 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0C4ScudS3MixRmsrhjwF4cId0CghiVhli-wiEsml_Rpl-HBWvHt3Ni1QNIWwgCef49tNIWZCwwWsjSSRuw74Udi-GhpdeC_Blh_RvBRlJAXExZBwvrwvIFlIpi9lVZ_gCZC453Axfmt1BcQnZ1z0641qYJy0WHZfkJPu0Kk-ivoHM9w Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95bb8113735e4903aa5919ec567b0b5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95bb8113735e4903aa5919ec567b0b5c Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-1168818123 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 4813aa5acf744a8dac42de00d7e5a519 Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-1168818123-project Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 could not be found. Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '17571f24-33af-4696-bb50-4e9f14a6cc96'} Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 could not be found. Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 could not be found. Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:05:04.530491 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 could not be found. Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Returning 404 to user: Instance 17571f24-33af-4696-bb50-4e9f14a6cc96 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:05:04.542085 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85e5a45b-9107-4bc8-a55a-4b2944237cd3 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96" status: 404 len: 111 microversion: 2.1 time: 0.088256 Jul 14 15:05:04.543992 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2346/4561] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:05:04 2022] GET /compute/v2.1/servers/17571f24-33af-4696-bb50-4e9f14a6cc96 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:05:04.553778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cba104f7-1064-467a-8e9a-f202baad7290 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] Calling method '.version_select at 0x7fdbf3161790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:04.608615 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cba104f7-1064-467a-8e9a-f202baad7290 tempest-ServerActionsTestJSON-1168818123 tempest-ServerActionsTestJSON-1168818123-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607770276" status: 202 len: 0 microversion: 2.1 time: 0.062884 Jul 14 15:05:04.610022 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2347/4562] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:05:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607770276 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:05:04.750991 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [None req-82c80861-f649-49b6-8675-f3e969d7a446 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [50677545-bed9-4d60-8e1a-46a41cb20dbc] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 60048. Jul 14 15:05:04.771227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-82c80861-f649-49b6-8675-f3e969d7a446 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 1.114012 Jul 14 15:05:04.772567 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2216/4563] 10.222.0.98 () {62 vars in 1199 bytes} [Thu Jul 14 15:05:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1116 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 15:05:11.591421 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:05:11.592544 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:05:14.785238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:14.799229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:14.834319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1228746028", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "72e0ab34-6842-49c4-8315-b7be0a01e060"}, {"port": "46c2e51a-51ca-4fdf-868a-828e8822655a", "tag": "port-1"}, {"port": "a52ddc00-dfb4-45b7-bae9-fda2e03aee2a", "tag": "port-2"}, {"uuid": "a21c4b41-25f3-48f3-9999-71853b8a3038", "tag": "net-1"}, {"uuid": "a21c4b41-25f3-48f3-9999-71853b8a3038"}, {"uuid": "49fb604e-0aee-4512-a0d9-3884d05b4310", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "49fb604e-0aee-4512-a0d9-3884d05b4310", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "79ecfbf0-2434-43d2-8e19-ea803c177f2c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "7d1dc052-4564-4810-8e8a-6e89d4ba8c03", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "e22a0abc-755d-4466-b29d-109dfe113875", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1371566147"}], "key_name": "tempest-keypair-1908813069", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:15.357535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] validate_networks() for [('72e0ab34-6842-49c4-8315-b7be0a01e060', None, None, None, None, None), (None, None, '46c2e51a-51ca-4fdf-868a-828e8822655a', None, None, None), (None, None, 'a52ddc00-dfb4-45b7-bae9-fda2e03aee2a', None, None, None), ('a21c4b41-25f3-48f3-9999-71853b8a3038', None, None, None, None, None), ('a21c4b41-25f3-48f3-9999-71853b8a3038', None, None, None, None, None), ('49fb604e-0aee-4512-a0d9-3884d05b4310', '10.2.2.100', None, None, None, None), ('49fb604e-0aee-4512-a0d9-3884d05b4310', '10.2.2.200', None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:05:21.197376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=23 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:21.198298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:21.199738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:21.696721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-541360a5-0a40-4331-a5b7-bff3d91e7979 tempest-ExtensionsTest-1723224966 tempest-ExtensionsTest-1723224966-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:21.699584 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-541360a5-0a40-4331-a5b7-bff3d91e7979 tempest-ExtensionsTest-1723224966 tempest-ExtensionsTest-1723224966-project] 10.222.0.98 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.509422 Jul 14 15:05:21.700607 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2217/4564] 10.222.0.98 () {58 vars in 1169 bytes} [Thu Jul 14 15:05:21 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:05:21.730540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21d4008a-0710-4e22-bf59-d18330700116 tempest-ExtensionsTest-1723224966 tempest-ExtensionsTest-1723224966-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:21.732910 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21d4008a-0710-4e22-bf59-d18330700116 tempest-ExtensionsTest-1723224966 tempest-ExtensionsTest-1723224966-project] 10.222.0.98 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.015523 Jul 14 15:05:21.754322 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2218/4565] 10.222.0.98 () {58 vars in 1133 bytes} [Thu Jul 14 15:05:21 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:05:26.895348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:27.145974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1357245037", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "90bd653d-9198-42eb-b274-2549e2fbe619"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:28.187609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] validate_networks() for [('90bd653d-9198-42eb-b274-2549e2fbe619', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:05:30.798546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:05:30.800554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:05:30.809556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:05:30.811752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:05:30.814101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:05:30.854680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:30.860578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:30.862156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:30.868742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:30.935131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Getting quotas for project faa511d1382c4963adb7977038e4be1b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:05:30.956908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Getting quotas for user 2e8db41673814667bd60069370262487 and project faa511d1382c4963adb7977038e4be1b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:05:30.994802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:05:31.003388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:05:31.184500 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b2c96f3-3b5b-4a75-911d-cca5b05f7f45 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 4.882801 Jul 14 15:05:31.207380 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2219/4566] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 15:05:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 4907 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 15:05:31.229045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed0e7c27-3bdc-4832-9eeb-6ba89eaece10 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:31.230371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed0e7c27-3bdc-4832-9eeb-6ba89eaece10 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:31.404572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed0e7c27-3bdc-4832-9eeb-6ba89eaece10 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:31.426630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed0e7c27-3bdc-4832-9eeb-6ba89eaece10 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:31.434458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed0e7c27-3bdc-4832-9eeb-6ba89eaece10 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:31.441540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:05:31.442268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:05:31.442268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:05:31.442772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:05:31.443125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:05:31.451735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed0e7c27-3bdc-4832-9eeb-6ba89eaece10 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1259 microversion: 2.21 time: 0.234915 Jul 14 15:05:31.464990 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2220/4567] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:31 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1259 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:31.470775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:31.471478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:31.472525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:31.473166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:31.531849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Getting quotas for project e83a2d7967344e64aac0c62b4e1f3d94. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:05:31.542876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Getting quotas for user 515dbc74a0544243bba03ae2974c218c and project e83a2d7967344e64aac0c62b4e1f3d94. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:05:32.131348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:05:32.147749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='79ecfbf0-2434-43d2-8e19-ea803c177f2c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='7d1dc052-4564-4810-8e8a-6e89d4ba8c03',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e22a0abc-755d-4466-b29d-109dfe113875',volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:05:32.472052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7280779d-043e-4af6-b500-2d51af592e23 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:32.472859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7280779d-043e-4af6-b500-2d51af592e23 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:32.675792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7280779d-043e-4af6-b500-2d51af592e23 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:32.692270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7280779d-043e-4af6-b500-2d51af592e23 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:32.708062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7280779d-043e-4af6-b500-2d51af592e23 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:32.709795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7280779d-043e-4af6-b500-2d51af592e23 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1259 microversion: 2.21 time: 0.242102 Jul 14 15:05:32.710292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2221/4568] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:32 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1259 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:33.106906 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cbe183f4-4729-48eb-8876-cdd6930c8eb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.32 time: 18.326264 Jul 14 15:05:33.111071 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2348/4569] 10.222.0.98 () {62 vars in 1188 bytes} [Thu Jul 14 15:05:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 18331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 15:05:33.121845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9a5d4db-ae20-4235-9ea0-7d7cc9ecf96d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:33.122682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9a5d4db-ae20-4235-9ea0-7d7cc9ecf96d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:33.644528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9a5d4db-ae20-4235-9ea0-7d7cc9ecf96d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:33.674498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9a5d4db-ae20-4235-9ea0-7d7cc9ecf96d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:33.685938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9a5d4db-ae20-4235-9ea0-7d7cc9ecf96d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:33.703700 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9a5d4db-ae20-4235-9ea0-7d7cc9ecf96d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1286 microversion: 2.32 time: 0.586891 Jul 14 15:05:33.713385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2222/4570] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:33 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1286 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:33.730276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:33.743101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:33.766334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.767132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.776006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:33.776484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:33.985259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2dc79985-ad54-4eb7-a44c-ca5ec393ddd5 tempest-ComputeTenantNetworksTest-538279601 tempest-ComputeTenantNetworksTest-538279601-project] Calling method '.version_select at 0x7fdbf31afee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:34.126067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:34.160556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:34.251653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:34.269757 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d574f6cc-4d68-4bda-9d8e-5ab4c4caad0d tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1263 microversion: 2.21 time: 0.543735 Jul 14 15:05:34.286847 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2223/4571] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:33 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1263 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:34.738440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-209a2334-973d-41c2-aeef-077ac8fba9f7 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:34.743117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-209a2334-973d-41c2-aeef-077ac8fba9f7 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:34.790166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2dc79985-ad54-4eb7-a44c-ca5ec393ddd5 tempest-ComputeTenantNetworksTest-538279601 tempest-ComputeTenantNetworksTest-538279601-project] 10.222.0.98 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.092372 Jul 14 15:05:34.793604 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2349/4572] 10.222.0.98 () {58 vars in 1157 bytes} [Thu Jul 14 15:05:33 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:34.830816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd2ad37e-80c0-47f0-8981-a0a062f5dc81 tempest-ComputeTenantNetworksTest-538279601 tempest-ComputeTenantNetworksTest-538279601-project] Calling method '.version_select at 0x7fdbf2b878b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:35.505479 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd2ad37e-80c0-47f0-8981-a0a062f5dc81 tempest-ComputeTenantNetworksTest-538279601 tempest-ComputeTenantNetworksTest-538279601-project] 10.222.0.98 "GET /compute/v2.1/os-tenant-networks/5e6c58e9-24ce-4ccf-aa56-3a976db71439" status: 200 len: 139 microversion: 2.1 time: 0.702410 Jul 14 15:05:35.508911 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2350/4573] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 15:05:34 2022] GET /compute/v2.1/os-tenant-networks/5e6c58e9-24ce-4ccf-aa56-3a976db71439 => generated 139 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:05:35.530268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:35.544779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:35.565987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:35.566441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:35.570691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:35.573392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:35.912099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.935841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.938347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.938578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-209a2334-973d-41c2-aeef-077ac8fba9f7 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.939970 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60c9c01b-eba5-424e-aff5-d4f342a26c58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1317 microversion: 2.21 time: 0.428666 Jul 14 15:05:35.952867 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2351/4574] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:35 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:35.968989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-209a2334-973d-41c2-aeef-077ac8fba9f7 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.972283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-209a2334-973d-41c2-aeef-077ac8fba9f7 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:35.977933 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-209a2334-973d-41c2-aeef-077ac8fba9f7 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1286 microversion: 2.32 time: 1.255594 Jul 14 15:05:35.982365 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2224/4575] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:34 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1286 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:36.960783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:36.962208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:36.982462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:36.983031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:36.983963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:36.984484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:37.002225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:37.003041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:37.020035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:37.020588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:37.021655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:37.022336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:37.346493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.378998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.383886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.389826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de5e546a-6e2e-40dc-a6de-e53eae3b20fe tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1317 microversion: 2.21 time: 0.431424 Jul 14 15:05:37.405827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2352/4576] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:36 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1317 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:37.477832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.503843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.511500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:37.513245 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a768428e-80e9-46b6-be9c-37bb0cd64516 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1594 microversion: 2.32 time: 0.515048 Jul 14 15:05:37.518806 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2225/4577] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:36 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1594 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:38.411901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:38.413511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:38.446406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.447434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.448621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.449415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.552511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:38.553955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:38.570965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.572383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.573392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:38.574016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:38.817928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:38.846496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:38.854875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:38.862721 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62794d38-ac45-4d94-af6b-59eebadcb0d8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1317 microversion: 2.21 time: 0.455947 Jul 14 15:05:38.864807 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2353/4578] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:38 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:39.127897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:39.145064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:39.147600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:39.149653 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aaec2a0c-d71b-4d49-a9a7-652c4697b79e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1594 microversion: 2.32 time: 0.602412 Jul 14 15:05:39.151032 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2226/4579] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:38 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1594 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:39.888786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:39.889549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:39.929417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:39.936745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:39.938711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:39.940902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:40.189367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:40.190433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:40.221817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:40.222609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:40.232551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:40.233798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:40.666223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:40.714989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:40.718130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:40.720223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67d9d1c9-f77b-4150-972e-f10c4e4785af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1594 microversion: 2.32 time: 0.540428 Jul 14 15:05:40.721168 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2227/4580] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:40 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1594 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:41.489037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:41.557612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:41.758577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:41.764741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:41.799433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:41.813939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:41.814784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:41.834067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:41.835350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:42.535496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.606452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.616232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.627571 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4d99e750-ccde-492b-9a82-2f4cff78c115 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 2.745507 Jul 14 15:05:42.659697 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2354/4581] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:39 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 2782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:42.796412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.847344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.856876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:42.861736 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9775277b-02d6-4e3f-91da-bdb3acefe17a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1594 microversion: 2.32 time: 1.108507 Jul 14 15:05:42.867044 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2228/4582] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:41 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1594 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:43.667783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:43.674181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:43.704355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.719872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:43.725138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.726083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:43.898853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:43.901003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:43.919234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.924452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:43.933256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:43.934575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:45.051463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:45.054083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:45.105892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:45.109543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:45.113450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:45.113767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:45.116844 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b6a6cfb4-8937-4de1-9d6f-24a214a0e790 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1594 microversion: 2.32 time: 1.225380 Jul 14 15:05:45.118892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2229/4583] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:43 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1594 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:45.119943 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-55355460-c6e6-4dc4-9997-1ebc0d8a84f8 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 1.460620 Jul 14 15:05:45.121280 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2355/4584] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:43 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:46.160704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:46.161806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:46.167441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=14 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:46.172049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:46.176907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:46.179392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:46.193750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:46.197753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:46.199243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:46.211705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:46.214749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:46.216660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:46.218058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:47.514834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:47.525467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:47.533605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:47.537697 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ab3b1de-c448-472d-b41e-b6bc6c3efcb0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1662 microversion: 2.32 time: 1.378571 Jul 14 15:05:47.538734 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2230/4585] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:46 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1662 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:47.715507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:47.746674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:47.752937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:47.755621 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-011d17ce-f4c4-4e1a-b04f-6d6b13431f58 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 1.592027 Jul 14 15:05:47.756364 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2356/4586] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:46 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:48.570940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:48.571921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:48.584893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:48.585343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:48.586532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:48.589088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:48.780533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:48.781444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:48.797697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:48.802433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:48.803716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:48.805384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:49.973352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.026990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.042055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.052745 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-486fab56-e286-4053-990c-57938449db50 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1662 microversion: 2.32 time: 1.485925 Jul 14 15:05:50.054692 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2231/4587] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:48 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1662 bytes in 1488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:50.527126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.538851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.541664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:50.543541 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0944110d-929a-4ef1-9484-2f7d703ca04b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 1.771307 Jul 14 15:05:50.544823 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2357/4588] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:48 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 1773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:51.093539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:51.097412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:51.134936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:51.140858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:51.143382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:51.148192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:51.577488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:51.578795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:51.598668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:51.598904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:51.599844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:51.600296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:53.065775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:53.090087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:53.092425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:53.104202 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5200488-9507-46d1-8a6f-c09800b58276 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 1.525038 Jul 14 15:05:53.106744 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2358/4589] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:51 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:53.209078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5d4c5f61-62ef-4594-b4e9-0971ce24bc26 req-c484b67b-ae24-436e-a085-8c32d27d6f50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92067b35-8d9a-43b5-8c6b-5665748f4093", "tag": "e5788b58-c9d1-4000-9e8b-654ef02a62e1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:05:53.238458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5d4c5f61-62ef-4594-b4e9-0971ce24bc26 req-c484b67b-ae24-436e-a085-8c32d27d6f50 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:53.246850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5d4c5f61-62ef-4594-b4e9-0971ce24bc26 req-c484b67b-ae24-436e-a085-8c32d27d6f50 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:53.308130 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5d4c5f61-62ef-4594-b4e9-0971ce24bc26 req-c484b67b-ae24-436e-a085-8c32d27d6f50 service nova] Creating event network-changed:e5788b58-c9d1-4000-9e8b-654ef02a62e1 for instance 92067b35-8d9a-43b5-8c6b-5665748f4093 on n-h1-768852-23 Jul 14 15:05:53.333786 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5d4c5f61-62ef-4594-b4e9-0971ce24bc26 req-c484b67b-ae24-436e-a085-8c32d27d6f50 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128943 Jul 14 15:05:53.335002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2359/4590] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:05:53.446176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:53.472362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=55 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:53.486719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:53.493767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:53.495702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-867f957a-74e4-46d2-9e26-bf2434177749 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1662 microversion: 2.32 time: 2.411768 Jul 14 15:05:53.497655 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2232/4591] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:51 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1662 bytes in 2415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:54.129342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:54.130079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:54.150016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:54.150495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:54.153454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:54.154082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:54.521746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:54.522398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:54.530993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:54.568313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:54.570464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:54.576075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:54.576596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:55.800117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:55.841754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:55.844657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:55.847446 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16e34190-c420-4002-ae7c-1642701e47bb tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1709 microversion: 2.32 time: 1.332714 Jul 14 15:05:55.848848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2233/4592] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:54 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1709 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:05:56.881688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:56.882810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:56.911462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:56.914131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:56.916837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:56.922879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:57.159331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:57.167244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=57 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:57.181261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:57.184503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:57.192789 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91d2f7a3-eb1f-4e03-92a9-aea11d620bc9 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 3.071332 Jul 14 15:05:57.200034 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2360/4593] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:54 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 3080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:05:58.218634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:05:58.219598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:05:58.234115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:05:58.248128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:58.248658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:58.250327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:05:58.251096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:05:59.141367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:59.172417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:59.186055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:05:59.191918 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e84e10a-08d6-413a-abf7-4daa9aa621d0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1756 microversion: 2.32 time: 2.328550 Jul 14 15:05:59.197580 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2234/4594] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:56 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1756 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:00.213025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:00.213638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:00.232844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:00.233302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:00.234120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:00.234567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:00.836232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.850328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.852001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.853874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c5e3b89b-768b-45b5-85b1-d8c47b526bc0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1756 microversion: 2.32 time: 0.645571 Jul 14 15:06:00.854388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.865922 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2235/4595] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:00 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1756 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:00.866271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.866271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:00.875093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5c2617b-df37-4998-9547-b2e427a90d77 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 2.661545 Jul 14 15:06:00.886225 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2361/4596] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:05:58 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:01.872655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:01.873282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:01.884933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:01.885395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:01.886220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:01.886665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:01.901036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:01.920841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:01.939387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:01.940181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:01.941623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:01.942596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:02.775978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:02.788406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:02.790545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:02.792055 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-452312ba-45fb-46cc-9c84-8deed72179ee tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 0.901459 Jul 14 15:06:02.792844 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2362/4597] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:01 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:02.798314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-02da66fd-ce9e-47e5-9714-ac2368d438ae req-17c029e6-c6eb-408f-8c88-1deeb61b6431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92067b35-8d9a-43b5-8c6b-5665748f4093", "name": "network-vif-plugged", "status": "completed", "tag": "e5788b58-c9d1-4000-9e8b-654ef02a62e1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:02.823582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-02da66fd-ce9e-47e5-9714-ac2368d438ae req-17c029e6-c6eb-408f-8c88-1deeb61b6431 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:02.824495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-02da66fd-ce9e-47e5-9714-ac2368d438ae req-17c029e6-c6eb-408f-8c88-1deeb61b6431 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:02.849748 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-02da66fd-ce9e-47e5-9714-ac2368d438ae req-17c029e6-c6eb-408f-8c88-1deeb61b6431 service nova] Creating event network-vif-plugged:e5788b58-c9d1-4000-9e8b-654ef02a62e1 for instance 92067b35-8d9a-43b5-8c6b-5665748f4093 on n-h1-768852-23 Jul 14 15:06:02.858485 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-02da66fd-ce9e-47e5-9714-ac2368d438ae req-17c029e6-c6eb-408f-8c88-1deeb61b6431 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064132 Jul 14 15:06:02.859869 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2363/4598] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:03.044182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:03.075790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:03.080776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:03.085358 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6261e3bb-ecf7-42aa-b31d-aae9e1b54e28 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1803 microversion: 2.32 time: 1.214630 Jul 14 15:06:03.100763 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2236/4599] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:01 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1803 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:03.827010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:03.827839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:03.844778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:03.845315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:03.846210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:03.846995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.113713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:04.116341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:04.128697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.133146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.134480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:04.135402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:04.660125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.686692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.689686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.697300 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-afe2f244-01bb-402c-99e5-4b00ec055577 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1803 microversion: 2.32 time: 0.592919 Jul 14 15:06:04.698889 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2237/4600] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:04 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1803 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:04.938372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.976232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.979788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:04.986710 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c73a6003-5a33-48ca-b556-88ef9bb2703b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1359 microversion: 2.21 time: 1.164283 Jul 14 15:06:04.995612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2364/4601] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:03 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1359 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:05.721095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:05.723207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:05.737229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:05.738385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:05.740240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:05.741459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:06.028165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:06.030696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:06.049764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:06.078539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:06.081079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:06.082371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:06.702873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:06.748960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:06.752256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:06.754060 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1ab0003-db2f-4caf-954b-0e4e15062879 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1850 microversion: 2.32 time: 1.040414 Jul 14 15:06:06.756028 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2238/4602] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:05 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1850 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:07.185197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:07.229892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:07.241203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:07.243568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f86d9df5-0d82-4393-985f-c02e4c875734 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1552 microversion: 2.21 time: 1.232116 Jul 14 15:06:07.256589 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2365/4603] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:06 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1552 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:07.267094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:07.267759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:07.285053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.296187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.297286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.299756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.376589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:06:07.573495 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4d6b2f6-f33b-4ee6-8d31-a194e827310b tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "DELETE /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 204 len: 0 microversion: 2.21 time: 0.311957 Jul 14 15:06:07.579322 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2239/4604] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 15:06:07 2022] DELETE /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 15:06:07.590767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:07.591494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:07.612471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.613213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.614200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.620445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.786595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:07.787503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:07.809142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.810127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:07.811312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:07.812052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:08.561221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:08.577695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:08.583067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:08.601479 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f7cd6332-d0f0-4f3c-8ef2-baacac76c89f tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1558 microversion: 2.21 time: 1.016638 Jul 14 15:06:08.613593 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2366/4605] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:07 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1558 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:09.315104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-744070394", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "8284c873-3a63-44bb-a29c-8f3f1842d048"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:09.470065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] validate_networks() for [('8284c873-3a63-44bb-a29c-8f3f1842d048', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:06:09.997706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:10.039582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:10.050554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:10.053071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45cb4874-b4ad-4012-a9bb-a54f01efe4b5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1850 microversion: 2.32 time: 2.271372 Jul 14 15:06:10.057690 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2240/4606] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:07 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1850 bytes in 2277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:10.079741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:10.089812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:10.114550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:10.122130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:10.124099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:10.128074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:11.549760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:11.566121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:11.571311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:11.578295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-31bc233d-9d61-4967-a020-f0edc8633213 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1516 microversion: 2.21 time: 1.513088 Jul 14 15:06:11.593058 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2241/4607] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:10 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1516 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:11.608428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:11.619339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:11.637633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:11.640043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:11.641068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:11.642315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:11.875942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:06:11.877446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:06:11.878451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:06:11.879256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:06:11.880001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:06:11.912486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:11.917051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:11.918684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:11.921593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:12.005370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Getting quotas for project 7f6e79cec08a4434be9d586deda74073. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:06:12.024823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Getting quotas for user c4adbe311c48409aa9956980fc3cbaaa and project 7f6e79cec08a4434be9d586deda74073. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:06:12.110765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:06:12.138582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:06:12.434631 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb3e1c3d-ded9-424c-ac27-83ec5e50e354 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.430546 Jul 14 15:06:12.464722 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2367/4608] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:06:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 3462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:06:12.485078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4bdb1dd6-155f-496d-8d7d-e1b62ef5d3df req-7787c179-bfd2-4c55-922d-6c8d0157ed8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92067b35-8d9a-43b5-8c6b-5665748f4093", "name": "network-vif-deleted", "tag": "e5788b58-c9d1-4000-9e8b-654ef02a62e1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:12.514558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4bdb1dd6-155f-496d-8d7d-e1b62ef5d3df req-7787c179-bfd2-4c55-922d-6c8d0157ed8d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:12.518324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4bdb1dd6-155f-496d-8d7d-e1b62ef5d3df req-7787c179-bfd2-4c55-922d-6c8d0157ed8d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:12.544967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4bdb1dd6-155f-496d-8d7d-e1b62ef5d3df req-7787c179-bfd2-4c55-922d-6c8d0157ed8d service nova] Creating event network-vif-deleted:e5788b58-c9d1-4000-9e8b-654ef02a62e1 for instance 92067b35-8d9a-43b5-8c6b-5665748f4093 on n-h1-768852-23 Jul 14 15:06:12.557971 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4bdb1dd6-155f-496d-8d7d-e1b62ef5d3df req-7787c179-bfd2-4c55-922d-6c8d0157ed8d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090560 Jul 14 15:06:12.564736 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2368/4609] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:12.575525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce1e14a9-6006-42cf-afaf-b096338113f2 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:12.579166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce1e14a9-6006-42cf-afaf-b096338113f2 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:12.806676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce1e14a9-6006-42cf-afaf-b096338113f2 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:12.858506 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce1e14a9-6006-42cf-afaf-b096338113f2 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1216 microversion: 2.1 time: 0.289107 Jul 14 15:06:12.868060 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2369/4610] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:12 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1216 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:12.894499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:12.917475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:12.968310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:12.978070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:12.991067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:12.991900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:13.203708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:13.204465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:13.205122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lazy-loading 'fault' on Instance uuid 92067b35-8d9a-43b5-8c6b-5665748f4093 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:06:13.335490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:13.346856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:13.348516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:13.349795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cb29e27e-a019-4c75-8e59-8df08b2820af tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1838 microversion: 2.32 time: 1.765985 Jul 14 15:06:13.361677 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2242/4611] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:11 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1838 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:13.585274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:13.602842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:13.611619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2e8db41673814667bd60069370262487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'faa511d1382c4963adb7977038e4be1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:13.615971 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6e7dd192-d36c-45ba-975e-c069bb44e102 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 200 len: 1349 microversion: 2.21 time: 0.745389 Jul 14 15:06:13.620014 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2370/4612] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:12 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 1349 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:13.896267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:13.897551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:13.924738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:13.925191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:13.926005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:13.932800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:14.371875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:14.372675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:14.396536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:14.397293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:14.399422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:14.401388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:14.863346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:14.896173 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24440a97-ab7d-4ae6-a862-2baa436e3743 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1220 microversion: 2.1 time: 0.997936 Jul 14 15:06:14.901819 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2243/4613] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:13 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1220 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:14.924894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:14.938869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:14.975493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:14.987435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.011354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.013273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.014421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.035970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:15.046649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:15.050942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad568e6b-1ae2-4480-b1e1-823ea45422b8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1838 microversion: 2.32 time: 0.684723 Jul 14 15:06:15.071056 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2371/4614] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:14 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1838 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:15.087465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ae3e23aa-54c3-4c5a-a081-fc3b117eab6f req-96631101-abe8-438f-9a93-87fef607b855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "a352d74d-30f9-4fde-9294-c024e6013bd2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:15.117707 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] HTTP exception thrown: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Request method failure captured: Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 HTTP/1.1 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DC1K-jz_TpyGd7imRnU4nKngdfDqPcvFnS3h0nXXfLJba23IQkKDh00OuUhw2b6D4mhchcTUtuNmVOhdx111fxCboGf0T51XT5xyuYr37RsakS9a6l7smxvgUGjzjuspjl23m1AMfAOr3Oox-aC_I4R7HZES7OKLVvJrwbax9DrL2E Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.21 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: faa511d1382c4963adb7977038e4be1b Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_faa511d1382c4963adb7977038e4be1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: faa511d1382c4963adb7977038e4be1b Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-InstanceActionsV221TestJSON-1844016046-project Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2e8db41673814667bd60069370262487 Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-InstanceActionsV221TestJSON-1844016046-project Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '92067b35-8d9a-43b5-8c6b-5665748f4093'} Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.121693 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Returning 404 to user: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:15.132074 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-021382d2-58f0-49cb-89de-4b73c190c966 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 404 len: 111 microversion: 2.21 time: 0.219349 Jul 14 15:06:15.134074 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2244/4615] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:14 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:06:15.139392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ae3e23aa-54c3-4c5a-a081-fc3b117eab6f req-96631101-abe8-438f-9a93-87fef607b855 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.139861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ae3e23aa-54c3-4c5a-a081-fc3b117eab6f req-96631101-abe8-438f-9a93-87fef607b855 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.147157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '.version_select at 0x7fdbf1df64c0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:15.149354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:15.166528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.168704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.171922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.172657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.233166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ae3e23aa-54c3-4c5a-a081-fc3b117eab6f req-96631101-abe8-438f-9a93-87fef607b855 service nova] Creating event network-changed:a352d74d-30f9-4fde-9294-c024e6013bd2 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:15.260507 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ae3e23aa-54c3-4c5a-a081-fc3b117eab6f req-96631101-abe8-438f-9a93-87fef607b855 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195573 Jul 14 15:06:15.266365 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2372/4616] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:15.381166 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c86d57a-938b-424e-a885-31698010455e tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.243204 Jul 14 15:06:15.385092 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2245/4617] 10.222.0.98 () {60 vars in 1336 bytes} [Thu Jul 14 15:06:15 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093/os-instance-actions => generated 611 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:06:15.411534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:15.415351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:15.428899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.429666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.431296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.431924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.453988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] HTTP exception thrown: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Request method failure captured: Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 HTTP/1.1 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DC1K-jz_TpyGd7imRnU4nKngdfDqPcvFnS3h0nXXfLJba23IQkKDh00OuUhw2b6D4mhchcTUtuNmVOhdx111fxCboGf0T51XT5xyuYr37RsakS9a6l7smxvgUGjzjuspjl23m1AMfAOr3Oox-aC_I4R7HZES7OKLVvJrwbax9DrL2E Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.21 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: faa511d1382c4963adb7977038e4be1b Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_faa511d1382c4963adb7977038e4be1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: faa511d1382c4963adb7977038e4be1b Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-InstanceActionsV221TestJSON-1844016046-project Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2e8db41673814667bd60069370262487 Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-InstanceActionsV221TestJSON-1844016046-project Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '92067b35-8d9a-43b5-8c6b-5665748f4093'} Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:15.456529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.460856 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.464659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Returning 404 to user: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:15.467826 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02262fbe-87bb-4e79-9490-2d214b19d059 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "DELETE /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 404 len: 111 microversion: 2.21 time: 0.063040 Jul 14 15:06:15.469619 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2373/4618] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 15:06:15 2022] DELETE /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:06:15.478714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:15.480062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] [instance: 92067b35-8d9a-43b5-8c6b-5665748f4093] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:15.500357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.500822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.501635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.506420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.542964 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] HTTP exception thrown: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Request method failure captured: Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 HTTP/1.1 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DC1K-jz_TpyGd7imRnU4nKngdfDqPcvFnS3h0nXXfLJba23IQkKDh00OuUhw2b6D4mhchcTUtuNmVOhdx111fxCboGf0T51XT5xyuYr37RsakS9a6l7smxvgUGjzjuspjl23m1AMfAOr3Oox-aC_I4R7HZES7OKLVvJrwbax9DrL2E Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.21 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: faa511d1382c4963adb7977038e4be1b Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_faa511d1382c4963adb7977038e4be1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/faa511d1382c4963adb7977038e4be1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: faa511d1382c4963adb7977038e4be1b Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1844016046 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-InstanceActionsV221TestJSON-1844016046-project Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2e8db41673814667bd60069370262487 Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-InstanceActionsV221TestJSON-1844016046-project Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '92067b35-8d9a-43b5-8c6b-5665748f4093'} Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.546810 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. Jul 14 15:06:15.551761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:15.556515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] Returning 404 to user: Instance 92067b35-8d9a-43b5-8c6b-5665748f4093 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:15.557752 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fd28620-e3f3-42d0-b3c5-4c2758317e70 tempest-InstanceActionsV221TestJSON-1844016046 tempest-InstanceActionsV221TestJSON-1844016046-project] 10.222.0.98 "GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093" status: 404 len: 111 microversion: 2.21 time: 0.083902 Jul 14 15:06:15.558881 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2246/4619] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:15 2022] GET /compute/v2.1/servers/92067b35-8d9a-43b5-8c6b-5665748f4093 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:06:15.920127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:15.924649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:15.942563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.948356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:15.950688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:15.952086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:16.093098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:16.095942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:16.111553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:16.112916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:16.118185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:16.119080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:16.122144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:16.150257 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dea45212-2c39-489a-8bd6-4e1b09dc5e28 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1274 microversion: 2.1 time: 0.239539 Jul 14 15:06:16.159826 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2374/4620] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:15 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1274 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:17.175196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:17.177007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:17.188755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:17.189613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:17.190627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:17.192867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:17.325890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:17.360019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:17.370910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:17.373836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e4fe3a2-b418-47b5-be35-33ec8cf76568 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1838 microversion: 2.32 time: 1.286715 Jul 14 15:06:17.379774 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2247/4621] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:16 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1838 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:18.086671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:18.096429 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-36a3aa25-6011-4716-9731-b5aa000b4774 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1274 microversion: 2.1 time: 0.929156 Jul 14 15:06:18.107261 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2375/4622] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:17 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1274 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:18.400279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:18.400909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:18.419068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:18.419805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:18.420818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:18.421261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:18.889600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:18.910696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:18.914108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:18.919716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b6613f6d-8bea-46b8-be67-2eb44b87cd49 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1838 microversion: 2.32 time: 0.524947 Jul 14 15:06:18.925608 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2248/4623] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:18 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1838 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:19.118196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:19.123952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:19.160257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.162449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:19.163491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.165604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:19.794194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:19.821354 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a60538b-6b17-403a-8cee-1524a6db61b8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 0.711375 Jul 14 15:06:19.824530 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2376/4624] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:19 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:19.967629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:19.967629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:19.986182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.986998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:19.988798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:19.989485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:20.030314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:20.849749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:20.853311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:20.878455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:20.878906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:20.883917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:20.885242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:21.302391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:21.321198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:21.324851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:21.327831 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad8103b7-daa5-43ce-a2b1-11b3b94a3ce9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1859 microversion: 2.32 time: 1.374776 Jul 14 15:06:21.339728 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2249/4625] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:19 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1859 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:21.604577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:21.613671 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4b0d7b21-223b-405d-8745-1f8e4948ff8c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 0.775578 Jul 14 15:06:21.625311 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2377/4626] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:20 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:22.209988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f7c8d24c-d03a-44a0-b883-eaa3452bf7b4 req-b1f3bf9a-895d-41ba-ac9e-9d19fc11ff5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "46c2e51a-51ca-4fdf-868a-828e8822655a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:22.299493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f7c8d24c-d03a-44a0-b883-eaa3452bf7b4 req-b1f3bf9a-895d-41ba-ac9e-9d19fc11ff5a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.302739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f7c8d24c-d03a-44a0-b883-eaa3452bf7b4 req-b1f3bf9a-895d-41ba-ac9e-9d19fc11ff5a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.350488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f7c8d24c-d03a-44a0-b883-eaa3452bf7b4 req-b1f3bf9a-895d-41ba-ac9e-9d19fc11ff5a service nova] Creating event network-changed:46c2e51a-51ca-4fdf-868a-828e8822655a for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:22.362124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:22.369222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:22.381984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:22.389882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f7c8d24c-d03a-44a0-b883-eaa3452bf7b4 req-b1f3bf9a-895d-41ba-ac9e-9d19fc11ff5a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189341 Jul 14 15:06:22.392547 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2250/4627] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:22.405525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.407236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.410062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.411530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.634342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:22.635446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:22.652989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.653454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.654323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:22.659740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:22.833811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:23.491108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:23.515144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:23.519029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:23.521624 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e199f0eb-e157-4d8a-a448-87a6fa64bb97 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1859 microversion: 2.32 time: 1.174345 Jul 14 15:06:23.522829 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2378/4628] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:22 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1859 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:24.396774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:24.430320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9363b71d-0a85-48f7-bae0-8b8cde9a69c8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 1.800889 Jul 14 15:06:24.456660 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2251/4629] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:22 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:24.561770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:24.562822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:24.588851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.590085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.591851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:24.592914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:24.885352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed24152a-7f05-4c61-b0e1-068c3c182e55 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: .version_select at 0x7fdbf1e850d0>, body: {"keypair": {"name": "tempest-keypair-1550954685", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEvofwv+M/IjnA1B3dTUKNWT8bsbQrynkvagUT2KorJUDyQAKvOQ+o3SotVbNiOv+/jGghHW9e9SvGsm6YFZsl3+9YJK8vr8b07pnjoqy0vpAo6gsPxIX5HXnl+BbGRVaw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:24.905190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:24.924584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-ed24152a-7f05-4c61-b0e1-068c3c182e55 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:06:24.938132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-ed24152a-7f05-4c61-b0e1-068c3c182e55 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:06:25.019727 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed24152a-7f05-4c61-b0e1-068c3c182e55 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.368780 Jul 14 15:06:25.027034 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2252/4630] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:06:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:06:25.459396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:25.460445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:25.472190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:25.472652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:25.473485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:25.473950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:25.482113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:25.500014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:25.502154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:25.503516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d801adc7-af4b-4986-8440-a1ef9a1ac199 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1859 microversion: 2.32 time: 0.952988 Jul 14 15:06:25.521549 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2379/4631] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:24 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1859 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:26.535856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:26.537036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:26.563954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.564793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:26.566286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:26.567081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:27.498683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:27.505768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:27.523354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:27.526094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:27.528592 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b379bcae-e53f-414a-b813-6eca39f6b458 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.002037 Jul 14 15:06:27.529992 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2380/4632] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:26 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:27.744138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:27.823578 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b7dab3e-f747-40f7-a6cd-6d6538e0c74c tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 2.357141 Jul 14 15:06:27.825341 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2253/4633] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:25 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 2372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:28.248216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3472e8d3-8961-484c-9eec-0e64f04401a4 req-460c5235-fab9-4296-9d30-ab1925008ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "906fbfb2-d3b4-4bfe-9abe-ddec16cc312c", "tag": "5357cb3c-6dbb-407f-aad1-f19a9f7deff1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:28.295951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3472e8d3-8961-484c-9eec-0e64f04401a4 req-460c5235-fab9-4296-9d30-ab1925008ad2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.303801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3472e8d3-8961-484c-9eec-0e64f04401a4 req-460c5235-fab9-4296-9d30-ab1925008ad2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.364825 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3472e8d3-8961-484c-9eec-0e64f04401a4 req-460c5235-fab9-4296-9d30-ab1925008ad2 service nova] Creating event network-changed:5357cb3c-6dbb-407f-aad1-f19a9f7deff1 for instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c on n-h1-768852-23 Jul 14 15:06:28.378854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3472e8d3-8961-484c-9eec-0e64f04401a4 req-460c5235-fab9-4296-9d30-ab1925008ad2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143347 Jul 14 15:06:28.380871 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2381/4634] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:28.562226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:28.562853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:28.577256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.577704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.578703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.580107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.852232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:28.853358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:28.872727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:28.877902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.878574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:28.879686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:28.883531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:29.607554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:29.638770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:29.646207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:29.648090 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b95238a-fe48-44e8-80da-bca251cd6f55 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.091199 Jul 14 15:06:29.655091 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2254/4635] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:28 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:30.024194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:30.039614 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b098dbb1-ab3f-437d-aba4-0b7cb050d97b tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 1.192032 Jul 14 15:06:30.040812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2382/4636] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:28 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:30.533797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-dd13e4bd-5f05-43e0-aab5-fb5beda24c64 req-9203e969-30f4-478f-b7f6-53a7a5582ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "a52ddc00-dfb4-45b7-bae9-fda2e03aee2a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:30.550672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dd13e4bd-5f05-43e0-aab5-fb5beda24c64 req-9203e969-30f4-478f-b7f6-53a7a5582ad7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.551444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dd13e4bd-5f05-43e0-aab5-fb5beda24c64 req-9203e969-30f4-478f-b7f6-53a7a5582ad7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:30.580886 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-dd13e4bd-5f05-43e0-aab5-fb5beda24c64 req-9203e969-30f4-478f-b7f6-53a7a5582ad7 service nova] Creating event network-changed:a52ddc00-dfb4-45b7-bae9-fda2e03aee2a for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:30.589921 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-dd13e4bd-5f05-43e0-aab5-fb5beda24c64 req-9203e969-30f4-478f-b7f6-53a7a5582ad7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063241 Jul 14 15:06:30.591702 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2255/4637] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:06:30.677016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:30.678581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:30.707429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.708959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:30.710978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:30.712268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:31.059195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:31.060113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:31.072181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:31.072874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:31.074065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:31.075028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:31.544298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:31.562248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:31.563811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:31.565307 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23b89d74-7560-4093-9869-f70196f1f69a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.899910 Jul 14 15:06:31.566730 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2383/4638] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:30 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:31.920074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:31.933069 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc3aadaa-b25c-4da0-ac18-ae5f60b61095 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 0.879600 Jul 14 15:06:31.933619 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2256/4639] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:31 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:32.589918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:32.592247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:32.605751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:32.607130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:32.608918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:32.610004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:32.950605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:32.951443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:32.970760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:32.973617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:32.974514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:32.974964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:33.582850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:33.605398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:33.607015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:33.614712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87b833e9-f1ad-4eef-b0d5-653707a003ce tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.032266 Jul 14 15:06:33.633132 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2384/4640] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:32 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:33.653165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-544319791", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611"}], "security_groups": [{"name": "tempest-securitygroup--659602504"}], "key_name": "tempest-keypair-1550954685", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:34.403247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:34.413498 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1bc7f1cf-cf07-497f-b064-777534b14654 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 1.466816 Jul 14 15:06:34.414874 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2257/4641] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:32 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:34.638952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:34.644225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:34.676876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.679018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:34.681650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:34.682758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:34.957229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:35.105562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] validate_networks() for [('8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:06:36.020888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:36.051854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:36.058609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:36.060730 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ddc024d-8801-4038-a6d4-01f3cc75cdf4 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.429239 Jul 14 15:06:36.068206 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2258/4642] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:34 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:36.077839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-eb4cc116-00d1-4ba1-9217-0b403a9ac6da req-ad9421d7-5512-4b41-bab3-a30314bfabc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:36.093225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-eb4cc116-00d1-4ba1-9217-0b403a9ac6da req-ad9421d7-5512-4b41-bab3-a30314bfabc1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.094168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-eb4cc116-00d1-4ba1-9217-0b403a9ac6da req-ad9421d7-5512-4b41-bab3-a30314bfabc1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:36.112114 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-eb4cc116-00d1-4ba1-9217-0b403a9ac6da req-ad9421d7-5512-4b41-bab3-a30314bfabc1 service nova] Creating event network-changed:53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:36.125023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-eb4cc116-00d1-4ba1-9217-0b403a9ac6da req-ad9421d7-5512-4b41-bab3-a30314bfabc1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053255 Jul 14 15:06:36.127213 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2259/4643] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:36.138408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:36.139908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:36.153905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.154885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:36.157101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.164320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:36.798923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:06:36.805251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:06:36.806594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:06:36.808691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:06:36.809808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:06:36.835545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.837483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:36.839230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:36.840685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:36.894177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:06:36.909197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:06:36.955681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:06:36.966692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:06:37.144336 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5bc8b2bf-6ca1-45c7-b162-1e920cb7d14b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.505025 Jul 14 15:06:37.151422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2385/4644] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:06:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 3517 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:06:37.714863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ad31c8c9-5930-4de8-a71c-0d641e881cd0 req-68d73878-3b69-4bee-ab97-5df565505c78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906fbfb2-d3b4-4bfe-9abe-ddec16cc312c", "name": "network-vif-plugged", "status": "completed", "tag": "5357cb3c-6dbb-407f-aad1-f19a9f7deff1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:37.762086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ad31c8c9-5930-4de8-a71c-0d641e881cd0 req-68d73878-3b69-4bee-ab97-5df565505c78 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:37.765296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ad31c8c9-5930-4de8-a71c-0d641e881cd0 req-68d73878-3b69-4bee-ab97-5df565505c78 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:37.814584 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ad31c8c9-5930-4de8-a71c-0d641e881cd0 req-68d73878-3b69-4bee-ab97-5df565505c78 service nova] Creating event network-vif-plugged:5357cb3c-6dbb-407f-aad1-f19a9f7deff1 for instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c on n-h1-768852-23 Jul 14 15:06:37.829456 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ad31c8c9-5930-4de8-a71c-0d641e881cd0 req-68d73878-3b69-4bee-ab97-5df565505c78 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.675378 Jul 14 15:06:37.834007 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2386/4645] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:37.853983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:37.858607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:37.884388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:37.885874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:37.888109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:37.889511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:38.155232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:38.169467 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d05e10e-a16a-42b9-8923-bff05ba8cb65 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 2.039913 Jul 14 15:06:38.172950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2260/4646] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:36 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:38.210131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-495defe2-2c35-4930-8250-41c819ccdf17 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:38.210815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-495defe2-2c35-4930-8250-41c819ccdf17 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:38.581549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:38.597895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:38.602941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:38.609436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5271d49c-11f8-4689-a65e-1fd5d75d988c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.771878 Jul 14 15:06:38.622331 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2387/4647] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:37 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:38.711647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-495defe2-2c35-4930-8250-41c819ccdf17 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:38.721935 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-495defe2-2c35-4930-8250-41c819ccdf17 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1241 microversion: 2.1 time: 0.533078 Jul 14 15:06:38.727193 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2261/4648] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:38 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1241 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:39.203178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:39.204069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:39.221910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:39.224212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:39.225543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:39.227814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:39.631038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:39.633293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:39.650575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:39.652207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:39.658591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:39.661759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:39.899664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:39.909832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aaa64ba9-f6f6-42f9-8653-91e4f886b359 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1316 microversion: 2.1 time: 0.710795 Jul 14 15:06:39.919318 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2388/4649] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:39 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1316 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:39.925410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:39.926261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:39.934328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:39.935113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:39.936265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:39.936919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:40.484152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:40.506271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:40.511555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:40.514174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1ffc065-f226-4d06-9066-67e786cb08c3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.888035 Jul 14 15:06:40.515560 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2262/4650] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:39 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:40.687667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:40.713264 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b081cca1-82ec-4fa1-bef8-18cda10a8b19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1301 microversion: 2.1 time: 0.792023 Jul 14 15:06:40.714543 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2389/4651] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:39 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1301 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:40.881703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4ed00fca-caf3-49e8-a674-9008de42ee83 req-7335ce46-c01d-4eb6-94df-9feafc1771d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "a0c04296-1fa2-4baa-8850-095f5e5b1325"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:40.935659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4ed00fca-caf3-49e8-a674-9008de42ee83 req-7335ce46-c01d-4eb6-94df-9feafc1771d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:40.936432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4ed00fca-caf3-49e8-a674-9008de42ee83 req-7335ce46-c01d-4eb6-94df-9feafc1771d5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:40.939564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:40.940741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:40.973317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:40.976046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:40.980057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:40.981455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:40.991572 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4ed00fca-caf3-49e8-a674-9008de42ee83 req-7335ce46-c01d-4eb6-94df-9feafc1771d5 service nova] Creating event network-changed:a0c04296-1fa2-4baa-8850-095f5e5b1325 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:41.013370 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4ed00fca-caf3-49e8-a674-9008de42ee83 req-7335ce46-c01d-4eb6-94df-9feafc1771d5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139843 Jul 14 15:06:41.014214 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2263/4652] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:41.534424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:41.535159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:41.551119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:41.551617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:41.552449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:41.552897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.007257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:42.042674 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-00a5bb1e-3b9d-4c38-a6a7-1658e39b5c1d tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1504 microversion: 2.1 time: 1.119161 Jul 14 15:06:42.049568 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2390/4653] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:40 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1504 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:42.075923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.080847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.106360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.109069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.113770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.120113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.469793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:42.486557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16d64a2a-61fd-42c3-921c-5fb37fd6c76d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1299 microversion: 2.1 time: 0.432082 Jul 14 15:06:42.493879 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2391/4654] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:42 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1299 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:42.500105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.500609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.508639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.509094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.510476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.510626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.545548 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56fc0e5d-931e-42c5-9c72-3009c8318473 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c/ips" status: 200 len: 108 microversion: 2.1 time: 0.049945 Jul 14 15:06:42.547006 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2392/4655] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:06:42 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c/ips => generated 108 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:42.570054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.570582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.580765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.581463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.582495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.583181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.623497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4cacf7bf-7e23-4f6f-8d1b-16f07ce16d0f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c/ips" status: 200 len: 108 microversion: 2.1 time: 0.058468 Jul 14 15:06:42.624762 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2393/4656] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:06:42 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c/ips => generated 108 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:06:42.638286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.639434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.648632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.649977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.651384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.652012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.683334 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-27aff887-7ac7-4e61-bc8a-9fa1c3f35a1f tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c/ips/tempest-ServerAddressesTestJSON-310353091-network" status: 200 len: 93 microversion: 2.1 time: 0.049118 Jul 14 15:06:42.684685 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2394/4657] 10.222.0.98 () {58 vars in 1397 bytes} [Thu Jul 14 15:06:42 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c/ips/tempest-ServerAddressesTestJSON-310353091-network => generated 93 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:06:42.703087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.703954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.712581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.713291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.714301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.715027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.770745 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:06:42.933561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-337d3e77-54b9-43c9-ab39-29f91c2cbc9a tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "DELETE /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 204 len: 0 microversion: 2.1 time: 0.235814 Jul 14 15:06:42.935426 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2395/4658] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:06:42 2022] DELETE /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:06:42.956636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:42.957387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:42.978564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.982719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:42.985181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:42.985672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:43.253044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:43.300041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:43.301920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:43.304717 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4281d0be-7710-4d7a-b3b4-e6aecc6c3dc5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.773598 Jul 14 15:06:43.306120 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2264/4659] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:41 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:43.506243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:43.506920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:43.514705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:43.515472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:43.518524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:43.519743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:43.744532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:43.769280 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da8f93a2-b692-4842-9f33-d0d891826ced tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1299 microversion: 2.1 time: 0.264577 Jul 14 15:06:43.771348 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2265/4660] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:43 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1299 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:43.781277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:43.806759 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2c2c54c-2a8f-4634-a7c0-eeb45d5d9e0e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1510 microversion: 2.1 time: 0.864843 Jul 14 15:06:43.809205 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2396/4661] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:42 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1510 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:44.324189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:44.324825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:44.332329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.332788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.333591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.334093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.790847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:44.792166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:44.802605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.807227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:44.810042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:44.811734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:45.077864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:45.092211 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5446bcbf-7442-423b-bb24-d1465c592930 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1299 microversion: 2.1 time: 0.307696 Jul 14 15:06:45.097147 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2397/4662] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:44 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1299 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:45.106339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:45.107910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:45.114967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:45.116333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:45.118081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:45.118450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:45.403629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:45.445682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:45.453633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:45.457183 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dbe4a5f3-a53c-417a-86ba-ec20e22e679a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.136631 Jul 14 15:06:45.464292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2266/4663] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:44 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:46.128476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:46.130522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:46.205197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:46.212034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:46.218878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:46.221904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:46.408075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:46.410781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:46.426042 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74d16e43-7c6f-4664-8925-710b4226483e tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1510 microversion: 2.1 time: 1.327272 Jul 14 15:06:46.430319 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2398/4664] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:45 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1510 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:46.444592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d58fb0ca-026b-4ea9-bba4-af96c8e5356b req-2b9dd1cc-199c-459a-8e73-8d0032668735 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:46.466446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d58fb0ca-026b-4ea9-bba4-af96c8e5356b req-2b9dd1cc-199c-459a-8e73-8d0032668735 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:46.466889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d58fb0ca-026b-4ea9-bba4-af96c8e5356b req-2b9dd1cc-199c-459a-8e73-8d0032668735 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:46.495007 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d58fb0ca-026b-4ea9-bba4-af96c8e5356b req-2b9dd1cc-199c-459a-8e73-8d0032668735 service nova] Creating event network-changed:ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:46.503512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d58fb0ca-026b-4ea9-bba4-af96c8e5356b req-2b9dd1cc-199c-459a-8e73-8d0032668735 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071084 Jul 14 15:06:46.504994 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2399/4665] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:46.517636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:46.518985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:46.536721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:46.537183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:46.538974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:46.539740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:46.877056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:46.937662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:47.403631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:47.422099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:47.426283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:47.427946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-64758b40-e203-4bba-a9d3-45c6c2e2f815 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.921375 Jul 14 15:06:47.432829 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2400/4666] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:46 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:47.458998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:47.459815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:47.480042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:47.480516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:47.481339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:47.482010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:47.703576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:47.741120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15abbc1e-183e-4466-9e35-4133e3648d04 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 1.626729 Jul 14 15:06:47.771082 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2267/4667] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:46 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:48.468774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:48.473045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:48.508636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:48.509546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:48.511293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:48.512378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:48.721766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:48.771607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c4adbe311c48409aa9956980fc3cbaaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f6e79cec08a4434be9d586deda74073', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:48.805503 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ff55c969-6de6-4374-af7a-62dbeff12298 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 200 len: 1510 microversion: 2.1 time: 1.350676 Jul 14 15:06:48.811131 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2401/4668] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:47 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 1510 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:49.408921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3a24322c-ef32-4b17-85b9-ea4088a073bf req-4a6f32a4-edc6-48b6-9cea-52fd9dd05469 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "906fbfb2-d3b4-4bfe-9abe-ddec16cc312c", "name": "network-vif-deleted", "tag": "5357cb3c-6dbb-407f-aad1-f19a9f7deff1"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:49.430252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3a24322c-ef32-4b17-85b9-ea4088a073bf req-4a6f32a4-edc6-48b6-9cea-52fd9dd05469 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:49.430854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3a24322c-ef32-4b17-85b9-ea4088a073bf req-4a6f32a4-edc6-48b6-9cea-52fd9dd05469 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:49.464702 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3a24322c-ef32-4b17-85b9-ea4088a073bf req-4a6f32a4-edc6-48b6-9cea-52fd9dd05469 service nova] Creating event network-vif-deleted:5357cb3c-6dbb-407f-aad1-f19a9f7deff1 for instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c on n-h1-768852-23 Jul 14 15:06:49.491957 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3a24322c-ef32-4b17-85b9-ea4088a073bf req-4a6f32a4-edc6-48b6-9cea-52fd9dd05469 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.673373 Jul 14 15:06:49.493122 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2402/4669] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:49.510488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:49.511231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:49.531675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:49.532080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:49.535123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:49.536125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:50.247851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:50.255294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=90 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:50.265955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:50.277329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:50.282310 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4dd54736-5503-42d6-aaf0-4ffe8fbe2b3c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.821910 Jul 14 15:06:50.300915 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2268/4670] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:48 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:50.321970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:50.325480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] [instance: 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:50.351292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:50.353960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:50.357101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:50.358079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:50.429120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] HTTP exception thrown: Instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c could not be found. Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Request method failure captured: Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c HTTP/1.1 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DDgd5T-20YxgFt8UD7_pnyuhZP0921pvOWXtQjIrkglhnl_aRQAKBCXQTkXoKA7c8sEZUYye-yRMreofVYl3w4eJBO0iUvJuOEzKXGVf3C851L5O07hSWGn3FiCYVDob1xjX6TTgINrcG-uJiyWQvqAdW5nhQ8mK6NY3bnPTooEM8A Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 7f6e79cec08a4434be9d586deda74073 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerAddressesTestJSON-1937583802 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7f6e79cec08a4434be9d586deda74073"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_7f6e79cec08a4434be9d586deda74073"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/7f6e79cec08a4434be9d586deda74073"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/7f6e79cec08a4434be9d586deda74073"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerAddressesTestJSON-1937583802 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 7f6e79cec08a4434be9d586deda74073 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1937583802 Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerAddressesTestJSON-1937583802-project Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: c4adbe311c48409aa9956980fc3cbaaa Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerAddressesTestJSON-1937583802-project Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c could not be found. Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '906fbfb2-d3b4-4bfe-9abe-ddec16cc312c'} Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c could not be found. Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c could not be found. Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:06:50.432961 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c could not be found. Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] Returning 404 to user: Instance 906fbfb2-d3b4-4bfe-9abe-ddec16cc312c could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:06:50.438179 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ddc60eef-a59a-4feb-8b6a-0ef439c34bc8 tempest-ServerAddressesTestJSON-1937583802 tempest-ServerAddressesTestJSON-1937583802-project] 10.222.0.98 "GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c" status: 404 len: 111 microversion: 2.1 time: 0.132378 Jul 14 15:06:50.447811 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2269/4671] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:50 2022] GET /compute/v2.1/servers/906fbfb2-d3b4-4bfe-9abe-ddec16cc312c => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:06:51.193397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:51.209375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eaa9ac60-156f-4021-bbd2-209ea79d4389 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 1.710035 Jul 14 15:06:51.212380 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2403/4672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:49 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:51.312603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:51.319285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:51.346659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:51.347278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:51.348666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:51.349447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:52.223130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c6e9f970-0d73-4642-8ab9-a88612cbe682 req-d9612f48-0876-4698-9e0f-43b1c4764846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "79814c34-6100-4478-ae14-15f6b596a8b3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:52.239545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c6e9f970-0d73-4642-8ab9-a88612cbe682 req-d9612f48-0876-4698-9e0f-43b1c4764846 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:52.240299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c6e9f970-0d73-4642-8ab9-a88612cbe682 req-d9612f48-0876-4698-9e0f-43b1c4764846 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:52.255891 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c6e9f970-0d73-4642-8ab9-a88612cbe682 req-d9612f48-0876-4698-9e0f-43b1c4764846 service nova] Creating event network-changed:79814c34-6100-4478-ae14-15f6b596a8b3 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:06:52.263625 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c6e9f970-0d73-4642-8ab9-a88612cbe682 req-d9612f48-0876-4698-9e0f-43b1c4764846 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053429 Jul 14 15:06:52.266015 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2404/4673] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:06:52.274955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:52.278016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:52.294891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:52.295809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:52.296871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:52.297541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:52.536117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:52.559546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:52.566249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:52.570949 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2202d834-2418-4d7e-8f11-defbe0cae832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.266276 Jul 14 15:06:52.590234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2270/4674] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:51 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:52.826457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a8433fcb-444b-435d-97cb-e3c84eeac6d9 req-7f35cea9-a03e-485e-b7ec-f7d625eda60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5f0954-5fd0-4d23-90fa-81709549b750", "tag": "11e4cf13-d392-4561-9aef-cf7f0ba66b59"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:06:52.864453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a8433fcb-444b-435d-97cb-e3c84eeac6d9 req-7f35cea9-a03e-485e-b7ec-f7d625eda60c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:52.867888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a8433fcb-444b-435d-97cb-e3c84eeac6d9 req-7f35cea9-a03e-485e-b7ec-f7d625eda60c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:52.910744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a8433fcb-444b-435d-97cb-e3c84eeac6d9 req-7f35cea9-a03e-485e-b7ec-f7d625eda60c service nova] Creating event network-changed:11e4cf13-d392-4561-9aef-cf7f0ba66b59 for instance cf5f0954-5fd0-4d23-90fa-81709549b750 on n-h1-768852-23 Jul 14 15:06:52.934758 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a8433fcb-444b-435d-97cb-e3c84eeac6d9 req-7f35cea9-a03e-485e-b7ec-f7d625eda60c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114350 Jul 14 15:06:52.936499 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2271/4675] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:06:53.387257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:53.400925 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4c7fd8b-7e45-4af8-91a9-7936df3e6b91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 1.133182 Jul 14 15:06:53.417391 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2405/4676] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:52 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:53.600866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:53.604654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:53.633371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:53.646599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:53.647828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:53.648993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:54.440379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:54.443037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:54.455873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:54.456868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:54.457887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:54.458560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:55.183058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:55.199831 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce4db343-5a12-4a37-9054-bd9aa7bd73e3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 0.768293 Jul 14 15:06:55.210778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2406/4677] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:54 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:55.355885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:55.401345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:55.403393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:55.404854 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-937c4d02-7dab-41ce-b512-963aeb89771c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.816565 Jul 14 15:06:55.417198 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2272/4678] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:53 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:06:56.218404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:56.219782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:56.228366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:56.229145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:56.230161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:56.230782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:56.428794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:56.430796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:56.436798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:56.444952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:56.446092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:56.449675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:56.449675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:56.715722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:56.741773 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cab13bc2-3527-4f1f-a08b-a0f863a8b13c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 0.526699 Jul 14 15:06:56.744309 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2407/4679] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:56 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:06:57.762456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:57.763582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:57.771850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:57.773351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:57.774500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:57.775142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:57.986357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:58.023502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:58.027160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:58.030580 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-02673db3-eba1-4ddc-8e49-79f8c1a09184 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.608983 Jul 14 15:06:58.032243 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2273/4680] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:56 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:06:58.521362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:58.538942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9280974d-c78b-4e54-aa30-a0e3f873a7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 0.781213 Jul 14 15:06:58.539909 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2408/4681] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:57 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:06:59.062283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:59.071849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:59.095939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:59.096723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:59.097734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:59.098445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:59.566527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:06:59.568797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:06:59.587827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:06:59.589946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:59.590909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:59.592132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:06:59.592849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:06:59.967558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:06:59.983314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5fefa34a-076d-4300-8685-f493cbcf2f0b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 0.421727 Jul 14 15:06:59.996290 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2409/4682] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:06:59 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:00.378002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:00.435328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:00.438886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:00.443908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-579264e0-6b64-421f-9d35-6e2f05bcd296 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.385456 Jul 14 15:07:00.446196 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2274/4683] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:06:59 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:01.017204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:01.020981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:01.044771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:01.046899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:01.049078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:01.050630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:01.484550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:01.494779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:01.506482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:01.507791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:01.510319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:01.511214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:01.520177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:01.534846 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ffa8e956-60ea-4f28-baa0-ed6f5dfa575c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 0.527083 Jul 14 15:07:01.555665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2410/4684] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:01 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:02.558723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:02.569089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:02.599049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:02.600380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:02.603008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:02.604158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:03.832625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:03.878573 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb8d4003-d176-4c0f-95db-ab3678da552e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 1.329160 Jul 14 15:07:03.886082 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2411/4685] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:02 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:03.912784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fbf347b5-3407-45c5-b909-12b563b7f91a req-8bf65f9f-50c5-4b68-9788-7dfb44cd5355 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5f0954-5fd0-4d23-90fa-81709549b750", "name": "network-vif-plugged", "status": "completed", "tag": "11e4cf13-d392-4561-9aef-cf7f0ba66b59"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:03.957156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fbf347b5-3407-45c5-b909-12b563b7f91a req-8bf65f9f-50c5-4b68-9788-7dfb44cd5355 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:03.958013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fbf347b5-3407-45c5-b909-12b563b7f91a req-8bf65f9f-50c5-4b68-9788-7dfb44cd5355 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:04.034166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fbf347b5-3407-45c5-b909-12b563b7f91a req-8bf65f9f-50c5-4b68-9788-7dfb44cd5355 service nova] Creating event network-vif-plugged:11e4cf13-d392-4561-9aef-cf7f0ba66b59 for instance cf5f0954-5fd0-4d23-90fa-81709549b750 on n-h1-768852-23 Jul 14 15:07:04.054506 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fbf347b5-3407-45c5-b909-12b563b7f91a req-8bf65f9f-50c5-4b68-9788-7dfb44cd5355 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.165721 Jul 14 15:07:04.071924 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2412/4686] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:04.217192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:04.236335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:04.240274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:04.242122 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50cfa5c2-a836-4003-86c5-eb07ebc44f24 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 2.772550 Jul 14 15:07:04.257352 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2275/4687] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:01 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 2788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:04.922840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:04.925890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:04.946856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:04.948194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:04.950221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:04.951349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:05.280881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:05.283310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:05.315096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:05.315931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:05.318017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:05.318987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:05.379730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:05.404654 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80d5bdb0-da89-413d-8236-61cac45c48a4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1366 microversion: 2.1 time: 0.493387 Jul 14 15:07:05.404654 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2413/4688] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:04 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1366 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:06.432841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:06.434261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:06.452698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:06.453163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:06.453966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:06.454592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:06.832685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:06.855147 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4107053-2683-41d5-8cbe-73b03e857f99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1556 microversion: 2.1 time: 0.432776 Jul 14 15:07:06.856209 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2414/4689] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:06 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1556 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:06.920560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:06.927761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:06.952121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:06.953963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:06.956064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:06.958060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:07.280024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:07.325038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:07.328748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:07.330818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ae515fe-facf-4095-942b-a8df9bba703d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 2.070579 Jul 14 15:07:07.343326 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2276/4690] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:05 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:07.360289 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ae3891a-f02f-4451-8454-58118952d2d7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.481784 Jul 14 15:07:07.361452 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2415/4691] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:07:06 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-interface => generated 285 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:08.364972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:08.371967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:08.394594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:08.396199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:08.397784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:08.398719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:09.476865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:09.523586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:09.531083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:09.535196 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-52e69ec6-49d9-4efa-9099-16885c0c39f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.182842 Jul 14 15:07:09.547325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2277/4692] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:08 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:10.571183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:10.573508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:10.591765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:10.593285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:10.596066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:10.597814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:11.681092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:11.723779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:11.727750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:11.730062 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4c58029a-0002-41aa-ac4b-51f6d15b22f8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.166567 Jul 14 15:07:11.731447 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2416/4693] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:10 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:11.774106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-688544745", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:11.969531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] validate_networks() for [('b7975146-e7f1-4871-aa94-7b1ee151f5af', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:07:12.059057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e00d873c-5421-4bae-a266-8b0572bc70a7 req-b06ea46b-4605-434c-a323-5617376ae6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5f0954-5fd0-4d23-90fa-81709549b750", "tag": "11e4cf13-d392-4561-9aef-cf7f0ba66b59"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:12.097076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e00d873c-5421-4bae-a266-8b0572bc70a7 req-b06ea46b-4605-434c-a323-5617376ae6d7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:12.098111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e00d873c-5421-4bae-a266-8b0572bc70a7 req-b06ea46b-4605-434c-a323-5617376ae6d7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:12.161746 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e00d873c-5421-4bae-a266-8b0572bc70a7 req-b06ea46b-4605-434c-a323-5617376ae6d7 service nova] Creating event network-changed:11e4cf13-d392-4561-9aef-cf7f0ba66b59 for instance cf5f0954-5fd0-4d23-90fa-81709549b750 on n-h1-768852-23 Jul 14 15:07:12.176291 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e00d873c-5421-4bae-a266-8b0572bc70a7 req-b06ea46b-4605-434c-a323-5617376ae6d7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124506 Jul 14 15:07:12.181653 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2417/4694] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:12.794375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:12.796931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:12.817374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:12.818950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:12.821641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:12.823082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:13.777737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:13.836847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:13.843511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:13.847919 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c203c07-bc2b-4f22-b778-1e5a4679b990 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.072678 Jul 14 15:07:13.852336 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2418/4695] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:12 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:14.355479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1631928457", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": "none"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:14.516691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:07:14.519840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:07:14.521219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:07:14.522943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:07:14.524110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:07:14.543995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:14.545370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:14.548416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:14.550208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:14.566619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:14.597647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Getting quotas for project 47a3e6ad267248838d4f940165a008c2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:07:14.614271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Getting quotas for user a473c0bffe29419e8abe282cc07df700 and project 47a3e6ad267248838d4f940165a008c2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:07:14.650866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:07:14.657525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:07:14.808081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7bcd2189-3c9e-4229-8e9b-68704dd232c6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.946657 Jul 14 15:07:14.813821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2419/4696] 10.222.0.98 () {62 vars in 1187 bytes} [Thu Jul 14 15:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 960 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 15:07:14.834220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07a74ed5-1d7a-4927-91f1-e3cd47be3263 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:14.835430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07a74ed5-1d7a-4927-91f1-e3cd47be3263 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:14.982341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07a74ed5-1d7a-4927-91f1-e3cd47be3263 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:14.991458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07a74ed5-1d7a-4927-91f1-e3cd47be3263 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:14.993133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07a74ed5-1d7a-4927-91f1-e3cd47be3263 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:14.996038 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07a74ed5-1d7a-4927-91f1-e3cd47be3263 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1278 microversion: 2.57 time: 0.167179 Jul 14 15:07:15.011454 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2420/4697] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:14 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:15.011454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:15.011454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:15.034392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:15.034865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:15.039923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:15.040401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:15.984615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.001083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.005160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.009476 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92a2c8fe-99c6-444f-b10b-7c067358b0f2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.008868 Jul 14 15:07:16.014759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2421/4698] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:14 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:16.046075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f7a7066e-f269-4735-8183-bc670b033236 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:16.048294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f7a7066e-f269-4735-8183-bc670b033236 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:16.188891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:07:16.190366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:07:16.191200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:07:16.191895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:07:16.192624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:07:16.214544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7a7066e-f269-4735-8183-bc670b033236 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.214841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:16.215506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:16.218174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:16.222549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:16.229068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7a7066e-f269-4735-8183-bc670b033236 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.232348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7a7066e-f269-4735-8183-bc670b033236 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.236570 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f7a7066e-f269-4735-8183-bc670b033236 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1278 microversion: 2.57 time: 0.200806 Jul 14 15:07:16.239310 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2422/4699] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:16 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:16.277873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Getting quotas for project 945e45f9ecb94ff49e934ff41ce5b97c. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:07:16.300408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Getting quotas for user db35ea89c4554a03abdcfe78d9a83e60 and project 945e45f9ecb94ff49e934ff41ce5b97c. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:07:16.338781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:07:16.341874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:07:16.505023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1a23b07-7e19-4aee-9261-ad6718fcd7f1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.048647 Jul 14 15:07:16.511418 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2278/4700] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 5060 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:07:16.541129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-810271ff-bb97-4cd4-8006-ecd54c26d14a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:16.542697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-810271ff-bb97-4cd4-8006-ecd54c26d14a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:16.816078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-810271ff-bb97-4cd4-8006-ecd54c26d14a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:16.855709 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-810271ff-bb97-4cd4-8006-ecd54c26d14a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1223 microversion: 2.1 time: 0.337590 Jul 14 15:07:16.865762 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2423/4701] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:16 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1223 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:17.046333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:17.047294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:17.067380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:17.067957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:17.069252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:17.071699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:17.272493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:17.275130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:17.301572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:17.302569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:17.304924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:17.307902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:17.784006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:17.800172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:17.807941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:17.812879 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e0badca-2b30-4d76-8bf1-11bbcf9eea27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1330 microversion: 2.57 time: 0.545151 Jul 14 15:07:17.815518 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2424/4702] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:17 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1330 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:17.874467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:17.875629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:17.887579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:17.890563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:17.891134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:17.892002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:17.894829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:17.912379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:17.919339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:17.921773 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4e92d74-5f69-4b18-8849-dad72fffaff2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.879936 Jul 14 15:07:17.936569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2279/4703] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:17 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:18.113449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:18.136109 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-55eaf30d-64ee-4aa8-8ad3-45a667ebe60f tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1227 microversion: 2.1 time: 0.265418 Jul 14 15:07:18.137895 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2425/4704] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:17 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1227 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:18.846762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:18.847776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:18.875066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:18.881747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:18.898223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:18.900582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:18.946300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:18.948722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:18.968893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:18.969490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:18.973791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:18.976510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.182656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:19.212902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:19.217239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:19.236612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62ac70ab-a4d2-4efd-86ee-8173e6f40f27 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1336 microversion: 2.57 time: 0.379447 Jul 14 15:07:19.258515 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2280/4705] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:18 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1336 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:19.291853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:19.292575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:19.333814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.339025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.339965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:19.346353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:19.525688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:19.555636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9e6e9eba-14e1-4cac-b8d2-c205e123205e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1275 microversion: 2.1 time: 0.296824 Jul 14 15:07:19.557456 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2281/4706] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:19 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1275 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:20.081675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.093642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.095658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.097190 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8449473f-14ef-47c8-9db3-c63eec3b6a42 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.156911 Jul 14 15:07:20.109607 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2426/4707] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:18 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:20.275770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:20.277314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:20.289294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:20.291225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:20.293156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:20.294328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:20.341859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=70 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:20.575797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:20.576810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:20.588039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:20.593190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:20.597060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:20.597902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:20.622543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.638192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.661148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.667646 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d44cc6be-c4d8-4be7-9f55-1da44e7760df tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1336 microversion: 2.57 time: 0.395935 Jul 14 15:07:20.671736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2282/4708] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:20 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1336 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:20.903130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:20.935673 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3b52d38-e969-4bb2-b161-8db8e7ff906c tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1293 microversion: 2.1 time: 0.364717 Jul 14 15:07:20.938171 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2427/4709] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:20 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1293 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:21.132349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:21.135541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:21.152925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.154362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.156396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.157574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.715200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:21.716295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:21.740352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.742097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.745375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.747000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.767531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.782734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.787112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.792119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98fdbad9-9c33-45d9-8c72-fa276ca4b385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.671425 Jul 14 15:07:21.803731 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2283/4710] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:21 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:21.912758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.964916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:21.965550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:21.971370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.974227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.974751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.975636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:21.976088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:21.976463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:21.979033 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ced64a2-74af-4e63-962c-dc354e797d2a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1357 microversion: 2.57 time: 0.278388 Jul 14 15:07:21.983150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2428/4711] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:21 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1357 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:22.016735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:22.029036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:22.072678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.073889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.078815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.080540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.175232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:22.185692 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3452d715-acc9-43ee-871c-4241173ab489 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1281 microversion: 2.1 time: 0.224608 Jul 14 15:07:22.206014 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2284/4712] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:21 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1281 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:22.454068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:07:22.454494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:07:22.455170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:07:22.455796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:07:22.456407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:07:22.620894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:22.633053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.633748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.635045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.635303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.712253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b4affb4-1ffa-4fce-88f0-efd82e3f12a9 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "POST /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44/action" status: 202 len: 1138 microversion: 2.57 time: 0.714023 Jul 14 15:07:22.729770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:22.730406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:22.734261 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2429/4713] 10.222.0.98 () {62 vars in 1319 bytes} [Thu Jul 14 15:07:21 2022] POST /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44/action => generated 1138 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Jul 14 15:07:22.747204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.747562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.748323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.748792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.812104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:22.812746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:22.826678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.832713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:22.839644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:22.840499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:23.396948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.414761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.416381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.428708 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3529ae2-0a49-47b9-974b-4cb152766595 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.703368 Jul 14 15:07:23.440048 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2285/4714] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:22 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:23.448289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:23.449184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:23.456425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:23.457306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:23.458402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:23.459255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:23.546417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.576805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.582113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.585213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fda9780f-0d2a-4f96-9076-b7d658c08a4a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.776692 Jul 14 15:07:23.601556 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2430/4715] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:22 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:23.740142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:23.753663 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6caeddb9-5268-41b8-a54c-bebc6ad4c529 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1281 microversion: 2.1 time: 0.311977 Jul 14 15:07:23.757362 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2286/4716] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:23 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1281 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:24.468406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:24.473030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:24.522573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.523530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.525287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.526351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.613356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:24.618555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:24.619922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:24.654715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.655624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.661549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.664465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.784907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:24.818548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:24.835595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:24.838532 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dca1692c-a812-4a7e-9a80-e4f142023287 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.390471 Jul 14 15:07:24.842476 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2431/4717] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:24 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:24.864627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:24.866255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:24.894209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.895016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:24.898924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:24.899786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:25.432460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:25.452576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:25.459359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:25.463035 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d966fa4-f1ca-4bd2-85f5-7bf1dd145cd1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.847560 Jul 14 15:07:25.465342 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2287/4718] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:24 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:25.565759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:25.577829 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-995b9954-2ef9-4c62-a264-b8bb0d2e06af tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 0.720710 Jul 14 15:07:25.591399 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2432/4719] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:24 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:25.873532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:25.874164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:25.890130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:25.890588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:25.891626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:25.892941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:26.076544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:26.100987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:26.110307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:26.118209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-443891d3-261c-4b5c-bafb-351945cbd449 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.248334 Jul 14 15:07:26.119099 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2288/4720] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:25 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:26.483487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:26.484132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:26.501200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:26.501951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:26.503020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:26.503684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:26.607527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:26.608464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:26.615065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:26.616318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:26.617558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:26.620041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:26.620866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:26.622124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:26.622852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:26.824519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=12 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:27.152361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.189658 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a9a3d3e-40d5-44b6-a4b9-a997c951eeed tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 0.585644 Jul 14 15:07:27.205277 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2289/4721] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:26 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:27.226118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:27.227916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:27.240754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:27.242389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:27.243889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:27.244835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:27.298045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.320713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.322882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.324669 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1b87756-43af-41f8-b106-a3ebb3ee364b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.845265 Jul 14 15:07:27.327846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2433/4722] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:26 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:27.395838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.409741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.414441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:27.415822 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d4069ce-5f5a-478a-891f-d5bfc3bbb861 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.208696 Jul 14 15:07:27.427142 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2290/4723] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:27 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:27.838138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-32865e78-7b97-448d-8f23-e64ab49ee4c6 req-7e012b01-25ff-4f93-bc83-ed0c744d70ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90b50750-3fa3-4444-88e4-ab68794d58e3", "tag": "4fae7ba3-07d5-46df-bc3e-8a0958578931"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:27.856925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-32865e78-7b97-448d-8f23-e64ab49ee4c6 req-7e012b01-25ff-4f93-bc83-ed0c744d70ec service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:27.857397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-32865e78-7b97-448d-8f23-e64ab49ee4c6 req-7e012b01-25ff-4f93-bc83-ed0c744d70ec service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:27.886202 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-32865e78-7b97-448d-8f23-e64ab49ee4c6 req-7e012b01-25ff-4f93-bc83-ed0c744d70ec service nova] Creating event network-changed:4fae7ba3-07d5-46df-bc3e-8a0958578931 for instance 90b50750-3fa3-4444-88e4-ab68794d58e3 on n-h1-768852-23 Jul 14 15:07:27.891990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-32865e78-7b97-448d-8f23-e64ab49ee4c6 req-7e012b01-25ff-4f93-bc83-ed0c744d70ec service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058650 Jul 14 15:07:27.892700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2434/4724] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:28.224263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:28.232092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:28.252827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.253488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.256675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.258676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.358444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:28.359831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:28.375954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.376424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.377264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.377944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.807415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:28.818161 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3115e04-e934-4e79-a605-b655e4bc99dc tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 0.600702 Jul 14 15:07:28.830285 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2291/4725] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:28 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:07:28.836567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:28.837836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:28.845670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.846514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.847667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:28.848395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:28.993704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:29.004664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:29.009675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:29.011672 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a45b08c5-c64c-4bb8-8094-91ea80ed69d6 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.179847 Jul 14 15:07:29.012642 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2292/4726] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:28 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:29.506674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:29.522415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:29.530190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:29.532013 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-da490321-d522-4b06-ab08-bafdf5fe8e74 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.178224 Jul 14 15:07:29.539548 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2435/4727] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:28 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:29.868393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:29.870634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:29.890750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:29.893273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:29.896311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:29.898488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:30.036248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:30.038978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:30.044627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:30.077981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:30.079258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:30.081535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:30.084432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:30.594453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:30.624760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:30.648859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:30.651393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20e20c89-eff7-4a7e-a7a0-535844d588e2 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.622337 Jul 14 15:07:30.660348 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2436/4728] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:30 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:30.679067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:30.684780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:30.704910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:30.712004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:30.713999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:30.714219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:31.240027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:31.254015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73733675-044e-4dc9-9ec3-d39358ce82f8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 1.418801 Jul 14 15:07:31.254634 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2293/4729] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:29 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:31.673347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:31.673983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:31.689725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:31.690185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:31.690994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:31.691468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:31.885523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:31.913636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:31.915561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:31.916831 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8673a1a-0aec-4dfa-961b-a68cacf53228 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.247486 Jul 14 15:07:31.917440 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2294/4730] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:31 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:32.116083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:32.132396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:32.140300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:32.142440 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c8e27b5-2168-417d-ac24-d21c881aceec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.479500 Jul 14 15:07:32.148264 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2437/4731] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:30 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:32.274988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:32.276377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:32.293171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:32.294066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:32.296237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:32.297051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:32.953374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:32.957847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:33.003509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:33.005856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:33.011001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:33.013067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:33.057439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:33.150693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.184738 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1c40134d-5f85-4710-b668-0a35fca7f1a9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 0.916469 Jul 14 15:07:33.190792 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2295/4732] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:32 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:33.213888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:33.215815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:33.240023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:33.240815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:33.242916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:33.243752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:33.613372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.659435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.664521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.676424 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-304e3a15-dace-43dc-abea-4f63ad388e71 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.730491 Jul 14 15:07:33.680402 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2438/4733] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:32 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:33.909747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.924758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.936010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:33.938882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-617f3cbd-b957-4609-9d02-969691791f88 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.745922 Jul 14 15:07:33.944554 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2296/4734] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:33 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:34.209954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:34.210774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:34.232854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:34.234943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:34.242928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:34.246460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:34.705338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:34.706255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:34.728438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:34.728438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:34.729999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:34.730689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:34.867975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:34.899840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:34.908586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:34.914472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0af5920a-6789-4dbd-ada8-9683332b790d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.211998 Jul 14 15:07:34.916896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:34.931085 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39297cb9-cadc-4b9f-a051-6c295b76d3f5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 0.725191 Jul 14 15:07:34.947062 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2439/4735] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:34 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:34.948050 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2297/4736] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:34 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:34.978875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:34.979867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:34.989437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:34.990358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:34.992236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:34.992984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:35.466448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:35.483260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:35.488257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:35.490570 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35907a21-1915-4a48-91ce-51da17a2a83c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.516205 Jul 14 15:07:35.503351 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2440/4737] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:34 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:35.956772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:35.958378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:35.959241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:35.959566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:35.974508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:35.975597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:35.976596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:35.977237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:35.979409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:35.985958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:35.988540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:35.989163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:36.232193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:36.252857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:36.254738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:36.256483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-840b88f7-ae3c-4c5e-9c9d-cf21dc172cd7 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.305134 Jul 14 15:07:36.271440 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2441/4738] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:35 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:36.509624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:36.510339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:36.524954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:36.531318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:36.532479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:36.535008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:36.990426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.000774 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1d98ba0-0d8b-480b-a0ae-6f2b92f391aa tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 1.050097 Jul 14 15:07:37.005429 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2298/4739] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:35 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:37.108633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e328d3a1-a9ae-4066-872d-6d79db436152 req-ea324c69-8a17-4cf0-8a45-f9999730394f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b50750-3fa3-4444-88e4-ab68794d58e3", "name": "network-vif-plugged", "status": "completed", "tag": "4fae7ba3-07d5-46df-bc3e-8a0958578931"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:37.124619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e328d3a1-a9ae-4066-872d-6d79db436152 req-ea324c69-8a17-4cf0-8a45-f9999730394f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:37.125227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e328d3a1-a9ae-4066-872d-6d79db436152 req-ea324c69-8a17-4cf0-8a45-f9999730394f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:37.149185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:37.155828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e328d3a1-a9ae-4066-872d-6d79db436152 req-ea324c69-8a17-4cf0-8a45-f9999730394f service nova] Creating event network-vif-plugged:4fae7ba3-07d5-46df-bc3e-8a0958578931 for instance 90b50750-3fa3-4444-88e4-ab68794d58e3 on n-h1-768852-23 Jul 14 15:07:37.183227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e328d3a1-a9ae-4066-872d-6d79db436152 req-ea324c69-8a17-4cf0-8a45-f9999730394f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068664 Jul 14 15:07:37.184643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2299/4740] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:07:37.300749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:37.302532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:37.317171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:37.323816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:37.325188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:37.325859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:37.486167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.507098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.510930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.516103 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0980e3e3-54d3-47f2-ab49-d49be9d95edf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.010475 Jul 14 15:07:37.517737 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2442/4741] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:36 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:37.740681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.754778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.759201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:37.764986 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7ffcd5ef-8073-41d1-8cfd-90bb9760199a tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.467933 Jul 14 15:07:37.768281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2300/4742] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:37 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:38.019456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:38.020298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:38.034151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.037031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.039145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.040268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.539234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:38.540598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:38.550237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.551112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.552145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.552776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.858150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:38.899510 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9675d217-4bc2-4116-87ad-9b2f5303ab1b tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1323 microversion: 2.1 time: 0.883740 Jul 14 15:07:38.906286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2443/4743] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:38 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1323 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:38.936778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:38.949120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:38.974034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.981077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:38.983253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:38.988959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:39.400988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.424331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.426447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.428385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-433fcfae-5f01-4a8c-8be9-d8bd2a039ea1 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.517646 Jul 14 15:07:39.440828 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2444/4744] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:38 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:39.533503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.558273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.592592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:39.599323 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d2caa94-5318-4e26-91d3-0f90da11cae9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.063887 Jul 14 15:07:39.614251 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2301/4745] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:38 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:39.932584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:39.933433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:39.944842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:39.945314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:39.946175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:39.946611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:40.465738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:40.466369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:40.478034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:40.488112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:40.489298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:40.491898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:40.691591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:40.709965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:40.714150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:40.716536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4ea28f8-8610-4970-91eb-b5ace56ca5b3 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.254107 Jul 14 15:07:40.719981 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2302/4746] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:40 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:40.727512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:40.728463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:40.735822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:40.736621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:40.737927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:40.738548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:41.152700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:41.182743 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f943fa19-8e50-4251-a3de-ed9a2964718a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1519 microversion: 2.1 time: 1.254954 Jul 14 15:07:41.192383 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2445/4747] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:39 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1519 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:41.452494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1b3451d-41e2-440b-ac48-4a61de710895 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-345233856", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1b3451d-41e2-440b-ac48-4a61de710895 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 242 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-345233856", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-345233856', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'b7975146-e7f1-4871-aa94-7b1ee151f5af'}]}}} Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'': 'data1'} Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:07:41.455907 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1b3451d-41e2-440b-ac48-4a61de710895 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1b3451d-41e2-440b-ac48-4a61de710895 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.010499 Jul 14 15:07:41.469233 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2446/4748] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:41 2022] POST /compute/v2.1/servers => generated 175 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:07:41.481159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-baa0b819-58da-4528-8127-60828db756f9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:41.482560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-baa0b819-58da-4528-8127-60828db756f9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:41.501139 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-baa0b819-58da-4528-8127-60828db756f9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] HTTP exception thrown: Instance 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109 could not be found. Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-baa0b819-58da-4528-8127-60828db756f9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/3ea21f94-5f45-4e5a-ac3f-dcb1765ff109/metadata HTTP/1.1 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109 could not be found. Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': '3ea21f94-5f45-4e5a-ac3f-dcb1765ff109'} Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109 could not be found. Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109 could not be found. Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.506677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.517712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:07:41.517712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:07:41.517712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109 could not be found. Jul 14 15:07:41.517712 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.521322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-baa0b819-58da-4528-8127-60828db756f9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 404 to user: Instance 3ea21f94-5f45-4e5a-ac3f-dcb1765ff109 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:41.528069 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-baa0b819-58da-4528-8127-60828db756f9 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/3ea21f94-5f45-4e5a-ac3f-dcb1765ff109/metadata" status: 404 len: 111 microversion: 2.1 time: 0.052603 Jul 14 15:07:41.538228 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2447/4749] 10.222.0.98 () {58 vars in 1262 bytes} [Thu Jul 14 15:07:41 2022] GET /compute/v2.1/servers/3ea21f94-5f45-4e5a-ac3f-dcb1765ff109/metadata => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:07:41.656734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-940cd57d-0677-4351-a3c1-54dd1359ba3e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1613031023", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-940cd57d-0677-4351-a3c1-54dd1359ba3e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 499 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1613031023", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1613031023', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b7975146-e7f1-4871-aa94-7b1ee151f5af'}]}}} Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 15:07:41.677054 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-940cd57d-0677-4351-a3c1-54dd1359ba3e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-940cd57d-0677-4351-a3c1-54dd1359ba3e tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.049461 Jul 14 15:07:41.681706 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2448/4750] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:41 2022] POST /compute/v2.1/servers => generated 687 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:07:41.753668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e7f83d1-d36e-4047-a082-28cbfd166996 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1832273555", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e7f83d1-d36e-4047-a082-28cbfd166996 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 500 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1832273555", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1832273555', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b7975146-e7f1-4871-aa94-7b1ee151f5af'}]}}} Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 15:07:41.762200 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:41.765900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:41.770130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e7f83d1-d36e-4047-a082-28cbfd166996 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:41.778622 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e7f83d1-d36e-4047-a082-28cbfd166996 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.029293 Jul 14 15:07:41.780227 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2449/4751] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:41 2022] POST /compute/v2.1/servers => generated 689 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:07:41.828687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:41.845112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:41.864818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:41.868210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:41.869111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:41.869565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:42.122825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:42.177305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:42.179923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:42.188957 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93f5dc10-6503-4c6c-be38-ddda86b1ed17 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.399910 Jul 14 15:07:42.189886 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2450/4752] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:41 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:42.207579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-053b1103-925b-4ac4-9f2b-5ea0c136494a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-57747768", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-053b1103-925b-4ac4-9f2b-5ea0c136494a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 752 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-57747768", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-57747768', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b7975146-e7f1-4871-aa94-7b1ee151f5af'}]}}} Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:07:42.218345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:07:42.221391 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:07:42.226487 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.226487 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.226487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-053b1103-925b-4ac4-9f2b-5ea0c136494a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:42.226487 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-053b1103-925b-4ac4-9f2b-5ea0c136494a tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.029656 Jul 14 15:07:42.226487 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2451/4753] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:07:42 2022] POST /compute/v2.1/servers => generated 1197 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 14 15:07:42.311515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77bea916-b2af-4ff7-be4c-f8f95bfdee87 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1917846179", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77bea916-b2af-4ff7-be4c-f8f95bfdee87 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers HTTP/1.1 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 1266 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1917846179", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "b7975146-e7f1-4871-aa94-7b1ee151f5af"}]}} Jul 14 15:07:42.315847 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1917846179', 'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'b7975146-e7f1-4871-aa94-7b1ee151f5af'}]}}} Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi 'type': 'object'} Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.319423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi On instance['server']: Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:07:42.320719 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:07:42.322734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Jul 14 15:07:42.322734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.325042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77bea916-b2af-4ff7-be4c-f8f95bfdee87 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:42.326249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77bea916-b2af-4ff7-be4c-f8f95bfdee87 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.020431 Jul 14 15:07:42.327577 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2452/4754] 10.222.0.98 () {60 vars in 1147 bytes} [Thu Jul 14 15:07:42 2022] POST /compute/v2.1/servers => generated 2221 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Jul 14 15:07:42.341138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ac0142e-0474-4c77-bbeb-78e6e15aeeae tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:42.341916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9ac0142e-0474-4c77-bbeb-78e6e15aeeae tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 289cfa4d-217d-4ce8-ac05-909ef1c755f7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:42.355600 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-9ac0142e-0474-4c77-bbeb-78e6e15aeeae tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] HTTP exception thrown: Instance 289cfa4d-217d-4ce8-ac05-909ef1c755f7 could not be found. Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ac0142e-0474-4c77-bbeb-78e6e15aeeae tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/289cfa4d-217d-4ce8-ac05-909ef1c755f7/metadata/test2 HTTP/1.1 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 289cfa4d-217d-4ce8-ac05-909ef1c755f7 could not be found. Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': '289cfa4d-217d-4ce8-ac05-909ef1c755f7', 'id': 'test2'} Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 289cfa4d-217d-4ce8-ac05-909ef1c755f7 could not be found. Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 289cfa4d-217d-4ce8-ac05-909ef1c755f7 could not be found. Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:42.357383 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:42.362126 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:07:42.362126 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:07:42.362126 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 289cfa4d-217d-4ce8-ac05-909ef1c755f7 could not be found. Jul 14 15:07:42.362126 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:42.362126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ac0142e-0474-4c77-bbeb-78e6e15aeeae tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 404 to user: Instance 289cfa4d-217d-4ce8-ac05-909ef1c755f7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:42.362126 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9ac0142e-0474-4c77-bbeb-78e6e15aeeae tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/289cfa4d-217d-4ce8-ac05-909ef1c755f7/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.023011 Jul 14 15:07:42.364017 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2453/4755] 10.222.0.98 () {58 vars in 1280 bytes} [Thu Jul 14 15:07:42 2022] GET /compute/v2.1/servers/289cfa4d-217d-4ce8-ac05-909ef1c755f7/metadata/test2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:07:42.386514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:42.387447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:42.399728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:42.400398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:42.401405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:42.402326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:42.451138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:07:42.529726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:42.554656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:42.561961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:42.566582 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf8df924-b4f7-4753-acd8-290aa92a239a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.843381 Jul 14 15:07:42.569743 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2303/4756] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:40 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:42.630537 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5662eb90-fd21-4cc7-8674-1fa5a6f14037 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "DELETE /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 204 len: 0 microversion: 2.1 time: 0.249728 Jul 14 15:07:42.636091 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2454/4757] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:07:42 2022] DELETE /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:07:42.657041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:42.658047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:42.684571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:42.686643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:42.690062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:42.690865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:43.229867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:43.236345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:43.269045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:43.273086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:43.275949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:43.292994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:43.500019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.515536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ffa67d8b-739a-497c-9fba-fa893dd9bee1 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1525 microversion: 2.1 time: 0.873738 Jul 14 15:07:43.518296 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2304/4758] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:42 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1525 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:43.598434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:43.600589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:43.621035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.621478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:43.622055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:43.623970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:43.624569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:43.645192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.649126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.663511 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c8e1fd5-58ee-4205-8b20-31180fcf0d2c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.445364 Jul 14 15:07:43.665191 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2455/4759] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:43 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:43.900800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.914065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.916052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:43.917840 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-721089d0-cca4-43a6-9d2e-3ab3114df832 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.326031 Jul 14 15:07:43.919747 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2305/4760] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:43 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:44.538902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:44.552898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:44.574241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:44.585046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:44.586790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:44.588120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:44.705175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:44.711713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:44.742814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:44.744100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:44.749004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:44.750270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:44.998357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:45.017031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:45.021790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:45.026211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-09f59e41-58ec-48dd-92ed-df8997a3eb64 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.342176 Jul 14 15:07:45.028463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2306/4761] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:44 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:45.045741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:45.048313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:45.063122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:45.064787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:45.066721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:45.068302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:45.133201 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b83ca25-3f1b-4ec9-bc40-cb160d817c75 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/ips" status: 200 len: 150 microversion: 2.1 time: 0.102267 Jul 14 15:07:45.135239 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2307/4762] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:07:45 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:45.147759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:45.150976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:45.162804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:45.163851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:45.173299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:45.175233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:45.648350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:45.699167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-feae522e-d4e6-4279-a762-ce5d58052989 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1525 microversion: 2.1 time: 1.166859 Jul 14 15:07:45.702696 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2456/4763] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:44 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1525 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:46.071513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:46.073770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:46.137008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:46.138946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:46.140866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:46.141838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:46.544038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.592947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.596148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.597595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.613261 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8c960ac-e0d5-4293-a511-81a301f0f46c tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.475694 Jul 14 15:07:46.621105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.626356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:46.632330 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2308/4764] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:45 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:46.645845 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b23edde7-87c8-45a5-9745-a5207a324754 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.586037 Jul 14 15:07:46.664352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2457/4765] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:46 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:46.737110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:46.738096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:46.779563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:46.780347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:46.796713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:46.797480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.265225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db35ea89c4554a03abdcfe78d9a83e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '945e45f9ecb94ff49e934ff41ce5b97c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:47.342556 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0884c063-ac6a-42fc-91a8-c02b9c7dbea8 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 200 len: 1483 microversion: 2.1 time: 0.592810 Jul 14 15:07:47.351922 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2309/4766] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:46 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 1483 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:07:47.492281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dcc03350-b82d-477a-8c8a-61446706b72f req-e5b167db-68e5-4912-8145-1de3c946481d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90b50750-3fa3-4444-88e4-ab68794d58e3", "name": "network-vif-deleted", "tag": "4fae7ba3-07d5-46df-bc3e-8a0958578931"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:47.544409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dcc03350-b82d-477a-8c8a-61446706b72f req-e5b167db-68e5-4912-8145-1de3c946481d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.553839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dcc03350-b82d-477a-8c8a-61446706b72f req-e5b167db-68e5-4912-8145-1de3c946481d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.656274 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dcc03350-b82d-477a-8c8a-61446706b72f req-e5b167db-68e5-4912-8145-1de3c946481d service nova] Creating event network-vif-deleted:4fae7ba3-07d5-46df-bc3e-8a0958578931 for instance 90b50750-3fa3-4444-88e4-ab68794d58e3 on n-h1-768852-23 Jul 14 15:07:47.657872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:47.667366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:47.695218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dcc03350-b82d-477a-8c8a-61446706b72f req-e5b167db-68e5-4912-8145-1de3c946481d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230224 Jul 14 15:07:47.701557 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2458/4767] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:47.714459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.715664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.721252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.722591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.728467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:47.730368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:47.787777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.789144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:47.791111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:47.799296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.261327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.312763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.317933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.329477 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8be7af4d-e6f9-43e5-948e-d26b5d205f58 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.625650 Jul 14 15:07:48.336432 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2459/4768] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:47 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:48.371118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:48.375632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] [instance: 90b50750-3fa3-4444-88e4-ab68794d58e3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:48.402079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:48.413568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.415499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:48.417557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.479707 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] HTTP exception thrown: Instance 90b50750-3fa3-4444-88e4-ab68794d58e3 could not be found. Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Request method failure captured: Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 HTTP/1.1 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEfG8houPbvH6mDS3tdb-1k06X7nrdJt4e7ZZkuL-5LhWsKWxmqUHdZiaEC32-cEKltblw1aD347AGweMl_42_oz69IIChn6aO5ALps5H7Kpg2OAWoQuLB3wJcvn0GtWvInu0R-hM7idlC8P8AFXs_8b_2ND-qTVGvCTBQz7MD-5mE Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/945e45f9ecb94ff49e934ff41ce5b97c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 945e45f9ecb94ff49e934ff41ce5b97c Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1887236334 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db35ea89c4554a03abdcfe78d9a83e60 Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1887236334-project Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 90b50750-3fa3-4444-88e4-ab68794d58e3 could not be found. Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '90b50750-3fa3-4444-88e4-ab68794d58e3'} Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90b50750-3fa3-4444-88e4-ab68794d58e3 could not be found. Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90b50750-3fa3-4444-88e4-ab68794d58e3 could not be found. Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:48.494021 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90b50750-3fa3-4444-88e4-ab68794d58e3 could not be found. Jul 14 15:07:48.499210 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:07:48.504085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] Returning 404 to user: Instance 90b50750-3fa3-4444-88e4-ab68794d58e3 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:07:48.506221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c94f2474-6fbd-485d-8b60-e80f49a7ada5 tempest-ServerMetadataNegativeTestJSON-1887236334 tempest-ServerMetadataNegativeTestJSON-1887236334-project] 10.222.0.98 "GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3" status: 404 len: 111 microversion: 2.1 time: 0.147221 Jul 14 15:07:48.511005 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2460/4769] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:07:48 2022] GET /compute/v2.1/servers/90b50750-3fa3-4444-88e4-ab68794d58e3 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:07:48.544916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.570782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.573445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:48.576163 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4955e38-e19e-4e0f-b7db-b91c3048f385 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.928432 Jul 14 15:07:48.577404 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2310/4770] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:47 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:48.599577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "666e92a4-0197-43b0-a434-2d44ca9a1a02"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:48.602464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:48.615145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:48.616345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.617900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:48.618883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:48.658642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:49.098183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-465d86f3-634a-42da-98a9-bdd5de940d07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503447 Jul 14 15:07:49.100023 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2461/4771] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:07:48 2022] POST /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 194 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:49.371029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:49.382660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:49.431351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.432740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.441029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.445648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.513857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-64598aa3-c2a9-4660-bfea-062341cd36fe req-9b830ef4-b657-4a36-97d5-82dd802f2029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:49.544107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-64598aa3-c2a9-4660-bfea-062341cd36fe req-9b830ef4-b657-4a36-97d5-82dd802f2029 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.545526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-64598aa3-c2a9-4660-bfea-062341cd36fe req-9b830ef4-b657-4a36-97d5-82dd802f2029 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.630596 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-64598aa3-c2a9-4660-bfea-062341cd36fe req-9b830ef4-b657-4a36-97d5-82dd802f2029 service nova] Creating event network-vif-plugged:53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:49.665666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-64598aa3-c2a9-4660-bfea-062341cd36fe req-9b830ef4-b657-4a36-97d5-82dd802f2029 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152793 Jul 14 15:07:49.667988 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2462/4772] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:49.692973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:49.698307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:49.739749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.740836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.741719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:49.742946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:49.875467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:49.936329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:49.948205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:49.957768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65c382d6-8d21-48c2-adc4-1e5af25e9d77 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.589199 Jul 14 15:07:49.960191 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2311/4773] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:49 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:50.994687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:50.997844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:51.037925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.049511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.057880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.065556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.297855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.327347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.332737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.340851 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-99173755-bde6-4fde-9e5b-be55cee2a441 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.355273 Jul 14 15:07:51.366685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2312/4774] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:50 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:07:51.416421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.441515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.443720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:51.447868 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5d1b730-a24d-4ce2-9ace-e18a517f6216 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.776003 Jul 14 15:07:51.450077 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2463/4775] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:49 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1781 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:51.725337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-fed9895c-f0eb-41c5-8c38-610743b3295a req-e4e0f067-07b0-4ee5-97f8-f6dc0e8572dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "a352d74d-30f9-4fde-9294-c024e6013bd2"}, {"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "a52ddc00-dfb4-45b7-bae9-fda2e03aee2a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:51.765406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fed9895c-f0eb-41c5-8c38-610743b3295a req-e4e0f067-07b0-4ee5-97f8-f6dc0e8572dc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:51.771074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fed9895c-f0eb-41c5-8c38-610743b3295a req-e4e0f067-07b0-4ee5-97f8-f6dc0e8572dc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:51.810011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fed9895c-f0eb-41c5-8c38-610743b3295a req-e4e0f067-07b0-4ee5-97f8-f6dc0e8572dc service nova] Creating event network-vif-plugged:a352d74d-30f9-4fde-9294-c024e6013bd2 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:51.813071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fed9895c-f0eb-41c5-8c38-610743b3295a req-e4e0f067-07b0-4ee5-97f8-f6dc0e8572dc service nova] Creating event network-vif-plugged:a52ddc00-dfb4-45b7-bae9-fda2e03aee2a for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:51.826146 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-fed9895c-f0eb-41c5-8c38-610743b3295a req-e4e0f067-07b0-4ee5-97f8-f6dc0e8572dc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.108924 Jul 14 15:07:51.827485 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2313/4776] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:52.392051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:52.393633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:52.432543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:52.433605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:52.436878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:52.437336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:52.489202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:52.492968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:52.525758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:52.535802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:52.540504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:52.543903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:53.021902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.040488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.047829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.050561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e8a886e-02e2-4798-9836-6611f341caab tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 0.671016 Jul 14 15:07:53.056323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2464/4777] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:52 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:53.527159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.567450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.575803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:53.589021 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13c1d285-35d2-49bd-981f-aaec470f12ab tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.110847 Jul 14 15:07:53.590319 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2314/4778] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:52 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:53.899690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c"}, {"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "79814c34-6100-4478-ae14-15f6b596a8b3"}, {"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "a0c04296-1fa2-4baa-8850-095f5e5b1325"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:53.923206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:53.924310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:53.966071 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] Creating event network-vif-plugged:ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:53.971659 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] Creating event network-vif-plugged:79814c34-6100-4478-ae14-15f6b596a8b3 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:53.973061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] Creating event network-vif-plugged:a0c04296-1fa2-4baa-8850-095f5e5b1325 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:54.005166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6aab8ebb-5cb6-4889-b3ec-bf75b1c4154f req-e48cf1da-90f7-4ab4-9891-27cf0f1e4e1a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.109298 Jul 14 15:07:54.006404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2465/4779] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:07:54.093784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:54.096352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:54.144786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:54.146057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:54.148032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:54.149181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:54.620822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:54.622214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:54.649825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:54.650540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:54.654567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:54.657944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:55.469889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.491555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.502187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.504219 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8f83514-66af-45fa-978f-4e8f080dc09c tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1366 microversion: 2.57 time: 1.421187 Jul 14 15:07:55.505270 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2315/4780] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:54 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1366 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:55.863664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.878148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.884747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:55.888677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-efd31ebe-d629-4f65-9955-0244540a7b31 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.273018 Jul 14 15:07:55.892246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2466/4781] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:54 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:56.032088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d661e353-3334-4a1f-bfba-3f0bd462a54a req-39b202e7-044f-4249-abfc-a2637265f8ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-plugged", "status": "completed", "tag": "46c2e51a-51ca-4fdf-868a-828e8822655a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:07:56.048991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d661e353-3334-4a1f-bfba-3f0bd462a54a req-39b202e7-044f-4249-abfc-a2637265f8ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.053399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d661e353-3334-4a1f-bfba-3f0bd462a54a req-39b202e7-044f-4249-abfc-a2637265f8ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.084383 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d661e353-3334-4a1f-bfba-3f0bd462a54a req-39b202e7-044f-4249-abfc-a2637265f8ea service nova] Creating event network-vif-plugged:46c2e51a-51ca-4fdf-868a-828e8822655a for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:07:56.100776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d661e353-3334-4a1f-bfba-3f0bd462a54a req-39b202e7-044f-4249-abfc-a2637265f8ea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071631 Jul 14 15:07:56.103675 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2316/4782] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:07:56.526075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:56.526819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:56.549531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.550083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.551232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.553074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.869939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:56.887763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:56.895439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:56.898915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b33ed1e-584f-43e9-a387-63fef3e203a8 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1372 microversion: 2.57 time: 0.377415 Jul 14 15:07:56.913402 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2467/4783] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:56 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1372 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:56.967554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:56.969783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:56.991071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=56 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:07:56.993902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.995171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:56.996328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:56.996997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:57.921200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:57.921895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:57.947323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:57.948437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:57.949410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:57.949869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:58.186372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.207016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.213527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.216450 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b665c0a9-4c38-4254-bc59-498dbe59dd2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1372 microversion: 2.57 time: 0.300859 Jul 14 15:07:58.221156 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2468/4784] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:57 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1372 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:58.239180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.255463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.265105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:07:58.266764 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9a2fa93e-2525-4b68-88c9-8938004a8f34 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 1.343811 Jul 14 15:07:58.279473 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2317/4785] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:56 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:07:59.238799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:59.241335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:59.253623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:59.257906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:59.259205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:59.262077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:59.291155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:07:59.293453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:07:59.330496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:59.336077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:59.341481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:07:59.352019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:07:59.364517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:00.114106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.136980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.138611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.140124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81fe0c4a-d79e-49e6-b1fd-c6a20829414d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1880 microversion: 2.32 time: 0.857739 Jul 14 15:08:00.141049 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2318/4786] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:59 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1880 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:08:00.187012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.196832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.202962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.206920 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7191be5-f728-43b5-b909-04f66024ecb4 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1357 microversion: 2.57 time: 0.972085 Jul 14 15:08:00.218312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2469/4787] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:07:59 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1357 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:08:00.248180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:00.248694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:00.273681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:00.274462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:00.288460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:00.289565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:00.344209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:08:00.511751 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6452f5b5-c0dc-4a8b-a91d-4d8dc7208b7e tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 204 len: 0 microversion: 2.57 time: 0.275539 Jul 14 15:08:00.520507 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2319/4788] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 15:08:00 2022] DELETE /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 15:08:00.529892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:00.538614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:00.544856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:00.563673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:00.579194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:00.580614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:00.586783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:00.854555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.869827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.871788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:00.875255 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-065845fa-80ae-4106-9890-453fec72d451 tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1363 microversion: 2.57 time: 0.349905 Jul 14 15:08:00.904764 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2470/4789] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:08:00 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:08:01.160327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:01.161288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:01.175195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:01.175871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:01.176880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:01.179109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:01.925507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:01.926626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:01.980492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:01.980972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:01.981806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:01.982254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:02.204000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.217655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.223583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.233356 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0cd6855b-249a-43ac-b117-007c304cee2d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1363 microversion: 2.57 time: 0.325413 Jul 14 15:08:02.248972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.251452 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2471/4790] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:08:01 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:08:02.278729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.284582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:02.288044 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d419ff1-5b2e-4eda-a6f0-9ed06639ced8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2829 microversion: 2.32 time: 1.131430 Jul 14 15:08:02.295711 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2320/4791] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:08:01 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2829 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:08:02.336448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:02.337655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:02.355694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:02.356576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:02.360679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:02.361578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:02.732803 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63f48826-53f0-43bf-8eb7-d76aa707f363 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.417385 Jul 14 15:08:02.734054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2472/4792] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 15:08:02 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739/os-interface => generated 1829 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:08:03.273124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:03.273766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:03.308163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:03.308752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:03.309622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:03.310087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:03.382566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:03.383347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:03.384033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lazy-loading 'fault' on Instance uuid 9dd73955-3715-4e03-9897-0865dd3f7a44 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:08:04.322606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:04.337469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:04.346231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a473c0bffe29419e8abe282cc07df700', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47a3e6ad267248838d4f940165a008c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:04.347799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b42dbf22-abf5-42d0-96d6-59a4b19458fa tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 200 len: 1368 microversion: 2.57 time: 1.080580 Jul 14 15:08:04.348423 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2321/4793] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:08:03 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 1368 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:08:05.381630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:05.390216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] [instance: 9dd73955-3715-4e03-9897-0865dd3f7a44] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:05.413606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:05.414354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:05.431784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:05.432207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:05.503101 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] HTTP exception thrown: Instance 9dd73955-3715-4e03-9897-0865dd3f7a44 could not be found. Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Request method failure captured: Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 HTTP/1.1 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DEg02CXdZ39mFIqmWKh8KNWcHbVlVxkWYWHI8zT0e-Hp-i80ZCC2bVgLefId2EkOSuREJkqrtNJ1USfUsXzn3SPmUvkYjeLx-ZLIbmDIGldczQ05wtcUXwvP8qCzgp5jgd_I7Pxw1907HXnDj8LW7YvnMm2Gu0OA_HB0hnoKNnLmLU Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.57 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 47a3e6ad267248838d4f940165a008c2 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerShowV257Test-252060220 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47a3e6ad267248838d4f940165a008c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_47a3e6ad267248838d4f940165a008c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/47a3e6ad267248838d4f940165a008c2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/47a3e6ad267248838d4f940165a008c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerShowV257Test-252060220 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 47a3e6ad267248838d4f940165a008c2 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerShowV257Test-252060220 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerShowV257Test-252060220-project Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a473c0bffe29419e8abe282cc07df700 Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerShowV257Test-252060220-project Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 9dd73955-3715-4e03-9897-0865dd3f7a44 could not be found. Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9dd73955-3715-4e03-9897-0865dd3f7a44'} Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd73955-3715-4e03-9897-0865dd3f7a44 could not be found. Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd73955-3715-4e03-9897-0865dd3f7a44 could not be found. Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:08:05.506900 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd73955-3715-4e03-9897-0865dd3f7a44 could not be found. Jul 14 15:08:05.516887 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:08:05.519508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] Returning 404 to user: Instance 9dd73955-3715-4e03-9897-0865dd3f7a44 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:08:05.522137 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20a7baa2-9676-4fe2-9f3e-9eb8c92b1f9d tempest-ServerShowV257Test-252060220 tempest-ServerShowV257Test-252060220-project] 10.222.0.98 "GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44" status: 404 len: 111 microversion: 2.57 time: 0.157509 Jul 14 15:08:05.523520 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2473/4794] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:08:05 2022] GET /compute/v2.1/servers/9dd73955-3715-4e03-9897-0865dd3f7a44 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:08:06.406816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-acde8164-ffbe-47ae-a8ca-a648d0b5b111 req-f9812d5b-e8be-4501-946b-1283a3942114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "tag": "a352d74d-30f9-4fde-9294-c024e6013bd2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:06.451244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-acde8164-ffbe-47ae-a8ca-a648d0b5b111 req-f9812d5b-e8be-4501-946b-1283a3942114 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:06.452796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-acde8164-ffbe-47ae-a8ca-a648d0b5b111 req-f9812d5b-e8be-4501-946b-1283a3942114 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:06.512145 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-acde8164-ffbe-47ae-a8ca-a648d0b5b111 req-f9812d5b-e8be-4501-946b-1283a3942114 service nova] Creating event network-changed:a352d74d-30f9-4fde-9294-c024e6013bd2 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:08:06.525171 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-acde8164-ffbe-47ae-a8ca-a648d0b5b111 req-f9812d5b-e8be-4501-946b-1283a3942114 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129270 Jul 14 15:08:06.528121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2322/4795] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:09.190011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50234689-d45b-44b5-91d0-d3686b18b280 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: .version_select at 0x7fdbf2bc6b80>, body: {"keypair": {"name": "tempest-keypair-1357391483", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkvx28EE3npAbR+vzXQoSrBAU4eoCgOD7h8mhjqnOLIwm37qK3SCEmI74jBLzQ4gt0an+tX3tdvmZE+VAOLIl76F9vpRM6+l3I6eSFSmtyOGpQ2j7Efx99M654B3V/CLg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:09.226481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-50234689-d45b-44b5-91d0-d3686b18b280 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:08:09.237077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-50234689-d45b-44b5-91d0-d3686b18b280 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:08:09.323899 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50234689-d45b-44b5-91d0-d3686b18b280 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.136346 Jul 14 15:08:09.327500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2474/4796] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:08:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:11.479187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63f121a8-33eb-4bbe-bf15-7ce375843b7e tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Calling method '.version_select at 0x7fdbf319f040>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:11.719307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63f121a8-33eb-4bbe-bf15-7ce375843b7e tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.609450 Jul 14 15:08:11.727383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2323/4797] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 15:08:11 2022] GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6/defaults => generated 371 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:11.735376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b461140d-20ef-458a-9e24-55a60f9b123a tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Calling method '.version_select at 0x7fdbf23330d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:12.010924 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b461140d-20ef-458a-9e24-55a60f9b123a tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6" status: 200 len: 371 microversion: 2.1 time: 0.279425 Jul 14 15:08:12.015250 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2475/4798] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:08:11 2022] GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6 => generated 371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:12.040735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f50ba47e-8f81-4cbd-a76b-5b9ce43df8d3 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Calling method '.version_select at 0x7fdbf1e2a820>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:12.244402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f50ba47e-8f81-4cbd-a76b-5b9ce43df8d3 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6/defaults" status: 200 len: 371 microversion: 2.1 time: 0.214200 Jul 14 15:08:12.251664 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2324/4799] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 15:08:12 2022] GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6/defaults => generated 371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:12.284486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54bc6435-e851-4dce-ad42-b6a21b7dc748 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Calling method '.version_select at 0x7fdbf1fd2790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:12.544214 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54bc6435-e851-4dce-ad42-b6a21b7dc748 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6" status: 200 len: 371 microversion: 2.1 time: 0.283070 Jul 14 15:08:12.551312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2476/4800] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:08:12 2022] GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6 => generated 371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:12.564857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f0408943-8e14-4dcd-b592-e6bc57a8e657 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] Calling method '.version_select at 0x7fdbf319fb80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:12.780221 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f0408943-8e14-4dcd-b592-e6bc57a8e657 tempest-QuotasTestJSON-1625003756 tempest-QuotasTestJSON-1625003756-project] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6?user_id=8280708212864b22af46b40d71ba07ef" status: 200 len: 371 microversion: 2.1 time: 0.226775 Jul 14 15:08:12.785059 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2325/4801] 10.222.0.98 () {58 vars in 1322 bytes} [Thu Jul 14 15:08:12 2022] GET /compute/v2.1/os-quota-sets/ce2d0a04588443b186f4c1d9504835f6?user_id=8280708212864b22af46b40d71ba07ef => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:19.220527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-676305565", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611"}], "security_groups": [{"name": "tempest-securitygroup--524983749"}], "key_name": "tempest-keypair-1357391483", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:19.270355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:19.791131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] validate_networks() for [('8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:08:22.496952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:22.857607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:08:22.858570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:08:22.859849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:08:22.860736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:08:22.861554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:08:22.912574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:22.913200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:22.914665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:22.936595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:23.048097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:08:23.078647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:08:23.157180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:08:23.177529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:08:23.385182 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-58050bc5-a389-4898-84a1-6b616c3229eb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.171924 Jul 14 15:08:23.385916 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2477/4802] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:08:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 4173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:08:23.408270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-edcfdabc-a24e-4aa7-bff0-91da5520f93f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:23.409900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-edcfdabc-a24e-4aa7-bff0-91da5520f93f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:23.444390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:23.447657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:23.453752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:24.393301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-edcfdabc-a24e-4aa7-bff0-91da5520f93f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:24.427795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-edcfdabc-a24e-4aa7-bff0-91da5520f93f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1241 microversion: 2.1 time: 1.033174 Jul 14 15:08:24.432837 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2326/4803] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:23 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1241 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:25.462973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:25.464479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:25.479514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:25.480579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:25.481677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:25.482323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:26.134837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:26.151214 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b13a883d-0d5a-40b8-a2d4-d6c73e78c4ee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1237 microversion: 2.1 time: 0.692745 Jul 14 15:08:26.153567 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2478/4804] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:25 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1237 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:27.177100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:27.182572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:27.224844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:27.230484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:27.232564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:27.233394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:28.041543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:28.100217 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50dfb5f3-dc95-4205-8998-7e5a2f0d7f69 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1299 microversion: 2.1 time: 0.932083 Jul 14 15:08:28.104114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2327/4805] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:27 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1299 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:29.128215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:29.128857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:29.144217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:29.145775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:29.147960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:29.159659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:29.343944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:29.367251 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38f811d9-35de-45a5-a311-4376874321f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1299 microversion: 2.1 time: 0.243309 Jul 14 15:08:29.369387 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2479/4806] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:29 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1299 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:30.388923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:30.389804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:30.416242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:30.417825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:30.418750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:30.419209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:31.765338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:31.783226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cf8f85b-a376-47f5-920b-e999f5cca08c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 1.398944 Jul 14 15:08:31.783871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2328/4807] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:30 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:32.801591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:32.804687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:32.808136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:32.845349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:32.846953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:32.849675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:32.851723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:33.008043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:33.126632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:33.263429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:33.283929 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8097ad5a-bb0b-4769-a30b-6bb8f31f8b8c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 0.485834 Jul 14 15:08:33.287508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2480/4808] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:32 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:08:33.895929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1856409062", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "d585a323-ac7e-46c1-a996-c93cad7f882d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:34.128270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] validate_networks() for [('d585a323-ac7e-46c1-a996-c93cad7f882d', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:08:34.313096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:34.314396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:34.338021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:34.344873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:34.349655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:34.354193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:34.423408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:34.891065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:34.909196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-717bfbbe-c272-4b85-97b2-7bac04a4ac41 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 0.592699 Jul 14 15:08:34.923379 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2481/4809] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:34 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:34.990511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b0a9590b-1f11-4da3-b080-a9e576a05a14 req-8f4c6f0f-ee32-4e0c-8cf8-02460976c46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a2a4a6-5969-4725-abbd-dce373f709e6", "tag": "b2d90aaa-dffd-47cc-a329-c5d72bf06e19"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:35.008814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b0a9590b-1f11-4da3-b080-a9e576a05a14 req-8f4c6f0f-ee32-4e0c-8cf8-02460976c46f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:35.009563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b0a9590b-1f11-4da3-b080-a9e576a05a14 req-8f4c6f0f-ee32-4e0c-8cf8-02460976c46f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:35.054634 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b0a9590b-1f11-4da3-b080-a9e576a05a14 req-8f4c6f0f-ee32-4e0c-8cf8-02460976c46f service nova] Creating event network-changed:b2d90aaa-dffd-47cc-a329-c5d72bf06e19 for instance 64a2a4a6-5969-4725-abbd-dce373f709e6 on n-h2-768852-23 Jul 14 15:08:35.065275 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b0a9590b-1f11-4da3-b080-a9e576a05a14 req-8f4c6f0f-ee32-4e0c-8cf8-02460976c46f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078924 Jul 14 15:08:35.086729 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2482/4810] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:35.947126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:35.948232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:36.010928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:36.023378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:36.035628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:36.043803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:36.853561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:36.914078 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f0c5da15-c810-4c44-aaeb-02d70f0a5856 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 0.981431 Jul 14 15:08:36.928663 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2483/4811] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:35 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:37.092171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:08:37.093852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:08:37.094851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:08:37.095552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:08:37.096474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:08:37.155453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:37.156701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:37.158831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:37.163851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:37.239688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Getting quotas for project 724eb41089bd40b8855a5c123343ac38. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:08:37.246462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Getting quotas for user f90bad9eb8734186a61e45fa7d915768 and project 724eb41089bd40b8855a5c123343ac38. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:08:37.276848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:08:37.282087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:08:37.365209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00e4a839-bb07-4784-b052-7c31e72a7f9d tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.265072 Jul 14 15:08:37.367172 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2329/4812] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:08:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 4269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:08:37.383960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb9b24f1-821d-4cbe-9200-5e3be9eb9e13 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:37.385431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb9b24f1-821d-4cbe-9200-5e3be9eb9e13 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:37.531719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb9b24f1-821d-4cbe-9200-5e3be9eb9e13 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:37.541309 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb9b24f1-821d-4cbe-9200-5e3be9eb9e13 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1216 microversion: 2.1 time: 0.167011 Jul 14 15:08:37.543508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2484/4813] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:37 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1216 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:37.953594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:37.954582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:38.028734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:38.037345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:38.046180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:38.056440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:38.579521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-04014d8f-f576-465c-9a5c-16c5ea48d811 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:38.584792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-04014d8f-f576-465c-9a5c-16c5ea48d811 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:39.073171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:39.094615 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-120c906b-fa63-4a46-90f7-55918d4e4eed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 1.150905 Jul 14 15:08:39.098051 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2330/4814] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:37 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:39.148130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-04014d8f-f576-465c-9a5c-16c5ea48d811 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:39.174955 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-04014d8f-f576-465c-9a5c-16c5ea48d811 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1216 microversion: 2.1 time: 0.598331 Jul 14 15:08:39.177099 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2485/4815] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:38 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1216 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:40.120555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:40.124276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:40.202769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:40.203624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:40.205564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:40.209282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.215848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:40.218397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.256517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:40.257313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.259016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:40.260592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:40.500276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:40.556044 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-98ab3a34-6a70-4dfd-b90a-340a2a05b384 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1268 microversion: 2.1 time: 0.358534 Jul 14 15:08:40.561627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2486/4816] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:40 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1268 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:41.582059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:41.583691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:41.615474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:41.619539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:41.624976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:41.626180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:41.845085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:41.898111 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-438997cc-0be2-49e5-a890-597aa90ac169 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1274 microversion: 2.1 time: 0.322191 Jul 14 15:08:41.900713 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2487/4817] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:41 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1274 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:42.155451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:42.226467 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e28f7399-219a-4903-9d86-49643497ed1a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 2.112601 Jul 14 15:08:42.234913 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2331/4818] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:40 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 2125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:42.921404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:42.922420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:42.946682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:42.949499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:42.952856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:42.955224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:43.267539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:43.279078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:43.472167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:43.484131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:43.495044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:43.495849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:43.965673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:43.985892 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b236ffa-a153-4217-96fa-62a8317d74c6 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1274 microversion: 2.1 time: 1.069003 Jul 14 15:08:43.988076 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2488/4819] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:42 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1274 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:44.309258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:44.329195 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c05c5183-1e06-4c5f-920a-bbb09ebe1531 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 1.081745 Jul 14 15:08:44.330709 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2332/4820] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:43 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:45.012723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:45.016415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:45.048967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-815bc32c-8f13-46ed-9692-a857f45dd027 req-9bfd1e9a-d58a-4db0-99af-a0cec4c4847f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2a4a6-5969-4725-abbd-dce373f709e6", "name": "network-vif-plugged", "status": "completed", "tag": "b2d90aaa-dffd-47cc-a329-c5d72bf06e19"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:45.088638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.090069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.093771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.094973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.131584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-815bc32c-8f13-46ed-9692-a857f45dd027 req-9bfd1e9a-d58a-4db0-99af-a0cec4c4847f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.134383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-815bc32c-8f13-46ed-9692-a857f45dd027 req-9bfd1e9a-d58a-4db0-99af-a0cec4c4847f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.194893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-815bc32c-8f13-46ed-9692-a857f45dd027 req-9bfd1e9a-d58a-4db0-99af-a0cec4c4847f service nova] Creating event network-vif-plugged:b2d90aaa-dffd-47cc-a329-c5d72bf06e19 for instance 64a2a4a6-5969-4725-abbd-dce373f709e6 on n-h2-768852-23 Jul 14 15:08:45.216066 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-815bc32c-8f13-46ed-9692-a857f45dd027 req-9bfd1e9a-d58a-4db0-99af-a0cec4c4847f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.181595 Jul 14 15:08:45.224412 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2333/4821] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:45.358263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:45.367214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:45.383637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.385002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.386995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:45.389887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:45.546217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:45.567318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af16380d-62a4-4b82-8fea-6ee2702e032e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 0.563698 Jul 14 15:08:45.583921 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2489/4822] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:45 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:45.927132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:45.939662 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9317e6c2-4a4d-4714-836f-4866e8c27800 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 0.592180 Jul 14 15:08:45.941588 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2334/4823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:45 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:08:46.589514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:46.590453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:46.598881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:46.599843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:46.600922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:46.601943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:46.960317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:46.961077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:46.977707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:46.978180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:46.979010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:46.979502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:47.079586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:47.105071 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b8de9d85-bf64-4463-8552-da444211e1e9 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 0.509613 Jul 14 15:08:47.120250 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2490/4824] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:46 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:47.201067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:47.266776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:47.731456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:47.740057 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b329a0f-ec3c-48f2-a545-01813f8b9f3a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1366 microversion: 2.1 time: 0.783735 Jul 14 15:08:47.748227 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2335/4825] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:46 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:48.132359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:48.139221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:48.172304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:48.173065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:48.174475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:48.175287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:48.735410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:48.751736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26d5c48a-53c5-411d-9468-6fc7fb559b5f tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 0.628295 Jul 14 15:08:48.753130 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2491/4826] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:48 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:48.775444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:48.776127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:48.793420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:48.796916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:48.799654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:48.800425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:49.504580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2ce76044-a28a-4408-ab50-c6f3c060af39 req-bd06112c-cf9e-4781-8056-9b17fb0cba29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5b9dc84-e956-44bd-85f9-ba4fbba33f43", "tag": "6d17159f-0e95-46ce-b9df-f1b11cf18782"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:49.556681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:49.577394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2ce76044-a28a-4408-ab50-c6f3c060af39 req-bd06112c-cf9e-4781-8056-9b17fb0cba29 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:49.577985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2ce76044-a28a-4408-ab50-c6f3c060af39 req-bd06112c-cf9e-4781-8056-9b17fb0cba29 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:49.598128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=71 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:49.623049 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2ce76044-a28a-4408-ab50-c6f3c060af39 req-bd06112c-cf9e-4781-8056-9b17fb0cba29 service nova] Creating event network-changed:6d17159f-0e95-46ce-b9df-f1b11cf18782 for instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 on n-h1-768852-23 Jul 14 15:08:49.641303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2ce76044-a28a-4408-ab50-c6f3c060af39 req-bd06112c-cf9e-4781-8056-9b17fb0cba29 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152448 Jul 14 15:08:49.643996 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2492/4827] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:49.786684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:49.787809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:49.805688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:49.806510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:49.811227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:49.812371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:49.973647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:49.993893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-719c2232-3026-40df-bf88-f034bbddc83e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1556 microversion: 2.1 time: 1.230789 Jul 14 15:08:50.017586 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2336/4828] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:48 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1556 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:50.035966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:50.045237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:50.070243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:50.080615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:50.087135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:50.088226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:50.461712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:50.509400 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-865181eb-cf17-4a0c-b679-13d53680a403 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 0.727550 Jul 14 15:08:50.517372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2493/4829] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:49 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:08:51.208902 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c5492d0-fcf4-471e-a7b0-4f947bea8899 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.189551 Jul 14 15:08:51.216516 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2337/4830] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:08:50 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/os-interface => generated 285 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:51.540150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:51.541082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:51.570375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:51.571028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:51.574358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:51.581234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:52.350537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:52.369108 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-926a74c6-5600-4156-804e-a4479cf49a48 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 0.839824 Jul 14 15:08:52.370101 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2494/4831] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:51 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:53.392329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:53.396040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:53.461350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:53.464450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:53.469012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:53.473453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:53.625948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=60 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:54.566074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-32302e8a-f1cb-4fcb-ba20-a140b5dcaaa4 req-34caa907-a60a-435f-a254-7d2a1cbd9b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64a2a4a6-5969-4725-abbd-dce373f709e6", "tag": "b2d90aaa-dffd-47cc-a329-c5d72bf06e19"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:54.578919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:54.601995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-32302e8a-f1cb-4fcb-ba20-a140b5dcaaa4 req-34caa907-a60a-435f-a254-7d2a1cbd9b91 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:54.602457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-32302e8a-f1cb-4fcb-ba20-a140b5dcaaa4 req-34caa907-a60a-435f-a254-7d2a1cbd9b91 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:54.609168 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d52c9c68-3673-4dd5-aad6-aabf5dd664a0 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 1.225451 Jul 14 15:08:54.614029 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2338/4832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:53 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:54.656687 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-32302e8a-f1cb-4fcb-ba20-a140b5dcaaa4 req-34caa907-a60a-435f-a254-7d2a1cbd9b91 service nova] Creating event network-changed:b2d90aaa-dffd-47cc-a329-c5d72bf06e19 for instance 64a2a4a6-5969-4725-abbd-dce373f709e6 on n-h2-768852-23 Jul 14 15:08:54.677712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-32302e8a-f1cb-4fcb-ba20-a140b5dcaaa4 req-34caa907-a60a-435f-a254-7d2a1cbd9b91 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116434 Jul 14 15:08:54.682707 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2495/4833] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:55.644338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:55.647154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:55.679494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:08:55.699510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:55.701138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:55.704201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:55.705454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:56.743446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:56.778845 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41e31109-f647-48f2-8f74-ca7e7854e045 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 1.126214 Jul 14 15:08:56.780114 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2339/4834] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:55 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:08:57.797540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:57.798463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:57.812078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:57.812565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:57.819363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:57.820116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:58.346637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:58.348405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:58.380697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:58.381612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:58.383234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:58.406802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.038021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:59.060744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:59.075854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:59.081081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54ef7d5c-10e7-4748-900b-3a2d55f6c475 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2948 microversion: 2.32 time: 1.615430 Jul 14 15:08:59.095313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2496/4835] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:08:57 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2948 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:08:59.122269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:08:59.122904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:08:59.139529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.141071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.141938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.142386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.379535 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5a0e55f-f2cb-416e-b1f8-f433c8d093dc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.262080 Jul 14 15:08:59.380907 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2497/4836] 10.222.0.98 () {60 vars in 1315 bytes} [Thu Jul 14 15:08:59 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739/os-interface => generated 1829 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:08:59.386612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-eef6bd2f-e57c-4554-b6ee-889ff48e6bcc req-07160978-7cd7-44a3-b362-0b6af38b232b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9dc84-e956-44bd-85f9-ba4fbba33f43", "name": "network-vif-plugged", "status": "completed", "tag": "6d17159f-0e95-46ce-b9df-f1b11cf18782"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:08:59.428339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-eef6bd2f-e57c-4554-b6ee-889ff48e6bcc req-07160978-7cd7-44a3-b362-0b6af38b232b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:08:59.429794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-eef6bd2f-e57c-4554-b6ee-889ff48e6bcc req-07160978-7cd7-44a3-b362-0b6af38b232b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:08:59.505655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-eef6bd2f-e57c-4554-b6ee-889ff48e6bcc req-07160978-7cd7-44a3-b362-0b6af38b232b service nova] Creating event network-vif-plugged:6d17159f-0e95-46ce-b9df-f1b11cf18782 for instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 on n-h1-768852-23 Jul 14 15:08:59.531725 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-eef6bd2f-e57c-4554-b6ee-889ff48e6bcc req-07160978-7cd7-44a3-b362-0b6af38b232b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148584 Jul 14 15:08:59.543960 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2498/4837] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:08:59.662214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:08:59.673340 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5582bd91-615f-4ef1-86bf-b8eac14f0a20 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 1.880325 Jul 14 15:08:59.677867 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2340/4838] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:08:57 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 1886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:09:00.704301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:00.706783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:00.762360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:00.763148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:00.764687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:00.765482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:01.617110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:01.647679 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-55fafa2a-0558-4e60-9434-c14b8326fd23 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1316 microversion: 2.1 time: 0.956084 Jul 14 15:09:01.648585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2499/4839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:00 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1316 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:02.669552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:02.670438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:02.699641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:02.708282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:02.712977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:02.714279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.247679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:03.269931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-393d9401-2bc9-4508-98b6-07b3635ade30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1504 microversion: 2.1 time: 0.606411 Jul 14 15:09:03.270557 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2341/4840] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:02 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1504 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:03.299692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:03.303483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:03.321231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=44 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:03.328814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.330032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.332082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.333556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.631136 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1b75544-702a-4438-84c2-408cab3fd779 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.346812 Jul 14 15:09:03.632692 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2500/4841] 10.222.0.98 () {58 vars in 1295 bytes} [Thu Jul 14 15:09:03 2022] DELETE /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43/os-server-password => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:09:03.649972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:03.651774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:03.667130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.668863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.672758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.675527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.739514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-173a1403-3ba1-4a4d-a8bc-3b5d1b97babd tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.098748 Jul 14 15:09:03.741810 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2342/4842] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:09:03 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43/os-server-password => generated 16 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:09:03.760218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:03.762964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:03.786287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.789051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.790859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:03.791935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:03.860034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:09:04.131109 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-57622cc8-2f89-41e1-afb3-eafb3b6d80f2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 204 len: 0 microversion: 2.1 time: 0.379331 Jul 14 15:09:04.132138 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2501/4843] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:09:03 2022] DELETE /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:09:04.154522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:04.157960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:04.184390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:04.185918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:04.194984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:04.196345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:04.920898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:04.944673 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a808dfe3-8102-42ac-9ae5-b5a610c81efa tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1510 microversion: 2.1 time: 0.807379 Jul 14 15:09:04.966741 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2343/4844] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:04 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1510 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:05.975564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:05.976463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:05.994927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:06.001274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:06.003124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:06.004680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:06.415670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:06.440197 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-82f8ed62-c533-488e-bdc3-fb76d0645f30 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1510 microversion: 2.1 time: 0.470515 Jul 14 15:09:06.450842 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2502/4845] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:05 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1510 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:09:07.469786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:07.470417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:07.494194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:07.498515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:07.506395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:07.507063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:07.927760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:07.939136 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5cdeb46-1e70-41db-9fcd-05ea5e674f8e tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1468 microversion: 2.1 time: 0.474496 Jul 14 15:09:07.945654 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2344/4846] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:07 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1468 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:08.151228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cda97071-b286-412d-adca-3b1b23eb5c72 req-b50a51d5-1c03-435c-b790-0a39da67ae34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5b9dc84-e956-44bd-85f9-ba4fbba33f43", "name": "network-vif-deleted", "tag": "6d17159f-0e95-46ce-b9df-f1b11cf18782"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:08.183232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cda97071-b286-412d-adca-3b1b23eb5c72 req-b50a51d5-1c03-435c-b790-0a39da67ae34 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:08.184608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cda97071-b286-412d-adca-3b1b23eb5c72 req-b50a51d5-1c03-435c-b790-0a39da67ae34 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:08.211814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cda97071-b286-412d-adca-3b1b23eb5c72 req-b50a51d5-1c03-435c-b790-0a39da67ae34 service nova] Creating event network-vif-deleted:6d17159f-0e95-46ce-b9df-f1b11cf18782 for instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 on n-h1-768852-23 Jul 14 15:09:08.221047 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cda97071-b286-412d-adca-3b1b23eb5c72 req-b50a51d5-1c03-435c-b790-0a39da67ae34 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077616 Jul 14 15:09:08.222178 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2503/4847] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:09:08.974027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:08.977004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:09.003181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.007714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.012631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.013988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.201651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:09.202729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:09.204447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lazy-loading 'fault' on Instance uuid b5b9dc84-e956-44bd-85f9-ba4fbba33f43 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:09:09.368690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90bad9eb8734186a61e45fa7d915768', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '724eb41089bd40b8855a5c123343ac38', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:09.376598 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8544a2f-07ed-4646-bfdd-f82797e4d85c tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 200 len: 1306 microversion: 2.1 time: 0.411559 Jul 14 15:09:09.386758 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2345/4848] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:08 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 1306 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:10.398500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:10.400457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] [instance: b5b9dc84-e956-44bd-85f9-ba4fbba33f43] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:10.414574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:10.415069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:10.416521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:10.417529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:10.448375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] HTTP exception thrown: Instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 could not be found. Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Request method failure captured: Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 HTTP/1.1 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DFw_Pv77YiiRErKuzMeaA1GTQ5sULGP_WhQyQ9ms_Nqe_6NC8iZGoeEM_JjZt_mnJWbt55St4KBEhWb4kSSttb1r7kaThd5tDHUGAi6RgQ7S-cKihL5zPKiw-3hbK1hek3yTAgyKKQ1fxon86R7bYm4bqTmLPAbxij36gv46HQjrb8 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 724eb41089bd40b8855a5c123343ac38 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerPasswordTestJSON-609588850 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/724eb41089bd40b8855a5c123343ac38"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_724eb41089bd40b8855a5c123343ac38"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/724eb41089bd40b8855a5c123343ac38"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/724eb41089bd40b8855a5c123343ac38"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerPasswordTestJSON-609588850 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 724eb41089bd40b8855a5c123343ac38 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerPasswordTestJSON-609588850 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerPasswordTestJSON-609588850-project Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: f90bad9eb8734186a61e45fa7d915768 Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerPasswordTestJSON-609588850-project Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 could not be found. Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b5b9dc84-e956-44bd-85f9-ba4fbba33f43'} Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 could not be found. Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 could not be found. Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:10.451187 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 could not be found. Jul 14 15:09:10.457905 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:10.459671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] Returning 404 to user: Instance b5b9dc84-e956-44bd-85f9-ba4fbba33f43 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:10.460840 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94e3c5ae-c343-432f-98fe-2fb7d7877df2 tempest-ServerPasswordTestJSON-609588850 tempest-ServerPasswordTestJSON-609588850-project] 10.222.0.98 "GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43" status: 404 len: 111 microversion: 2.1 time: 0.069659 Jul 14 15:09:10.462246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2504/4849] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:10 2022] GET /compute/v2.1/servers/b5b9dc84-e956-44bd-85f9-ba4fbba33f43 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:09:25.915312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:25.927785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:25.970953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=15 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:25.984046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=44 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:25.991687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.000844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.027524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.035702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.140484 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45ac6238-0172-475e-bcac-e2ed797de8bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/ips" status: 200 len: 149 microversion: 2.1 time: 0.233433 Jul 14 15:09:26.151238 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2346/4850] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:09:25 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/ips => generated 149 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:26.161294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "666e92a4-0197-43b0-a434-2d44ca9a1a02"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:26.170256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:26.197946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:26.203626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:26.225988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.227496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.229922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.235418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.521248 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Invalid volume: volume 666e92a4-0197-43b0-a434-2d44ca9a1a02 is already attached to instances: cf5f0954-5fd0-4d23-90fa-81709549b750 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/os-volume_attachments HTTP/1.1 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 74 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: {"volumeAttachment": {"volumeId": "666e92a4-0197-43b0-a434-2d44ca9a1a02"}} Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid volume: volume 666e92a4-0197-43b0-a434-2d44ca9a1a02 is already attached to instances: cf5f0954-5fd0-4d23-90fa-81709549b750 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': '64a2a4a6-5969-4725-abbd-dce373f709e6', 'body': {'volumeAttachment': {'volumeId': '666e92a4-0197-43b0-a434-2d44ca9a1a02'}}} Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 666e92a4-0197-43b0-a434-2d44ca9a1a02 is already attached to instances: cf5f0954-5fd0-4d23-90fa-81709549b750 Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:09:26.527100 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 666e92a4-0197-43b0-a434-2d44ca9a1a02 is already attached to instances: cf5f0954-5fd0-4d23-90fa-81709549b750 Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 666e92a4-0197-43b0-a434-2d44ca9a1a02 is already attached to instances: cf5f0954-5fd0-4d23-90fa-81709549b750 Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 400 to user: Invalid volume: volume 666e92a4-0197-43b0-a434-2d44ca9a1a02 is already attached to instances: cf5f0954-5fd0-4d23-90fa-81709549b750 {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:26.536974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a87ee714-620a-47cd-b434-e0d2d0e2a4ba tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.383359 Jul 14 15:09:26.540316 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2505/4851] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:09:26 2022] POST /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6/os-volume_attachments => generated 174 bytes in 388 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:09:26.576353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:26.583735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:26.625237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.628877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.634277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.636162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.728919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:09:26.959681 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4feef9ff-54f4-4d0a-b4d2-a2c14d76ab29 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 204 len: 0 microversion: 2.1 time: 0.413409 Jul 14 15:09:26.962917 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2347/4852] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:09:26 2022] DELETE /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:09:26.973485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:26.974950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:26.986051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.986505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:26.987489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:26.988476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:27.584164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:27.597930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d032c239-dd99-4269-8a19-0db0bd6f7375 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1680 microversion: 2.1 time: 0.628529 Jul 14 15:09:27.604667 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2506/4853] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:26 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1680 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:28.637891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:28.643163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:28.688339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:28.691533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:28.694290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:28.695019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:29.182644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:29.192091 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cb2f5dfa-820e-47a6-944a-0d603d870c77 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1680 microversion: 2.1 time: 0.561385 Jul 14 15:09:29.192977 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2348/4854] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:28 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1680 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:09:30.220997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:30.221962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:30.247533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:30.252245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:30.260021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:30.260836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:30.753044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:30.765410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a1445a30-d8c5-4f5a-a05d-e4199f4ca542 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1680 microversion: 2.1 time: 0.554321 Jul 14 15:09:30.771120 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2507/4855] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:30 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1680 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:31.799859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:31.801891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:31.849486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:31.851575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:31.854759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:31.856971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:32.406468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:32.432977 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5e37247-8117-47d0-b8e1-e8550a936cee tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 200 len: 1613 microversion: 2.1 time: 0.638673 Jul 14 15:09:32.433892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2349/4856] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:31 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 1613 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:32.529046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f6131fc8-fcd4-44fd-a998-d57b8659e313 req-81148f9a-c8ee-4544-b519-f9f62d7b2eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64a2a4a6-5969-4725-abbd-dce373f709e6", "name": "network-vif-deleted", "tag": "b2d90aaa-dffd-47cc-a329-c5d72bf06e19"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:32.631881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f6131fc8-fcd4-44fd-a998-d57b8659e313 req-81148f9a-c8ee-4544-b519-f9f62d7b2eb1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:32.637277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f6131fc8-fcd4-44fd-a998-d57b8659e313 req-81148f9a-c8ee-4544-b519-f9f62d7b2eb1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:32.755487 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f6131fc8-fcd4-44fd-a998-d57b8659e313 req-81148f9a-c8ee-4544-b519-f9f62d7b2eb1 service nova] Creating event network-vif-deleted:b2d90aaa-dffd-47cc-a329-c5d72bf06e19 for instance 64a2a4a6-5969-4725-abbd-dce373f709e6 on n-h2-768852-23 Jul 14 15:09:32.804755 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f6131fc8-fcd4-44fd-a998-d57b8659e313 req-81148f9a-c8ee-4544-b519-f9f62d7b2eb1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281044 Jul 14 15:09:32.816079 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2508/4857] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:33.457932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:33.461709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:33.498873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:33.508198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:33.509730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:33.510497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:33.555412 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 HTTP/1.1 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '64a2a4a6-5969-4725-abbd-dce373f709e6'} Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:09:33.558331 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:09:33.577913 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37cc4c28-9d9f-4791-bc7e-75d77c878b35 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 404 len: 111 microversion: 2.1 time: 0.111577 Jul 14 15:09:33.580928 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2350/4858] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:33 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:09:33.595783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcbc6280-7604-4b14-80eb-d867320635d1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '.version_select at 0x7fdbf2af71f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:33.706445 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcbc6280-7604-4b14-80eb-d867320635d1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357391483" status: 202 len: 0 microversion: 2.1 time: 0.136173 Jul 14 15:09:33.713613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2509/4859] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:09:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1357391483 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:09:36.480650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:36.483317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:36.521985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.522614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.526496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:36.526961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:36.917989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lazy-loading 'services' on Instance uuid cf5f0954-5fd0-4d23-90fa-81709549b750 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:09:37.150260 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d93ac63-8b8a-458f-97b2-a34786098973 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments/666e92a4-0197-43b0-a434-2d44ca9a1a02" status: 202 len: 0 microversion: 2.1 time: 0.677816 Jul 14 15:09:37.155328 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2351/4860] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:09:36 2022] DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments/666e92a4-0197-43b0-a434-2d44ca9a1a02 => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:09:37.186786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:37.198452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:37.259902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:37.261557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:37.264251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:37.265568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:37.403178 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31b0a31f-537b-4763-88d0-96605ad0bc5a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.228938 Jul 14 15:09:37.414725 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2510/4861] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:37 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:38.428298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:38.436688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:38.489755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:38.492234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:38.496631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:38.501615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:38.702503 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54d98cc3-ce15-4393-97a4-c597f31337b6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.286525 Jul 14 15:09:38.707776 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2352/4862] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:38 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:39.734054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:39.748844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:39.811135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:39.824311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:39.828024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:39.837893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:40.056300 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d99b3db4-f08b-4881-aed7-01b886ab9c4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.340538 Jul 14 15:09:40.075438 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2511/4863] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:39 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:41.086163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:41.089294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:41.150981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:41.155044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:41.173835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:41.175809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:41.394285 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-59deb07f-7417-43a4-8e7b-bdff99327ee5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.315697 Jul 14 15:09:41.399049 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2353/4864] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:41 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:42.407365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:42.408440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:42.434053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:42.438310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:42.443112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:42.446681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:42.614416 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f6767bd-9398-4429-8c9e-757a4bc1254f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211274 Jul 14 15:09:42.621522 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2512/4865] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:42 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:43.627115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:43.636324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:43.655716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:43.656181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:43.656997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:43.657443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:43.887090 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a026bb1-99e0-4f92-826b-c48095b61a95 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.263807 Jul 14 15:09:43.891780 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2354/4866] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:43 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:44.902073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:44.903115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:44.931592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:44.932070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:44.932923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:44.933376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:45.150497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-600d13ed-ba35-42df-ae82-758cbf3c5a0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253477 Jul 14 15:09:45.151125 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2513/4867] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:44 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:46.163118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:46.164518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:46.185571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:46.186046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:46.197919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:46.198545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:46.304032 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-34134925-1335-424a-b7c2-693a982a7dc9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145012 Jul 14 15:09:46.307300 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2355/4868] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:46 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:47.323598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:47.324613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:47.338374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:47.338836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:47.339707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:47.340149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:47.542563 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-926d1763-204e-483d-8c29-4eafc5c1460a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.216623 Jul 14 15:09:47.543260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2514/4869] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:47 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:48.562114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:48.573405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:48.604449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:48.605266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:48.607117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:48.608568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:48.788386 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a68001b4-26a1-4862-aea3-3a3b226a9259 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.233814 Jul 14 15:09:48.802088 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2356/4870] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:48 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:49.823409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:49.825459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:49.855072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:49.855860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:49.860439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:49.861299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:49.965938 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a5408df-b335-41b2-9c72-8ce607a6f38a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155276 Jul 14 15:09:49.969196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2515/4871] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:49 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:50.980555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:50.982533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:50.996508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:50.997537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:51.000200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:51.001065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:51.139855 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2fe63ea-5b92-473f-8cae-351b236bf12a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162252 Jul 14 15:09:51.149926 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2516/4872] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:50 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:09:51.166112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-843815225", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:09:51.327975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:09:52.158254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:52.159994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:52.180087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:52.180545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:52.181354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:52.181796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:52.308792 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07d5615a-88a7-414c-9991-d970993aa558 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154741 Jul 14 15:09:52.316421 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2517/4873] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:52 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:09:53.324242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:53.326065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:53.345477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:09:53.347097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:09:53.347790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:09:53.348383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:09:53.349010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:09:53.358818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:53.365388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:53.368855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:53.372926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:53.374025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:53.374799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:53.378563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:53.382725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:53.448770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:09:53.467472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:09:53.517326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:09:53.520159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:09:53.586035 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-452a658d-3fd3-4ce5-b4d3-095f1d0d8835 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.262947 Jul 14 15:09:53.595587 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2518/4874] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:53 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 197 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:09:53.792148 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-48ed65d4-d9fa-4166-8b80-f280d65c79f9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.454791 Jul 14 15:09:53.798528 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2357/4875] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:09:53.811053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-022f3312-d332-445c-8836-187bd90d948e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:53.813074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-022f3312-d332-445c-8836-187bd90d948e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:53.894511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-022f3312-d332-445c-8836-187bd90d948e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:53.906204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-022f3312-d332-445c-8836-187bd90d948e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1192 microversion: 2.1 time: 0.099821 Jul 14 15:09:53.923382 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2519/4876] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:53 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1192 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:54.613915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:54.621280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:54.673743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:54.678277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:54.684002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:54.685601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:54.852633 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e447993-c122-4960-afa7-ea07b4e11bf1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.250091 Jul 14 15:09:54.861780 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2358/4877] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:09:54 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750/os-volume_attachments => generated 25 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:09:54.945791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87b0072b-602c-4148-9c17-45d1ee8c1f64 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:54.951047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87b0072b-602c-4148-9c17-45d1ee8c1f64 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:54.991620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:54.998796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:55.065878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:55.071647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:55.073379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:55.074239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:55.343457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:09:55.598984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87b0072b-602c-4148-9c17-45d1ee8c1f64 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:55.668263 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87b0072b-602c-4148-9c17-45d1ee8c1f64 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1192 microversion: 2.1 time: 0.718329 Jul 14 15:09:55.673904 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2520/4878] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:54 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1192 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:55.820733 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17ed2bc8-8788-4fe9-9e6c-33afc88b1f76 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 204 len: 0 microversion: 2.1 time: 0.837620 Jul 14 15:09:55.826809 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2359/4879] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:09:54 2022] DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 0 bytes in 841 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:09:55.839507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:55.845504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:55.922281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:55.932687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:55.937644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:55.945330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:56.653688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:56.660294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=79 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:56.682362 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f1bed5a-2478-4fa4-996d-854d6e9010fb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1681 microversion: 2.1 time: 0.853276 Jul 14 15:09:56.688214 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2521/4880] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:55 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1681 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:56.711742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:56.712471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:56.714632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:56.767067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:56.773007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:56.774331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:56.774807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:56.790448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:56.932435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:56.950001 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a6033a4-a827-4091-a237-32f57ab716b2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1188 microversion: 2.1 time: 0.239069 Jul 14 15:09:56.952009 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2360/4881] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:56 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1188 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:57.714145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:57.714827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:57.718481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:09:57.773656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:57.774121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:57.775516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:57.776230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:57.971166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:57.973625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:57.999502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:58.000858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:58.006492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:58.011971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:58.351565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:58.376965 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5e03e04-6201-45d8-ad6c-5332723dee42 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1244 microversion: 2.1 time: 0.410519 Jul 14 15:09:58.377948 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2361/4882] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:57 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1244 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:59.255407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:59.316353 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f849028-8609-4b53-abbb-9478f2c3df3f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1681 microversion: 2.1 time: 1.605958 Jul 14 15:09:59.322222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2522/4883] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:57 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1681 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:09:59.405138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:09:59.405803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:09:59.421916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:59.424287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:59.426629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:09:59.427185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:09:59.656179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:09:59.674060 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eff0e3b6-7a1b-4561-acc5-27695f5b4eb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1250 microversion: 2.1 time: 0.283138 Jul 14 15:09:59.674728 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2362/4884] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:09:59 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1250 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:00.339471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:00.340202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:00.360566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:00.361027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:00.369897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:00.371877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:00.695210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:00.700457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:00.708225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:00.743655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bcbfaffc-333b-4f20-8ad7-36ac332919e4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 200 len: 1614 microversion: 2.1 time: 0.402146 Jul 14 15:10:00.749038 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2523/4885] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:00 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 1614 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:00.757405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:00.758543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:00.760553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:00.769944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:00.892734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fc544de0-ca8e-420c-8db7-8f7ea8290685 req-e238e319-e16f-43fa-b2e7-d4d6b1ae5bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5f0954-5fd0-4d23-90fa-81709549b750", "name": "network-vif-deleted", "tag": "11e4cf13-d392-4561-9aef-cf7f0ba66b59"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:00.922826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fc544de0-ca8e-420c-8db7-8f7ea8290685 req-e238e319-e16f-43fa-b2e7-d4d6b1ae5bb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:00.925726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fc544de0-ca8e-420c-8db7-8f7ea8290685 req-e238e319-e16f-43fa-b2e7-d4d6b1ae5bb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:00.964964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fc544de0-ca8e-420c-8db7-8f7ea8290685 req-e238e319-e16f-43fa-b2e7-d4d6b1ae5bb9 service nova] Creating event network-vif-deleted:11e4cf13-d392-4561-9aef-cf7f0ba66b59 for instance cf5f0954-5fd0-4d23-90fa-81709549b750 on n-h1-768852-23 Jul 14 15:10:00.992761 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fc544de0-ca8e-420c-8db7-8f7ea8290685 req-e238e319-e16f-43fa-b2e7-d4d6b1ae5bb9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106062 Jul 14 15:10:01.001068 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2524/4886] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:01.258457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:01.270735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a04d8507-eb95-4d40-afef-87ced06072ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1250 microversion: 2.1 time: 0.579036 Jul 14 15:10:01.287423 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2363/4887] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:00 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1250 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:01.767145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:01.773197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:01.800783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:01.801706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:01.802816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:01.804322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:01.849168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 HTTP/1.1 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'cf5f0954-5fd0-4d23-90fa-81709549b750'} Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:01.859108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:10:01.864222 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:01.870680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:10:01.879692 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e47b040e-4c8e-46e7-8014-e624d91cd516 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 404 len: 111 microversion: 2.1 time: 0.116758 Jul 14 15:10:01.882874 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2525/4888] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:01 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:10:01.891672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db20c2dd-38d9-491e-94d6-fb63ff5d2acd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '.version_select at 0x7fdbf1eb1dc0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:02.001612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db20c2dd-38d9-491e-94d6-fb63ff5d2acd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550954685" status: 202 len: 0 microversion: 2.1 time: 0.108285 Jul 14 15:10:02.008885 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2364/4889] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:10:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550954685 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:10:02.323949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:02.329982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:02.385754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:02.406270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:02.411307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:02.412806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:03.522216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:03.582800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f44a68f-35f4-4340-9a31-08febda0a322 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1250 microversion: 2.1 time: 1.286391 Jul 14 15:10:03.585933 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2526/4890] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:02 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1250 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:04.621550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:04.627796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:04.672336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:04.684790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:04.746768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:04.761273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:04.781127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:04.781947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:05.372376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:05.398446 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2f8ae14-b60e-4964-8837-fb14400b5e6e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1250 microversion: 2.1 time: 0.782348 Jul 14 15:10:05.400161 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2365/4891] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:04 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1250 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:05.770317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:05.841658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20f540f6-972c-4007-a25b-2f3b40962123 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: .version_select at 0x7fdbf1fd2550>, body: {"keypair": {"name": "tempest-keypair-640760443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIX7SfB/9SRyJv0YfbBP0HhcZYrCAgn6vR7X8LEAZNuUYJdAvpo0au2lDpGRFTumMU5BuMeq/f0LbRHt5UYjAAfqdCsJPg6DVbP4qonp7WXEdc5upe1QzGDWoZVDTMi1iA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:06.055534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-20f540f6-972c-4007-a25b-2f3b40962123 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:10:06.083631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-20f540f6-972c-4007-a25b-2f3b40962123 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:10:06.154839 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20f540f6-972c-4007-a25b-2f3b40962123 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.388098 Jul 14 15:10:06.162694 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2527/4892] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:10:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:06.434296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:06.435746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:06.506934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:06.508110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:06.509212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:06.509964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:07.495211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:07.556692 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ebdf79b0-fe4c-46a5-a9ab-968851363dc8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 1.134588 Jul 14 15:10:07.561972 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2366/4893] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:06 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:08.594714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:08.607039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:08.634893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:08.637100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:08.639118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:08.645260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:09.585760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:09.636765 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-03c4c437-c25e-498d-9a77-7fb92b185034 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 1.054143 Jul 14 15:10:09.637752 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2528/4894] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:08 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:10.675987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:10.680033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:10.709031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:10.715743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:10.722539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:10.730689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:11.553527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:11.571942 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e8bd1622-5ce5-46ba-a028-85dfd9ef4d06 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.906766 Jul 14 15:10:11.581644 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2367/4895] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:10 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:12.597911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:12.599224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:12.625554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:12.626377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:12.632493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:12.633566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:12.695899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c91a17ef-d678-4205-b22e-eb04a4007d99 req-a32667ca-402a-4c08-afa3-b4df22ceeb89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec1f760-02b1-44a0-88d9-830fc289c4aa", "tag": "6b2d320e-e238-4637-9d1c-fd5901eb0e31"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:12.734010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c91a17ef-d678-4205-b22e-eb04a4007d99 req-a32667ca-402a-4c08-afa3-b4df22ceeb89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:12.738860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c91a17ef-d678-4205-b22e-eb04a4007d99 req-a32667ca-402a-4c08-afa3-b4df22ceeb89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:12.770497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c91a17ef-d678-4205-b22e-eb04a4007d99 req-a32667ca-402a-4c08-afa3-b4df22ceeb89 service nova] Creating event network-changed:6b2d320e-e238-4637-9d1c-fd5901eb0e31 for instance eec1f760-02b1-44a0-88d9-830fc289c4aa on n-h1-768852-23 Jul 14 15:10:12.784914 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c91a17ef-d678-4205-b22e-eb04a4007d99 req-a32667ca-402a-4c08-afa3-b4df22ceeb89 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.914652 Jul 14 15:10:12.787260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2529/4896] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:12.966177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:12.983441 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a34ae0e1-86c8-48b9-8eb7-f45978d14a8c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.392294 Jul 14 15:10:12.987223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2368/4897] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:12 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:13.921235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-968049881", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611"}], "security_groups": [{"name": "tempest-securitygroup--1419400161"}], "key_name": "tempest-keypair-640760443", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:14.005573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:14.006293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:14.052072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:14.052660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:14.053622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:14.054432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:14.234481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] validate_networks() for [('8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:10:14.710021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:14.727648 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d927087-958d-4e79-9845-89579816398f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.726449 Jul 14 15:10:14.746472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2369/4898] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:13 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:15.620512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:10:15.621336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:10:15.622405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:10:15.623195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:10:15.624033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:10:15.666514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:15.674018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:15.676435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:15.677165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:15.717768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:10:15.742024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:10:15.773976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:15.774846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:15.798603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:15.799108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:15.799983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:15.800443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:15.824561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:10:15.835090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:10:16.008511 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-575ebbc3-4935-48de-b43c-3a2486b77147 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.085612 Jul 14 15:10:16.019653 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2530/4899] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:10:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 2105 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:10:16.039979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8436b100-ccce-4fdf-a34e-1e177e063e0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:16.040791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8436b100-ccce-4fdf-a34e-1e177e063e0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:16.255678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8436b100-ccce-4fdf-a34e-1e177e063e0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:16.271637 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8436b100-ccce-4fdf-a34e-1e177e063e0d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1240 microversion: 2.1 time: 0.243877 Jul 14 15:10:16.276506 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2531/4900] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:16 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1240 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:17.285940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5801f8a-0f7f-4c55-8bc5-8f05f0c06cc8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:17.286915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5801f8a-0f7f-4c55-8bc5-8f05f0c06cc8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:17.452998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e5801f8a-0f7f-4c55-8bc5-8f05f0c06cc8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:17.484091 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5801f8a-0f7f-4c55-8bc5-8f05f0c06cc8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1240 microversion: 2.1 time: 0.203345 Jul 14 15:10:17.488001 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2532/4901] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:17 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1240 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:17.612010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:17.657212 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be4e29a9-b99a-400c-931e-4d4daceb265d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 1.888729 Jul 14 15:10:17.668600 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2370/4902] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:15 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:18.517143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:18.519183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:18.529058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:18.530876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:18.532125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:18.533143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:18.686628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:18.688086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:18.709213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:18.715410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:18.716271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:18.716736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:18.909558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:18.933419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-628818ae-982c-4d4e-b907-35141e61aef9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1292 microversion: 2.1 time: 0.421099 Jul 14 15:10:18.935409 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2533/4903] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:18 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1292 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:19.242017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:19.256820 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec4113cd-0d14-477e-a6d7-cb343773d429 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.573290 Jul 14 15:10:19.258928 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2371/4904] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:18 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:19.955674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:19.956623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:19.988750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:19.989850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.007551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.009343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.148788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:20.178808 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd0de038-1680-425d-978a-5a802cbfa64b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1298 microversion: 2.1 time: 0.228950 Jul 14 15:10:20.193172 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2534/4905] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:19 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1298 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:20.282912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:20.284804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:20.309426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.309805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.310820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:20.311505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:20.666301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:20.676189 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51c88b98-7884-4b8e-acab-843c42eede4f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.397664 Jul 14 15:10:20.683740 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2372/4906] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:20 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:21.201279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:21.207616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:21.253739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.259749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:21.273331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.275503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:21.719582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:21.721635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:21.789225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.790392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:21.801908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:21.804497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.359343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:22.375233 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8af98f8b-3698-4ea0-8e07-03280fa1dc90 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 1.181384 Jul 14 15:10:22.376788 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2535/4907] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:21 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:22.384896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bd74dae2-7f01-4958-b770-0ebe83368863 req-f0890e0c-7645-4d2c-941a-030570fd8cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec1f760-02b1-44a0-88d9-830fc289c4aa", "name": "network-vif-plugged", "status": "completed", "tag": "6b2d320e-e238-4637-9d1c-fd5901eb0e31"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:22.407381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bd74dae2-7f01-4958-b770-0ebe83368863 req-f0890e0c-7645-4d2c-941a-030570fd8cc3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:22.418061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bd74dae2-7f01-4958-b770-0ebe83368863 req-f0890e0c-7645-4d2c-941a-030570fd8cc3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:22.456436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bd74dae2-7f01-4958-b770-0ebe83368863 req-f0890e0c-7645-4d2c-941a-030570fd8cc3 service nova] Creating event network-vif-plugged:6b2d320e-e238-4637-9d1c-fd5901eb0e31 for instance eec1f760-02b1-44a0-88d9-830fc289c4aa on n-h1-768852-23 Jul 14 15:10:22.475346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bd74dae2-7f01-4958-b770-0ebe83368863 req-f0890e0c-7645-4d2c-941a-030570fd8cc3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096268 Jul 14 15:10:22.483461 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2536/4908] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:22.836895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:22.868145 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36a8c7f4-d073-4967-b088-939053364e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 1.159505 Jul 14 15:10:22.871757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2373/4909] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:21 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:23.409041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:23.410686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:23.435031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:23.449796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:23.452269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:23.456672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:23.887723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:23.889030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:23.917553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:23.920897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:23.922103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:23.931110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.580958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:24.604361 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d18396b1-8a5f-405e-978e-196ef0b53ccf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.720959 Jul 14 15:10:24.631796 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2374/4910] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:23 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:24.760356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-564aa8cc-12da-4c7d-999e-260cf685feae req-485d601b-10ea-4da2-ae18-8ef4cbddc07b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28", "tag": "879d92c5-2520-4891-8b47-5ce70a2663ef"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:24.808065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-564aa8cc-12da-4c7d-999e-260cf685feae req-485d601b-10ea-4da2-ae18-8ef4cbddc07b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:24.808537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-564aa8cc-12da-4c7d-999e-260cf685feae req-485d601b-10ea-4da2-ae18-8ef4cbddc07b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:24.851442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-564aa8cc-12da-4c7d-999e-260cf685feae req-485d601b-10ea-4da2-ae18-8ef4cbddc07b service nova] Creating event network-changed:879d92c5-2520-4891-8b47-5ce70a2663ef for instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 on n-h2-768852-23 Jul 14 15:10:24.862290 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-564aa8cc-12da-4c7d-999e-260cf685feae req-485d601b-10ea-4da2-ae18-8ef4cbddc07b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114936 Jul 14 15:10:24.870723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2375/4911] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:25.688983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:25.691094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:25.693282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:25.701555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:25.702372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:25.703449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:25.722980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:25.990634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:26.024293 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9a84886-8095-48ed-99a2-bbf0842a1d91 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 2.614697 Jul 14 15:10:26.025835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2537/4912] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:23 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:26.508461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:26.537565 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e7b11b3-476c-4321-8a78-8d56e348af38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1292 microversion: 2.1 time: 0.890741 Jul 14 15:10:26.555161 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2376/4913] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:25 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1292 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:27.080680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:27.087124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:27.169707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:27.183668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:27.187945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:27.191243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:27.486207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=14 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:27.565603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:27.566268 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:27.582050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:27.613938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:27.614815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:27.624636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:27.625813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:27.640622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=92 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:28.282009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:28.306691 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-453f2df7-df12-4756-a008-b279dfea2b78 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1472 microversion: 2.1 time: 0.742309 Jul 14 15:10:28.319883 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2377/4914] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:27 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1472 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:28.556417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:28.564034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=64 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:28.567164 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-163c2761-d0d2-406d-ab64-4e3f630b2392 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 1.505277 Jul 14 15:10:28.577188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2538/4915] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:27 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:28.787440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-40444793", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:29.613151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:29.613151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:29.622973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:29.624785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:29.632133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:29.633395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:29.635014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:29.856829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:10:31.063978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:31.076373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0750ddbf-a74d-4581-bcac-cbb22ddbe354 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 1.477948 Jul 14 15:10:31.090859 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2539/4916] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:29 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:31.335943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:10:31.337075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:10:31.337786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:10:31.338400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:10:31.339011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:10:31.374881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:31.382498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:31.389557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:31.395893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:31.483160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:10:31.498733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:10:31.559999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:10:31.565551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 2363d069-7fda-4e92-9113-5c7f2023758f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:10:31.798745 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b6c3b890-db48-4a9c-90c5-4b22a130ca73 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.038250 Jul 14 15:10:31.815756 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2378/4917] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:10:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:10:31.816260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4abb6b52-d147-4889-9396-8a5f5ab6dbee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:31.817676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4abb6b52-d147-4889-9396-8a5f5ab6dbee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 2363d069-7fda-4e92-9113-5c7f2023758f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:31.901882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4abb6b52-d147-4889-9396-8a5f5ab6dbee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 2363d069-7fda-4e92-9113-5c7f2023758f] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:10:32.117224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:32.120150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:32.173140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:32.184475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:32.190052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:32.191162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:32.826998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4abb6b52-d147-4889-9396-8a5f5ab6dbee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f" status: 204 len: 0 microversion: 2.1 time: 1.017849 Jul 14 15:10:32.831763 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2540/4918] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:10:31 2022] DELETE /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:10:32.864708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4069a77-f56e-4c01-b0a3-2eca0cc0ec1b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:32.870606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f4069a77-f56e-4c01-b0a3-2eca0cc0ec1b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 2363d069-7fda-4e92-9113-5c7f2023758f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:32.916524 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-f4069a77-f56e-4c01-b0a3-2eca0cc0ec1b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4069a77-f56e-4c01-b0a3-2eca0cc0ec1b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f HTTP/1.1 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2363d069-7fda-4e92-9113-5c7f2023758f'} Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2877, in _get_instance Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 2363d069-7fda-4e92-9113-5c7f2023758f Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2889, in _get_instance Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:10:32.931235 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f4069a77-f56e-4c01-b0a3-2eca0cc0ec1b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f4069a77-f56e-4c01-b0a3-2eca0cc0ec1b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f" status: 404 len: 111 microversion: 2.1 time: 0.101025 Jul 14 15:10:33.004801 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2541/4919] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:32 2022] GET /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:10:33.126138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:33.143630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-39931c2d-c1e9-4263-af07-3a63e991b797 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 1.037819 Jul 14 15:10:33.154126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2379/4920] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:32 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:33.182011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1636218691", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:33.334624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:10:34.163532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:34.167498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:34.184718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:34.185627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:34.187555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:34.188202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.336065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:35.347908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d54d6c7-e286-4894-849a-904642718a89 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 1.190249 Jul 14 15:10:35.352071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2380/4921] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:34 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:35.488449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:10:35.491101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:10:35.501337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:10:35.502057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:10:35.502698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:10:35.530989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.534979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.536194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.536823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.596948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:10:35.619893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:10:35.674413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:10:35.683373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:10:35.828545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-aa9b59f7-8683-4d01-971a-0bf9765ceaef req-9a2d009a-6630-42d7-8b65-8636b7da34d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28", "name": "network-vif-plugged", "status": "completed", "tag": "879d92c5-2520-4891-8b47-5ce70a2663ef"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:35.881690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-aa9b59f7-8683-4d01-971a-0bf9765ceaef req-9a2d009a-6630-42d7-8b65-8636b7da34d7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:35.882486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-aa9b59f7-8683-4d01-971a-0bf9765ceaef req-9a2d009a-6630-42d7-8b65-8636b7da34d7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:35.938039 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-aa9b59f7-8683-4d01-971a-0bf9765ceaef req-9a2d009a-6630-42d7-8b65-8636b7da34d7 service nova] Creating event network-vif-plugged:879d92c5-2520-4891-8b47-5ce70a2663ef for instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 on n-h2-768852-23 Jul 14 15:10:35.944757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a2f9c9b1-3bdc-4479-b2ce-1464f778edbb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.763885 Jul 14 15:10:35.946918 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2542/4922] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:10:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:10:35.959504 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-aa9b59f7-8683-4d01-971a-0bf9765ceaef req-9a2d009a-6630-42d7-8b65-8636b7da34d7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139239 Jul 14 15:10:35.962651 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2381/4923] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:10:35.967651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cbf020f-1720-436b-8e36-2c047e35e8d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:35.968502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6cbf020f-1720-436b-8e36-2c047e35e8d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:36.268561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cbf020f-1720-436b-8e36-2c047e35e8d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:36.278793 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6cbf020f-1720-436b-8e36-2c047e35e8d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1221 microversion: 2.1 time: 0.323436 Jul 14 15:10:36.279856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2543/4924] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:35 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1221 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:36.400308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:36.401998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:36.411770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:36.412694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:36.414002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:36.414968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:37.181352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:37.195722 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b61fa2a6-d636-4ac3-b1d1-55eb36d210e7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1366 microversion: 2.1 time: 0.810184 Jul 14 15:10:37.204464 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2382/4925] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:36 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1366 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:37.312472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:37.316138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:37.371657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:37.376327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:37.378008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:37.378700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:37.744246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:37.754231 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28493b08-33a5-4acb-8284-a0bf5ffdd584 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1217 microversion: 2.1 time: 0.447954 Jul 14 15:10:37.775956 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2544/4926] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:37 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1217 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:38.224148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:38.224783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:38.270726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:38.271474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:38.272390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:38.272867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:38.785500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:38.787017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:38.829029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:38.829029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:38.829029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:38.832022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:38.973403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:38.994246 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2643d0be-fac3-43f7-83be-f00b63126ddf tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1556 microversion: 2.1 time: 0.775676 Jul 14 15:10:38.995774 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2383/4927] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:38 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1556 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:39.023706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:39.024277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:39.041810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:39.042504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:39.043841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:39.044439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:39.160832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:39.177000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3708890-8fc8-48dd-9d20-71c5004c22fb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1279 microversion: 2.1 time: 0.397308 Jul 14 15:10:39.179578 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2545/4928] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:38 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1279 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:39.687429 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd9fc16f-70c6-4a27-a464-b599dcee68b5 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.667433 Jul 14 15:10:39.689508 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2384/4929] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:10:39 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-interface => generated 285 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:10:40.205342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:40.206079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:40.223340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:40.223757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:40.224562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:40.225058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:40.716158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:40.725707 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d86a39ee-dcb6-4990-a5e4-9f5506780c0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.524890 Jul 14 15:10:40.731682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2546/4930] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:40 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:41.748195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:41.748860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:41.753291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:41.760253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:41.785190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:41.786212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:41.793534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:41.794346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:42.585614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:42.597812 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0453a5aa-2bcd-4982-89ff-c95914540f2f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.853603 Jul 14 15:10:42.598992 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2385/4931] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:41 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:43.622254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:43.623263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:43.636289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:43.638407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:43.640558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:43.641979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:44.610521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:44.620689 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5cf8c39a-9a98-41b7-bbb0-d13dab81e586 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 1.005091 Jul 14 15:10:44.636540 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2547/4932] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:43 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:45.239902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0e3593ea-ffc9-4bb9-a2e9-cba3f7aeefb1 req-b5b879d5-06e2-4748-8ea2-8ea7ec83ff20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64954a7e-48d5-46ef-a29a-2d740ff4dae4", "tag": "a66bcc42-443a-4594-bd71-97df2e5bb6e5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:45.325629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e3593ea-ffc9-4bb9-a2e9-cba3f7aeefb1 req-b5b879d5-06e2-4748-8ea2-8ea7ec83ff20 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:45.332124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0e3593ea-ffc9-4bb9-a2e9-cba3f7aeefb1 req-b5b879d5-06e2-4748-8ea2-8ea7ec83ff20 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:45.381591 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0e3593ea-ffc9-4bb9-a2e9-cba3f7aeefb1 req-b5b879d5-06e2-4748-8ea2-8ea7ec83ff20 service nova] Creating event network-changed:a66bcc42-443a-4594-bd71-97df2e5bb6e5 for instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 on n-h1-768852-23 Jul 14 15:10:45.408195 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0e3593ea-ffc9-4bb9-a2e9-cba3f7aeefb1 req-b5b879d5-06e2-4748-8ea2-8ea7ec83ff20 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177265 Jul 14 15:10:45.409757 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2386/4933] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:10:45.648836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:45.650873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:45.680120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:45.688163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:45.690908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:45.694537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:45.698371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:45.881200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-216d727a-63f9-40d9-b95b-3cc569475ccf req-99be07db-685c-4a67-b128-aca1c9d2cc14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28", "tag": "879d92c5-2520-4891-8b47-5ce70a2663ef"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:10:45.907141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-216d727a-63f9-40d9-b95b-3cc569475ccf req-99be07db-685c-4a67-b128-aca1c9d2cc14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:45.907880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-216d727a-63f9-40d9-b95b-3cc569475ccf req-99be07db-685c-4a67-b128-aca1c9d2cc14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:45.948217 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-216d727a-63f9-40d9-b95b-3cc569475ccf req-99be07db-685c-4a67-b128-aca1c9d2cc14 service nova] Creating event network-changed:879d92c5-2520-4891-8b47-5ce70a2663ef for instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 on n-h2-768852-23 Jul 14 15:10:45.964629 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-216d727a-63f9-40d9-b95b-3cc569475ccf req-99be07db-685c-4a67-b128-aca1c9d2cc14 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086502 Jul 14 15:10:45.965499 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2387/4934] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:10:46.274273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:46.353424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:46.369837 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4697ac8-c4b1-44ca-8f36-7833831c1c55 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.729120 Jul 14 15:10:46.378093 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2548/4935] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:45 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:47.396159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:47.397570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:47.412530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:47.417846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:47.419508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:47.425730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:48.188837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:48.213326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c53354d2-d6fa-44c3-85c1-3e3364c6cee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.822187 Jul 14 15:10:48.220809 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2388/4936] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:47 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:49.247406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:49.247406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:49.276122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:49.285152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:49.292291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:49.300206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:50.678418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:50.698601 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-975d578a-4567-4a4d-8b88-fb908635e085 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 1.460635 Jul 14 15:10:50.708090 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2549/4937] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:49 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 1476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:51.725375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:51.726299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:51.757601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:51.758182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:51.769691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:51.770401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:52.297318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:52.308110 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ade31503-6ceb-4352-beec-eb21a86e8a3e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.587499 Jul 14 15:10:52.311518 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2389/4938] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:51 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:53.335518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:53.338128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:53.356653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:53.357098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:53.359180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:53.362936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:53.788276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:53.817665 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e876abd8-aa4b-4818-af31-8607fa9ef770 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.492684 Jul 14 15:10:53.831169 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2550/4939] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:53 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:10:54.854175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:54.856264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:54.886302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:54.887127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:54.891225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:54.894440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:56.205113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:56.263418 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a5f3c52-df7c-4c35-8c5d-0ad532886738 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 1.407453 Jul 14 15:10:56.292541 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2390/4940] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:54 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:57.309909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:57.314750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:57.332789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:57.336059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:57.338836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:57.341798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:58.383723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:10:58.415569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-49515656-78da-4f16-b2d5-030bcf541277 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 1.129625 Jul 14 15:10:58.422552 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2551/4941] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:57 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:10:59.446065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:10:59.447164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:10:59.474401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:10:59.484943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:59.486303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:59.487832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:10:59.498614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:10:59.605394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=66 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:00.059126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:00.080577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e5a3388-08ef-4ec7-bc1b-6c93b58d893c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.642879 Jul 14 15:11:00.081763 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2391/4942] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:10:59 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:00.120798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b06c26a1-122d-475c-a78c-a31bd9baaca4 req-e6433bf2-32e4-44cf-99b7-2a64024676ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64954a7e-48d5-46ef-a29a-2d740ff4dae4", "name": "network-vif-plugged", "status": "completed", "tag": "a66bcc42-443a-4594-bd71-97df2e5bb6e5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:00.158366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:00.172635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b06c26a1-122d-475c-a78c-a31bd9baaca4 req-e6433bf2-32e4-44cf-99b7-2a64024676ce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:00.175690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b06c26a1-122d-475c-a78c-a31bd9baaca4 req-e6433bf2-32e4-44cf-99b7-2a64024676ce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:00.192047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=58 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:00.224318 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b06c26a1-122d-475c-a78c-a31bd9baaca4 req-e6433bf2-32e4-44cf-99b7-2a64024676ce service nova] Creating event network-vif-plugged:a66bcc42-443a-4594-bd71-97df2e5bb6e5 for instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 on n-h1-768852-23 Jul 14 15:11:00.233925 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b06c26a1-122d-475c-a78c-a31bd9baaca4 req-e6433bf2-32e4-44cf-99b7-2a64024676ce service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118059 Jul 14 15:11:00.235398 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2552/4943] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:11:01.099886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:01.100582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:01.114875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:01.114875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:01.115762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:01.116074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:01.407818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:01.416614 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07a06d62-f8a1-4761-ac78-458e3d4deee8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1321 microversion: 2.1 time: 0.320664 Jul 14 15:11:01.427024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2392/4944] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:01 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:02.450733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:02.452496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:02.478317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:02.480402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:02.483662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:02.490832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.144752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:03.197350 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ffd99d49-2049-45a8-b9e6-751857fe7163 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1501 microversion: 2.1 time: 0.751845 Jul 14 15:11:03.205427 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2553/4945] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:02 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1501 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:03.233372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:03.234289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:03.326496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.330981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.336420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.337224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.942637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:03.961327 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4c08640b-60d9-4553-a4a7-8ae6001d7dd8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1501 microversion: 2.1 time: 0.734614 Jul 14 15:11:03.963423 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2393/4946] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:03 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1501 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:03.979712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:03.980555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:03.993238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.993469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:03.994218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:03.994695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.047169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:11:04.335099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1a1e1e17-6b8b-47fa-9d5a-c1e57c66cff2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 204 len: 0 microversion: 2.1 time: 0.359357 Jul 14 15:11:04.336852 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2554/4947] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:11:03 2022] DELETE /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:11:04.374437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:04.377627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:04.388454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:04.389057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:04.399560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.400492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.403404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.406908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.407700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.408696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.409163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.409777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.466036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:11:04.749448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8229ee74-859d-4967-8010-1b3ca7c0c5db tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "DELETE /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 204 len: 0 microversion: 2.32 time: 0.365502 Jul 14 15:11:04.750462 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2555/4948] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 15:11:04 2022] DELETE /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 15:11:04.760055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:04.761440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:04.777245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.778065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:04.779110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:04.782987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:05.081975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:05.100882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d46f0fa-f484-42b1-8ebf-66655ef78297 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1507 microversion: 2.1 time: 0.759282 Jul 14 15:11:05.108256 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2394/4949] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:04 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1507 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:05.803069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:05.813582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:05.815113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:05.825933 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d05c08a-d33c-4390-9d9a-3f53af7db25d tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2954 microversion: 2.32 time: 1.070462 Jul 14 15:11:05.827317 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2556/4950] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:04 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2954 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:06.125513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:06.127146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:06.150467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:06.150950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:06.151826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:06.152276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:06.448147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:06.467594 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dff9e21c-9599-4143-af2f-e78a16bcad5e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1507 microversion: 2.1 time: 0.346745 Jul 14 15:11:06.468235 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2395/4951] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:06 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1507 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:06.850974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:06.851823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:06.869856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:06.870327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:06.871158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:06.871649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:07.487966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:07.489291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:07.523408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:07.526168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:07.528710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:07.533449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:07.687256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:07.719740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:07.732929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:07.740439 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-040556b4-b65c-4c00-92f2-982bcc3366f5 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2954 microversion: 2.32 time: 0.890921 Jul 14 15:11:07.742299 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2557/4952] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:06 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2954 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:07.779753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:07.840938 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4969ab60-7d12-4efe-b975-c561faf8ee9d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1465 microversion: 2.1 time: 0.358410 Jul 14 15:11:07.841543 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2396/4953] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:07 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1465 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:07.893167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b2976d6c-56fc-4650-87d6-8021cf07b9ec req-4a37bcbb-618a-42f7-aba1-14bed5fb8c2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64954a7e-48d5-46ef-a29a-2d740ff4dae4", "name": "network-vif-deleted", "tag": "a66bcc42-443a-4594-bd71-97df2e5bb6e5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:07.941256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b2976d6c-56fc-4650-87d6-8021cf07b9ec req-4a37bcbb-618a-42f7-aba1-14bed5fb8c2b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:07.942068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b2976d6c-56fc-4650-87d6-8021cf07b9ec req-4a37bcbb-618a-42f7-aba1-14bed5fb8c2b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:07.983487 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b2976d6c-56fc-4650-87d6-8021cf07b9ec req-4a37bcbb-618a-42f7-aba1-14bed5fb8c2b service nova] Creating event network-vif-deleted:a66bcc42-443a-4594-bd71-97df2e5bb6e5 for instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 on n-h1-768852-23 Jul 14 15:11:08.015478 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b2976d6c-56fc-4650-87d6-8021cf07b9ec req-4a37bcbb-618a-42f7-aba1-14bed5fb8c2b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127432 Jul 14 15:11:08.017756 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2558/4954] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:08.763661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:08.764520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:08.780652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:08.781182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:08.793145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:08.796021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:08.872139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:08.873226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:08.903893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:08.904942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:08.906633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:08.908928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:09.038903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:09.045376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:09.049395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lazy-loading 'fault' on Instance uuid 64954a7e-48d5-46ef-a29a-2d740ff4dae4 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:11:09.170707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:09.181206 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3bfd8ec9-3dc4-4fff-8700-fd2316967dee tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 200 len: 1311 microversion: 2.1 time: 0.312407 Jul 14 15:11:09.182911 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2559/4955] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:08 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 1311 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:10.218676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:10.219691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:10.235704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:10.236291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:10.237139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:10.237700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:10.301338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 HTTP/1.1 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64954a7e-48d5-46ef-a29a-2d740ff4dae4'} Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:10.303193 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:11:10.307001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ab6a983f-6a4b-4d17-9297-49d40c17ebd0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 404 len: 111 microversion: 2.1 time: 0.091069 Jul 14 15:11:10.318394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2560/4956] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:10 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:11:10.326618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9dadd44c-4490-4e5f-a9f4-e86723288530 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: .version_select at 0x7fdbf23781f0>, body: {"keypair": {"name": "tempest-key-634527827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMJQrOoPbm/1v0RjmFsQoXW7c/355JkyeTFlS1msvR3KhBpJ36vcZRQOmGgyMvSKlbYZQ2iGCLT+J8278CyoGzAwGhUHdKW4cx8qVuBH9XsnVFZRpuRKgvcAzH7+4s8Cw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:10.392775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-9dadd44c-4490-4e5f-a9f4-e86723288530 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:11:10.408724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-9dadd44c-4490-4e5f-a9f4-e86723288530 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:11:10.519371 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9dadd44c-4490-4e5f-a9f4-e86723288530 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.190370 Jul 14 15:11:10.523457 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2561/4957] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:11:10 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:10.539680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c69d8d02-c6d5-4647-82db-60f3bf1784a8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '.version_select at 0x7fdbf1c24a60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:10.574139 n-d-768852-23 devstack@n-api.service[125965]: WARNING oslo_db.sqlalchemy.utils [None req-c69d8d02-c6d5-4647-82db-60f3bf1784a8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Unique keys not in sort_keys. The sorting order may be unstable. Jul 14 15:11:10.606080 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c69d8d02-c6d5-4647-82db-60f3bf1784a8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.071523 Jul 14 15:11:10.611778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2562/4958] 10.222.0.98 () {58 vars in 1136 bytes} [Thu Jul 14 15:11:10 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:10.919578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1336860040", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-key-634527827", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:12.078212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:12.189213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:12.203367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:12.206136 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-676a0167-ed0f-4e78-a822-87b47224ba46 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2954 microversion: 2.32 time: 3.447664 Jul 14 15:11:12.222022 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2397/4959] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:08 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2954 bytes in 3464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:12.228490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f7f947ca-cbf9-4183-9a21-8f31c45a6d09 req-c65d22fa-1179-4ff3-bb94-6a5d0a8f9efa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-unplugged", "status": "completed", "tag": "53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:12.249327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f7f947ca-cbf9-4183-9a21-8f31c45a6d09 req-c65d22fa-1179-4ff3-bb94-6a5d0a8f9efa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:12.250011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f7f947ca-cbf9-4183-9a21-8f31c45a6d09 req-c65d22fa-1179-4ff3-bb94-6a5d0a8f9efa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:12.297836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f7f947ca-cbf9-4183-9a21-8f31c45a6d09 req-c65d22fa-1179-4ff3-bb94-6a5d0a8f9efa service nova] Creating event network-vif-unplugged:53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:12.339705 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f7f947ca-cbf9-4183-9a21-8f31c45a6d09 req-c65d22fa-1179-4ff3-bb94-6a5d0a8f9efa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114600 Jul 14 15:11:12.342953 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2398/4960] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:13.228525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:13.229472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:13.255474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:13.256335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:13.258237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:13.259011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:14.090885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:14.106303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:14.108846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:14.110931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-268f2a26-3f21-4f7b-8e1b-2a0c13ff302e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2933 microversion: 2.32 time: 0.887927 Jul 14 15:11:14.124435 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2399/4961] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:13 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2933 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:14.557846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-74e2ae9a-7394-4f6f-a34f-c619eef00fe8 req-2bd90bda-501e-4f1e-b453-c72612f632e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-unplugged", "status": "completed", "tag": "a352d74d-30f9-4fde-9294-c024e6013bd2"}, {"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-unplugged", "status": "completed", "tag": "a52ddc00-dfb4-45b7-bae9-fda2e03aee2a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:14.582336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-74e2ae9a-7394-4f6f-a34f-c619eef00fe8 req-2bd90bda-501e-4f1e-b453-c72612f632e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:14.601626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-74e2ae9a-7394-4f6f-a34f-c619eef00fe8 req-2bd90bda-501e-4f1e-b453-c72612f632e0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:14.646722 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-74e2ae9a-7394-4f6f-a34f-c619eef00fe8 req-2bd90bda-501e-4f1e-b453-c72612f632e0 service nova] Creating event network-vif-unplugged:a352d74d-30f9-4fde-9294-c024e6013bd2 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:14.655411 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-74e2ae9a-7394-4f6f-a34f-c619eef00fe8 req-2bd90bda-501e-4f1e-b453-c72612f632e0 service nova] Creating event network-vif-unplugged:a52ddc00-dfb4-45b7-bae9-fda2e03aee2a for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:14.672147 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-74e2ae9a-7394-4f6f-a34f-c619eef00fe8 req-2bd90bda-501e-4f1e-b453-c72612f632e0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.118148 Jul 14 15:11:14.690767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2400/4962] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:11:15.136274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:15.137450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:15.160420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:15.162813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:15.165510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:15.168211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:15.925476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:15.969213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:15.974370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:15.988744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1de177d4-c8c4-4696-9493-6cb974e3dadf tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2933 microversion: 2.32 time: 0.857174 Jul 14 15:11:15.992838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2401/4963] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:15 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2933 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:17.029326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:17.031165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:17.046480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.048728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:17.053004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.053813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:17.511823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:17.530554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:17.533470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:17.562006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-20511b98-5398-4c71-b414-1bc15a4ff223 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2912 microversion: 2.32 time: 0.511443 Jul 14 15:11:17.563224 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2402/4964] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:17 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2912 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:17.602914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-df4a4d47-bbbc-415f-b52b-5e8d28cf841e req-5371b25d-80ae-4185-a2fb-5a57057b1e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-unplugged", "status": "completed", "tag": "ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c"}, {"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-unplugged", "status": "completed", "tag": "79814c34-6100-4478-ae14-15f6b596a8b3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:17.655755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-df4a4d47-bbbc-415f-b52b-5e8d28cf841e req-5371b25d-80ae-4185-a2fb-5a57057b1e88 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.658921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-df4a4d47-bbbc-415f-b52b-5e8d28cf841e req-5371b25d-80ae-4185-a2fb-5a57057b1e88 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:17.779805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-df4a4d47-bbbc-415f-b52b-5e8d28cf841e req-5371b25d-80ae-4185-a2fb-5a57057b1e88 service nova] Creating event network-vif-unplugged:ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:17.791010 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-df4a4d47-bbbc-415f-b52b-5e8d28cf841e req-5371b25d-80ae-4185-a2fb-5a57057b1e88 service nova] Creating event network-vif-unplugged:79814c34-6100-4478-ae14-15f6b596a8b3 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:17.819452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-df4a4d47-bbbc-415f-b52b-5e8d28cf841e req-5371b25d-80ae-4185-a2fb-5a57057b1e88 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.250815 Jul 14 15:11:17.822006 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2403/4965] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:17.843677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:17.845443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:17.854964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.855970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:17.857424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:17.858003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:17.986745 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa941f0b-134d-4c68-83f3-33abaa33c125 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/ips" status: 200 len: 150 microversion: 2.1 time: 0.138547 Jul 14 15:11:17.989373 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2404/4966] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:11:17 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/ips => generated 150 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:18.440984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c2cc91a4-ddd8-4462-bbb8-5a919efe2779 req-64919160-c11d-4001-8d02-b91231653efe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-deleted", "tag": "a0c04296-1fa2-4baa-8850-095f5e5b1325"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:18.474583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c2cc91a4-ddd8-4462-bbb8-5a919efe2779 req-64919160-c11d-4001-8d02-b91231653efe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:18.482482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c2cc91a4-ddd8-4462-bbb8-5a919efe2779 req-64919160-c11d-4001-8d02-b91231653efe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:18.526038 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c2cc91a4-ddd8-4462-bbb8-5a919efe2779 req-64919160-c11d-4001-8d02-b91231653efe service nova] Creating event network-vif-deleted:a0c04296-1fa2-4baa-8850-095f5e5b1325 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:18.557962 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c2cc91a4-ddd8-4462-bbb8-5a919efe2779 req-64919160-c11d-4001-8d02-b91231653efe service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118330 Jul 14 15:11:18.567126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2405/4967] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:18.606179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:18.613851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:18.675698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:18.676691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:18.691376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:18.692629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:19.807045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:19.854895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:19.873875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:19.882517 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03ea2d8d-6adb-42fd-ba7c-46f8a0b1ba15 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2752 microversion: 2.32 time: 1.297342 Jul 14 15:11:19.890768 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2406/4968] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:18 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2752 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:20.301523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:20.427240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:20.912514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:20.925103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:20.954435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:20.964956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:20.967943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:20.972844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:20.975842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:22.421684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:22.477383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:22.501754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:22.509720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f101b30a-9a79-4385-b959-c385d9ee12ee tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2705 microversion: 2.32 time: 1.603499 Jul 14 15:11:22.510801 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2407/4969] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:20 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2705 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:22.573738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-083c1748-7b8c-4f44-bfea-6fab85403810 req-29d79974-64df-4d84-a7c6-1aea902367c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-deleted", "tag": "a352d74d-30f9-4fde-9294-c024e6013bd2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:22.682277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-083c1748-7b8c-4f44-bfea-6fab85403810 req-29d79974-64df-4d84-a7c6-1aea902367c4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:22.683056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-083c1748-7b8c-4f44-bfea-6fab85403810 req-29d79974-64df-4d84-a7c6-1aea902367c4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:22.780396 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-083c1748-7b8c-4f44-bfea-6fab85403810 req-29d79974-64df-4d84-a7c6-1aea902367c4 service nova] Creating event network-vif-deleted:a352d74d-30f9-4fde-9294-c024e6013bd2 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:22.808857 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-083c1748-7b8c-4f44-bfea-6fab85403810 req-29d79974-64df-4d84-a7c6-1aea902367c4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263832 Jul 14 15:11:22.820348 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2408/4970] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:22.911791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:22.924982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:23.070624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:23.072157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:23.076246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:23.085430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:24.904165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b33cf07f-b32c-470e-b423-592604e51b62 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.056775 Jul 14 15:11:24.921292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2409/4971] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:11:22 2022] POST /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 194 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:24.984312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:24.987736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:25.032657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:25.042173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:25.044142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:25.051244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:25.103732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:26.535299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:26.585966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:26.589820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:26.598641 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6aa7bf8f-090f-4044-934b-68dad7cf5ae2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 2325 microversion: 2.32 time: 1.675330 Jul 14 15:11:26.618265 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2410/4972] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:24 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 2325 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:26.631294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8044de73-4b80-4214-bdac-2ea850ea62e8 req-f4aa7b79-2da1-47f2-b0de-d14dc43dbb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-deleted", "tag": "ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:26.671905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8044de73-4b80-4214-bdac-2ea850ea62e8 req-f4aa7b79-2da1-47f2-b0de-d14dc43dbb5f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:26.677629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8044de73-4b80-4214-bdac-2ea850ea62e8 req-f4aa7b79-2da1-47f2-b0de-d14dc43dbb5f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:26.724071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8044de73-4b80-4214-bdac-2ea850ea62e8 req-f4aa7b79-2da1-47f2-b0de-d14dc43dbb5f service nova] Creating event network-vif-deleted:ec0072dc-0cb7-4f4d-be0c-6c81d0aa1f9c for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:26.746415 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8044de73-4b80-4214-bdac-2ea850ea62e8 req-f4aa7b79-2da1-47f2-b0de-d14dc43dbb5f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125798 Jul 14 15:11:26.747374 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2411/4973] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:27.626974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:27.628047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:27.654432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:27.656322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:27.658950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:27.668901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:27.977620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:27.995763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:28.002662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:28.009046 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a3b4e914-f40b-44cc-9564-f530d8ae93cc tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.383577 Jul 14 15:11:28.022047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2412/4974] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:27 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:28.990009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-38f45d10-fb85-4d4a-996d-ef950a365940 req-efe38187-4b87-4c7c-996d-bc9c5a025ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-deleted", "tag": "53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258"}, {"server_uuid": "34d753b2-8253-43c3-b363-423d167a8739", "name": "network-vif-deleted", "tag": "79814c34-6100-4478-ae14-15f6b596a8b3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:29.008199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-38f45d10-fb85-4d4a-996d-ef950a365940 req-efe38187-4b87-4c7c-996d-bc9c5a025ed3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.013303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-38f45d10-fb85-4d4a-996d-ef950a365940 req-efe38187-4b87-4c7c-996d-bc9c5a025ed3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.052967 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-38f45d10-fb85-4d4a-996d-ef950a365940 req-efe38187-4b87-4c7c-996d-bc9c5a025ed3 service nova] Creating event network-vif-deleted:53e9a3af-b2cc-4f0c-9e0a-e2ed1112c258 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:29.053834 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-38f45d10-fb85-4d4a-996d-ef950a365940 req-efe38187-4b87-4c7c-996d-bc9c5a025ed3 service nova] Creating event network-vif-deleted:79814c34-6100-4478-ae14-15f6b596a8b3 for instance 34d753b2-8253-43c3-b363-423d167a8739 on n-h2-768852-23 Jul 14 15:11:29.074565 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-38f45d10-fb85-4d4a-996d-ef950a365940 req-efe38187-4b87-4c7c-996d-bc9c5a025ed3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.089354 Jul 14 15:11:29.076355 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2413/4975] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:11:29.099575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:29.101387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:29.114982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.119087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.120982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:29.124496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:29.489651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:29.518929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:29.522963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:29.525796 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77c7eb54-d7d0-4a62-a82f-5d8437770286 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.447038 Jul 14 15:11:29.527158 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2414/4976] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:29 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:30.564871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:30.574575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:30.606116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=48 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:30.612999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:30.614552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:30.616335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:30.617365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:30.783659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:30.829658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:30.833028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:30.836028 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2e538a8-2984-41f3-b215-098aad6758d6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.291482 Jul 14 15:11:30.837399 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2415/4977] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:30 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:31.857019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:31.858820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:31.870685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:31.871531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:31.872785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:31.884017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:32.098795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:32.111808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:32.117766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:32.118977 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37da7181-39d0-4906-99af-2fafdfde6ba6 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.266040 Jul 14 15:11:32.133355 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2416/4978] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:31 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:33.152014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:33.157612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:33.176248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:33.177617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:33.179441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:33.180581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:33.337891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:33.376373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:33.383497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:33.386389 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-954111e0-99d7-4368-851d-9229cb9c3185 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.245134 Jul 14 15:11:33.388925 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2417/4979] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:33 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:34.416590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:34.417587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:34.462172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:34.463319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:34.469777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:34.485555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:34.729575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:34.779401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:34.782679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:34.792450 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b69ce24-f832-44d1-be41-b330ae0f66dd tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.385987 Jul 14 15:11:34.793617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2418/4980] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:34 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:35.442350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:11:35.825633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:35.827041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:35.842135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:35.842954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:35.847923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:35.848627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:35.988145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:36.005280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:36.009037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:36.012315 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3909d06e-79fa-447d-8b26-d6d2f29cf55f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.190578 Jul 14 15:11:36.018905 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2419/4981] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:35 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:36.343778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:11:36.343778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:11:36.343778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:11:36.343778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:11:36.343778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:11:36.377606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:36.379251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:36.386188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:36.390778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:36.470633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:11:36.486510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:11:36.523115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:11:36.529037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:11:36.606435 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4fb491ed-d90d-45ad-8958-bc85a1f77ef8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 25.692651 Jul 14 15:11:36.607680 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2563/4982] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 25695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:11:36.625430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4bc7a6ef-9415-42f9-b5db-6e5a2669c6ab tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:36.628798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4bc7a6ef-9415-42f9-b5db-6e5a2669c6ab tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:36.888269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4bc7a6ef-9415-42f9-b5db-6e5a2669c6ab tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:36.908744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4bc7a6ef-9415-42f9-b5db-6e5a2669c6ab tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1228 microversion: 2.1 time: 0.288182 Jul 14 15:11:36.910987 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2420/4983] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:36 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1228 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:37.044877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:37.045517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:37.056503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:37.056974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:37.057830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:37.058283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:37.279600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:37.342715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:37.349957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:37.358713 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7029899e-e256-40ca-93af-eca8bfbee7d8 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.318611 Jul 14 15:11:37.361966 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2564/4984] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:37 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:37.938361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:37.941079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:37.957072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:37.958373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:37.959827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:37.960669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:38.296711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:38.307664 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e563f92-8bf7-4f69-af8f-ce8f2e78d4ba tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1232 microversion: 2.1 time: 0.382711 Jul 14 15:11:38.308842 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2421/4985] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:37 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1232 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:38.405956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:38.407626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:38.430408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:38.431584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:38.433323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:38.434398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:38.639218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:38.676877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:38.694376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:38.696759 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be8076fd-8e39-401a-b406-eef577a50434 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.317488 Jul 14 15:11:38.707857 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2565/4986] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:38 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:39.341694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:39.342940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:39.376059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:39.376938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:39.382113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:39.385783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:39.703042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:39.736306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:39.740366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:39.741764 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0fc3785a-b023-4b62-8870-0c8e16f32dd6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1298 microversion: 2.1 time: 0.407150 Jul 14 15:11:39.745215 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2422/4987] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:39 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1298 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:39.788791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:39.789650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:39.791086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:39.793298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:40.063319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:40.089751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:40.101438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:40.103799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44668964-144f-4fa2-bd42-62f41b2c92df tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.375467 Jul 14 15:11:40.127827 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2566/4988] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:39 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:40.770216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:40.777687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:40.812064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:40.818231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:40.827895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:40.830843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:41.057173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:41.091515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57e57c82-9e4a-4beb-94ca-b259fc252056 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1286 microversion: 2.1 time: 0.332591 Jul 14 15:11:41.107610 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2423/4989] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:40 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1286 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:41.143978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:41.145517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:41.180064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:41.181108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:41.182592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:41.184726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:41.673947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:41.698523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:41.700601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:41.704722 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87ef0888-ea49-45e5-bc59-4acfae16fbb9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.566676 Jul 14 15:11:41.713267 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2567/4990] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:41 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:42.116594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:42.119024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:42.148128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:42.149203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:42.151128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:42.152067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:42.739877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:42.741240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:42.766650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:42.767747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:42.768834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:42.769431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:42.788804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:42.836731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-92c10898-2073-4193-b207-2f78be883e74 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.727299 Jul 14 15:11:42.837810 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2424/4991] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:42 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:43.210766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:43.225592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:43.232795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:43.234754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60aba088-ba6c-44d9-a8a9-8f4f45e4040e tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.499119 Jul 14 15:11:43.240056 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2568/4992] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:42 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:43.889043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:43.893559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:43.930867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:43.933326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:43.936248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:43.937941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:44.260133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:44.273025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:44.274310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:44.275377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1f278e2-0d06-4535-b056-192115b4b042 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.413499 Jul 14 15:11:44.287868 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2425/4993] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:43 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:44.289776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:44.293460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:44.296834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:44.298793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:44.459817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:44.492982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:44.495393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:44.502942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-98ea7cd5-a369-4e4a-82ab-178ffb14dcec tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.232193 Jul 14 15:11:44.505704 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2569/4994] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:44 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:44.815959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2fa28e11-b3e2-4bd9-bede-e39174eef672 req-1139bd15-9c11-46c4-8419-f4dddb5595f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a956ed4e-54b1-4ce7-8009-a90ce8823276", "tag": "83e89f94-ae92-44ac-a4fe-62575f9bcffd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:44.854038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2fa28e11-b3e2-4bd9-bede-e39174eef672 req-1139bd15-9c11-46c4-8419-f4dddb5595f1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:44.859448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2fa28e11-b3e2-4bd9-bede-e39174eef672 req-1139bd15-9c11-46c4-8419-f4dddb5595f1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:44.936895 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2fa28e11-b3e2-4bd9-bede-e39174eef672 req-1139bd15-9c11-46c4-8419-f4dddb5595f1 service nova] Creating event network-changed:83e89f94-ae92-44ac-a4fe-62575f9bcffd for instance a956ed4e-54b1-4ce7-8009-a90ce8823276 on n-h1-768852-23 Jul 14 15:11:44.959777 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2fa28e11-b3e2-4bd9-bede-e39174eef672 req-1139bd15-9c11-46c4-8419-f4dddb5595f1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.155599 Jul 14 15:11:44.960926 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2426/4995] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:45.294547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:45.296046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:45.311341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:45.315390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:45.316795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:45.317545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:45.535574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:45.536609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:45.552765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:45.557688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:45.573788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:45.573788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:45.785541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:45.815988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:45.822576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:45.826280 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da77ddc5-9af6-4ec4-822c-0dcd50159712 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.295353 Jul 14 15:11:45.833410 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2427/4996] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:45 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:46.002894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:46.012144 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-01ecc730-6e4f-4bb4-9aeb-aff55007fe08 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.721771 Jul 14 15:11:46.020937 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2570/4997] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:45 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:46.862664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:46.864104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:46.880830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:46.881757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:46.882842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:46.883556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:46.996563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:47.036062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:47.037427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:47.052075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:47.053930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:47.057757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:47.058453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:47.064656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:47.066444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:47.449198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:47.517510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:47.520532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:47.522645 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-06d0841e-c2bc-4d8e-90b4-79085e61d7ef tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.664146 Jul 14 15:11:47.557084 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2428/4998] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:46 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:48.113165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:48.141641 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1124a0d2-7d2e-4b68-bfe9-19f4c8bfdfa6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 1.110521 Jul 14 15:11:48.148114 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2571/4999] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:47 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:48.578974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:48.580766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:48.605240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:48.612532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:48.613861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:48.614316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:49.106714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:49.123318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:49.144240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:49.146739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:49.157860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-109bc457-9a62-4493-996f-5bd47a2bc03f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.583085 Jul 14 15:11:49.168083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:49.169308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:49.180967 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2429/5000] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:48 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:11:49.207850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:49.209677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:49.224358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:49.229442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:50.190352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:50.210908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:50.212202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:50.218308 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b349a31-4536-40fc-ae4b-540a8f017e44 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 1.053980 Jul 14 15:11:50.224837 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2572/5001] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:49 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:50.227629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:50.228094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:50.228898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:50.229347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:50.404519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:50.407813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:50.455567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:50.462812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:50.464589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:50.465369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:50.506383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:50.524568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:50.526233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:50.541680 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cec792f3-54b4-4907-a36e-af17615f5796 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.334939 Jul 14 15:11:50.551362 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2430/5002] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:50 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:50.863091 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Invalid volume: volume 1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 is already attached to instances: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments HTTP/1.1 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 74 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: {"volumeAttachment": {"volumeId": "1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3"}} Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: exception: Invalid volume: volume 1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 is already attached to instances: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': '98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28', 'body': {'volumeAttachment': {'volumeId': '1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3'}}} Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 is already attached to instances: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:11:50.881445 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 is already attached to instances: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 is already attached to instances: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 400 to user: Invalid volume: volume 1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 is already attached to instances: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-156f6d45-d7aa-48aa-ba4a-bcc2a9a60430 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.487431 Jul 14 15:11:50.894081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2573/5003] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:11:50 2022] POST /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 174 bytes in 490 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:11:51.110477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:51.111115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:51.124040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.124511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.125383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.125840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.246655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:51.247442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:51.285347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.285828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.286719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.288783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.451150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lazy-loading 'services' on Instance uuid 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:11:51.692776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4f843085-78b1-4668-a01a-6d997d4aba1f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments/1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3" status: 202 len: 0 microversion: 2.1 time: 0.582302 Jul 14 15:11:51.696303 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2431/5004] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:11:51 2022] DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments/1fe5ea8f-23d0-47f8-abf6-13ca7d2ceaa3 => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:11:51.719234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:51.720592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:51.748469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.751843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.756305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.757763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.772076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:51.794358 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e6975e0a-238b-46f0-afb2-57c9fc2a3d97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.549512 Jul 14 15:11:51.796176 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2574/5005] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:51 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:51.823093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:51.824818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:51.836192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.836422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.848369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:51.849250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:51.994792 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-89612350-3efa-448f-8891-f9fdac6b595b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.191387 Jul 14 15:11:51.997927 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2575/5006] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:51 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:52.098445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:52.129793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:52.143704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:52.146611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-30bdf587-4ec9-4438-8b1e-34761c9478b1 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.448299 Jul 14 15:11:52.148653 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2432/5007] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:51 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:52.816811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:52.817684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:52.858058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:52.858517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:52.860356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:52.867670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:53.011242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:53.013230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:53.042513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:53.044167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:53.051038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:53.051945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:53.139174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d486edaf-a93c-4c06-8942-2b17602cb898 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131787 Jul 14 15:11:53.152574 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2433/5008] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:53 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:11:53.178585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:53.179677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:53.193471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:53.194506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:53.198926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:53.199957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:53.345911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:53.367177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:53.372053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:53.381201 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c64ea647-d155-4def-8e50-97af6ee732ba tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.206969 Jul 14 15:11:53.382717 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2434/5009] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:53 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:53.525080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:53.533463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d0d146b8-a0f4-46f2-ac70-93b6c9024a38 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.723018 Jul 14 15:11:53.534076 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2576/5010] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:52 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:54.168503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:54.170283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:54.201470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.211449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.220631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.221457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.380504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f646fabb-1181-405e-b13b-c463c320ef54 req-7b91eb7d-cd3e-48f2-b70a-a60390124e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a956ed4e-54b1-4ce7-8009-a90ce8823276", "name": "network-vif-plugged", "status": "completed", "tag": "83e89f94-ae92-44ac-a4fe-62575f9bcffd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:11:54.398859 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-128d54a2-fb95-41f6-b871-a4917e2ebfc7 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.227210 Jul 14 15:11:54.400833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f646fabb-1181-405e-b13b-c463c320ef54 req-7b91eb7d-cd3e-48f2-b70a-a60390124e3d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.401058 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2577/5011] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:54 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:54.401624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f646fabb-1181-405e-b13b-c463c320ef54 req-7b91eb7d-cd3e-48f2-b70a-a60390124e3d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.418394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:54.423848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:54.424509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f646fabb-1181-405e-b13b-c463c320ef54 req-7b91eb7d-cd3e-48f2-b70a-a60390124e3d service nova] Creating event network-vif-plugged:83e89f94-ae92-44ac-a4fe-62575f9bcffd for instance a956ed4e-54b1-4ce7-8009-a90ce8823276 on n-h1-768852-23 Jul 14 15:11:54.442834 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f646fabb-1181-405e-b13b-c463c320ef54 req-7b91eb7d-cd3e-48f2-b70a-a60390124e3d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.527655 Jul 14 15:11:54.444424 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2435/5012] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:54.451976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.453448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.454954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.455762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.551867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:54.553027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:54.568243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.569110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.570431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:54.571153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:54.837314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:54.854455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:54.860385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:54.869963 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73f28ec3-7eee-45d1-9796-666849e6a753 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.453712 Jul 14 15:11:54.869963 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2578/5013] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:54 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:54.943731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:54.956906 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-954cc9bf-6d32-4d33-ab8d-8a392c265b03 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.409981 Jul 14 15:11:54.959782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2436/5014] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:54 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:55.412839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:55.413790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:55.426270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:55.426736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:55.427580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:55.438608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:55.509167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c0a8f5d-54c3-49ee-9f16-511c394c27ab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100128 Jul 14 15:11:55.513238 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2579/5015] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:55 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:55.903522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:55.904963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:55.922107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:55.923916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:55.935637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:55.946312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:55.976738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:55.977600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:55.991448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:55.992761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:55.993773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:55.994373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:56.048072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:11:56.288563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:56.315903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:56.348226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:56.349756 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-69ba99a1-2343-49c5-bc7b-51bb8085ba3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.451236 Jul 14 15:11:56.356535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2437/5016] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:55 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:56.415434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:56.434417 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f1edc9c4-a69b-43a4-9391-e372586a69ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1328 microversion: 2.1 time: 0.461028 Jul 14 15:11:56.436360 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2580/5017] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:55 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1328 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:56.533987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:56.536807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:56.549791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:56.550292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:56.551232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:56.551783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:56.731557 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1274fb25-6f42-4729-a7ca-a67cc2b8d14e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211840 Jul 14 15:11:56.732223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2438/5018] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:56 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:11:57.387464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:57.388860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:57.417778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.418612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.420371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.422039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.461814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:57.473839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:57.491509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.501654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.506815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.508007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.638084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:57.657963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:57.660716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:57.663131 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a967061-b91e-4e94-bc2b-8e46ee41f153 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.283640 Jul 14 15:11:57.677216 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2581/5019] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:57 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:57.747909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:57.750798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:57.773045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.777337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.780216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.781303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.823454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:57.855620 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab3a21e2-2a69-47f7-995d-99fd041aac3f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1508 microversion: 2.1 time: 0.401098 Jul 14 15:11:57.857573 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2439/5020] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:57 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:57.874068 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-51a828f0-e580-4e8d-9ee6-4144e8da24f9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133002 Jul 14 15:11:57.885573 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2582/5021] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:57 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:11:57.892695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:57.894076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:57.906325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.907429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:57.909098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:57.909971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.271669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:58.291228 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-968ee9b8-f4ce-4ac2-a50b-94785e09383f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1508 microversion: 2.1 time: 0.413682 Jul 14 15:11:58.304934 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2440/5022] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:57 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1508 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:11:58.323916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:58.325292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:58.339024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:58.339861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.340987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:58.341629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.411812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:11:58.561557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c9f3d74-5d3a-4d1f-b5a2-0cdf2ad8a8b5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 204 len: 0 microversion: 2.1 time: 0.241385 Jul 14 15:11:58.566813 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2583/5023] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:11:58 2022] DELETE /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:11:58.577210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:58.579104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:58.591787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:58.592717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.595598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:58.597518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.713075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:58.725040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:58.746274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:58.757534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.759737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:58.762200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:58.965044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:58.984716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:58.988181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:58.990784 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-603029e5-8811-4a7e-9981-d730fe435559 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.286231 Jul 14 15:11:59.003323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2584/5024] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:11:58 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:11:59.003323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:11:59.004523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:11:59.017102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:59.018971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:59.022308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:11:59.027206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:11:59.043386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:11:59.073817 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-396c0c87-3404-4fd2-a00b-6071c1f6f6ef tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1514 microversion: 2.1 time: 0.504705 Jul 14 15:11:59.075063 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2441/5025] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:11:58 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1514 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:11:59.141477 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61386821-5491-46b3-9358-d830231c7a99 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146549 Jul 14 15:11:59.148561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2585/5026] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:11:58 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:00.031526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:00.034108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:00.045980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:00.047916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:00.049483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:00.050563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:00.094804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:00.095639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:00.125559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:00.126303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:00.127820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:00.128630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:00.184745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:00.200593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:00.203571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:00.206643 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6e465f7-f447-49db-8a66-afaf01571b4b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.184071 Jul 14 15:12:00.207905 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2442/5027] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:00 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:00.214176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:00.215578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:00.223984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:00.225987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:00.226866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:00.227533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:00.287253 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae81d546-4033-44af-b3e6-724ede932d53 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076769 Jul 14 15:12:00.291912 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2443/5028] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:12:00 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:00.731562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:00.746642 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-262b1c46-a905-4902-bb79-723a176cbb9a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1514 microversion: 2.1 time: 0.657062 Jul 14 15:12:00.750461 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2586/5029] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:00 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1514 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:01.222279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6c7e5265-4e41-4536-a812-9fd62dce9fe2 req-4fd3063b-3715-4ed1-bcb8-6ca1daf468a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a956ed4e-54b1-4ce7-8009-a90ce8823276", "name": "network-vif-deleted", "tag": "83e89f94-ae92-44ac-a4fe-62575f9bcffd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:01.235803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:01.236523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:01.238629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:01.242289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=60 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:01.266213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.266667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.274484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6c7e5265-4e41-4536-a812-9fd62dce9fe2 req-4fd3063b-3715-4ed1-bcb8-6ca1daf468a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.280292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6c7e5265-4e41-4536-a812-9fd62dce9fe2 req-4fd3063b-3715-4ed1-bcb8-6ca1daf468a8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.288616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.294721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.333516 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6c7e5265-4e41-4536-a812-9fd62dce9fe2 req-4fd3063b-3715-4ed1-bcb8-6ca1daf468a8 service nova] Creating event network-vif-deleted:83e89f94-ae92-44ac-a4fe-62575f9bcffd for instance a956ed4e-54b1-4ce7-8009-a90ce8823276 on n-h1-768852-23 Jul 14 15:12:01.350812 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6c7e5265-4e41-4536-a812-9fd62dce9fe2 req-4fd3063b-3715-4ed1-bcb8-6ca1daf468a8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128226 Jul 14 15:12:01.351860 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2444/5030] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:01.370391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:01.371941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:01.388432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.394944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.396633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.397470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.493209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4f1b8fc-b37c-42ec-808f-3e225b404348 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139627 Jul 14 15:12:01.494249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2445/5031] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:12:01 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:01.567746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:01.592819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:01.597438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:01.600623 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2329bb81-7dd1-40be-901c-4fc59af4e035 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.371841 Jul 14 15:12:01.615332 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2587/5032] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:01 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:12:01.768409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:01.769470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:01.777491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.778407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.779690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.781084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.847205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:01.848892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:01.848892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lazy-loading 'fault' on Instance uuid a956ed4e-54b1-4ce7-8009-a90ce8823276 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:12:02.502425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:02.506208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:02.507876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:02.508922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:02.516948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd56f3b8-4d35-4544-bc07-d75ae7e280bf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 200 len: 1318 microversion: 2.1 time: 0.754480 Jul 14 15:12:02.518010 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2446/5033] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:01 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:02.532992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:02.533505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:02.534413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:02.534891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:02.621610 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3bf88dfd-f915-4ea8-afa6-cff025ab42f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118949 Jul 14 15:12:02.623372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2588/5034] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:12:02 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:12:02.633610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:02.634246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:02.642677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:02.643466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:02.644513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:02.645134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:02.768077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:02.784847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:02.790610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:02.791975 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-827c488a-863f-427c-9138-93a83cbf5bd0 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.162580 Jul 14 15:12:02.798663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2447/5035] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:02 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:03.535871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:03.537611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:03.551881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.552337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.553178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.553622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.593925 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 HTTP/1.1 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'a956ed4e-54b1-4ce7-8009-a90ce8823276'} Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:03.599213 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:03.608305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:03.608305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:03.608305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:12:03.608305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:12:03.608305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:12:03.608305 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:03.609906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:12:03.614138 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-743f56fc-a457-40a3-8cf8-e274164bb524 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 404 len: 111 microversion: 2.1 time: 0.079368 Jul 14 15:12:03.619362 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2589/5036] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:03 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:12:03.628316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17958c90-8fd4-4a9a-92e4-1065cd61f75b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '.version_select at 0x7fdbf306e430>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:03.639347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:03.641185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:03.655336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.655336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.657074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.657878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.682013 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17958c90-8fd4-4a9a-92e4-1065cd61f75b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-key-634527827" status: 202 len: 0 microversion: 2.1 time: 0.057721 Jul 14 15:12:03.683033 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2448/5037] 10.222.0.98 () {58 vars in 1205 bytes} [Thu Jul 14 15:12:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-634527827 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:12:03.751853 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4eeae20-bad8-48c3-a20e-6b56e661dd07 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118549 Jul 14 15:12:03.753063 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2590/5038] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:12:03 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:03.817262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:03.818249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:03.833078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.833804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.839217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:03.840020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:03.915463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-329911002", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:04.086290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:12:04.145306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:04.194056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:04.202364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:04.205941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3f842487-b084-4213-8ed7-bc803746ba2a tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.392904 Jul 14 15:12:04.211727 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2449/5039] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:03 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:12:04.775087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:04.791795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:04.904786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.910416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:04.914309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:04.917795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:05.165430 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ba68f0e-0bf8-4692-8931-2989b32d4ca6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.399846 Jul 14 15:12:05.185785 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2450/5040] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:12:04 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28/os-volume_attachments => generated 25 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 15:12:05.243392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:05.243392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:05.255355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:05.255823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:05.256633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:05.257081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:05.542630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:05.566717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:05.571098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:05.578214 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-032b7cd3-1819-4ec6-b482-0240b68fff06 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.341426 Jul 14 15:12:05.579500 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2451/5041] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:05 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:05.860458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:05.861738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:05.881201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:05.886670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:05.894422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:05.895227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.021749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:12:06.382361 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aba667b7-0ff4-4a05-aa12-6cfe461b0a5f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 204 len: 0 microversion: 2.1 time: 0.529032 Jul 14 15:12:06.388351 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2452/5042] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:12:05 2022] DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:12:06.411655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:06.412861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:06.432626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:06.433302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.434639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:06.435535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.474470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:12:06.475322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:12:06.475532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:12:06.475799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:12:06.476211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:12:06.499013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:06.503282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.506050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:06.508289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.564620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:06.572843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:06.635836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:12:06.647528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:12:06.859184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:06.863468 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4306f937-bb50-4462-95c8-f1966cc5394a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.954741 Jul 14 15:12:06.864149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2591/5043] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:12:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:12:06.893479 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0897efa4-c995-47b0-a81d-12b0a75cca1b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1681 microversion: 2.1 time: 0.502804 Jul 14 15:12:06.896511 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2453/5044] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:06 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1681 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:06.898472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:06.906288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:06.918801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4f6d4761-6c96-4407-a584-acc892fc9225 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:06.939698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:06.940242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.941357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:06.942193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:06.942398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4f6d4761-6c96-4407-a584-acc892fc9225 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:07.230406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:07.289199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:07.302848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:07.313176 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3d63ca6-766e-4e47-862e-a81df278db3f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.427902 Jul 14 15:12:07.314791 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2592/5045] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:06 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:07.442421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4f6d4761-6c96-4407-a584-acc892fc9225 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:07.476857 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4f6d4761-6c96-4407-a584-acc892fc9225 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1208 microversion: 2.1 time: 0.574869 Jul 14 15:12:07.496281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2454/5046] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:06 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1208 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:07.920392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:07.929349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:07.987524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:07.996666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:08.000241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:08.001822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:08.350669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:08.354503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:08.400632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:08.405312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:08.411862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:08.412316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:08.912102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:08.960827 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92c63566-32ca-48df-8d9a-1f72d659191f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1681 microversion: 2.1 time: 1.048790 Jul 14 15:12:08.964870 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2593/5047] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:07 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1681 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:08.996012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:08.999671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:09.024693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:09.025144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:09.028408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:09.029043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:09.133477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:09.149780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:09.159847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:09.161398 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9254703-4a35-4cee-b6ab-5f72be1e7cd3 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.819073 Jul 14 15:12:09.162366 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2455/5048] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:08 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:09.232470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:09.279311 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-adb53eac-e95c-4b8e-acbf-4c1da58fcc0c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1204 microversion: 2.1 time: 0.312086 Jul 14 15:12:09.284595 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2594/5049] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:08 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1204 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:09.985151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:09.985919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:10.009667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:10.010139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:10.017779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:10.021091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:10.194924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:10.197307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:10.261450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:10.282546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:10.286704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:10.314059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:10.846547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:10.862826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:10.864451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:10.865697 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bcc3ad12-71f9-4e12-9cd2-db5ae80529b2 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.678333 Jul 14 15:12:10.890215 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2595/5050] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:10 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:10.905714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:10.918954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:10.955442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:10.955934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:10.956768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:10.957241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:11.063260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:11.403740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:11.415132 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e6eb624-4ec8-4067-8a15-6de3b024030e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1681 microversion: 2.1 time: 1.434192 Jul 14 15:12:11.420247 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2456/5051] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:09 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1681 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:11.487658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:11.537808 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d0ad128-a4be-4f0c-851c-8b4b8bc9470c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1266 microversion: 2.1 time: 0.645632 Jul 14 15:12:11.541665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2596/5052] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:10 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1266 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:11.902183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:11.903123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:11.918925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:11.920630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:11.923675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:11.925012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:12.449004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:12.472880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:12.498944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:12.504701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:12.509029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:12.510127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:12.547202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:12.564487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:12.566454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:12.589163 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-176d1f7b-0795-41c0-8676-4d3c39e7917f tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.685132 Jul 14 15:12:12.592625 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2457/5053] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:11 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:12.619575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:12.627264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:12.652809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:12.659255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:12.662113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:12.665090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:12.918795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:12.961553 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-514f11d9-4ab7-4c88-a5fb-68ce9f548e52 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1613 microversion: 2.1 time: 0.527138 Jul 14 15:12:12.962665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2597/5054] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:12 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1613 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:13.601531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:13.623133 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b93d127-b02a-44b7-84e7-2e2d32754cd3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.015952 Jul 14 15:12:13.626809 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2458/5055] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:12 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:13.654776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:13.694695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:13.722607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:13.748189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:13.749850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:13.752185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.139442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:14.190815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:14.198783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:14.207804 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d1d9b79-7b75-4aba-972b-0d82f747f75b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.587739 Jul 14 15:12:14.219765 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2598/5056] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:13 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:14.255937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:14.257029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:14.317907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:14.318967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.329165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:14.338115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.338669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-23b0219a-588e-4425-a0ce-2fb0ee9f8467 req-68531add-9ab2-4161-a305-ee7dd22a9d47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28", "name": "network-vif-deleted", "tag": "879d92c5-2520-4891-8b47-5ce70a2663ef"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:14.385868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-23b0219a-588e-4425-a0ce-2fb0ee9f8467 req-68531add-9ab2-4161-a305-ee7dd22a9d47 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:14.388811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-23b0219a-588e-4425-a0ce-2fb0ee9f8467 req-68531add-9ab2-4161-a305-ee7dd22a9d47 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.444719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-23b0219a-588e-4425-a0ce-2fb0ee9f8467 req-68531add-9ab2-4161-a305-ee7dd22a9d47 service nova] Creating event network-vif-deleted:879d92c5-2520-4891-8b47-5ce70a2663ef for instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 on n-h2-768852-23 Jul 14 15:12:14.469127 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-23b0219a-588e-4425-a0ce-2fb0ee9f8467 req-68531add-9ab2-4161-a305-ee7dd22a9d47 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.580107 Jul 14 15:12:14.469831 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2459/5057] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:12:14.562494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:14.566929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.573664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lazy-loading 'fault' on Instance uuid 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:12:14.652052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:14.652946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:14.667926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:14.668386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.669207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:14.669653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:14.737007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:14.783891 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-282ab151-faad-4243-a753-651f6411e984 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 200 len: 1330 microversion: 2.1 time: 0.557216 Jul 14 15:12:14.808755 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2599/5058] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:14 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 1330 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:15.246226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:15.251891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:15.284374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:15.285822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:15.294318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:15.295916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:15.744825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:15.817184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:15.831832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:15.838658 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-593c3da0-16c6-4804-bb1c-d087f12a935b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.598957 Jul 14 15:12:15.848179 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2600/5059] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:15 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:15.869287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:15.873847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:15.908305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:15.909359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:15.911600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:15.916229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:15.986463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 HTTP/1.1 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28'} Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:15.995845 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:12:16.003189 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:16.009378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:12:16.018230 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3e766d4-3c25-4abc-bfaf-93aa85987324 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 404 len: 111 microversion: 2.1 time: 0.163196 Jul 14 15:12:16.025732 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2601/5060] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:15 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:12:16.049276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba431e1c-fa50-4db2-98f0-f2435e3318cc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '.version_select at 0x7fdbf1b82f70>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:16.106700 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba431e1c-fa50-4db2-98f0-f2435e3318cc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-640760443" status: 202 len: 0 microversion: 2.1 time: 0.078778 Jul 14 15:12:16.109023 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2602/5061] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 15:12:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-640760443 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:12:16.290230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:16.304213 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d9144f1-4e14-4d70-9e53-0e0d0457087d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.656845 Jul 14 15:12:16.305827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2460/5062] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:14 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:16.871839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:16.875620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:16.887977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:16.889118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:16.898520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-279d6406-c1b8-4793-85c1-ea8618593a5f req-d0e609e7-cbe7-4761-be4d-1301dd859c3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7c6cd4-04f0-4c1e-9a76-713959d65d4a", "tag": "38476fc9-edb3-4953-b3e8-896df62a80f3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:16.936294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:16.937144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:16.959565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:16.960297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:16.982671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-279d6406-c1b8-4793-85c1-ea8618593a5f req-d0e609e7-cbe7-4761-be4d-1301dd859c3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:16.993948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-279d6406-c1b8-4793-85c1-ea8618593a5f req-d0e609e7-cbe7-4761-be4d-1301dd859c3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:17.057666 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-279d6406-c1b8-4793-85c1-ea8618593a5f req-d0e609e7-cbe7-4761-be4d-1301dd859c3f service nova] Creating event network-changed:38476fc9-edb3-4953-b3e8-896df62a80f3 for instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a on n-h1-768852-23 Jul 14 15:12:17.095823 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-279d6406-c1b8-4793-85c1-ea8618593a5f req-d0e609e7-cbe7-4761-be4d-1301dd859c3f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.223944 Jul 14 15:12:17.098083 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2603/5063] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:17.339260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:17.357137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:17.389939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:17.391128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:17.393008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:17.396420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:17.427009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:17.488727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:17.532871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:17.536407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:17.548027 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e09e73c3-7e75-4471-b13b-99ff2a2e6f48 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.678704 Jul 14 15:12:17.553782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2461/5064] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:16 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:18.346880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:18.363301 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b01f8e57-e233-4a26-8149-6d5f9065507d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.032834 Jul 14 15:12:18.366269 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2604/5065] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:17 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:18.578838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:18.584385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:18.607305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:18.607925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:18.618736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:18.619414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:18.825072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:18.845660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:18.847953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '515dbc74a0544243bba03ae2974c218c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e83a2d7967344e64aac0c62b4e1f3d94', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:18.853748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79358114-e94b-4e80-9782-3d9912a4d9a9 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 200 len: 1605 microversion: 2.32 time: 0.283513 Jul 14 15:12:18.871437 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2462/5066] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:18 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 1605 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:12:19.410201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:19.413835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:19.445455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:19.446419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:19.450013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:19.451307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:19.816226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d911b10-5f0a-4000-b8ff-e9a8f2e5fbf8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: .version_select at 0x7fdbf3273670>, body: {"keypair": {"name": "tempest-keypair-1540543716", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKBji4lV4yVrFNISlP7Cgu+NDTUDF3IPUYjoXSJNOM3Y1hMj1/3kmnNi5O5befXunCDHrx5DGwDLAj0OXzkX47ummXII7zWvVyUoxw39HMCIqWv2maSDOVcNbunSgCTV7Q=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:19.919957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3d911b10-5f0a-4000-b8ff-e9a8f2e5fbf8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:19.950306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3d911b10-5f0a-4000-b8ff-e9a8f2e5fbf8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:20.068544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d911b10-5f0a-4000-b8ff-e9a8f2e5fbf8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.259284 Jul 14 15:12:20.070431 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2463/5067] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:12:19 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:20.082150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:20.096797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:20.128092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:20.129826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:20.131880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:20.133077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:20.204257 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] HTTP exception thrown: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Request method failure captured: Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 HTTP/1.1 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DA9mtbXXa8vuAb01DrpcDx9L0GiNQ9GQ-3LXBVlvnX9PbJqIP08MZJwdUOJ2DuEZns2pK0HcicW5Ti6e4Y3DYKiNUgIAmlpFw38l_QgQO4uFtvQFIG6-Sxj8QjFMaTinMong05d8pewT0e9kN8zq0rtPLZpn-7iWJABatdATdew_lQ Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Openstack-Nova-Api-Version: 2.32 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e83a2d7967344e64aac0c62b4e1f3d94 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e83a2d7967344e64aac0c62b4e1f3d94 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TaggedBootDevicesTest-558049431-project Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 515dbc74a0544243bba03ae2974c218c Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TaggedBootDevicesTest-558049431-project Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '34d753b2-8253-43c3-b363-423d167a8739'} Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:20.211752 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:12:20.221586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Returning 404 to user: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:12:20.225831 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-580f3276-119b-4b87-9b37-2126c77cb85b tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 404 len: 111 microversion: 2.32 time: 0.146069 Jul 14 15:12:20.225831 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2464/5068] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:20 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:12:20.275106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9981c516-3da7-40a9-b498-41781f728854 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '.version_select at 0x7fdbf3273b80>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:20.349702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9981c516-3da7-40a9-b498-41781f728854 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908813069" status: 204 len: 0 microversion: 2.32 time: 0.113217 Jul 14 15:12:20.361127 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2465/5069] 10.222.0.98 () {60 vars in 1261 bytes} [Thu Jul 14 15:12:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1908813069 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 15:12:21.196635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:21.211695 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6422c332-7af5-44a7-acc4-2dec498dd3f7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.817518 Jul 14 15:12:21.217197 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2605/5070] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:19 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:22.250802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:22.265564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:22.342107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:22.352221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:22.354021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:22.355186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:23.628148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:23.644257 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-734d80f7-7fce-4c77-bd04-e29361cf5bbc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.405387 Jul 14 15:12:23.652070 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2466/5071] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:22 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:24.705930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:24.710980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:24.791618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:24.804290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:24.823944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:24.831816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:25.163247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3abad21f-9327-4814-878a-f23bf7db5b24 req-fa76d69d-7e99-4aa7-b392-2940fd743b30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7c6cd4-04f0-4c1e-9a76-713959d65d4a", "name": "network-vif-plugged", "status": "completed", "tag": "38476fc9-edb3-4953-b3e8-896df62a80f3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:25.217184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3abad21f-9327-4814-878a-f23bf7db5b24 req-fa76d69d-7e99-4aa7-b392-2940fd743b30 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:25.227835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3abad21f-9327-4814-878a-f23bf7db5b24 req-fa76d69d-7e99-4aa7-b392-2940fd743b30 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:25.289454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:25.298846 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3abad21f-9327-4814-878a-f23bf7db5b24 req-fa76d69d-7e99-4aa7-b392-2940fd743b30 service nova] Creating event network-vif-plugged:38476fc9-edb3-4953-b3e8-896df62a80f3 for instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a on n-h1-768852-23 Jul 14 15:12:25.314390 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3abad21f-9327-4814-878a-f23bf7db5b24 req-fa76d69d-7e99-4aa7-b392-2940fd743b30 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154845 Jul 14 15:12:25.315656 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2467/5072] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:12:25.878179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:25.899419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99a6a5e9-e956-4191-92e3-da126f0afe16 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.225129 Jul 14 15:12:25.914570 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2606/5073] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:24 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:26.933078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:26.943343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:26.996351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:26.997229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:27.004111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:27.013076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:27.915304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1059688476", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611"}], "security_groups": [{"name": "tempest-securitygroup--988525320"}], "key_name": "tempest-keypair-1540543716", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:28.000957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:28.048916 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fb205e9-9c3d-4c88-b09e-c4636d738f97 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1308 microversion: 2.1 time: 1.129445 Jul 14 15:12:28.095825 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2468/5074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:26 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1308 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:28.308493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] validate_networks() for [('8cdbaf5d-898a-4b0a-8d0d-c0a3362d4611', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:12:29.099057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:29.101557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:29.142138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:29.144378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:29.148591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:29.152474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:29.605820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:12:29.606893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:12:29.607500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:12:29.607994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:12:29.608521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:12:29.630152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:29.630609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:29.633564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:29.634348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:29.669751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:29.698464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Getting quotas for user ed79aa2ea715471bb970282c9e8dfd7d and project a800489ef5a24105b8f9eaee334937c1. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:29.726639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:12:29.738610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:12:29.925976 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-75292c54-589c-49e7-9a41-764869992384 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.016516 Jul 14 15:12:29.938551 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2607/5075] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:12:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 2033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:12:29.961709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-24d82571-69d4-4031-a4a9-1ced020edf34 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:29.961709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-24d82571-69d4-4031-a4a9-1ced020edf34 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:29.983774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:30.590249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-24d82571-69d4-4031-a4a9-1ced020edf34 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:30.648095 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-24d82571-69d4-4031-a4a9-1ced020edf34 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1242 microversion: 2.1 time: 0.685300 Jul 14 15:12:30.658160 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2608/5076] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:29 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1242 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:31.441141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:31.508840 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d411ca6e-17ba-4c17-a2c1-9c388dd590bc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1488 microversion: 2.1 time: 2.412734 Jul 14 15:12:31.528307 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2469/5077] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:29 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1488 bytes in 2439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:31.676034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3eaf9595-83ef-43d7-8a32-2dbec902e44a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:31.682001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3eaf9595-83ef-43d7-8a32-2dbec902e44a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:31.705406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:31.735951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-329911002", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:31.824098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:31.987925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:12:32.128141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3eaf9595-83ef-43d7-8a32-2dbec902e44a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:32.150403 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3eaf9595-83ef-43d7-8a32-2dbec902e44a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1242 microversion: 2.1 time: 0.482553 Jul 14 15:12:32.175093 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2609/5078] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:31 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1242 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:33.196088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:33.197196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:33.253699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:33.264223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:33.268294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:33.277794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:34.227022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:34.271561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b81df1f7-3cd7-4894-b5b0-bffd248a6fc4 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1302 microversion: 2.1 time: 1.081052 Jul 14 15:12:34.281020 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2610/5079] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:33 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1302 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:35.296090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:35.297426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:35.312856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.313566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.314571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.315473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.717028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:12:35.718848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:12:35.719742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:12:35.720480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:12:35.721217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:12:35.741062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.744607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.749277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:35.753996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:35.808799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:12:35.830095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:12:35.871187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:12:35.874449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:12:36.020527 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d3dee0a3-5d6b-4730-b1f2-696cff822198 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.291547 Jul 14 15:12:36.022888 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2470/5080] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:12:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 4304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:12:36.066560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9029caa8-b973-4764-9fb2-7b2cb70ce990 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:36.071803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9029caa8-b973-4764-9fb2-7b2cb70ce990 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:36.126186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:36.178758 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99e77602-d9ad-401c-aadf-3826398ea980 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1300 microversion: 2.1 time: 0.879305 Jul 14 15:12:36.186437 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2611/5081] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:35 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1300 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:36.420124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9029caa8-b973-4764-9fb2-7b2cb70ce990 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:36.459765 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9029caa8-b973-4764-9fb2-7b2cb70ce990 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1208 microversion: 2.1 time: 0.423981 Jul 14 15:12:36.474215 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2471/5082] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:36 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1208 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:37.212149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:37.215173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:37.301573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:37.308530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:37.311263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:37.316336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:37.482926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:37.484282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:37.497947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:37.499600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:37.503262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:37.505189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:37.916785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:37.938747 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77e1e703-6be4-4457-859f-e9130071e3b2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1300 microversion: 2.1 time: 0.739712 Jul 14 15:12:37.947208 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2612/5083] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:37 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1300 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:37.975301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:37.975912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:38.014179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.020385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.024655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.037242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.148455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] HTTP exception thrown: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Request method failure captured: Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 HTTP/1.1 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DA9mtbXXa8vuAb01DrpcDx9L0GiNQ9GQ-3LXBVlvnX9PbJqIP08MZJwdUOJ2DuEZns2pK0HcicW5Ti6e4Y3DYKiNUgIAmlpFw38l_QgQO4uFtvQFIG6-Sxj8QjFMaTinMong05d8pewT0e9kN8zq0rtPLZpn-7iWJABatdATdew_lQ Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.32 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e83a2d7967344e64aac0c62b4e1f3d94 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e83a2d7967344e64aac0c62b4e1f3d94 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TaggedBootDevicesTest-558049431-project Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 515dbc74a0544243bba03ae2974c218c Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TaggedBootDevicesTest-558049431-project Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '34d753b2-8253-43c3-b363-423d167a8739'} Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:12:38.166267 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Returning 404 to user: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dab7045a-d75c-4d7e-9071-477269044693 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "DELETE /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 404 len: 111 microversion: 2.32 time: 0.211027 Jul 14 15:12:38.186008 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2613/5084] 10.222.0.98 () {60 vars in 1279 bytes} [Thu Jul 14 15:12:37 2022] DELETE /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 111 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:12:38.192139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:38.201634 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bb1b1c12-4233-4a3d-bc09-7d4260913e14 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1212 microversion: 2.1 time: 0.721534 Jul 14 15:12:38.208176 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2472/5085] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:37 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1212 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:38.231816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:38.246850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] [instance: 34d753b2-8253-43c3-b363-423d167a8739] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:38.296712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.300281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.302912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:38.306513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:38.401034 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] HTTP exception thrown: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Request method failure captured: Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 HTTP/1.1 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DA9mtbXXa8vuAb01DrpcDx9L0GiNQ9GQ-3LXBVlvnX9PbJqIP08MZJwdUOJ2DuEZns2pK0HcicW5Ti6e4Y3DYKiNUgIAmlpFw38l_QgQO4uFtvQFIG6-Sxj8QjFMaTinMong05d8pewT0e9kN8zq0rtPLZpn-7iWJABatdATdew_lQ Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Openstack-Nova-Api-Version: 2.32 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e83a2d7967344e64aac0c62b4e1f3d94 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e83a2d7967344e64aac0c62b4e1f3d94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e83a2d7967344e64aac0c62b4e1f3d94 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TaggedBootDevicesTest-558049431 Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TaggedBootDevicesTest-558049431-project Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 515dbc74a0544243bba03ae2974c218c Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TaggedBootDevicesTest-558049431-project Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '34d753b2-8253-43c3-b363-423d167a8739'} Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:12:38.406877 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. Jul 14 15:12:38.415824 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:12:38.427625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] Returning 404 to user: Instance 34d753b2-8253-43c3-b363-423d167a8739 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:12:38.431483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05e6a4f6-361a-44ea-a7e1-7f1465c89088 tempest-TaggedBootDevicesTest-558049431 tempest-TaggedBootDevicesTest-558049431-project] 10.222.0.98 "GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739" status: 404 len: 111 microversion: 2.32 time: 0.232907 Jul 14 15:12:38.433817 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2614/5086] 10.222.0.98 () {60 vars in 1276 bytes} [Thu Jul 14 15:12:38 2022] GET /compute/v2.1/servers/34d753b2-8253-43c3-b363-423d167a8739 => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:12:38.960691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:38.961659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:39.010878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:39.011400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:39.022085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:39.022678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:39.230037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:39.231245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:39.308079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:39.313954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:39.315488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:39.335923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:39.651938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:39.871985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:39.908669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:39.914413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c09ade40-1156-418d-a606-0c75532f3fc5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1278 microversion: 2.1 time: 0.690799 Jul 14 15:12:39.917807 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2615/5087] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:39 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1278 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:39.930053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8921eee5-160e-412b-94a6-4abf43ae1bab tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 0.973869 Jul 14 15:12:39.932263 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2473/5088] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:38 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:40.934722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:40.935929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:40.954546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:40.955567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:40.957927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:40.958118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:40.962000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:40.962782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:40.983395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:40.984458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:40.987488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:40.988428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:41.352297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:41.355785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=85 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:41.395044 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-411f81a1-f555-4919-b728-7002473db567 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1266 microversion: 2.1 time: 0.464554 Jul 14 15:12:41.396353 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2616/5089] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:40 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1266 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:42.069497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:42.086265 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-76bcc532-ba18-41b9-80c3-74c9628872a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 1.140255 Jul 14 15:12:42.088116 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2474/5090] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:40 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:42.427548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:42.431677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:42.455711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:42.478286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:42.482379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:42.493150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:42.506107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:42.944387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:42.954867 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef09f188-3c58-480c-ab8c-c5a63c0749ff tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.541748 Jul 14 15:12:42.956973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2617/5091] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:42 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:43.105885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:43.106859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:43.151381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:43.152745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:43.156387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:43.161479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:43.952243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ad681bb2-99e8-492e-87bd-c7b23da14890 req-8a4e583e-e82d-4289-8bd6-af9a951fffb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3314905-09db-4e45-b8f1-bcccb95d2754", "tag": "00fe7f57-8929-4034-91b1-5f4d75aa5038"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:43.980143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ad681bb2-99e8-492e-87bd-c7b23da14890 req-8a4e583e-e82d-4289-8bd6-af9a951fffb0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:43.981404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ad681bb2-99e8-492e-87bd-c7b23da14890 req-8a4e583e-e82d-4289-8bd6-af9a951fffb0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:44.007535 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ad681bb2-99e8-492e-87bd-c7b23da14890 req-8a4e583e-e82d-4289-8bd6-af9a951fffb0 service nova] Creating event network-changed:00fe7f57-8929-4034-91b1-5f4d75aa5038 for instance b3314905-09db-4e45-b8f1-bcccb95d2754 on n-h2-768852-23 Jul 14 15:12:44.020501 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ad681bb2-99e8-492e-87bd-c7b23da14890 req-8a4e583e-e82d-4289-8bd6-af9a951fffb0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084431 Jul 14 15:12:44.022330 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2618/5092] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:44.035221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:44.038510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:44.051136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:44.053431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:44.056837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:44.058078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:44.447845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:44.462036 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0fad7111-fac8-4258-a63b-c9bcc5053450 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.437734 Jul 14 15:12:44.462669 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2619/5093] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:44 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:44.514586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:44.525927 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a35e470d-5b40-4e3d-8748-a2824319e0b1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 1.425214 Jul 14 15:12:44.546465 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2475/5094] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:43 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:45.494001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:45.494823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:45.516956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:45.520463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:45.523372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:45.526651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:45.548331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:45.549546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:45.571462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:45.575792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:45.578800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:45.580700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:45.785602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:45.984157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:46.008067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20841b74-fcfc-4689-9a3a-849f58343be5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.511309 Jul 14 15:12:46.011674 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2620/5095] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:45 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:46.446535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:47.041734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:47.043747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:47.057528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:47.063181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:47.064311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:47.064923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:47.507030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:47.571657 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cfaf3293-3df4-4aee-b9e3-2870085def19 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 2.028340 Jul 14 15:12:47.582674 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2476/5096] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:45 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 2043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:47.629476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:47.640765 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8eb982ec-5acc-48e4-a89c-40efc446767e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.603016 Jul 14 15:12:47.641592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2621/5097] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:47 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:48.598182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:48.598802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:48.617099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:48.617565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:48.633838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:48.635689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:48.676512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:48.677750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:48.701933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:48.723512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:48.724545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:48.724997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:49.364680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:49.403306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-71895a02-c68a-4d47-bb88-46364e60d335 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.733490 Jul 14 15:12:49.407073 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2622/5098] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:48 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:49.418055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c66a543b-d7a9-4a42-ad9b-8d2a0a8aedb6 req-e701ef83-6d7e-48e8-b2b9-11e52190173b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cdbb228-73cf-4123-918c-0c216725162d", "tag": "ce44f7a5-072b-4b29-a7a4-af2dbe3c7ce2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:49.449881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c66a543b-d7a9-4a42-ad9b-8d2a0a8aedb6 req-e701ef83-6d7e-48e8-b2b9-11e52190173b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:49.450692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c66a543b-d7a9-4a42-ad9b-8d2a0a8aedb6 req-e701ef83-6d7e-48e8-b2b9-11e52190173b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:49.474085 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c66a543b-d7a9-4a42-ad9b-8d2a0a8aedb6 req-e701ef83-6d7e-48e8-b2b9-11e52190173b service nova] Creating event network-changed:ce44f7a5-072b-4b29-a7a4-af2dbe3c7ce2 for instance 6cdbb228-73cf-4123-918c-0c216725162d on n-h1-768852-23 Jul 14 15:12:49.488792 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c66a543b-d7a9-4a42-ad9b-8d2a0a8aedb6 req-e701ef83-6d7e-48e8-b2b9-11e52190173b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078586 Jul 14 15:12:49.491679 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2623/5099] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:50.202748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:50.213477 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b84cf7e0-5f4d-48cb-85c7-ad10b124daed tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 1.619088 Jul 14 15:12:50.225028 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2477/5100] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:48 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:50.433995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:50.434719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:50.479236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:50.484027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:50.486883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:50.489689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:51.208411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:51.224787 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0821863c-acb6-4b49-95ea-b4534c307310 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.795658 Jul 14 15:12:51.230591 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2624/5101] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:50 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:51.249355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:51.252941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:51.319729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:51.320335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:51.321168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:51.328490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:51.878674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:51.892262 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae0d3d65-9439-4354-91ee-974a12023c71 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 0.654050 Jul 14 15:12:51.896186 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2478/5102] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:51 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:52.270283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:52.271872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:52.282772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.283712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:52.284996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.285705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:52.565430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7707f4a7-6d93-42ad-ba84-f936c73f84b8 req-73660220-1112-4b5e-9599-3cfe45615d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3314905-09db-4e45-b8f1-bcccb95d2754", "name": "network-vif-plugged", "status": "completed", "tag": "00fe7f57-8929-4034-91b1-5f4d75aa5038"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:52.590558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7707f4a7-6d93-42ad-ba84-f936c73f84b8 req-73660220-1112-4b5e-9599-3cfe45615d25 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.593756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7707f4a7-6d93-42ad-ba84-f936c73f84b8 req-73660220-1112-4b5e-9599-3cfe45615d25 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:52.668142 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7707f4a7-6d93-42ad-ba84-f936c73f84b8 req-73660220-1112-4b5e-9599-3cfe45615d25 service nova] Creating event network-vif-plugged:00fe7f57-8929-4034-91b1-5f4d75aa5038 for instance b3314905-09db-4e45-b8f1-bcccb95d2754 on n-h2-768852-23 Jul 14 15:12:52.691328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7707f4a7-6d93-42ad-ba84-f936c73f84b8 req-73660220-1112-4b5e-9599-3cfe45615d25 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131955 Jul 14 15:12:52.692355 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2479/5103] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:12:52.773248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:52.785489 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7537782-8e73-4766-a7b9-512fe8c8aeb3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.542442 Jul 14 15:12:52.798631 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2625/5104] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:52 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:52.921285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:52.922104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:52.934767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.935263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:52.936202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:52.936656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:53.726072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:53.753328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b0542414-d9c7-4f10-9722-73fa9b0bf619 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 0.836296 Jul 14 15:12:53.766626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2480/5105] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:52 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:12:53.832348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:53.835116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:53.864408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:53.866972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:53.871014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:53.874961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:54.269717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:54.282806 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5fd62c41-c5d3-4346-98e2-ab92ff913315 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.473470 Jul 14 15:12:54.283521 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2626/5106] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:53 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:54.772867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:54.774046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:54.784690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:54.788031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:54.792976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:54.793648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:55.304232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:55.306190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:55.320019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:55.338941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:55.339436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:55.340260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:55.340706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:55.349013 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d99fb008-1528-4539-8a7f-39ab397490a2 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1367 microversion: 2.1 time: 0.580066 Jul 14 15:12:55.362415 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2481/5107] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:54 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1367 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:55.742496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:55.768743 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c58eb5aa-49dd-49a8-bf27-483ae2d80961 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.470508 Jul 14 15:12:55.770514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2627/5108] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:55 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:56.398864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:56.402614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:56.449494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:56.450376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:56.466737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:56.468030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:56.790114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:56.791569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:56.815326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:56.816456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:56.817542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:56.818254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:56.944288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:56.978155 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b1d4d35-4dab-4961-9a76-831af6b864da tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1557 microversion: 2.1 time: 0.589166 Jul 14 15:12:57.008315 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2482/5109] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:56 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1557 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:57.062115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:57.063240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:57.094242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:57.098733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:57.108842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:57.111081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:57.186575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=78 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:12:57.239227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:57.262012 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dff6739a-a4fa-4832-b436-199ecf771e58 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 0.472733 Jul 14 15:12:57.273658 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2628/5110] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:56 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:12:57.294793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-37a3176d-bfdb-4701-a459-602845117dea req-5376043b-53fe-4e9c-a66a-92f47847c29b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cdbb228-73cf-4123-918c-0c216725162d", "name": "network-vif-plugged", "status": "completed", "tag": "ce44f7a5-072b-4b29-a7a4-af2dbe3c7ce2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:12:57.308707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-37a3176d-bfdb-4701-a459-602845117dea req-5376043b-53fe-4e9c-a66a-92f47847c29b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:57.312335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-37a3176d-bfdb-4701-a459-602845117dea req-5376043b-53fe-4e9c-a66a-92f47847c29b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:57.345994 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-37a3176d-bfdb-4701-a459-602845117dea req-5376043b-53fe-4e9c-a66a-92f47847c29b service nova] Creating event network-vif-plugged:ce44f7a5-072b-4b29-a7a4-af2dbe3c7ce2 for instance 6cdbb228-73cf-4123-918c-0c216725162d on n-h1-768852-23 Jul 14 15:12:57.361234 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-37a3176d-bfdb-4701-a459-602845117dea req-5376043b-53fe-4e9c-a66a-92f47847c29b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084582 Jul 14 15:12:57.373788 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2629/5111] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:12:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:57.508052 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-720d0edc-11d2-401a-9350-740c604bc0df tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.497077 Jul 14 15:12:57.515978 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2483/5112] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:12:57 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-interface => generated 285 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:12:58.299414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:12:58.300133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:12:58.318403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:58.324063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:58.327377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:12:58.337243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:12:59.599349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:12:59.613527 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1566bb8-c57b-4dc0-a485-e4e08c319d50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1308 microversion: 2.1 time: 1.320159 Jul 14 15:12:59.628739 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2630/5113] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:12:58 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1308 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:00.636731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:00.637519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:00.653332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:00.659545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:00.664106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:00.665191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:01.038784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:01.051424 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8edfac6-a10f-4c5b-8850-18b822677904 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1488 microversion: 2.1 time: 0.420243 Jul 14 15:13:01.052288 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2484/5114] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:00 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1488 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:01.073164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:01.073967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:01.090554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:01.091007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:01.096229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:01.096852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:01.656277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:01.661819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7042317d-5736-490c-8ba9-963259b9b595 req-5003593d-75ad-40b4-b908-a423375560bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3314905-09db-4e45-b8f1-bcccb95d2754", "tag": "00fe7f57-8929-4034-91b1-5f4d75aa5038"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:01.679150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed5fd402-273b-47b0-b98b-6b59ba245837 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1488 microversion: 2.1 time: 0.610387 Jul 14 15:13:01.688963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7042317d-5736-490c-8ba9-963259b9b595 req-5003593d-75ad-40b4-b908-a423375560bf service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:01.689591 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2631/5115] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:01 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1488 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:01.692326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7042317d-5736-490c-8ba9-963259b9b595 req-5003593d-75ad-40b4-b908-a423375560bf service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:01.712541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:01.714661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:01.733305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:01.747639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:01.749103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:01.753070 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7042317d-5736-490c-8ba9-963259b9b595 req-5003593d-75ad-40b4-b908-a423375560bf service nova] Creating event network-changed:00fe7f57-8929-4034-91b1-5f4d75aa5038 for instance b3314905-09db-4e45-b8f1-bcccb95d2754 on n-h2-768852-23 Jul 14 15:13:01.754442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:01.774336 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7042317d-5736-490c-8ba9-963259b9b595 req-5003593d-75ad-40b4-b908-a423375560bf service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116219 Jul 14 15:13:01.786010 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2485/5116] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:02.295614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:02.315436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29900b1f-3c50-4b6b-94d1-6302b66bdc28 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1488 microversion: 2.1 time: 0.607183 Jul 14 15:13:02.316869 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2632/5117] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:01 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1488 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:02.338324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:02.339023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:02.349717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:02.351672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:02.352246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:02.353060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:02.353505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:02.499344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:13:02.782640 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ee39798-a5b0-4149-8dfa-47fafbe12c81 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 204 len: 0 microversion: 2.1 time: 0.448462 Jul 14 15:13:02.784111 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2486/5118] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:13:02 2022] DELETE /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:13:02.792481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:02.793490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:02.809914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=50 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:02.812088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:02.815976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:02.817193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:02.824073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:03.625560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:03.654656 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3bf1e56-dbf6-475a-bfa1-ca1c1f37400b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1494 microversion: 2.1 time: 0.861574 Jul 14 15:13:03.662457 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2633/5119] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:02 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1494 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:04.674925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:04.675730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:04.708776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:04.715739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:04.716882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:04.717370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:06.036044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:06.048677 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5fb9b90-e5c1-493b-b7f1-a907d9ba2af8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1494 microversion: 2.1 time: 1.378297 Jul 14 15:13:06.049558 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2487/5120] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:04 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1494 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:06.789214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6a590f59-f648-4a50-a036-ec912f942f44 req-6e6b84ef-e8a3-461d-91ae-f8f8e894f9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cdbb228-73cf-4123-918c-0c216725162d", "name": "network-vif-deleted", "tag": "ce44f7a5-072b-4b29-a7a4-af2dbe3c7ce2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:06.831249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6a590f59-f648-4a50-a036-ec912f942f44 req-6e6b84ef-e8a3-461d-91ae-f8f8e894f9d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:06.831819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6a590f59-f648-4a50-a036-ec912f942f44 req-6e6b84ef-e8a3-461d-91ae-f8f8e894f9d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:06.955037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6a590f59-f648-4a50-a036-ec912f942f44 req-6e6b84ef-e8a3-461d-91ae-f8f8e894f9d8 service nova] Creating event network-vif-deleted:ce44f7a5-072b-4b29-a7a4-af2dbe3c7ce2 for instance 6cdbb228-73cf-4123-918c-0c216725162d on n-h1-768852-23 Jul 14 15:13:06.979861 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6a590f59-f648-4a50-a036-ec912f942f44 req-6e6b84ef-e8a3-461d-91ae-f8f8e894f9d8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.204849 Jul 14 15:13:06.997609 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2634/5121] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:07.068652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:07.069284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:07.093509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:07.095463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:07.098103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:07.099045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:07.211027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:07.211862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:07.213464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lazy-loading 'fault' on Instance uuid 6cdbb228-73cf-4123-918c-0c216725162d {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:13:07.401568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:07.427374 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ca7d32f-fe0a-4177-8a5a-16dbae4ffb48 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 200 len: 1298 microversion: 2.1 time: 0.362988 Jul 14 15:13:07.428053 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2488/5122] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:07 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 1298 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:08.472142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:08.479182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:08.546161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:08.547043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:08.548501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:08.549282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:08.617965 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d HTTP/1.1 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6cdbb228-73cf-4123-918c-0c216725162d'} Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:08.626463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:08.630656 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:08.630656 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:08.630656 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:13:08.630656 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:13:08.630656 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:13:08.630656 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:08.639384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:13:08.640217 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f27708f-2146-4fe7-a137-3fb3a5350048 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 404 len: 111 microversion: 2.1 time: 0.181168 Jul 14 15:13:08.645001 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2635/5123] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:08 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 111 bytes in 187 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:13:08.649726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:08.650909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:08.678201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:08.679107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:08.680360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:08.681034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:08.768229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:13:09.120949 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3421fe18-bb95-4a91-a210-c4687568a375 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 204 len: 0 microversion: 2.1 time: 0.474161 Jul 14 15:13:09.124892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2489/5124] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:13:08 2022] DELETE /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:13:09.133237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:09.133884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:09.154805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:09.155338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:09.156300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:09.156757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:09.743261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:09.749144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:09.771121 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77572eca-c1ff-4c49-a631-fc07c321ef34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1494 microversion: 2.1 time: 0.641285 Jul 14 15:13:09.772046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2636/5125] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:09 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1494 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:10.804685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:10.805276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:10.829482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:10.836034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:10.837200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:10.845440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:11.501831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:11.524729 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a6c97fc-14f3-4205-8abe-fb597274abc6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1494 microversion: 2.1 time: 0.725772 Jul 14 15:13:11.536443 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2490/5126] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:10 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1494 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:12.551190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:12.554367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:12.621290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:12.622065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:12.628159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:12.628982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:13.001292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:13.043215 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-981ca7fc-5e83-40b4-9702-981b76d20428 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 200 len: 1293 microversion: 2.1 time: 0.499354 Jul 14 15:13:13.052725 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2491/5127] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:12 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 1293 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:13.086922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6ccaa730-4aa5-4aac-bd28-2847066a4875 req-c9689fb7-ba2a-4937-82a3-538799de00ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7c6cd4-04f0-4c1e-9a76-713959d65d4a", "name": "network-vif-deleted", "tag": "38476fc9-edb3-4953-b3e8-896df62a80f3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:13.139837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6ccaa730-4aa5-4aac-bd28-2847066a4875 req-c9689fb7-ba2a-4937-82a3-538799de00ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:13.144508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6ccaa730-4aa5-4aac-bd28-2847066a4875 req-c9689fb7-ba2a-4937-82a3-538799de00ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:13.287517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-60935155", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f36db56c-2ce0-465d-b4d5-0a76fafd765e"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:13.304562 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6ccaa730-4aa5-4aac-bd28-2847066a4875 req-c9689fb7-ba2a-4937-82a3-538799de00ee service nova] Creating event network-vif-deleted:38476fc9-edb3-4953-b3e8-896df62a80f3 for instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a on n-h1-768852-23 Jul 14 15:13:13.351799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6ccaa730-4aa5-4aac-bd28-2847066a4875 req-c9689fb7-ba2a-4937-82a3-538799de00ee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.296372 Jul 14 15:13:13.360228 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2492/5128] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:13.583603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] validate_networks() for [('f36db56c-2ce0-465d-b4d5-0a76fafd765e', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:13:14.070572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:14.078060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:14.105138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:14.105943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:14.107947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:14.108761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:14.168337 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a HTTP/1.1 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'aa7c6cd4-04f0-4c1e-9a76-713959d65d4a'} Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:14.172620 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:14.180857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:14.180857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:14.180857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:13:14.180857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:13:14.180857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:13:14.180857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:14.186959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:13:14.189167 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2ec6353e-075b-4f4c-992a-e8bef7042ccc tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 404 len: 111 microversion: 2.1 time: 0.128268 Jul 14 15:13:14.191231 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2493/5129] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:14 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:13:14.481037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-536550663", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:14.631017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:13:14.634314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:13:14.634844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:13:14.635353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:13:14.636428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:13:14.682033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:13:14.693071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:14.695041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:14.714163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:14.714976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:14.772854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Getting quotas for project cc957622784843ba912f59ce75aee2a7. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:13:14.784975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Getting quotas for user ef0565f08c444052b98b007d344ea2ba and project cc957622784843ba912f59ce75aee2a7. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:13:14.802202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:13:14.805178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:13:14.901756 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b69afdcc-5b19-4757-9d35-57c0ea6cb6e6 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.393580 Jul 14 15:13:14.903010 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2637/5130] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 2396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:13:14.913933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4177c86-481f-42e0-a0c9-4a7cc0775e1f tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:14.917685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4177c86-481f-42e0-a0c9-4a7cc0775e1f tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:15.087718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4177c86-481f-42e0-a0c9-4a7cc0775e1f tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:15.095593 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4177c86-481f-42e0-a0c9-4a7cc0775e1f tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1212 microversion: 2.1 time: 0.185803 Jul 14 15:13:15.096215 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2638/5131] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:14 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1212 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:16.113407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:16.114388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:16.133030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:16.133587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:16.134452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:16.136830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:16.289755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:16.300710 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53e00db1-f8a6-47e4-91ae-d634ebca29e5 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1216 microversion: 2.1 time: 0.191258 Jul 14 15:13:16.301541 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2639/5132] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:16 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1216 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:17.332297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:17.332930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:17.349842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:17.350592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:17.351472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:17.352056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:17.452073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:13:17.452573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:13:17.452994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:13:17.453422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:13:17.453845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:13:17.478334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:17.478795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:17.479668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:17.480118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:17.504784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:17.513978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a4d6060-16e8-4223-bad9-151245acb679 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1270 microversion: 2.1 time: 0.184986 Jul 14 15:13:17.514612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2640/5133] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:17 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1270 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:17.540549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:13:17.559069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:13:17.632708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:13:17.648273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:13:17.845534 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e45862b-133d-4c9b-b563-d5976b907041 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.371242 Jul 14 15:13:17.891939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-da810b77-d57a-4a90-b99d-529212ae92df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:17.893424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-da810b77-d57a-4a90-b99d-529212ae92df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:17.899635 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2494/5134] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:13:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 3425 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:13:18.115378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da810b77-d57a-4a90-b99d-529212ae92df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:18.133454 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-da810b77-d57a-4a90-b99d-529212ae92df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1208 microversion: 2.1 time: 0.272473 Jul 14 15:13:18.134911 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2641/5135] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:17 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1208 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:18.533696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:18.534520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:18.550172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:18.552649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:18.554406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:18.555373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:18.789671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:18.802476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0daa4643-4e78-430e-af40-fb1472e2c0d8 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1270 microversion: 2.1 time: 0.275033 Jul 14 15:13:18.806222 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2495/5136] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:18 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1270 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:19.168507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:19.171211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:19.201668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:19.203441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:19.212481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:19.213958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:19.437077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:19.458070 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-111c3e96-2355-4b0e-8c84-3d8fdfd5dd13 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1212 microversion: 2.1 time: 0.295781 Jul 14 15:13:19.458860 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2642/5137] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:19 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1212 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:19.834227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:19.834807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:19.850413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:19.851766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:19.855903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:19.856368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:20.475531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:20.476256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:20.517208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:20.519679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:20.523879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:20.527613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:20.712319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:20.729319 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d80c29ce-9ac8-463a-ac47-d670d633ea56 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1268 microversion: 2.1 time: 0.257407 Jul 14 15:13:20.730965 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2643/5138] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:20 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:21.049966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:21.115564 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50823fe8-561c-4a04-8a86-f68ec01b7e59 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 1.285267 Jul 14 15:13:21.119191 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2496/5139] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:19 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:21.748700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:21.749808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:21.768431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:21.769156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:21.780741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:21.781433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:21.919353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:21.928314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-13a18450-2b4e-4b43-9190-9680a8007e30 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1266 microversion: 2.1 time: 0.184091 Jul 14 15:13:21.933363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2644/5140] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:21 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:22.137727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:22.138795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:22.174333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:22.180597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:22.182557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:22.183589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:22.960882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:22.968959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:22.986279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:22.986975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:22.988018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:22.996566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:23.033121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:23.041846 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-733bcde4-8d42-406b-a8b3-875ee26e93e0 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 0.909048 Jul 14 15:13:23.052099 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2497/5141] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:22 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:23.145765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:23.157500 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f6f5b0d3-e40c-45b1-884e-30f65afeb60f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1266 microversion: 2.1 time: 0.200411 Jul 14 15:13:23.158622 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2645/5142] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:22 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:23.804446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-07d1ae9a-134b-43f7-b09e-d1ed0d226b6a req-b71c2afa-d106-40ae-bb65-842b5ec01e61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2b3c883-a958-4ec9-bdc2-a7a3ff850448", "tag": "b754032e-d2e8-44f5-9e36-e1dd81e454f5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:23.827037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-07d1ae9a-134b-43f7-b09e-d1ed0d226b6a req-b71c2afa-d106-40ae-bb65-842b5ec01e61 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:23.828537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-07d1ae9a-134b-43f7-b09e-d1ed0d226b6a req-b71c2afa-d106-40ae-bb65-842b5ec01e61 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:23.861418 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-07d1ae9a-134b-43f7-b09e-d1ed0d226b6a req-b71c2afa-d106-40ae-bb65-842b5ec01e61 service nova] Creating event network-changed:b754032e-d2e8-44f5-9e36-e1dd81e454f5 for instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 on n-h1-768852-23 Jul 14 15:13:23.878407 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-07d1ae9a-134b-43f7-b09e-d1ed0d226b6a req-b71c2afa-d106-40ae-bb65-842b5ec01e61 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079970 Jul 14 15:13:23.881867 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2498/5143] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:24.076664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:24.077282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:24.097891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:24.102044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:24.103656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:24.110536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:24.178402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:24.179176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:24.196081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:24.197315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:24.198449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:24.199911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:24.382193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:24.394767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:24.404588 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-237e5b41-e4c7-4b67-8be3-715122f42bc7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1266 microversion: 2.1 time: 0.229588 Jul 14 15:13:24.416665 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2499/5144] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:24 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:24.471310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:24.481311 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c78ddc9-cb71-41ee-9a36-26e85917969b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 0.408193 Jul 14 15:13:24.482660 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2646/5145] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:24 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:25.424736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:25.426410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:25.441117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:25.442199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:25.444765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:25.446595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:25.500341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:25.501548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:25.512510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:25.516312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:25.523999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:25.525069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:25.527615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:25.890144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:25.902414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-41d28489-2bc2-4e58-b387-42bf4c35e97e tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 0.405783 Jul 14 15:13:25.911709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2647/5146] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:25 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:26.588807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:26.618724 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca8ea550-9a83-4f2a-b16c-6726745d1a34 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 1.200305 Jul 14 15:13:26.625122 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2500/5147] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:25 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:26.924608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:26.925930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:26.941202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:26.941975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:26.944425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:26.945051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:27.315398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:27.323989 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9600468c-ea8c-4c2b-a3ea-be56c5008edd tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 0.404571 Jul 14 15:13:27.324616 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2648/5148] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:26 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:27.642885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:27.645113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:27.648313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:27.656405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:27.685528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:27.693561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:27.694643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:27.696999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:28.348178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:28.349054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:28.373601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:28.388504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:28.388997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:28.389800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:28.390235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:28.896965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:28.914693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7bcd1d8e-02f7-4f61-9b11-22f45e0c715f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 1.276236 Jul 14 15:13:28.956281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2501/5149] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:27 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:29.790096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:29.839414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74ec5fc1-54e0-4afd-90bf-44082734931b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 1.495343 Jul 14 15:13:29.846067 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2649/5150] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:28 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:29.979140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:29.980039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:30.006047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.006508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:30.007337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.007790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:30.418504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-54d495d2-cb87-4ea4-9e4c-27d60cf5f68b req-617c1b2d-76a3-46f9-af40-0be886dae92d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9835a80d-616a-4f7e-8b97-71a7c0bd7a71", "tag": "0b8ffd4d-e336-47c5-8a5d-fad9485e6453"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:30.497231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-54d495d2-cb87-4ea4-9e4c-27d60cf5f68b req-617c1b2d-76a3-46f9-af40-0be886dae92d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.498070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-54d495d2-cb87-4ea4-9e4c-27d60cf5f68b req-617c1b2d-76a3-46f9-af40-0be886dae92d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:30.552099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-54d495d2-cb87-4ea4-9e4c-27d60cf5f68b req-617c1b2d-76a3-46f9-af40-0be886dae92d service nova] Creating event network-changed:0b8ffd4d-e336-47c5-8a5d-fad9485e6453 for instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 on n-h2-768852-23 Jul 14 15:13:30.578117 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-54d495d2-cb87-4ea4-9e4c-27d60cf5f68b req-617c1b2d-76a3-46f9-af40-0be886dae92d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180076 Jul 14 15:13:30.583342 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2650/5151] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:30.876003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:30.877763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:30.914047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.914718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:30.921851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:30.922658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:31.715213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:31.771508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1715c15e-adcc-4384-a508-e8aeb552004f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 1.776237 Jul 14 15:13:31.773002 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2502/5152] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:29 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:32.660048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:32.762308 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb960afe-b8eb-4544-afaa-5f4034855b91 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 1.872338 Jul 14 15:13:32.772441 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2651/5153] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:30 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 1903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:32.842458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:32.845375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:32.851058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:32.906792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:32.908303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:32.919821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:32.923537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.329965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:33.330483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:33.333986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:33.375573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:33.380493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.393139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:33.405393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.584059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21d45640-300a-48f6-bf95-c8155e44babb tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/ips" status: 200 len: 149 microversion: 2.1 time: 0.258796 Jul 14 15:13:33.587665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2652/5154] 10.222.0.98 () {58 vars in 1247 bytes} [Thu Jul 14 15:13:33 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/ips => generated 149 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:33.784407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:33.785415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:33.801360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:33.801803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.802785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:33.803427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:33.831099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:33.876269 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f28fce3e-ae21-4065-94f1-50c525b2ce07 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 1.034639 Jul 14 15:13:33.881992 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2503/5155] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:32 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:34.408047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0c090e52-f7e2-4278-aa97-343e71e12b7c req-50a4a190-6aa4-4c45-922d-cf3503ecf54a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b3c883-a958-4ec9-bdc2-a7a3ff850448", "name": "network-vif-plugged", "status": "completed", "tag": "b754032e-d2e8-44f5-9e36-e1dd81e454f5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:34.474197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:34.487106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0c090e52-f7e2-4278-aa97-343e71e12b7c req-50a4a190-6aa4-4c45-922d-cf3503ecf54a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:34.487596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0c090e52-f7e2-4278-aa97-343e71e12b7c req-50a4a190-6aa4-4c45-922d-cf3503ecf54a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:34.507327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f211db63-7a73-42c7-bbab-5bd38fa0cf79 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 0.727186 Jul 14 15:13:34.518991 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2653/5156] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:33 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:34.588509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0c090e52-f7e2-4278-aa97-343e71e12b7c req-50a4a190-6aa4-4c45-922d-cf3503ecf54a service nova] Creating event network-vif-plugged:b754032e-d2e8-44f5-9e36-e1dd81e454f5 for instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 on n-h1-768852-23 Jul 14 15:13:34.630027 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0c090e52-f7e2-4278-aa97-343e71e12b7c req-50a4a190-6aa4-4c45-922d-cf3503ecf54a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.229855 Jul 14 15:13:34.633839 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2504/5157] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:13:34.900704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:34.902352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:34.939421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:34.948919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:34.956583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:34.960907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:35.537329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:35.538043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:35.561014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:35.567424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:35.569160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:35.579745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:35.615518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:35.645341 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6e88ce6-6a9c-400c-bb89-27f53ced9666 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 0.749575 Jul 14 15:13:35.683675 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2654/5158] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:34 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:36.396443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:36.428199 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e340c19b-88ff-4c37-9696-3f8bd0f1f82d tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1312 microversion: 2.1 time: 0.887062 Jul 14 15:13:36.429743 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2505/5159] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:35 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1312 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:36.680859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:36.686766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:36.728863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:36.737392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:36.739031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:36.744801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:37.338494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:37.346629 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e2de701-aa19-4d9d-8919-309680b96728 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 0.674615 Jul 14 15:13:37.362373 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2655/5160] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:36 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:37.450989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:37.453161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:37.486836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:37.493160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:37.494899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:37.496207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:38.103758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:38.123311 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ac7b70a-3793-4768-a558-0a4efaf421a9 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1496 microversion: 2.1 time: 0.674870 Jul 14 15:13:38.133125 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2506/5161] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:37 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1496 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:38.369030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:38.370543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:38.382341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:38.385595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:38.388880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:38.391949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:38.809547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8842cdf7-e696-45bb-ae86-1ca208fc0cb2 req-c3eba369-f827-4d96-b980-b8b7cc5837ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9835a80d-616a-4f7e-8b97-71a7c0bd7a71", "name": "network-vif-plugged", "status": "completed", "tag": "0b8ffd4d-e336-47c5-8a5d-fad9485e6453"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:38.864384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8842cdf7-e696-45bb-ae86-1ca208fc0cb2 req-c3eba369-f827-4d96-b980-b8b7cc5837ce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:38.870395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8842cdf7-e696-45bb-ae86-1ca208fc0cb2 req-c3eba369-f827-4d96-b980-b8b7cc5837ce service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:38.911536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8842cdf7-e696-45bb-ae86-1ca208fc0cb2 req-c3eba369-f827-4d96-b980-b8b7cc5837ce service nova] Creating event network-vif-plugged:0b8ffd4d-e336-47c5-8a5d-fad9485e6453 for instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 on n-h2-768852-23 Jul 14 15:13:38.928443 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8842cdf7-e696-45bb-ae86-1ca208fc0cb2 req-c3eba369-f827-4d96-b980-b8b7cc5837ce service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123571 Jul 14 15:13:38.937745 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2507/5162] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:13:39.010861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:39.058516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-879f5d06-919e-4470-939b-37f157dfd7e6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 0.692830 Jul 14 15:13:39.081012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc749dff-595e-49ee-8e5f-dd44a15d2837"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:39.131986 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2656/5163] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:38 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:39.143356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:39.164394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:39.165402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:39.166506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:39.169847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:40.137009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:40.138976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:40.156967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:40.159990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:40.166159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:40.167228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:40.182986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:40.451496 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ef5a225-33b9-46cf-9f96-2227d7fb755f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "POST /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.380757 Jul 14 15:13:40.454270 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2508/5164] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:13:39 2022] POST /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 194 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:40.975753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:40.991224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac720f24-f2ae-4e67-a28d-113f2e7b24ad tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1308 microversion: 2.1 time: 0.861411 Jul 14 15:13:40.998968 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2657/5165] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:40 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1308 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:42.025816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:42.027942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:42.071510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.072510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.078116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.078892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.408302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:42.433592 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-304fc421-a259-4a15-baeb-cb93832adc4c tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1488 microversion: 2.1 time: 0.413321 Jul 14 15:13:42.439325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2509/5166] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:42 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1488 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:42.463458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:42.464761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:42.477902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.478367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.484373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.484838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.634386 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9895a052-65b1-4329-a112-dae2f5e07c50 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "PUT /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1083 microversion: 2.1 time: 0.174872 Jul 14 15:13:42.640632 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2658/5167] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 15:13:42 2022] PUT /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1083 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:42.658992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:42.660069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:42.675009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.675642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.683073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.684175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.880775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:42.894511 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-878efe58-effd-44a2-8bd8-a1a4bdfd6aa7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1509 microversion: 2.1 time: 0.239063 Jul 14 15:13:42.896242 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2510/5168] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:42 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:42.914105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:42.914891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:42.926597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.927514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:42.930319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:42.933535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:43.364325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:43.400168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6cbe38a2-8825-4bac-8220-3119c8ba1625 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1509 microversion: 2.1 time: 0.490689 Jul 14 15:13:43.411514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2659/5169] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:42 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1509 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:43.456717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:43.475762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:43.510299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:43.513663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:43.520253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:43.524510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:43.644035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:13:43.922094 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-054d8bbf-5380-4b44-a1bc-06ac9771cb37 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 204 len: 0 microversion: 2.1 time: 0.496053 Jul 14 15:13:43.927772 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2511/5170] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:13:43 2022] DELETE /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:13:43.941782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:43.943256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:43.957163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:43.962134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:43.963657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:43.964452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:44.933054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:44.952112 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-841469a4-d325-4b3e-a544-0956032b6e47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1515 microversion: 2.1 time: 1.017048 Jul 14 15:13:44.965839 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2660/5171] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:43 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1515 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:45.973351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:45.976619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:46.009943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:46.013297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:46.015668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:46.032426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:46.847665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:46.885924 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98280369-f039-49f1-ae29-6790eca74ce1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1515 microversion: 2.1 time: 0.910975 Jul 14 15:13:46.914243 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2512/5172] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:45 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1515 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:47.570740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e8fa5550-4059-441f-a7e8-99c304e00a9e req-8d705e8e-cf15-4f52-8ab9-89839261b183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9835a80d-616a-4f7e-8b97-71a7c0bd7a71", "name": "network-vif-deleted", "tag": "0b8ffd4d-e336-47c5-8a5d-fad9485e6453"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:47.680425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e8fa5550-4059-441f-a7e8-99c304e00a9e req-8d705e8e-cf15-4f52-8ab9-89839261b183 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:47.681210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e8fa5550-4059-441f-a7e8-99c304e00a9e req-8d705e8e-cf15-4f52-8ab9-89839261b183 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:47.752785 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e8fa5550-4059-441f-a7e8-99c304e00a9e req-8d705e8e-cf15-4f52-8ab9-89839261b183 service nova] Creating event network-vif-deleted:0b8ffd4d-e336-47c5-8a5d-fad9485e6453 for instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 on n-h2-768852-23 Jul 14 15:13:47.767938 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e8fa5550-4059-441f-a7e8-99c304e00a9e req-8d705e8e-cf15-4f52-8ab9-89839261b183 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.215607 Jul 14 15:13:47.773405 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2661/5173] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:47.935367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:47.944714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:48.001321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.001801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.002651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.018945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.110660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.111119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.111609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lazy-loading 'fault' on Instance uuid 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:13:48.170197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:48.180944 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ee761f91-65e0-4024-955e-a68eeebe5185 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 200 len: 1319 microversion: 2.1 time: 0.262925 Jul 14 15:13:48.182383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2513/5174] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:47 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:48.259387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:48.260118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:48.278872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.279634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.280639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.281256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.349501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:13:48.567183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a96e420e-a41a-437b-bd74-3ecc4532f90c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 204 len: 0 microversion: 2.1 time: 0.313326 Jul 14 15:13:48.568214 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2662/5175] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:13:48 2022] DELETE /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:13:48.579054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:48.579761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:48.592302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.592763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.598746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:48.599445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:48.673099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:13:49.162119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:49.176739 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eed0499a-c6ec-488f-8939-5728adcc3a41 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1502 microversion: 2.1 time: 0.597371 Jul 14 15:13:49.179872 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2514/5176] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:48 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1502 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:49.210271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:49.210995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:49.230091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:49.235877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:49.238101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:49.242702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:49.291530 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 HTTP/1.1 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9835a80d-616a-4f7e-8b97-71a7c0bd7a71'} Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:49.299108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:49.303749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:49.303749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:49.303749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:13:49.303749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:13:49.303749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:13:49.303749 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:13:49.305167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:13:49.309996 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a284af8-99fd-4f01-b518-964dd0cfb1d6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 404 len: 111 microversion: 2.1 time: 0.102639 Jul 14 15:13:49.312835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2663/5177] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:49 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:13:49.872949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1030333495", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "25dc3567-7ede-45ee-8de7-e3c7b89b65fd"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:50.174981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] validate_networks() for [('25dc3567-7ede-45ee-8de7-e3c7b89b65fd', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:13:50.212426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:50.215797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:50.256467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:50.257409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:50.267660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:50.268439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:52.818073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:52.847590 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2bd46ba8-9422-422a-97ee-92fc4406ac8a tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1502 microversion: 2.1 time: 2.642369 Jul 14 15:13:52.867349 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2664/5178] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:50 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1502 bytes in 2663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:53.283850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:13:53.284757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:13:53.285785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:13:53.286702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:13:53.287630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:13:53.330569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:53.342867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:53.345809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:53.355754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:53.478347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:13:53.498918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Getting quotas for user 0110507279914488aca33cec9a2fc9f0 and project 2e413ee06c0848c3bbdad2e46c394e69. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:13:53.592022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:13:53.598083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:13:53.835151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-98bf85fb-80c6-4fdb-adce-5efa40a4b6e0 req-11a801bf-b9b4-4734-9f89-f7ff0052d0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b3c883-a958-4ec9-bdc2-a7a3ff850448", "name": "network-vif-unplugged", "status": "completed", "tag": "b754032e-d2e8-44f5-9e36-e1dd81e454f5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:53.839745 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-49a9f9b6-00b3-4bc9-97fb-8efb3222edf7 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.974053 Jul 14 15:13:53.842053 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2515/5179] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:13:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 3982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:13:53.861226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ddbfe3d7-33e8-4030-92d8-21244251c99d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:53.864100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ddbfe3d7-33e8-4030-92d8-21244251c99d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:53.924222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-98bf85fb-80c6-4fdb-adce-5efa40a4b6e0 req-11a801bf-b9b4-4734-9f89-f7ff0052d0a4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:53.930117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-98bf85fb-80c6-4fdb-adce-5efa40a4b6e0 req-11a801bf-b9b4-4734-9f89-f7ff0052d0a4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:53.979895 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-98bf85fb-80c6-4fdb-adce-5efa40a4b6e0 req-11a801bf-b9b4-4734-9f89-f7ff0052d0a4 service nova] Creating event network-vif-unplugged:b754032e-d2e8-44f5-9e36-e1dd81e454f5 for instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 on n-h1-768852-23 Jul 14 15:13:54.004142 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-98bf85fb-80c6-4fdb-adce-5efa40a4b6e0 req-11a801bf-b9b4-4734-9f89-f7ff0052d0a4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.173451 Jul 14 15:13:54.006038 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2665/5180] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:54.029966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:54.031625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:54.058613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:54.065055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:54.071550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:54.072817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:54.102342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ddbfe3d7-33e8-4030-92d8-21244251c99d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:54.132207 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ddbfe3d7-33e8-4030-92d8-21244251c99d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1209 microversion: 2.1 time: 0.277725 Jul 14 15:13:54.139436 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2516/5181] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:53 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1209 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:55.183902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a6de4a0-8f7c-4f36-a0ef-3be3f9465f8e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:55.184875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a6de4a0-8f7c-4f36-a0ef-3be3f9465f8e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:55.361266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:55.424852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f7e3cdd0-c7ff-496c-90bd-41e2ad4e9d9b tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1502 microversion: 2.1 time: 1.412013 Jul 14 15:13:55.429542 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2666/5182] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:54 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1502 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:55.452617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7a6de4a0-8f7c-4f36-a0ef-3be3f9465f8e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:55.479936 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a6de4a0-8f7c-4f36-a0ef-3be3f9465f8e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1209 microversion: 2.1 time: 0.300302 Jul 14 15:13:55.488110 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2517/5183] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:55 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1209 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:55.562252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-55536e1a-7a95-41ef-a83f-b4f394dd6357 req-76bd01d2-bfca-4046-b0f8-e2b9b4f683ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2b3c883-a958-4ec9-bdc2-a7a3ff850448", "name": "network-vif-deleted", "tag": "b754032e-d2e8-44f5-9e36-e1dd81e454f5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:13:55.608276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-55536e1a-7a95-41ef-a83f-b4f394dd6357 req-76bd01d2-bfca-4046-b0f8-e2b9b4f683ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:55.622337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-55536e1a-7a95-41ef-a83f-b4f394dd6357 req-76bd01d2-bfca-4046-b0f8-e2b9b4f683ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:55.677394 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-55536e1a-7a95-41ef-a83f-b4f394dd6357 req-76bd01d2-bfca-4046-b0f8-e2b9b4f683ea service nova] Creating event network-vif-deleted:b754032e-d2e8-44f5-9e36-e1dd81e454f5 for instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 on n-h1-768852-23 Jul 14 15:13:55.706492 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-55536e1a-7a95-41ef-a83f-b4f394dd6357 req-76bd01d2-bfca-4046-b0f8-e2b9b4f683ea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158503 Jul 14 15:13:55.716507 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2667/5184] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:13:56.461880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:56.463508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:56.485602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:56.488247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:56.489987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:56.492362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:56.510152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:56.511045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:56.539895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:56.540641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:56.541672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:56.542335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:56.638787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:56.642706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:56.643791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lazy-loading 'fault' on Instance uuid d2b3c883-a958-4ec9-bdc2-a7a3ff850448 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:13:56.780010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:56.816071 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a0986d9-7414-48ee-9d0d-bfc432e83e98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1261 microversion: 2.1 time: 0.310251 Jul 14 15:13:56.822534 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2668/5185] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:56 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1261 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:13:56.991451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef0565f08c444052b98b007d344ea2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc957622784843ba912f59ce75aee2a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:57.011322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a18eba8f-ab2c-4b3a-9297-15a34b289f29 tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 200 len: 1302 microversion: 2.1 time: 0.550056 Jul 14 15:13:57.011322 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2518/5186] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:56 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 1302 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:57.849761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:57.857697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:57.900702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:57.908611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:57.915112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:57.919840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:58.041792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:58.049891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] [instance: d2b3c883-a958-4ec9-bdc2-a7a3ff850448] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:58.095333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:58.100183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:58.102012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:58.113736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:58.186559 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] HTTP exception thrown: Instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 could not be found. Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Request method failure captured: Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 HTTP/1.1 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DKDTklkc-P7MOD00gsKrLhOt0zdvMfJF6cfuP15In0zQ5whix4w5t0mACweaPmPBIRGYTVyUIym6CHkdId4XhY6HNOe4-Z-AjuTs-8biDwM3QDClctWzdxQDB5hnWaPY1EL8XnsL78lcmt3nDbmrPG4pRIvoPmtFYEzo0n71QR66rM Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc957622784843ba912f59ce75aee2a7 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesActionsTest-39018117 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc957622784843ba912f59ce75aee2a7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc957622784843ba912f59ce75aee2a7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc957622784843ba912f59ce75aee2a7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc957622784843ba912f59ce75aee2a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesActionsTest-39018117 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc957622784843ba912f59ce75aee2a7 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesActionsTest-39018117 Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesActionsTest-39018117-project Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ef0565f08c444052b98b007d344ea2ba Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesActionsTest-39018117-project Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 could not be found. Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd2b3c883-a958-4ec9-bdc2-a7a3ff850448'} Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 could not be found. Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 could not be found. Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:58.190779 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:13:58.201455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:13:58.201455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:13:58.201455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:13:58.201455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:13:58.201455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 could not be found. Jul 14 15:13:58.201455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:13:58.207259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] Returning 404 to user: Instance d2b3c883-a958-4ec9-bdc2-a7a3ff850448 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:13:58.207259 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-20199046-d868-45f2-91a0-12fc5581123c tempest-VolumesActionsTest-39018117 tempest-VolumesActionsTest-39018117-project] 10.222.0.98 "GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448" status: 404 len: 111 microversion: 2.1 time: 0.171108 Jul 14 15:13:58.229922 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2519/5187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:58 2022] GET /compute/v2.1/servers/d2b3c883-a958-4ec9-bdc2-a7a3ff850448 => generated 111 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:13:58.468045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:13:58.483100 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c2560a5-2d1c-4611-8d11-0236351c260e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1267 microversion: 2.1 time: 0.641179 Jul 14 15:13:58.494227 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2669/5188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:57 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1267 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:13:59.516411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:13:59.517915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:13:59.536720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:59.544235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:59.545595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:13:59.550167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:13:59.991768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:00.012446 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56ef3b0b-9601-4bc0-95de-5a94b1d54bdf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1267 microversion: 2.1 time: 0.503234 Jul 14 15:14:00.015472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2520/5189] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:13:59 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1267 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:01.051087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:01.052839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:01.086108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:01.092258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:01.094211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:01.100456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:01.461438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:01.483661 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0fafa3a1-9c8e-4175-9dd7-1a34c1a336d5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1267 microversion: 2.1 time: 0.437462 Jul 14 15:14:01.495312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2670/5190] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:01 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1267 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:02.514181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:02.514847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:02.540933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:02.541828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:02.543408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:02.544929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:03.415794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:03.577686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:03.589986 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bd5dc290-f6fb-46b7-b1d2-6948b09832c6 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 1.082806 Jul 14 15:14:03.604907 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2521/5191] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:02 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:04.619826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:04.620657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:04.627147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:04.654424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:04.665507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:04.669426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:04.673650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:04.813265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:04.840833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:04.894363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:04.915208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:04.932284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:04.933599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:04.934380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:05.292953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:05.304109 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-140380cd-9e7e-4806-ae74-60c382c1d812 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.687924 Jul 14 15:14:05.304321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lazy-loading 'services' on Instance uuid b3314905-09db-4e45-b8f1-bcccb95d2754 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:14:05.305600 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2671/5192] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:04 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:05.474691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:05.629981 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0939e7f-516d-4169-b95a-317740076322 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments/cc749dff-595e-49ee-8e5f-dd44a15d2837" status: 202 len: 0 microversion: 2.1 time: 0.824241 Jul 14 15:14:05.636066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2522/5193] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:14:04 2022] DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments/cc749dff-595e-49ee-8e5f-dd44a15d2837 => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:14:05.679323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:05.685345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:05.725143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:05.729379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:05.736567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:05.737659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:05.877937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ba8d766-e12e-4bf4-8220-97fde398852d tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.232735 Jul 14 15:14:05.887099 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2523/5194] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:05 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:05.960322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1173698962", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "bd014607-a4ed-47de-9613-e9b4f419074d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:06.161793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] validate_networks() for [('bd014607-a4ed-47de-9613-e9b4f419074d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:14:06.334014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:06.334927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:06.353438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:06.355648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:06.362415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:06.362876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:07.350249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:14:07.350980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:14:07.352210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:14:07.352963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:14:07.353729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:14:07.441307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:07.441827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:07.442439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:07.450183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:07.455518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:07.457869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00d85de1-7386-4a6d-9415-0cc3e1403dcb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 1.125468 Jul 14 15:14:07.468685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2524/5195] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:06 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:07.481917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b79cd09c-8dab-4285-9bf0-98065d3bff82 req-03385208-8d67-4843-aa57-2907d3f9bff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749276d1-ce4d-4741-841f-478f06e398f4", "tag": "98ca7668-f394-4cfe-bd11-46f30a851dad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:07.522767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b79cd09c-8dab-4285-9bf0-98065d3bff82 req-03385208-8d67-4843-aa57-2907d3f9bff1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:07.523547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b79cd09c-8dab-4285-9bf0-98065d3bff82 req-03385208-8d67-4843-aa57-2907d3f9bff1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:07.582708 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b79cd09c-8dab-4285-9bf0-98065d3bff82 req-03385208-8d67-4843-aa57-2907d3f9bff1 service nova] Creating event network-changed:98ca7668-f394-4cfe-bd11-46f30a851dad for instance 749276d1-ce4d-4741-841f-478f06e398f4 on n-h2-768852-23 Jul 14 15:14:07.596009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Getting quotas for project b0d773410b4f4f569ba3afa8661c17d8. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:14:07.610203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b79cd09c-8dab-4285-9bf0-98065d3bff82 req-03385208-8d67-4843-aa57-2907d3f9bff1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145255 Jul 14 15:14:07.615390 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2525/5196] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:07.641844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Getting quotas for user 94ce161302f9413e9ea56f41dc4ad728 and project b0d773410b4f4f569ba3afa8661c17d8. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:14:07.658698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:07.670603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:07.701493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:14:07.703906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:14:07.750711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:07.751725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:07.763468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:07.773045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:07.902859 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d0e3648-d2b2-4597-8a6b-ec59288b2b37 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.595045 Jul 14 15:14:07.910956 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2672/5197] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:14:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:14:07.940058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ab21ab2-3f99-48d4-a282-f24524cf2fde tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:07.940058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ab21ab2-3f99-48d4-a282-f24524cf2fde tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:08.002322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a7eaeead-80f8-4838-982f-0821efbed408 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.374556 Jul 14 15:14:08.003321 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2526/5198] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:07 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:08.167824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6ab21ab2-3f99-48d4-a282-f24524cf2fde tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:08.192756 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ab21ab2-3f99-48d4-a282-f24524cf2fde tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1225 microversion: 2.1 time: 0.279238 Jul 14 15:14:08.193594 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2673/5199] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:07 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1225 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:08.476804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:08.477443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:08.517092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:08.521437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:08.523458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:08.527149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:09.017133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:09.018204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:09.072647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:09.073124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:09.083103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:09.090033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:09.265996 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d11d422f-8698-47b6-aae3-cac54dec5d97 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.249754 Jul 14 15:14:09.266804 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2674/5200] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:09 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:14:09.275383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80782e1f-1f7f-43be-bc38-07574d6bbfdc tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:09.298984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80782e1f-1f7f-43be-bc38-07574d6bbfdc tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:09.511661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-80782e1f-1f7f-43be-bc38-07574d6bbfdc tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:09.522659 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80782e1f-1f7f-43be-bc38-07574d6bbfdc tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1225 microversion: 2.1 time: 0.253511 Jul 14 15:14:09.533714 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2675/5201] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:09 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1225 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:10.141229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:10.162155 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03733ba1-e766-4b3a-bb4e-61940dae4d95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 1.686822 Jul 14 15:14:10.179525 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2527/5202] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:08 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 1708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:10.289323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:10.306930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:10.385503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:10.391717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:10.405815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:10.406851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:10.425581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:10.534476 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-037ef324-1854-4545-bb6a-7b47b51dd292 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.259721 Jul 14 15:14:10.542250 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2676/5203] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:10 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:10.547851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:10.548655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:10.587632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:10.588691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:10.592707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:10.593519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:11.196223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:11.197029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:11.218404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:11.218963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:11.220783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:11.221389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:11.230433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:11.240113 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5dacb098-0a34-4418-ad43-c4d33885bc04 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1221 microversion: 2.1 time: 0.696331 Jul 14 15:14:11.265483 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2528/5204] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:10 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1221 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:11.549116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:11.550288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:11.559041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:11.573670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:11.577550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:11.579198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:11.737085 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50724e3f-ab45-439a-890f-61410fecdfc6 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193322 Jul 14 15:14:11.753742 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2529/5205] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:11 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:12.019485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:12.029544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-105fb2b5-2058-4492-8856-f0fb020ce1a9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.848535 Jul 14 15:14:12.054166 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2677/5206] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:11 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:12.273054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:12.273802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:12.283764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:12.296031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:12.297958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:12.298559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:12.645863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:12.671987 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1212a75-e2e5-4e12-a821-3a01001f367a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1283 microversion: 2.1 time: 0.394491 Jul 14 15:14:12.674672 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2530/5207] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:12 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1283 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:12.754397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:12.755675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:12.780287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:12.781064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:12.782253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:12.784966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:12.937671 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7d00b602-699a-4700-853a-652e3b541875 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.190805 Jul 14 15:14:12.976404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2678/5208] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:12 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:13.071159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:13.072651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:13.089022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:13.093847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:13.103535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:13.114975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:13.692446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:13.693793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:13.726686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:13.730360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:13.733417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:13.741218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:14.450421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:14.488454 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60681cd2-9a30-4d46-b65c-0f6c96c5d5a2 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 1.412675 Jul 14 15:14:14.492192 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2531/5209] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:13 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:14.503620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:14.511660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:14.539497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:14.544203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:14.545450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:14.552398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:14.709322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0230fc63-e125-4511-8d2b-5668487d6872 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215727 Jul 14 15:14:14.722868 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2532/5210] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:14 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:14.800792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:14.858551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8df0ee49-3169-4204-9431-1723c0bca617 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 1.166334 Jul 14 15:14:14.861374 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2679/5211] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:13 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:15.506102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:15.507575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:15.529472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.535496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.537371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.540607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.756828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:15.764267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:15.839431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.843694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.846002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:15.851709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:15.953513 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4ba3406-bd8e-4db7-a29c-5081e63d8b4e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222267 Jul 14 15:14:15.968196 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2680/5212] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:15 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:15.980432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:15.989447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:16.021102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:16.023925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:16.034010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:16.034749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:16.079013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:16.115513 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2666be15-d595-490f-bf6b-a6a0e0f4bfb9 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.603217 Jul 14 15:14:16.117883 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2533/5213] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:15 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:16.442727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:16.461606 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dfe8fc63-8fde-421a-8ea1-b2c54a8c41aa tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.491211 Jul 14 15:14:16.477026 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2681/5214] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:15 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:16.989444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:16.990594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:17.022678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.023132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.039807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.040733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.044623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:17.136750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:17.137526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:17.154714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e99227d-7013-49ff-b401-c4e5cb2ce36e tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184340 Jul 14 15:14:17.160346 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2534/5215] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:16 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:17.164713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.166765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.170554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.173093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.482351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:17.483511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:17.502270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.503219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.504300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.505082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:17.529218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:17.891692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:17.895493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:17.908528 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a01f6616-bf12-48a4-97db-191b85862ce4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.778214 Jul 14 15:14:17.910198 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2682/5216] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:17 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:17.912318 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07f843c4-124e-43d5-8b2c-84faa28e05d8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.430702 Jul 14 15:14:17.913190 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2535/5217] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:17 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:17.948719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-48117875-fca7-4266-a5e5-8762f48f0d03 req-cbfb4065-c601-496e-bb70-47146facfc2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fcfa92e-8bab-46b2-b54b-643410c8160c", "tag": "b95c0af9-8d0b-4590-889a-8a3aec7de6ca"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:17.972444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-48117875-fca7-4266-a5e5-8762f48f0d03 req-cbfb4065-c601-496e-bb70-47146facfc2e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:17.974523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-48117875-fca7-4266-a5e5-8762f48f0d03 req-cbfb4065-c601-496e-bb70-47146facfc2e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.054157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-48117875-fca7-4266-a5e5-8762f48f0d03 req-cbfb4065-c601-496e-bb70-47146facfc2e service nova] Creating event network-changed:b95c0af9-8d0b-4590-889a-8a3aec7de6ca for instance 2fcfa92e-8bab-46b2-b54b-643410c8160c on n-h1-768852-23 Jul 14 15:14:18.072097 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-48117875-fca7-4266-a5e5-8762f48f0d03 req-cbfb4065-c601-496e-bb70-47146facfc2e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124112 Jul 14 15:14:18.075841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2683/5218] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:18.166477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:18.167580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:18.202199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.202652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.215162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.216084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.431001 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ff13cd6d-e956-42a0-9069-3757bff7b051 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.267907 Jul 14 15:14:18.437672 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2536/5219] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:18 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:18.930408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:18.938316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:18.939396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:18.941944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:18.956506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.957398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.959046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.960862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.962646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.981716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:18.983210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:18.983841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:19.275173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:19.295724 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7e30cc1-78da-4e9d-b0be-d3176d8aab06 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.362240 Jul 14 15:14:19.296829 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2537/5220] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:18 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:19.306468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-33324ad5-2514-4bde-83d3-ba23db601930 req-4e9b0911-2886-404a-be14-316b6e437344 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749276d1-ce4d-4741-841f-478f06e398f4", "name": "network-vif-plugged", "status": "completed", "tag": "98ca7668-f394-4cfe-bd11-46f30a851dad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:19.328496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-33324ad5-2514-4bde-83d3-ba23db601930 req-4e9b0911-2886-404a-be14-316b6e437344 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:19.331653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-33324ad5-2514-4bde-83d3-ba23db601930 req-4e9b0911-2886-404a-be14-316b6e437344 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:19.369307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-33324ad5-2514-4bde-83d3-ba23db601930 req-4e9b0911-2886-404a-be14-316b6e437344 service nova] Creating event network-vif-plugged:98ca7668-f394-4cfe-bd11-46f30a851dad for instance 749276d1-ce4d-4741-841f-478f06e398f4 on n-h2-768852-23 Jul 14 15:14:19.384877 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-33324ad5-2514-4bde-83d3-ba23db601930 req-4e9b0911-2886-404a-be14-316b6e437344 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084130 Jul 14 15:14:19.385626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2538/5221] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:19.462512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:19.476172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:19.495376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:19.509514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de7a84f8-88af-4da4-9574-22810c8e6edd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.585258 Jul 14 15:14:19.512259 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2684/5222] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:18 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:19.518347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:19.519589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:19.521000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:19.526879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:19.697614 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32e90c31-f1b9-460a-86c3-8251510e6886 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.251063 Jul 14 15:14:19.699468 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2539/5223] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:19 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:20.323180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:20.323860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:20.326574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:20.358016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:20.358961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:20.373333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:20.380107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:20.536334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:20.537529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:20.561378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:20.561851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:20.562665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:20.563118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:20.823754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:20.873439 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cb2cc404-a7ac-44ba-b2dc-5de222fbf52a tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.553931 Jul 14 15:14:20.874346 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2685/5224] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:20 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:20.916580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:20.919767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:20.942070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:20.957358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:20.959861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:20.961319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:20.965257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:20.969456 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67c7a216-1dba-47c5-93a7-2137bc09ef47 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.436637 Jul 14 15:14:20.970216 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2540/5225] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:20 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:21.119966 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56c373c2-ae4f-4199-b621-9e5ffca07521 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.225737 Jul 14 15:14:21.131176 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2686/5226] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:14:20 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754/os-volume_attachments => generated 25 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:14:21.245204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:21.259946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:21.290635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:21.292656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:21.294614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:21.300778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:21.419257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:14:21.769603 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00f3f3cf-23c9-4e8d-9496-0f97c0435fda tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 204 len: 0 microversion: 2.1 time: 0.540898 Jul 14 15:14:21.774367 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2541/5227] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:21 2022] DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:14:21.787165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:21.787843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:21.794759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:21.795217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:21.799786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:21.801518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:21.894259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:21.895106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:21.911374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:21.912653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:21.915724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:21.916331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:22.259909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:22.278251 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ea8df3e-0c29-4afb-bb9d-27564b37265d tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.389142 Jul 14 15:14:22.279586 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2542/5228] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:21 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:22.288328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:22.301845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:22.317730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:22.318582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:22.319858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:22.320480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:22.370041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:22.396385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e88471e5-dbb8-45b3-bcee-3e999543f61a tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1681 microversion: 2.1 time: 0.619862 Jul 14 15:14:22.403255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2687/5229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:21 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1681 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:22.579357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:22.590671 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6267721a-8a50-49f8-9864-9b351a81eabd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1490 microversion: 2.1 time: 0.306589 Jul 14 15:14:22.604019 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2543/5230] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:22 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1490 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:22.610845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1160325711"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:22.612497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:22.620943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:22.622276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:22.623264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:22.624342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:22.754011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25cbc0de-6bba-47e9-bf7b-ee4a8af84ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "PUT /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1075 microversion: 2.1 time: 0.148026 Jul 14 15:14:22.765116 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2688/5231] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 15:14:22 2022] PUT /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1075 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:22.776509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:22.778314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:22.785733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:22.786398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:22.788002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:22.788631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.149423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:23.163064 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d81584ee-9695-4574-86b8-dc97cc460480 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1501 microversion: 2.1 time: 0.391550 Jul 14 15:14:23.177392 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2544/5232] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:22 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:23.182507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:23.183152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:23.202529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.202982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.203810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.204240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.296423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:23.297059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:23.308171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.309012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.311187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.311899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.563894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:23.576668 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-667621f7-31cf-44fd-be38-eb0fa3c27df4 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1501 microversion: 2.1 time: 0.398156 Jul 14 15:14:23.577997 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2689/5233] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:23 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1501 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:23.594174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:23.596225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:23.619869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.620680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.621836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.622762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.745012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:23.779781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-821aa51d-f321-49aa-84fe-193ea5cdb7f5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.488311 Jul 14 15:14:23.780447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2545/5234] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:23 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:23.800656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a158909-590c-475c-868d-b0241283343a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:23.829320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a158909-590c-475c-868d-b0241283343a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:23.830537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a158909-590c-475c-868d-b0241283343a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:23.923314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a158909-590c-475c-868d-b0241283343a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:14:23.943221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:23.969634 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4314194-5da5-4e44-bd39-7c8d407d6260 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1681 microversion: 2.1 time: 0.390193 Jul 14 15:14:23.970186 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2690/5235] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:23 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1681 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:24.033301 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a158909-590c-475c-868d-b0241283343a tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "POST /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4/action" status: 202 len: 0 microversion: 2.1 time: 0.249363 Jul 14 15:14:24.034368 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2546/5236] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:14:23 2022] POST /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:14:24.042818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:24.044182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:24.059926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:24.060415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:24.061255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:24.061696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:24.238333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d49af4cb-86c0-4681-8bf8-2e5ea21a1983 req-1177cc03-e26d-438b-b96f-e5db387355cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fcfa92e-8bab-46b2-b54b-643410c8160c", "name": "network-vif-plugged", "status": "completed", "tag": "b95c0af9-8d0b-4590-889a-8a3aec7de6ca"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:24.314056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d49af4cb-86c0-4681-8bf8-2e5ea21a1983 req-1177cc03-e26d-438b-b96f-e5db387355cd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:24.314516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d49af4cb-86c0-4681-8bf8-2e5ea21a1983 req-1177cc03-e26d-438b-b96f-e5db387355cd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:24.393191 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d49af4cb-86c0-4681-8bf8-2e5ea21a1983 req-1177cc03-e26d-438b-b96f-e5db387355cd service nova] Creating event network-vif-plugged:b95c0af9-8d0b-4590-889a-8a3aec7de6ca for instance 2fcfa92e-8bab-46b2-b54b-643410c8160c on n-h1-768852-23 Jul 14 15:14:24.412528 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d49af4cb-86c0-4681-8bf8-2e5ea21a1983 req-1177cc03-e26d-438b-b96f-e5db387355cd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180272 Jul 14 15:14:24.420339 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2547/5237] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:24.456968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:24.467613 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cbc09ced-b60d-4a1e-a9b3-894e78a2d06f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.428630 Jul 14 15:14:24.485643 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2691/5238] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:24 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:24.798273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:24.799510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:24.819672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:24.820135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:24.820963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:24.821376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:24.990765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:24.991908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:25.004866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:25.009099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:25.013275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:25.022566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:25.318351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:25.334231 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8cd2fd5-bdf8-48a5-bf1a-890eb46309e3 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1325 microversion: 2.1 time: 0.541152 Jul 14 15:14:25.372765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2548/5239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:24 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1325 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:25.494676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:25.495514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:25.520215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:25.520866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:25.568610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:25.569437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:25.694363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:25.702136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:25.731571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:25.747393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07481f50-a8d0-49a9-a3be-b0f7b6dc6b3b tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1681 microversion: 2.1 time: 0.759624 Jul 14 15:14:25.781361 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2692/5240] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:24 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1681 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:26.378264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:26.378892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:26.390554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:26.390936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:26.391718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:26.392153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:26.790443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:26.803423 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fab14f1b-13d7-43e1-bbe5-83947124210f tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1522 microversion: 2.1 time: 0.429213 Jul 14 15:14:26.820768 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2693/5241] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:26 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1522 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:26.826282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:26.839357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:26.862475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:26.863320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:26.864349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:26.865028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:26.895027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:26.922241 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-47d6b6f6-15cb-4714-a0fb-caad49b41c7d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 1.421210 Jul 14 15:14:26.922936 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2549/5242] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:25 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:26.949825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:26.950370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:27.019467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.024471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.028633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.035046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.057215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:27.068867 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69370a28-1cb9-4acc-9556-93f181ff55fc tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1614 microversion: 2.1 time: 0.246236 Jul 14 15:14:27.083319 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2694/5243] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:26 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1614 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:27.147596 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] HTTP exception thrown: Action 999 not found Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Request method failure captured: Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c/os-instance-actions/999 HTTP/1.1 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DK8IYusJkF77qtI5plY8_-mZBmBThQcQPFriy-e-F0VgWRaNkiBQ-ZEuR5g6wCQa8HZMvjSnb1qHEqywNsa-EfH0jaRhBGLbcM_8WMHhMjuozT42rrRNYizLQ-CGYzeGo7Kq4jlUYxyfTF1HsnvdUIy9FgpUFQiWc6uydnjBxt-lWs Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: b0d773410b4f4f569ba3afa8661c17d8 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: b0d773410b4f4f569ba3afa8661c17d8 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-InstanceActionsNegativeTestJSON-1545787492-project Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 94ce161302f9413e9ea56f41dc4ad728 Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1545787492-project Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: exception: Action 999 not found Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': '2fcfa92e-8bab-46b2-b54b-643410c8160c', 'id': '999'} Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Jul 14 15:14:27.161020 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.164453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Returning 404 to user: Action 999 not found {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:27.164453 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1f2ee48-ed74-4293-923c-0e97acf12f00 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.223934 Jul 14 15:14:27.164453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2550/5244] 10.222.0.98 () {58 vars in 1307 bytes} [Thu Jul 14 15:14:26 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c/os-instance-actions/999 => generated 66 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:14:27.180172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-543724ba-23e3-40fb-9a2e-140e98068ad8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '.version_select at 0x7fdbf1b10a60>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:27.180770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-543724ba-23e3-40fb-9a2e-140e98068ad8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: eb25b6af-84ad-40ca-af56-9681a888ef4c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:27.189695 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-543724ba-23e3-40fb-9a2e-140e98068ad8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] HTTP exception thrown: Instance eb25b6af-84ad-40ca-af56-9681a888ef4c could not be found. Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-543724ba-23e3-40fb-9a2e-140e98068ad8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Request method failure captured: Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/eb25b6af-84ad-40ca-af56-9681a888ef4c/os-instance-actions HTTP/1.1 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DK8IYusJkF77qtI5plY8_-mZBmBThQcQPFriy-e-F0VgWRaNkiBQ-ZEuR5g6wCQa8HZMvjSnb1qHEqywNsa-EfH0jaRhBGLbcM_8WMHhMjuozT42rrRNYizLQ-CGYzeGo7Kq4jlUYxyfTF1HsnvdUIy9FgpUFQiWc6uydnjBxt-lWs Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b0d773410b4f4f569ba3afa8661c17d8 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b0d773410b4f4f569ba3afa8661c17d8 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-InstanceActionsNegativeTestJSON-1545787492-project Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 94ce161302f9413e9ea56f41dc4ad728 Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1545787492-project Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: method: Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance eb25b6af-84ad-40ca-af56-9681a888ef4c could not be found. Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': 'eb25b6af-84ad-40ca-af56-9681a888ef4c'} Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb25b6af-84ad-40ca-af56-9681a888ef4c could not be found. Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:27.193482 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb25b6af-84ad-40ca-af56-9681a888ef4c could not be found. Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb25b6af-84ad-40ca-af56-9681a888ef4c could not be found. Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-543724ba-23e3-40fb-9a2e-140e98068ad8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Returning 404 to user: Instance eb25b6af-84ad-40ca-af56-9681a888ef4c could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:27.198147 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-543724ba-23e3-40fb-9a2e-140e98068ad8 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/eb25b6af-84ad-40ca-af56-9681a888ef4c/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.024452 Jul 14 15:14:27.215467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:27.215861 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2695/5245] 10.222.0.98 () {58 vars in 1295 bytes} [Thu Jul 14 15:14:27 2022] GET /compute/v2.1/servers/eb25b6af-84ad-40ca-af56-9681a888ef4c/os-instance-actions => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:27.219588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:27.238579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.243250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.246369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.248552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.388704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:14:27.642238 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b102979-44bb-4da1-b734-9cb2f39236cb tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 204 len: 0 microversion: 2.1 time: 0.434715 Jul 14 15:14:27.643233 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2551/5246] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:27 2022] DELETE /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:14:27.660431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:27.662128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:27.729713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.730503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.739322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.740081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.941246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:27.942967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:27.955378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.967619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:27.968873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:27.969547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:28.238472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:28.253770 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-473b66d7-d218-414b-9456-a050925f0da5 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1528 microversion: 2.1 time: 0.604873 Jul 14 15:14:28.255033 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2696/5247] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:27 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1528 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:28.266287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:28.277066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:28.295997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:28.310925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:28.311965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:28.312424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:28.460824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:28.476522 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea56593b-a710-43bd-8bdb-fec35c1e69e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1614 microversion: 2.1 time: 0.215138 Jul 14 15:14:28.477243 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2697/5248] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:28 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1614 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:28.530498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:28.542126 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7ee3d2c5-bba0-4e5b-91c6-e640c19ef111 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.603043 Jul 14 15:14:28.553576 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2552/5249] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:27 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:29.083960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-31414e17-6e3f-4258-8fb2-9c2beae4c7af req-ac06bdde-7787-42d3-876a-451ae40d154f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3314905-09db-4e45-b8f1-bcccb95d2754", "name": "network-vif-deleted", "tag": "00fe7f57-8929-4034-91b1-5f4d75aa5038"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:29.095011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31414e17-6e3f-4258-8fb2-9c2beae4c7af req-ac06bdde-7787-42d3-876a-451ae40d154f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.095898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31414e17-6e3f-4258-8fb2-9c2beae4c7af req-ac06bdde-7787-42d3-876a-451ae40d154f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.110170 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-31414e17-6e3f-4258-8fb2-9c2beae4c7af req-ac06bdde-7787-42d3-876a-451ae40d154f service nova] Creating event network-vif-deleted:00fe7f57-8929-4034-91b1-5f4d75aa5038 for instance b3314905-09db-4e45-b8f1-bcccb95d2754 on n-h2-768852-23 Jul 14 15:14:29.119548 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-31414e17-6e3f-4258-8fb2-9c2beae4c7af req-ac06bdde-7787-42d3-876a-451ae40d154f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040671 Jul 14 15:14:29.132903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2698/5250] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:14:29.273678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:29.274929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:29.290907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.291595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.292742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.293423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.498195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:29.500325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:29.509739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.512712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.514117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.516958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.614593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:29.616151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:29.617889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lazy-loading 'fault' on Instance uuid b3314905-09db-4e45-b8f1-bcccb95d2754 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:14:29.926735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed79aa2ea715471bb970282c9e8dfd7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a800489ef5a24105b8f9eaee334937c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:29.963215 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-089a7e50-8b0a-41f3-8f49-af8af558a1f1 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 200 len: 1332 microversion: 2.1 time: 0.469935 Jul 14 15:14:29.995090 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2699/5251] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:29 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 1332 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:30.031078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:30.033870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:30.065709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:30.069103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:30.072499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:30.073026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:30.681293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:30.695376 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8eeb8c32-1bc0-437e-9e46-49d753cdd2b7 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1528 microversion: 2.1 time: 1.426205 Jul 14 15:14:30.695889 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2553/5252] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:29 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1528 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:31.002525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:31.003588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:31.014550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:31.020297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:31.023673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:31.043546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:31.135344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 HTTP/1.1 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b3314905-09db-4e45-b8f1-bcccb95d2754'} Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:31.213685 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:31.218857 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:14:31.220234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:31.223840 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ea72ce54-e6b1-4974-993a-70160ee67968 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 404 len: 111 microversion: 2.1 time: 0.227154 Jul 14 15:14:31.248174 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2554/5253] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:30 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 111 bytes in 252 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:14:31.254138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-acebeafc-0119-4585-9b58-7a226c7ced0c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '.version_select at 0x7fdbf23d55e0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:31.312071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-acebeafc-0119-4585-9b58-7a226c7ced0c tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540543716" status: 202 len: 0 microversion: 2.1 time: 0.062404 Jul 14 15:14:31.317774 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2555/5254] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:14:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1540543716 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:14:31.729923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:31.747542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:31.797211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:31.798007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:31.800596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:31.802208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:32.374371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:32.414184 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-83eb91cc-d0ff-4a49-a105-84bae7bd1972 tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1486 microversion: 2.1 time: 0.693921 Jul 14 15:14:32.415378 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2556/5255] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:31 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1486 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:14:32.587491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3459a43b-ed2d-42a2-868c-6e4fef0e203f req-4184e363-ba63-45c6-8789-3f6af2015c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fcfa92e-8bab-46b2-b54b-643410c8160c", "name": "network-vif-deleted", "tag": "b95c0af9-8d0b-4590-889a-8a3aec7de6ca"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:32.630994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3459a43b-ed2d-42a2-868c-6e4fef0e203f req-4184e363-ba63-45c6-8789-3f6af2015c45 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:32.634610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3459a43b-ed2d-42a2-868c-6e4fef0e203f req-4184e363-ba63-45c6-8789-3f6af2015c45 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:32.731302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:32.742106 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3459a43b-ed2d-42a2-868c-6e4fef0e203f req-4184e363-ba63-45c6-8789-3f6af2015c45 service nova] Creating event network-vif-deleted:b95c0af9-8d0b-4590-889a-8a3aec7de6ca for instance 2fcfa92e-8bab-46b2-b54b-643410c8160c on n-h1-768852-23 Jul 14 15:14:32.758939 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fd5acb4-f3eb-45b7-83d3-1183ad9ab405 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 2.760986 Jul 14 15:14:32.774512 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2700/5256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:29 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 2778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:32.801749 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3459a43b-ed2d-42a2-868c-6e4fef0e203f req-4184e363-ba63-45c6-8789-3f6af2015c45 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220346 Jul 14 15:14:32.801749 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2557/5257] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:33.452045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:33.453285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:33.499706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.500614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.504169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.509287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.664181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.664866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.665516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lazy-loading 'fault' on Instance uuid 2fcfa92e-8bab-46b2-b54b-643410c8160c {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:14:33.785524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:33.786918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:33.826123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.826736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.827889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:33.828314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:33.845569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '94ce161302f9413e9ea56f41dc4ad728', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0d773410b4f4f569ba3afa8661c17d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:33.885046 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-daac3a66-ebfa-4b6a-843f-3f6fc194636b tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 200 len: 1315 microversion: 2.1 time: 0.425107 Jul 14 15:14:33.888851 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2701/5258] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:33 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:34.381374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:34.392954 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ff5702c-0d4c-44a2-9191-0929e27e5b98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.614027 Jul 14 15:14:34.393889 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2558/5259] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:33 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:34.926853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:34.937232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] [instance: 2fcfa92e-8bab-46b2-b54b-643410c8160c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:34.979652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:34.985825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:34.989385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:34.992690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:34.998661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:35.072747 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] HTTP exception thrown: Instance 2fcfa92e-8bab-46b2-b54b-643410c8160c could not be found. Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Request method failure captured: Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c HTTP/1.1 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DK8IYusJkF77qtI5plY8_-mZBmBThQcQPFriy-e-F0VgWRaNkiBQ-ZEuR5g6wCQa8HZMvjSnb1qHEqywNsa-EfH0jaRhBGLbcM_8WMHhMjuozT42rrRNYizLQ-CGYzeGo7Kq4jlUYxyfTF1HsnvdUIy9FgpUFQiWc6uydnjBxt-lWs Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: b0d773410b4f4f569ba3afa8661c17d8 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/b0d773410b4f4f569ba3afa8661c17d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: b0d773410b4f4f569ba3afa8661c17d8 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1545787492 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-InstanceActionsNegativeTestJSON-1545787492-project Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 94ce161302f9413e9ea56f41dc4ad728 Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1545787492-project Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2fcfa92e-8bab-46b2-b54b-643410c8160c could not be found. Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2fcfa92e-8bab-46b2-b54b-643410c8160c'} Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fcfa92e-8bab-46b2-b54b-643410c8160c could not be found. Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fcfa92e-8bab-46b2-b54b-643410c8160c could not be found. Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:35.075237 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fcfa92e-8bab-46b2-b54b-643410c8160c could not be found. Jul 14 15:14:35.078969 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:35.088419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] Returning 404 to user: Instance 2fcfa92e-8bab-46b2-b54b-643410c8160c could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:35.090634 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ff2967f-aa6d-4403-ac9d-dab55aa89b1c tempest-InstanceActionsNegativeTestJSON-1545787492 tempest-InstanceActionsNegativeTestJSON-1545787492-project] 10.222.0.98 "GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c" status: 404 len: 111 microversion: 2.1 time: 0.176574 Jul 14 15:14:35.093422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2702/5260] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:34 2022] GET /compute/v2.1/servers/2fcfa92e-8bab-46b2-b54b-643410c8160c => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:35.410134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:35.411728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:35.415075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:35.435135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:35.435874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:35.436861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:35.437508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:35.805455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:35.829468 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f90acff0-5248-4097-a823-39f44eec41e3 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.423117 Jul 14 15:14:35.830088 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2559/5261] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:35 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:36.861346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:36.863057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:36.898328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:36.901000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:36.909452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:36.910746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:37.547898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:37.572347 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2accec5d-3a26-49ee-b5db-743efe0a8a09 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.718512 Jul 14 15:14:37.573991 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2703/5262] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:36 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:38.591793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:38.592422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:38.611086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:38.617030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:38.618168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:38.618798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:39.081678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:39.110982 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-86f22041-607a-4872-8122-50d75ddf4e6b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.514858 Jul 14 15:14:39.112319 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2560/5263] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:38 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:40.138117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:40.139780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:40.165575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:40.166031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:40.166828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:40.167285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:40.603159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:40.626232 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-732de8c5-a513-4b34-a88b-4f35d7cdb1d0 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.483981 Jul 14 15:14:40.631401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2704/5264] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:40 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:41.651644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:41.658836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:41.684285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:41.704143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:41.705020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:41.705490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.534379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:42.535099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:42.561065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.562090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.563087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.566383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.667357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 HTTP/1.1 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b3314905-09db-4e45-b8f1-bcccb95d2754'} Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:42.675195 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.678813 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.681949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:42.684880 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e5a691f-3856-4fb6-bfff-30f817c75f16 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 404 len: 111 microversion: 2.1 time: 0.161791 Jul 14 15:14:42.687721 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2705/5265] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:42 2022] DELETE /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:42.702052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:42.703077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: b3314905-09db-4e45-b8f1-bcccb95d2754] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:42.718587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.723293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.724564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:42.725258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:42.753816 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 HTTP/1.1 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b3314905-09db-4e45-b8f1-bcccb95d2754'} Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:42.755734 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. Jul 14 15:14:42.759463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:42.762529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance b3314905-09db-4e45-b8f1-bcccb95d2754 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:42.763661 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-89cbdbf4-1ef5-44cf-a2e9-590895d7b7e8 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754" status: 404 len: 111 microversion: 2.1 time: 0.066089 Jul 14 15:14:42.764474 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2706/5266] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:42 2022] GET /compute/v2.1/servers/b3314905-09db-4e45-b8f1-bcccb95d2754 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:42.782185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:42.791175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2e15f82e-3c87-4dbe-bfa6-c601d1f87f45 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 1.149593 Jul 14 15:14:42.792099 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2561/5267] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:41 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:43.819167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:43.819167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:43.840800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:43.841776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:43.842411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:43.846671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:44.250485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:44.264568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28854dd7-670d-45a5-abb4-627990a2ec98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.451866 Jul 14 15:14:44.267486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2707/5268] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:43 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:45.292100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:45.296492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:45.356641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:45.361103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:45.375106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:45.375822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:45.997797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:46.012876 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4575475e-6ad3-46e3-ac59-9da137c4d49e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.731266 Jul 14 15:14:46.013497 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2562/5269] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:45 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:47.031750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:47.032621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:47.066683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:47.079041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:47.083138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:47.094118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:47.434306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:47.446672 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-da778c6f-0cdc-4896-bd0c-cdb5d387c11f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.420097 Jul 14 15:14:47.451376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2708/5270] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:47 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:48.465744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:48.466537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:48.474709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.475167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.475996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:48.476436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:48.958095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:48.972026 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fd2733fe-4241-49ed-87e7-b5376e6c7d63 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1511 microversion: 2.1 time: 0.510040 Jul 14 15:14:48.982815 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2563/5271] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:48 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1511 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:49.992740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:49.993633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:50.016768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:50.024113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:50.031583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:50.034007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:50.764896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:50.778913 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7054566-c0c3-4213-a731-bb2a41d9c6cb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1488 microversion: 2.1 time: 0.789017 Jul 14 15:14:50.784435 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2709/5272] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:49 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1488 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:50.796940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-692486558"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:50.798504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:50.819454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:50.819870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:50.822703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:50.823104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:51.019070 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94e9bcb0-867b-4c84-aeee-39591e9902bb tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "PUT /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1060 microversion: 2.1 time: 0.226519 Jul 14 15:14:51.034929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:51.036355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:51.039882 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2564/5273] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 15:14:50 2022] PUT /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1060 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:51.050057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:51.050507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:51.052223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:51.060199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:53.301801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:53.338605 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be719340-18c1-43d3-baa4-34a000bb13f8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1487 microversion: 2.1 time: 2.307470 Jul 14 15:14:53.368604 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2710/5274] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:51 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1487 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:53.375128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:53.376471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:53.394719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:53.396398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:53.397239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:53.401153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.425677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:54.448908 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b71aa22-31d5-4628-a30e-2b53dc4a6ff8 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1487 microversion: 2.1 time: 1.075887 Jul 14 15:14:54.452788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2565/5275] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:53 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1487 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:54.483029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:54.497146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:54.568165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:54.569065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.570506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:54.571323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.687752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:14:54.822383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:54.895379 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-964d355f-cf7c-40f0-88c1-8cc9e50339ac tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 204 len: 0 microversion: 2.1 time: 0.419571 Jul 14 15:14:54.900158 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2711/5276] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:54 2022] DELETE /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:14:54.905874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:54.906496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:54.924230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:54.935686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.937062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:54.941133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:54.944779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:14:55.349996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:55.350593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:55.410217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.413563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.415534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.418573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.465183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 HTTP/1.1 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28'} Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:55.477350 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a214604e-3a7d-4d1e-91f5-7ba60072a739 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 404 len: 111 microversion: 2.1 time: 0.133446 Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2712/5277] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:55 2022] DELETE /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:55.491430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:55.515367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.518139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.518994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.519469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.612833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 HTTP/1.1 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28'} Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.614797 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. Jul 14 15:14:55.618525 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.620762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance 98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:55.625458 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-56ae6a40-5f38-45a9-a1bd-5f55b05838b3 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28" status: 404 len: 111 microversion: 2.1 time: 0.140605 Jul 14 15:14:55.634899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2713/5278] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:55 2022] GET /compute/v2.1/servers/98b43ec1-a8b3-4cc3-a16b-2ddeeaeb4e28 => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:55.649075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:55.654018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:55.673122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.674150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.676325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.677168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.702022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 HTTP/1.1 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64a2a4a6-5969-4725-abbd-dce373f709e6'} Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:55.704581 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.708149 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.720824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:55.722293 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ea29727-1d5f-4347-b896-98bbb5b767a9 tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 404 len: 111 microversion: 2.1 time: 0.085856 Jul 14 15:14:55.726770 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2714/5279] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:14:55 2022] DELETE /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:14:55.736414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:55.752008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: 64a2a4a6-5969-4725-abbd-dce373f709e6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:55.775807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.776275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.777974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:55.778617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:55.832448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 HTTP/1.1 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64a2a4a6-5969-4725-abbd-dce373f709e6'} Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:14:55.838766 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. Jul 14 15:14:55.844240 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:14:55.846363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance 64a2a4a6-5969-4725-abbd-dce373f709e6 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:14:55.855822 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6bd502e3-9c62-426d-8f4d-ed565a0ec78f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6" status: 404 len: 111 microversion: 2.1 time: 0.122696 Jul 14 15:14:55.858721 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2715/5280] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:55 2022] GET /compute/v2.1/servers/64a2a4a6-5969-4725-abbd-dce373f709e6 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:14:57.977181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:57.992971 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-294a0d99-80e6-4fd6-88be-65813c239671 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1493 microversion: 2.1 time: 3.091723 Jul 14 15:14:57.997419 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2566/5281] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:54 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1493 bytes in 3097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:14:59.031879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:14:59.033131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:14:59.101137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:59.104295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:59.106407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:59.112295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:59.538408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-269c2aeb-7a45-42fb-9cb7-56c6521b592c req-2140f7d8-9844-43f8-9cc2-00fd247eb0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749276d1-ce4d-4741-841f-478f06e398f4", "name": "network-vif-unplugged", "status": "completed", "tag": "98ca7668-f394-4cfe-bd11-46f30a851dad"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:14:59.565906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-269c2aeb-7a45-42fb-9cb7-56c6521b592c req-2140f7d8-9844-43f8-9cc2-00fd247eb0f6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:14:59.566379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-269c2aeb-7a45-42fb-9cb7-56c6521b592c req-2140f7d8-9844-43f8-9cc2-00fd247eb0f6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:14:59.625852 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-269c2aeb-7a45-42fb-9cb7-56c6521b592c req-2140f7d8-9844-43f8-9cc2-00fd247eb0f6 service nova] Creating event network-vif-unplugged:98ca7668-f394-4cfe-bd11-46f30a851dad for instance 749276d1-ce4d-4741-841f-478f06e398f4 on n-h2-768852-23 Jul 14 15:14:59.680753 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-269c2aeb-7a45-42fb-9cb7-56c6521b592c req-2140f7d8-9844-43f8-9cc2-00fd247eb0f6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130452 Jul 14 15:14:59.690529 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2567/5282] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:14:59.749013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:14:59.800192 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ef59175-6db8-4172-88c4-9e5e18dc7faf tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1493 microversion: 2.1 time: 0.775864 Jul 14 15:14:59.807986 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2716/5283] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:14:59 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1493 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:00.841091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:00.841860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:00.858182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:00.858936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:00.863024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:00.866019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:01.146180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:01.155461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19941d46-9a2a-4831-a70b-b5f52330c628 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1451 microversion: 2.1 time: 0.320225 Jul 14 15:15:01.156621 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2568/5284] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:00 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1451 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:01.598905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-79aa77fc-dda6-4c85-b61a-4ea8a0883b40 req-18cd520b-11fc-4722-88f5-34a3f2bf1c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749276d1-ce4d-4741-841f-478f06e398f4", "name": "network-vif-deleted", "tag": "98ca7668-f394-4cfe-bd11-46f30a851dad"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:01.637270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-79aa77fc-dda6-4c85-b61a-4ea8a0883b40 req-18cd520b-11fc-4722-88f5-34a3f2bf1c03 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:01.638111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-79aa77fc-dda6-4c85-b61a-4ea8a0883b40 req-18cd520b-11fc-4722-88f5-34a3f2bf1c03 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:01.690942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-79aa77fc-dda6-4c85-b61a-4ea8a0883b40 req-18cd520b-11fc-4722-88f5-34a3f2bf1c03 service nova] Creating event network-vif-deleted:98ca7668-f394-4cfe-bd11-46f30a851dad for instance 749276d1-ce4d-4741-841f-478f06e398f4 on n-h2-768852-23 Jul 14 15:15:01.726606 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-79aa77fc-dda6-4c85-b61a-4ea8a0883b40 req-18cd520b-11fc-4722-88f5-34a3f2bf1c03 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129381 Jul 14 15:15:01.743207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2717/5285] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:02.185058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:02.191305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:02.203731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:02.208071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:02.209401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:02.210121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:02.336061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:02.336916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:02.337753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lazy-loading 'fault' on Instance uuid 749276d1-ce4d-4741-841f-478f06e398f4 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:15:02.552839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:02.597882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d649a82c-e907-42fb-a47c-8b75904323df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 200 len: 1309 microversion: 2.1 time: 0.417080 Jul 14 15:15:02.616458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2569/5286] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:02 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 1309 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:03.644388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:03.646974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:03.707143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.710773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.719806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:03.720872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:03.859910 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 HTTP/1.1 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '749276d1-ce4d-4741-841f-478f06e398f4'} Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:03.928782 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:03.933795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:03.933795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:03.933795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:03.933795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:03.933795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:03.933795 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:03.953193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:03.955366 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-126c3d07-05a6-4815-ae8d-56c3d178754b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 404 len: 111 microversion: 2.1 time: 0.324344 Jul 14 15:15:03.968509 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2718/5287] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:03 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 111 bytes in 339 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:03.989743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:03.992434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.007142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.008289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.009987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.011841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.043660 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 HTTP/1.1 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '749276d1-ce4d-4741-841f-478f06e398f4'} Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.048473 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.056962 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.063761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.071868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ddfffda-bf97-43a1-a9fd-b428f5380365 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 404 len: 111 microversion: 2.1 time: 0.081775 Jul 14 15:15:04.074399 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2570/5288] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:03 2022] DELETE /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:04.085113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.086326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 749276d1-ce4d-4741-841f-478f06e398f4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.112165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.112625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.122703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.125340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.209154 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 HTTP/1.1 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '749276d1-ce4d-4741-841f-478f06e398f4'} Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.210759 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.214863 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.214863 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.214863 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.214863 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.214863 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. Jul 14 15:15:04.214863 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.218854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 749276d1-ce4d-4741-841f-478f06e398f4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.222162 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-495a1bff-0ad1-46a5-9c21-e92f2e22570f tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4" status: 404 len: 111 microversion: 2.1 time: 0.141576 Jul 14 15:15:04.222813 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2719/5289] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:04 2022] GET /compute/v2.1/servers/749276d1-ce4d-4741-841f-478f06e398f4 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:15:04.242248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.243051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.265349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.267460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.268533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.268994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.321130 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 HTTP/1.1 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9835a80d-616a-4f7e-8b97-71a7c0bd7a71'} Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.333726 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.341842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.346560 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa15d9ca-baf3-4321-bb36-8c81b00aca19 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 404 len: 111 microversion: 2.1 time: 0.100619 Jul 14 15:15:04.348773 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2571/5290] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:04 2022] DELETE /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:15:04.361204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.362088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 9835a80d-616a-4f7e-8b97-71a7c0bd7a71] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.387790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.388545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.389559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.391181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.464898 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 HTTP/1.1 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '9835a80d-616a-4f7e-8b97-71a7c0bd7a71'} Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.468463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.476332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.476332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.476332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.476332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.476332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. Jul 14 15:15:04.476332 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.482406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 9835a80d-616a-4f7e-8b97-71a7c0bd7a71 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.490284 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2cb6dc7-9767-4bb1-ad9e-3c16b072a66d tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71" status: 404 len: 111 microversion: 2.1 time: 0.133659 Jul 14 15:15:04.494489 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2720/5291] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:04 2022] GET /compute/v2.1/servers/9835a80d-616a-4f7e-8b97-71a7c0bd7a71 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:04.502469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.502996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.522172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.525383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.528719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.531362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.573779 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d HTTP/1.1 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6cdbb228-73cf-4123-918c-0c216725162d'} Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.576180 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.581186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.582232 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4389f7cf-802a-4ec9-89be-5c76218a7bec tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 404 len: 111 microversion: 2.1 time: 0.082379 Jul 14 15:15:04.584717 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2572/5292] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:04 2022] DELETE /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:04.600223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.602097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 6cdbb228-73cf-4123-918c-0c216725162d] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.616176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.617750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.636991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.644708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.738210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d HTTP/1.1 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6cdbb228-73cf-4123-918c-0c216725162d'} Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.741411 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 6cdbb228-73cf-4123-918c-0c216725162d could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.755852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b68abaec-0966-4926-9075-b9129c0d75a5 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d" status: 404 len: 111 microversion: 2.1 time: 0.151967 Jul 14 15:15:04.758973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.758973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.759581 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2721/5293] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:04 2022] GET /compute/v2.1/servers/6cdbb228-73cf-4123-918c-0c216725162d => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:15:04.770864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.771440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.772418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.778152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.834825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a HTTP/1.1 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'aa7c6cd4-04f0-4c1e-9a76-713959d65d4a'} Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.842120 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.847625 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.853310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.857305 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e562853d-e7fd-487a-be31-212627d95ccd tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 404 len: 111 microversion: 2.1 time: 0.106766 Jul 14 15:15:04.861571 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2573/5294] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:04 2022] DELETE /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:15:04.869299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.871680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: aa7c6cd4-04f0-4c1e-9a76-713959d65d4a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.897182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.897644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.898447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.902485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.947701 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a HTTP/1.1 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'aa7c6cd4-04f0-4c1e-9a76-713959d65d4a'} Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.954649 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:04.959330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:04.959330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:04.959330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:04.959330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:04.959330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. Jul 14 15:15:04.959330 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:04.960753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance aa7c6cd4-04f0-4c1e-9a76-713959d65d4a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:04.967677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3159ad3-c36e-4185-8ff9-f34a5a75e677 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a" status: 404 len: 111 microversion: 2.1 time: 0.098706 Jul 14 15:15:04.969151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2722/5295] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:04 2022] GET /compute/v2.1/servers/aa7c6cd4-04f0-4c1e-9a76-713959d65d4a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:15:04.977453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:04.978236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:04.992026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.995945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:04.997116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:04.998923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.084375 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 HTTP/1.1 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a956ed4e-54b1-4ce7-8009-a90ce8823276'} Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:05.097464 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.112118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:05.124324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5dc7c01-ea78-4f2a-9754-f9be11f69978 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 404 len: 111 microversion: 2.1 time: 0.142829 Jul 14 15:15:05.126390 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2574/5296] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:04 2022] DELETE /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:05.134414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:05.137559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: a956ed4e-54b1-4ce7-8009-a90ce8823276] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:05.153481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.159808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.160973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.165029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.235218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 HTTP/1.1 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'a956ed4e-54b1-4ce7-8009-a90ce8823276'} Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.242168 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.248454 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.248454 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.248454 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:05.248454 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:05.248454 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. Jul 14 15:15:05.248454 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.253115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance a956ed4e-54b1-4ce7-8009-a90ce8823276 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:05.254944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63cc2d9f-a638-4bf6-92f8-cfd73ee47a4e tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276" status: 404 len: 111 microversion: 2.1 time: 0.124686 Jul 14 15:15:05.260528 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2723/5297] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:05 2022] GET /compute/v2.1/servers/a956ed4e-54b1-4ce7-8009-a90ce8823276 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:05.277437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:05.280142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:05.334584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.337930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.341075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.342900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.441837 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 HTTP/1.1 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '64954a7e-48d5-46ef-a29a-2d740ff4dae4'} Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:05.463354 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.471029 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.475495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:05.491653 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4524b8d9-8095-460f-8636-279c7462c05b tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 404 len: 111 microversion: 2.1 time: 0.225503 Jul 14 15:15:05.500472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2575/5298] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:05 2022] DELETE /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 111 bytes in 237 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:05.531215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:05.537691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 64954a7e-48d5-46ef-a29a-2d740ff4dae4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:05.616880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.619652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.625472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:05.629005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:05.709499 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 HTTP/1.1 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '64954a7e-48d5-46ef-a29a-2d740ff4dae4'} Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.730943 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.735605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 64954a7e-48d5-46ef-a29a-2d740ff4dae4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:05.741551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93afe896-50ae-4ac1-a271-4fc7ddf719e1 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4" status: 404 len: 111 microversion: 2.1 time: 0.231031 Jul 14 15:15:05.775305 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2724/5299] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:05 2022] GET /compute/v2.1/servers/64954a7e-48d5-46ef-a29a-2d740ff4dae4 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:05.779223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-936d76f7-fcf3-431c-b741-8153e5d348df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:05.790167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-936d76f7-fcf3-431c-b741-8153e5d348df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 2363d069-7fda-4e92-9113-5c7f2023758f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:05.822544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=36 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:05.865392 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-936d76f7-fcf3-431c-b741-8153e5d348df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-936d76f7-fcf3-431c-b741-8153e5d348df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f HTTP/1.1 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2363d069-7fda-4e92-9113-5c7f2023758f'} Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.882768 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.897068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-936d76f7-fcf3-431c-b741-8153e5d348df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:05.900498 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-936d76f7-fcf3-431c-b741-8153e5d348df tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f" status: 404 len: 111 microversion: 2.1 time: 0.124991 Jul 14 15:15:05.918487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ace8e9b5-5314-44c1-978f-2cbea17d4809 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:05.919380 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2576/5300] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:05 2022] DELETE /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:05.922916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ace8e9b5-5314-44c1-978f-2cbea17d4809 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: 2363d069-7fda-4e92-9113-5c7f2023758f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:05.968331 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ace8e9b5-5314-44c1-978f-2cbea17d4809 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ace8e9b5-5314-44c1-978f-2cbea17d4809 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f HTTP/1.1 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2363d069-7fda-4e92-9113-5c7f2023758f'} Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:05.974452 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:05.978508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:05.978508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:05.978508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. Jul 14 15:15:05.978508 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:05.982898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ace8e9b5-5314-44c1-978f-2cbea17d4809 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance 2363d069-7fda-4e92-9113-5c7f2023758f could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:05.988553 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ace8e9b5-5314-44c1-978f-2cbea17d4809 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f" status: 404 len: 111 microversion: 2.1 time: 0.078162 Jul 14 15:15:05.994191 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2725/5301] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:05 2022] GET /compute/v2.1/servers/2363d069-7fda-4e92-9113-5c7f2023758f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:06.022715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:06.033337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:06.035144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:06.036242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:06.107137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.108177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.115084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.116580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.118293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.123346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.125021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.125988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.200971 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 HTTP/1.1 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'cf5f0954-5fd0-4d23-90fa-81709549b750'} Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:06.205057 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.209423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.215636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:06.220320 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f02cdaf-507e-468a-b72e-82fe779fc6bd tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 404 len: 111 microversion: 2.1 time: 0.190124 Jul 14 15:15:06.221401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2726/5302] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:06 2022] DELETE /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 111 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:15:06.232940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:06.236192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] [instance: cf5f0954-5fd0-4d23-90fa-81709549b750] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:06.256682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.260149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.261840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.263911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.290501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:15:06.299459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] HTTP exception thrown: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Request method failure captured: Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 HTTP/1.1 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DDwZ8D0UrfQmbZEJ-wPIIDJqdHx6ol5ZO30RtarMT0cOioCm2u1ekOiy1ZwwOPWXiS4MveFGB81iKuWgMQzlHMRrXMtg32PY9kWV5byGir2FejvgOCcwaVqLNe-_OC_VjtveIS0-2FaMC3SiSsTQrBlJZA139LIjo7tVoODoE7BR8Q Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a800489ef5a24105b8f9eaee334937c1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a800489ef5a24105b8f9eaee334937c1 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1113588699 Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ed79aa2ea715471bb970282c9e8dfd7d Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-AttachVolumeNegativeTest-1113588699-project Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'cf5f0954-5fd0-4d23-90fa-81709549b750'} Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:06.302060 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. Jul 14 15:15:06.306433 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:15:06.309846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] Returning 404 to user: Instance cf5f0954-5fd0-4d23-90fa-81709549b750 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:06.314922 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3713b394-115b-4a45-ac59-a3744f6a023f tempest-AttachVolumeNegativeTest-1113588699 tempest-AttachVolumeNegativeTest-1113588699-project] 10.222.0.98 "GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750" status: 404 len: 111 microversion: 2.1 time: 0.086129 Jul 14 15:15:06.319167 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2727/5303] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:06 2022] GET /compute/v2.1/servers/cf5f0954-5fd0-4d23-90fa-81709549b750 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:06.759487 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c593ac02-b951-4bec-a43c-34a8f79dbb95 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "DELETE /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 204 len: 0 microversion: 2.1 time: 0.761039 Jul 14 15:15:06.768095 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2577/5304] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:15:05 2022] DELETE /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 0 bytes in 771 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:15:06.783671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:06.784326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:06.797886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.804085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:06.805044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:06.805523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:08.235803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:08.309437 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b00f3b41-d822-4563-b3bd-1bfa82477369 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1478 microversion: 2.1 time: 1.529760 Jul 14 15:15:08.326369 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2728/5305] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:06 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1478 bytes in 1546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:08.544212 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:15:08.544477 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:15:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:15:09.343982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:09.356577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:09.407497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:09.410232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:09.412264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:09.413399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:11.079761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:11.092826 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c137ce30-c562-42d9-95be-50cc5f6c2491 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1478 microversion: 2.1 time: 1.757891 Jul 14 15:15:11.099129 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2578/5306] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:09 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1478 bytes in 1765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:12.145089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:12.152689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:12.212528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:12.229087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:12.233653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:12.237201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:12.363454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1117937176", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:12.421020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:12.698808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] validate_networks() for [('a573bb3c-2bdb-414c-9b03-70fdb5ec8e73', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:15:13.159727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0110507279914488aca33cec9a2fc9f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e413ee06c0848c3bbdad2e46c394e69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:13.196178 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cd1acdf-cc29-4252-a16e-9f2cba3c9c98 tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 200 len: 1436 microversion: 2.1 time: 1.061885 Jul 14 15:15:13.212850 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2579/5307] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:12 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 1436 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:13.457962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6a3616f4-e801-4083-9454-e00ac4dfc332 req-de1c87bc-5c8d-405b-9d81-ff517ebfd70b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec1f760-02b1-44a0-88d9-830fc289c4aa", "name": "network-vif-deleted", "tag": "6b2d320e-e238-4637-9d1c-fd5901eb0e31"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:13.506810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a3616f4-e801-4083-9454-e00ac4dfc332 req-de1c87bc-5c8d-405b-9d81-ff517ebfd70b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:13.527067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a3616f4-e801-4083-9454-e00ac4dfc332 req-de1c87bc-5c8d-405b-9d81-ff517ebfd70b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:13.578759 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6a3616f4-e801-4083-9454-e00ac4dfc332 req-de1c87bc-5c8d-405b-9d81-ff517ebfd70b service nova] Creating event network-vif-deleted:6b2d320e-e238-4637-9d1c-fd5901eb0e31 for instance eec1f760-02b1-44a0-88d9-830fc289c4aa on n-h1-768852-23 Jul 14 15:15:13.615718 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6a3616f4-e801-4083-9454-e00ac4dfc332 req-de1c87bc-5c8d-405b-9d81-ff517ebfd70b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171161 Jul 14 15:15:13.631808 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2580/5308] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:14.236918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:14.250437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] [instance: eec1f760-02b1-44a0-88d9-830fc289c4aa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:14.284433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:14.296282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:14.301262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:14.302575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:14.418626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:15:14.419693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:15:14.419693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:15:14.419983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:15:14.420370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:15:14.425233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] HTTP exception thrown: Instance eec1f760-02b1-44a0-88d9-830fc289c4aa could not be found. Jul 14 15:15:14.441253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Request method failure captured: Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa HTTP/1.1 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DG92LEaKtNv-FF7USPeyEBYuBybGml-yEIPqf3Xzfa9Z9eOg4bKmdOe_OzqChqRfNtjEG7hvEBWnKHFdoOgorzBdAnCwdaS1NtkC7Bdm7AS_f0zZAlua2C5X6a8DLoqPSQHITFZ86LvAQZOXejBAKRj4TMcRD6VJgt4vE4o3H0j0hA Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e413ee06c0848c3bbdad2e46c394e69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersTestJSON-1918820215 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 2e413ee06c0848c3bbdad2e46c394e69 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersTestJSON-1918820215 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 0110507279914488aca33cec9a2fc9f0 Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersTestJSON-1918820215-project Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance eec1f760-02b1-44a0-88d9-830fc289c4aa could not be found. Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'eec1f760-02b1-44a0-88d9-830fc289c4aa'} Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec1f760-02b1-44a0-88d9-830fc289c4aa could not be found. Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec1f760-02b1-44a0-88d9-830fc289c4aa could not be found. Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:14.441798 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec1f760-02b1-44a0-88d9-830fc289c4aa could not be found. Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:15:14.445623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] Returning 404 to user: Instance eec1f760-02b1-44a0-88d9-830fc289c4aa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:15:14.449042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:14.453230 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a8e67e2-a9a4-405a-9de3-364af333fbae tempest-ServersTestJSON-1918820215 tempest-ServersTestJSON-1918820215-project] 10.222.0.98 "GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa" status: 404 len: 111 microversion: 2.1 time: 0.236030 Jul 14 15:15:14.454169 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2581/5309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:14 2022] GET /compute/v2.1/servers/eec1f760-02b1-44a0-88d9-830fc289c4aa => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:15:14.454508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:14.455168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:14.586676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Getting quotas for project 105c133485b84b21a9b029141b5053ad. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:15:14.626383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Getting quotas for user 83513b7f5185436b8ea320c025f673af and project 105c133485b84b21a9b029141b5053ad. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:15:14.712508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:15:14.719254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:15:15.008038 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2f341f8-ee32-4451-95fb-b07b78f1d3dd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.325227 Jul 14 15:15:15.023902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9b661ab-eaee-40d2-9173-df3b1ffc55b9 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:15.025079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9b661ab-eaee-40d2-9173-df3b1ffc55b9 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:15.027473 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2729/5310] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:15:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 3335 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:15:15.499546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c9b661ab-eaee-40d2-9173-df3b1ffc55b9 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:15.524658 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9b661ab-eaee-40d2-9173-df3b1ffc55b9 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1214 microversion: 2.1 time: 0.506464 Jul 14 15:15:15.541260 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2582/5311] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:15 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1214 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:16.561585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:16.562657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:16.607450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:16.622788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:16.628473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:16.637832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:17.521025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:17.533676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1f965e0-485a-4e6d-96ba-5d87d99e9d01 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1218 microversion: 2.1 time: 0.981458 Jul 14 15:15:17.545838 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2730/5312] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:16 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1218 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:18.554616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:18.555801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:18.586492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:18.594519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:18.596247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:18.596722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:19.036291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:19.064487 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ede9621-8b50-4d1d-b3b2-8cd20399edef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1272 microversion: 2.1 time: 0.508085 Jul 14 15:15:19.067968 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2583/5313] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:18 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1272 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:20.088677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:20.100333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:20.145877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:20.155938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:20.157113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:20.157848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:21.412572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:21.453508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6cf17078-7e57-4868-bc0c-3449e7b15f84 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1272 microversion: 2.1 time: 1.369017 Jul 14 15:15:21.473551 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2731/5314] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:20 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1272 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:22.486441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:22.487471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:22.543843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:22.545979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:22.553173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:22.556064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:22.920304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:22.934619 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7df17f5-5a1e-4e2d-9693-c0b4bd7654ea tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1272 microversion: 2.1 time: 0.457551 Jul 14 15:15:22.949398 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2584/5315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:22 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1272 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:23.962496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:23.963217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:23.978396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:23.983880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:23.984859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:23.987535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:24.497570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:24.683521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:25.350579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:25.355752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:25.388520 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4ec7922-95e6-4dda-84aa-d308e96ae8a3 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1314 microversion: 2.1 time: 1.427675 Jul 14 15:15:25.393011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2732/5316] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:23 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1314 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:25.591856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8b145d1b-b2cd-4161-bce1-d7e8b2bb97bf req-0c25cbaf-5baa-4a1a-a276-dd7e296cdad5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0ee153-435d-4257-a56a-f1a06c96f6c7", "tag": "baf3c878-9d47-4bc9-8999-defe11674a76"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:25.604640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:25.645195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b145d1b-b2cd-4161-bce1-d7e8b2bb97bf req-0c25cbaf-5baa-4a1a-a276-dd7e296cdad5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:25.645868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b145d1b-b2cd-4161-bce1-d7e8b2bb97bf req-0c25cbaf-5baa-4a1a-a276-dd7e296cdad5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:25.690438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:25.696491 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8b145d1b-b2cd-4161-bce1-d7e8b2bb97bf req-0c25cbaf-5baa-4a1a-a276-dd7e296cdad5 service nova] Creating event network-changed:baf3c878-9d47-4bc9-8999-defe11674a76 for instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 on n-h1-768852-23 Jul 14 15:15:25.718062 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8b145d1b-b2cd-4161-bce1-d7e8b2bb97bf req-0c25cbaf-5baa-4a1a-a276-dd7e296cdad5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132375 Jul 14 15:15:25.721901 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2585/5317] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:26.415780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:26.417454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:26.472569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:26.473307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:26.480651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:26.481527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:27.377397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:27.387037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4919693e-348a-408f-adbe-30db12b5297d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1314 microversion: 2.1 time: 0.977219 Jul 14 15:15:27.404398 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2733/5318] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:26 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1314 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:28.426407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:28.430196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:28.443046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:28.444607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:28.446113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:28.446740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:30.627984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:30.640162 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2d30323-8144-4030-88bf-3450832f4139 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1314 microversion: 2.1 time: 2.233352 Jul 14 15:15:30.641403 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2586/5319] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:28 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1314 bytes in 2236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:31.678123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:31.678984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:31.716741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:31.717551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:31.719132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:31.728451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:33.341304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:33.357506 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-03155b1c-4f2e-48f8-85bb-006078ade339 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1314 microversion: 2.1 time: 1.686095 Jul 14 15:15:33.367714 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2734/5320] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:31 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1314 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:34.413290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:34.417697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:34.435922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.435922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.436447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.467193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.733005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-cf51c4c4-2165-4660-ba40-08584f693fa4 req-629f2545-b08d-4e6f-9e7d-adfa2aa73ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ee153-435d-4257-a56a-f1a06c96f6c7", "name": "network-vif-plugged", "status": "completed", "tag": "baf3c878-9d47-4bc9-8999-defe11674a76"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:34.779628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cf51c4c4-2165-4660-ba40-08584f693fa4 req-629f2545-b08d-4e6f-9e7d-adfa2aa73ff8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:34.788210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-cf51c4c4-2165-4660-ba40-08584f693fa4 req-629f2545-b08d-4e6f-9e7d-adfa2aa73ff8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:34.865978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-cf51c4c4-2165-4660-ba40-08584f693fa4 req-629f2545-b08d-4e6f-9e7d-adfa2aa73ff8 service nova] Creating event network-vif-plugged:baf3c878-9d47-4bc9-8999-defe11674a76 for instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 on n-h1-768852-23 Jul 14 15:15:34.895251 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-cf51c4c4-2165-4660-ba40-08584f693fa4 req-629f2545-b08d-4e6f-9e7d-adfa2aa73ff8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171111 Jul 14 15:15:34.900304 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2735/5321] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:15:35.313385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:35.332397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8aaf34db-3afa-436f-8d57-454471a008cb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1314 microversion: 2.1 time: 0.927023 Jul 14 15:15:35.336207 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2587/5322] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:34 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1314 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:36.369314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:36.377937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:36.463813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:36.466893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:36.470207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:36.489013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:37.236079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:37.258240 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4d5e3606-3f1c-48b0-b7d5-656cac6eac4a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1314 microversion: 2.1 time: 0.899831 Jul 14 15:15:37.263313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2736/5323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:36 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:38.290857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:38.292400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:38.312778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:38.317143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:38.322098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:38.323005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:38.329115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:39.554693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:39.623181 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-171965e8-70b5-45a8-a03b-b55d231a7292 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1499 microversion: 2.1 time: 1.335755 Jul 14 15:15:39.629764 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2588/5324] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:38 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1499 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:39.658081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:15:39.660652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:39.737435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:39.748655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:39.752509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:39.753233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:39.913126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lazy-loading 'flavor' on Instance uuid 7a0ee153-435d-4257-a56a-f1a06c96f6c7 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:15:40.214562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed57eb13-bcbe-4dac-8584-22272da2bc66 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "POST /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7/action" status: 200 len: 32 microversion: 2.1 time: 0.573340 Jul 14 15:15:40.232592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2737/5325] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:15:39 2022] POST /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7/action => generated 32 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:15:40.259145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:40.263430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:40.306305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:40.309961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:40.313882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:40.317578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:41.326658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:41.367163 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c57f1f6d-031a-40a1-bbf2-c3f176eb2138 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 1.129029 Jul 14 15:15:41.368210 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2589/5326] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:40 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:15:42.391442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:42.393365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:42.449690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:42.459860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:42.461463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:42.462227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:42.912523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:42.926972 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d3bda92-af01-4f66-9fbf-5cecff626c5f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.538771 Jul 14 15:15:42.941291 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2738/5327] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:42 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:43.948577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:43.949278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:43.965536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:43.966031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:43.966822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:43.967286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:44.433690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:44.442383 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ac8a6a1-713a-455f-9380-53f44541efbb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.498275 Jul 14 15:15:44.447365 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2590/5328] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:43 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:45.463709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:45.464235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:45.470770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:45.515820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:45.523652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:45.531773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:45.532350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:45.895566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:45.921414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-111c6e8c-54c9-40ce-8b4c-1ac36d6e974e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.461933 Jul 14 15:15:45.922814 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2739/5329] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:45 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:46.941616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:46.942456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:46.968160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:46.969078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:46.970182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:46.970893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:47.794277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:47.810285 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f6d95f4-c813-4538-be6a-3b5742e5ac5c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.874483 Jul 14 15:15:47.812334 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2591/5330] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:46 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:48.852293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:48.854552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:48.870376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:48.888494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:48.890044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:48.891819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:49.236228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:49.245515 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7489b412-08c8-49d5-95a7-1eba7e4f8218 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.403848 Jul 14 15:15:49.252008 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2740/5331] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:48 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:50.272744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:50.278854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:50.305502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:50.316045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:50.321850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:50.323468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:50.750312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:50.760462 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2090b2d7-c68b-4202-90f4-4ea351744cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.494515 Jul 14 15:15:50.761623 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2592/5332] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:50 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:51.782607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:51.783408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:51.808321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:51.808598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:51.822810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:51.823304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:52.211819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:52.227027 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d99f4f7-3e7f-4342-a0f4-bf8c1a167d07 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.449201 Jul 14 15:15:52.228420 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2741/5333] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:51 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:53.245554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:53.246077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:53.261395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:53.261860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:53.262677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:53.263120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:53.624993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:53.641408 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7dfb48e-2201-469e-9ec8-5fe2d6396f30 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.400501 Jul 14 15:15:53.642570 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2593/5334] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:53 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:54.662784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:54.665145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:54.675964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:54.676826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:54.677844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:54.678511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:55.017498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:55.028918 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94c73c50-c293-4df1-9f6a-00a6f00be298 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.372510 Jul 14 15:15:55.037186 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2742/5335] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:54 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:56.066953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:56.080479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:56.109138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:56.111991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:56.113587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:56.114478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:56.605746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:56.629927 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4f81d3cd-ffcc-4e7d-8e63-0f542b354ee0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.573704 Jul 14 15:15:56.642075 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2594/5336] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:56 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:57.656177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:57.657013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:57.694448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:57.694924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:57.701629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:57.705627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:57.734413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:58.228728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:58.251967 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65a2f035-1575-4caa-96e1-12f9ad88f7b5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.606730 Jul 14 15:15:58.275012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2743/5337] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:57 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:15:59.279830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:15:59.280536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:15:59.294139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:59.294603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:59.298805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:15:59.301776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:15:59.319206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=56 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:15:59.689670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:15:59.711545 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-88fc57cd-c74c-4647-9b2a-018a8f3ba493 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1505 microversion: 2.1 time: 0.438202 Jul 14 15:15:59.713581 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2595/5338] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:15:59 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1505 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:00.760069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:00.763681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:00.794119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:00.796323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:00.799648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:00.800115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:01.415338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:01.463685 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a00cbb8b-d741-45a9-a411-032c317238ac tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1485 microversion: 2.1 time: 0.718388 Jul 14 15:16:01.467002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2744/5339] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:00 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1485 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:01.977358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-132658301", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:02.145212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] validate_networks() for [('a573bb3c-2bdb-414c-9b03-70fdb5ec8e73', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:16:04.110124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:16:04.110764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:16:04.111130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:16:04.112874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:16:04.113347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:16:04.146342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:04.146809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:04.147678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:04.152840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:04.222667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Getting quotas for project 105c133485b84b21a9b029141b5053ad. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:16:04.245920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Getting quotas for user 83513b7f5185436b8ea320c025f673af and project 105c133485b84b21a9b029141b5053ad. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:16:04.321396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:16:04.328918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:16:04.523332 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d18f6d59-67a1-4447-a45f-c124972b93fa tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.550194 Jul 14 15:16:04.529561 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2596/5340] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:16:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:16:04.557693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1eeeee4d-99f2-459d-a117-92d36a0aef2d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:04.565448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1eeeee4d-99f2-459d-a117-92d36a0aef2d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:04.803762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1eeeee4d-99f2-459d-a117-92d36a0aef2d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:04.814632 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1eeeee4d-99f2-459d-a117-92d36a0aef2d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1213 microversion: 2.1 time: 0.277468 Jul 14 15:16:04.924551 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2745/5341] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:04 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1213 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:05.842534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:05.843566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:05.860473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:05.861285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:05.863885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:05.864485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:06.136352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:06.148885 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c974b7d-74d2-40b6-9d2d-994a0e908aef tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1217 microversion: 2.1 time: 0.310958 Jul 14 15:16:06.153177 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2597/5342] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:05 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:07.198816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:07.199779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:08.108849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:08.109534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:08.110791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:08.125370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:08.385957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:08.406212 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37111917-2207-419c-90eb-09a4197f0113 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1271 microversion: 2.1 time: 1.229375 Jul 14 15:16:08.409127 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2746/5343] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:07 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1271 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:09.428012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:09.429930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:09.435737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:09.504262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:09.504910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:09.515736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:09.516376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:10.323604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:10.340542 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c385cec9-7068-4b96-92d8-54fc9efac801 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.916918 Jul 14 15:16:10.341443 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2598/5344] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:09 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:11.360253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:11.361103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:11.384780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:11.386398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:11.387660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:11.388303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:11.424424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5434aad0-6c1c-450c-b102-69efb4960060 req-3ca4d6fc-7a51-419f-a9bb-1c8f7f102308 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d856fda-bd21-4d44-add4-3fe0d06429cb", "tag": "aedb7f7b-7ab7-40fc-babc-7e037e03ad51"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:11.481350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5434aad0-6c1c-450c-b102-69efb4960060 req-3ca4d6fc-7a51-419f-a9bb-1c8f7f102308 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:11.485803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5434aad0-6c1c-450c-b102-69efb4960060 req-3ca4d6fc-7a51-419f-a9bb-1c8f7f102308 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:11.536206 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5434aad0-6c1c-450c-b102-69efb4960060 req-3ca4d6fc-7a51-419f-a9bb-1c8f7f102308 service nova] Creating event network-changed:aedb7f7b-7ab7-40fc-babc-7e037e03ad51 for instance 2d856fda-bd21-4d44-add4-3fe0d06429cb on n-h2-768852-23 Jul 14 15:16:11.546227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5434aad0-6c1c-450c-b102-69efb4960060 req-3ca4d6fc-7a51-419f-a9bb-1c8f7f102308 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141389 Jul 14 15:16:11.548745 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2599/5345] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:11.926256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:11.945667 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-63692dba-8c82-4ce9-ba13-05b8d96bed4b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.591110 Jul 14 15:16:11.951377 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2747/5346] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:11 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:12.972404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:12.973247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:13.023018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:13.024473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:13.032949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:13.034519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:13.482430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:13.508735 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a83d7ca-119a-4469-9867-cc148f23a55c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.542902 Jul 14 15:16:13.511634 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2600/5347] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:12 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:14.544197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:14.546107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:14.566476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:14.566940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:14.567778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:14.582955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:14.815815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:14.996460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:15.006698 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06af88f6-36c3-4c5f-b64d-4528cb9efa10 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.476631 Jul 14 15:16:15.016292 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2748/5348] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:14 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:15.640110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1999784648", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f57468b4-14e5-453f-a8e9-10f5a9bd5efe"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:15.657027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:15.660972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:15.754385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] validate_networks() for [('f57468b4-14e5-453f-a8e9-10f5a9bd5efe', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:16:16.025096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:16.025776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:16.029966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=22 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:16.044076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:16.044579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:16.053024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:16.053910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:16.453781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:16.465213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b24819c0-2caf-4586-81ab-4fa5db0b3c80 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.444081 Jul 14 15:16:16.466541 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2749/5349] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:16 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:17.308919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:16:17.309463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:16:17.309947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:16:17.310519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:16:17.311534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:16:17.337737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:17.338245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:17.340104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:17.340564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:17.404186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Getting quotas for project 178964408b17444d8a2c38c9b3e64359. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:16:17.441514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Getting quotas for user 450b7ea9a4e44d149bd7ea40eaf0d31d and project 178964408b17444d8a2c38c9b3e64359. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:16:17.482974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:17.484732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:17.501230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:17.506364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:17.507509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:17.516456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:17.523436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:16:17.526705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:16:17.720096 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b9b93cd9-45af-42ed-9289-683f6c3c6ab4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.082052 Jul 14 15:16:17.730611 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2601/5350] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:16:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:16:17.749961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-049ae63e-8ae8-4d5e-ba1f-417961a88808 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:17.752633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-049ae63e-8ae8-4d5e-ba1f-417961a88808 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:17.899759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:17.905831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-049ae63e-8ae8-4d5e-ba1f-417961a88808 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:17.909508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7158b96-851e-4e7d-b99b-a0c45700e752 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.431088 Jul 14 15:16:17.918538 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-049ae63e-8ae8-4d5e-ba1f-417961a88808 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1214 microversion: 2.1 time: 0.186280 Jul 14 15:16:17.919996 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2750/5351] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:17 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:17.920823 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2602/5352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:17 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1214 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:17.949356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-956402d9-a94f-4998-8e63-695cb105741d req-8879c2e3-5eeb-4410-bf03-1ba3f3e11a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d856fda-bd21-4d44-add4-3fe0d06429cb", "name": "network-vif-plugged", "status": "completed", "tag": "aedb7f7b-7ab7-40fc-babc-7e037e03ad51"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:17.966485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-956402d9-a94f-4998-8e63-695cb105741d req-8879c2e3-5eeb-4410-bf03-1ba3f3e11a41 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:17.967400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-956402d9-a94f-4998-8e63-695cb105741d req-8879c2e3-5eeb-4410-bf03-1ba3f3e11a41 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:17.988990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-956402d9-a94f-4998-8e63-695cb105741d req-8879c2e3-5eeb-4410-bf03-1ba3f3e11a41 service nova] Creating event network-vif-plugged:aedb7f7b-7ab7-40fc-babc-7e037e03ad51 for instance 2d856fda-bd21-4d44-add4-3fe0d06429cb on n-h2-768852-23 Jul 14 15:16:17.996852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-956402d9-a94f-4998-8e63-695cb105741d req-8879c2e3-5eeb-4410-bf03-1ba3f3e11a41 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061380 Jul 14 15:16:17.999303 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2751/5353] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:18.968199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:18.969451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:18.973632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:18.983611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:19.028185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:19.029634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:19.032189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:19.037617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:19.039444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:19.044568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:19.051179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:19.057705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:19.387833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:19.423195 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f19e830-1b11-4cb3-97c6-d831f1c2ab78 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1218 microversion: 2.1 time: 0.477510 Jul 14 15:16:19.435488 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2752/5354] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:18 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1218 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:19.545994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:19.565474 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3de455d2-4ea2-4a31-af85-c0d666afe1d2 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1313 microversion: 2.1 time: 0.633345 Jul 14 15:16:19.566146 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2603/5355] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:18 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1313 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:20.453041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:20.454656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:20.483102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:20.486077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:20.487514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:20.489239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:20.582874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:20.583502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:20.603340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:20.608405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:20.609272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:20.609725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:20.717237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:20.729980 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b68b4cde-88c2-49aa-a978-d2a647db4312 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1274 microversion: 2.1 time: 0.284881 Jul 14 15:16:20.742592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2753/5356] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:20 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1274 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:21.305306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:21.338057 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79d7a552-1a15-4793-b321-5d806fa253f5 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1498 microversion: 2.1 time: 0.755274 Jul 14 15:16:21.339336 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2604/5357] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:20 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1498 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:21.372106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:21.384319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:21.406383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:21.406843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:21.407697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:21.408161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:21.491617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lazy-loading 'flavor' on Instance uuid 2d856fda-bd21-4d44-add4-3fe0d06429cb {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:16:21.749637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:21.750390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:21.782572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:21.785390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:21.787592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:21.792823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:21.926385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7e0c8f6-e55f-4d0b-a75a-3267e8cafa87 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "POST /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb/action" status: 200 len: 32 microversion: 2.1 time: 0.552065 Jul 14 15:16:21.932381 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2754/5358] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:16:21 2022] POST /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb/action => generated 32 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:16:21.966212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:21.967624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:21.995985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:21.996442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:21.998277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:21.998731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:22.566953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:22.583679 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9de95d39-76c5-4a6b-a45a-5d82dffd0c7a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.641578 Jul 14 15:16:22.587736 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2755/5359] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:21 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:23.604541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:23.607476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:23.630792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:23.631563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:23.650305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:23.653079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:24.141933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:24.161737 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-93f66fc3-4820-4c32-b016-130724d81fc0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.562366 Jul 14 15:16:24.171903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2756/5360] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:23 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:24.484969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:24.557579 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13449347-5eb9-4b49-9675-7f6cdc5ffe75 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 2.794680 Jul 14 15:16:24.565264 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2605/5361] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:21 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 2822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:25.205498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:25.206471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:25.282859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:25.297399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:25.301416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:25.304156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:25.601459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:25.602300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:25.651828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:25.657041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:25.659785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:25.662984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:26.248337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:26.297366 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bf0768f3-56bf-403e-a492-7f4deb51c9fe tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 1.117407 Jul 14 15:16:26.328553 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2757/5362] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:25 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:27.200571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:27.263791 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-111fc064-3459-4c62-8925-6ac33c8a46b1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 1.672850 Jul 14 15:16:27.284074 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2606/5363] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:25 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:27.344591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:27.345971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:27.357612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:27.362372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:27.365230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:27.368383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:27.792228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:27.822327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ccf8abf5-1c9e-46d0-bf5a-c69ca856e122 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.481681 Jul 14 15:16:27.824597 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2758/5364] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:27 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:28.304598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:28.305741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:28.322135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:28.330631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:28.372269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:28.376393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:28.380727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:28.386089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:28.845943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:28.847572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:28.871663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:28.872202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:28.874441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:28.879593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:28.885208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:29.312373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:29.328003 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17361037-4913-4789-95da-070b3f6abbf7 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 1.029506 Jul 14 15:16:29.330591 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2607/5365] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:28 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:29.631592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:29.671374 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80b61b9f-50f1-439f-8ade-8cb81bbfd7f1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.829932 Jul 14 15:16:29.703628 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2759/5366] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:28 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:29.872261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e2f81c5c-49b9-49d1-b1a8-df04009a7fd5 req-f03f7325-05c9-4667-8317-12cd3f43e582 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07ddec6-6f84-4f94-b6a1-d47e27448dd1", "tag": "416ebf57-8a12-494b-a023-ad0d24d5b304"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:29.900402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e2f81c5c-49b9-49d1-b1a8-df04009a7fd5 req-f03f7325-05c9-4667-8317-12cd3f43e582 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:29.901744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e2f81c5c-49b9-49d1-b1a8-df04009a7fd5 req-f03f7325-05c9-4667-8317-12cd3f43e582 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:29.928665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=60 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:29.933149 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e2f81c5c-49b9-49d1-b1a8-df04009a7fd5 req-f03f7325-05c9-4667-8317-12cd3f43e582 service nova] Creating event network-changed:416ebf57-8a12-494b-a023-ad0d24d5b304 for instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 on n-h1-768852-23 Jul 14 15:16:29.968545 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e2f81c5c-49b9-49d1-b1a8-df04009a7fd5 req-f03f7325-05c9-4667-8317-12cd3f43e582 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101542 Jul 14 15:16:29.969337 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2608/5367] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:30.351972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:30.352925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:30.372885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:30.385483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:30.386885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:30.387653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:30.694451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:30.696630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:30.725817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:30.726226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:30.727054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:30.732037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:30.770710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:30.782603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e995bd8-8c10-46e3-b096-70baa6fd209d tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 0.435367 Jul 14 15:16:30.783850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2760/5368] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:30 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:31.145640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:31.174077 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95920116-034e-483f-b690-e9fa04dc15ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.485691 Jul 14 15:16:31.177864 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2609/5369] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:30 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:31.817037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:31.818117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:31.851955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:31.852991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:31.872035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:31.880545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:32.206911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:32.208172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:32.227819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:32.242300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:32.246411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:32.252019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:32.699525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:32.721887 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-163f43d3-5b4e-4989-b8db-b4c516cc617e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 0.924072 Jul 14 15:16:32.727035 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2761/5370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:31 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:33.675174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:33.711330 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45523475-b4aa-4b11-a364-189fab2f7e2a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 1.504288 Jul 14 15:16:33.714693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2610/5371] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:32 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:33.756795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:33.758441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:33.782526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:33.787073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:33.788784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:33.793820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:34.313979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:34.334210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b70fddd-eeba-4618-a634-624aeda56324 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 0.583359 Jul 14 15:16:34.335946 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2762/5372] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:33 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:34.735622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:34.736509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:34.766126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:34.767368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:34.771778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:34.776744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:35.357761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:35.358346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:35.364306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:35.375911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:35.376437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:35.377173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:35.377624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:35.389344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a515abd0-5594-4ef2-a9dc-232a6bc35cfb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.662242 Jul 14 15:16:35.394441 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2611/5373] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:34 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:36.415587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:36.424791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:36.425444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:36.436224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1a85f78-b03e-4247-9c38-6b9e69012591 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 1.080530 Jul 14 15:16:36.442965 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2763/5374] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:35 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:36.456539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:36.457667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:36.467779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:36.469045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:37.005075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:37.024289 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ddcd95d-000a-4a73-ab68-5de820c9b757 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.615445 Jul 14 15:16:37.026134 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2612/5375] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:36 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:37.492285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:37.502526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:37.546592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:37.548433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:37.560625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:37.561803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.042999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:38.043658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:38.076408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.076943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.077921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.078379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.819342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:38.832937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f58500bf-b62f-454c-960a-e349eb6f2b0a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.793278 Jul 14 15:16:38.834285 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2613/5376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:38 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:38.856059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-57e7e4be-30ac-4be6-9f39-4e73637f9df6 req-6ba4aadd-0424-4de1-86f0-14280debe6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07ddec6-6f84-4f94-b6a1-d47e27448dd1", "name": "network-vif-plugged", "status": "completed", "tag": "416ebf57-8a12-494b-a023-ad0d24d5b304"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:38.859299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:38.869289 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-434c5609-6778-4c0c-b5c9-56c45860ead4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 1.416408 Jul 14 15:16:38.878459 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2764/5377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:37 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 1428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:38.897058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57e7e4be-30ac-4be6-9f39-4e73637f9df6 req-6ba4aadd-0424-4de1-86f0-14280debe6d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:38.897658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57e7e4be-30ac-4be6-9f39-4e73637f9df6 req-6ba4aadd-0424-4de1-86f0-14280debe6d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:38.936630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-57e7e4be-30ac-4be6-9f39-4e73637f9df6 req-6ba4aadd-0424-4de1-86f0-14280debe6d8 service nova] Creating event network-vif-plugged:416ebf57-8a12-494b-a023-ad0d24d5b304 for instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 on n-h1-768852-23 Jul 14 15:16:38.951050 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-57e7e4be-30ac-4be6-9f39-4e73637f9df6 req-6ba4aadd-0424-4de1-86f0-14280debe6d8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114579 Jul 14 15:16:38.957643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2614/5378] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:39.854981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:39.855634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:39.875896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:39.876513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:39.877036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:39.877478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:39.897220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:39.898775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:39.915453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:39.921001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:39.928208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:39.941668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:39.942798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:40.287174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:40.295645 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85d11b07-9b80-45a8-8757-625b8de8e361 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.445650 Jul 14 15:16:40.296263 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2765/5379] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:39 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:40.407531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1494438765", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f4583239-1585-47de-a051-cdfd124b6bfb"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:40.542903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] validate_networks() for [('f4583239-1585-47de-a051-cdfd124b6bfb', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:16:40.769749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:40.813620 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f2eb06c1-6b54-4dee-8d9f-3efc5cd390e6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1314 microversion: 2.1 time: 0.916862 Jul 14 15:16:40.822463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2615/5380] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:39 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1314 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:41.319045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:41.320246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:41.343203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:41.347075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:41.348939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:41.349883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:41.975634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:41.990236 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0b70cb25-ab76-4e04-b6c5-ad38b16750b7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.679432 Jul 14 15:16:41.992367 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2616/5381] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:41 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:42.020735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:42.021610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:42.060668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:42.061323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:42.069823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:42.073853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:42.728333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:42.734280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:16:42.735577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:16:42.736451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:16:42.738057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:16:42.739087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:16:42.749204 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8ea62d1-a618-41e1-9468-efe14297786c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1499 microversion: 2.1 time: 0.744488 Jul 14 15:16:42.749834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2617/5382] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:41 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1499 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:42.791879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:42.797941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:42.803491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:42.804472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:42.896316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Getting quotas for project 406107b53d424678a716867f11bebae2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:16:42.958722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Getting quotas for user df8c67406d8f4722a1234aad34c75194 and project 406107b53d424678a716867f11bebae2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:16:43.015137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:43.015840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:43.016879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:16:43.025295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:16:43.037685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:43.038315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:43.039632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:43.046651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:43.297724 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-751fa73e-ffca-49e5-8e8a-be8994cbe773 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.892239 Jul 14 15:16:43.302519 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2766/5383] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:16:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:16:43.329396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77b087d9-30cd-48db-85c5-9451e13bfd52 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:43.336384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77b087d9-30cd-48db-85c5-9451e13bfd52 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:43.651451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77b087d9-30cd-48db-85c5-9451e13bfd52 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:43.691450 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77b087d9-30cd-48db-85c5-9451e13bfd52 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1219 microversion: 2.1 time: 0.378047 Jul 14 15:16:43.719433 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2767/5384] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:43 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1219 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:43.745783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:43.753892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:43.791594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:43.800880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:43.807018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:43.808192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:43.989744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:43.998930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:16:44.002931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93b92e64-1ac2-4203-8f71-5e98706c7427 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.994567 Jul 14 15:16:44.007098 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2618/5385] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:43 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:44.300814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-242d2102-4464-4620-9d99-63c8992117bc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 204 len: 0 microversion: 2.1 time: 0.578364 Jul 14 15:16:44.301919 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2768/5386] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:16:43 2022] DELETE /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:16:44.314680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:44.316430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:44.342072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:44.343699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:44.345012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:44.345516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:44.727598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d64dbdd-ba41-4138-8f7f-cc9539e5a2cd tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:44.728430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d64dbdd-ba41-4138-8f7f-cc9539e5a2cd tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:45.231315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d64dbdd-ba41-4138-8f7f-cc9539e5a2cd tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:45.276937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d64dbdd-ba41-4138-8f7f-cc9539e5a2cd tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1219 microversion: 2.1 time: 0.537590 Jul 14 15:16:45.295556 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2769/5387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:44 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1219 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:45.310339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:45.312235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:45.327614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:45.333799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:45.336949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:45.340480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:45.812205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:45.821477 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ecc8ff6-4d23-4f40-bf31-c94a151e3dc7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.523880 Jul 14 15:16:45.822094 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2770/5388] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:45 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:46.235810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:46.256917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d0df018-9169-4faf-9172-2cb70629e44f tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1505 microversion: 2.1 time: 1.950299 Jul 14 15:16:46.258280 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2619/5389] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:44 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1505 bytes in 1953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:46.299361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:46.300120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:46.303073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:46.355047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:46.355835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:46.362091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:46.363875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:46.615315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:46.627354 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c07f4926-3225-49a1-9c98-7a520da14d65 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1271 microversion: 2.1 time: 0.332756 Jul 14 15:16:46.627994 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2771/5390] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:46 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1271 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:46.850821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:46.851496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:46.871049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:46.871580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:46.885037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:46.886046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:47.275590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:47.276539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:47.293313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:47.301097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:47.303599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:47.306192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:48.384761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:48.396457 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-08a3fdf8-e222-4b26-81cb-236dcd534990 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1505 microversion: 2.1 time: 1.125968 Jul 14 15:16:48.401705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2772/5391] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:47 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1505 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:48.423142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:48.430053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:48.459034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:48.465098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:48.472813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:48.477598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:48.709330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:48.724073 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4cb8aca2-3426-4b78-b12a-fec0f1f9e7d3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1277 microversion: 2.1 time: 0.319286 Jul 14 15:16:48.726116 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2773/5392] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:48 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1277 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:48.896730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:48.924614 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ca30264-48b6-4e89-82d1-f0c3210267d0 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 2.077362 Jul 14 15:16:48.931883 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2620/5393] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:46 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:49.430521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:49.431895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:49.448762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.450472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.452179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.453172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.750599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:49.761094 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d2c3e07-9833-4529-8fe7-1c0d8c7a3024 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1505 microversion: 2.1 time: 0.335700 Jul 14 15:16:49.761709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2774/5394] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:49 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:49.781164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:49.783548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:49.810409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.813886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.816370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.821077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.951144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:49.951987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:49.971113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.971621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:49.976668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:49.977141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:50.433456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:50.451294 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44c77666-bcf9-4d7e-a880-f97e629a81c4 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1277 microversion: 2.1 time: 0.698239 Jul 14 15:16:50.456078 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2621/5395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:49 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1277 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:50.792945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:50.794332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:50.818616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:50.822009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:50.827141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:50.828308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:51.205014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:51.223305 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-930e4f03-c709-4575-ae57-2719910223b6 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 200 len: 1463 microversion: 2.1 time: 0.436293 Jul 14 15:16:51.253832 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2622/5396] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:50 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 1463 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:51.283478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-734ccf4d-7551-4e8b-aabc-0811f76081c2 req-9a185cf1-6eca-4ba2-8fe5-56dd4a54cbad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07ddec6-6f84-4f94-b6a1-d47e27448dd1", "name": "network-vif-deleted", "tag": "416ebf57-8a12-494b-a023-ad0d24d5b304"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:51.324025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-734ccf4d-7551-4e8b-aabc-0811f76081c2 req-9a185cf1-6eca-4ba2-8fe5-56dd4a54cbad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:51.326056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-734ccf4d-7551-4e8b-aabc-0811f76081c2 req-9a185cf1-6eca-4ba2-8fe5-56dd4a54cbad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:51.358765 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-734ccf4d-7551-4e8b-aabc-0811f76081c2 req-9a185cf1-6eca-4ba2-8fe5-56dd4a54cbad service nova] Creating event network-vif-deleted:416ebf57-8a12-494b-a023-ad0d24d5b304 for instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 on n-h1-768852-23 Jul 14 15:16:51.366353 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-734ccf4d-7551-4e8b-aabc-0811f76081c2 req-9a185cf1-6eca-4ba2-8fe5-56dd4a54cbad service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110773 Jul 14 15:16:51.367590 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2623/5397] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:51.470800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:51.485530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:51.486463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:51.496683 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be493b14-25d7-43ee-875c-18166a2b89d8 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 1.549340 Jul 14 15:16:51.503018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:51.509196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:51.510704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:51.514580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:51.520957 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2775/5398] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:49 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:51.866377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:51.881045 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a2201a1b-49e9-49ce-8e5e-595e37ec1b86 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1277 microversion: 2.1 time: 0.399750 Jul 14 15:16:51.886645 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2624/5399] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:51 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1277 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:52.255580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:52.256822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: d07ddec6-6f84-4f94-b6a1-d47e27448dd1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:52.294394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.295153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.297018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.297799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.380226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] HTTP exception thrown: Instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 could not be found. Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Request method failure captured: Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 HTTP/1.1 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DM6nUq3iG8f0lbqugkUvy0EZ5LdQruw7f2xV6NWQuRBoq1bLLbuWVKr8th8iSkbjp3vwgk0GSFqZdc5P03NOoosuFxIlV3fiUU2Sb6IsFRF8rzHS4MEmK11yhnHq1xyRIp1qjYFQFgS8kaeHIDbh3kX3RuhuCZV6hGBClpEHnw3X98 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178964408b17444d8a2c38c9b3e64359 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesActionsTest-520379472 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178964408b17444d8a2c38c9b3e64359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178964408b17444d8a2c38c9b3e64359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178964408b17444d8a2c38c9b3e64359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178964408b17444d8a2c38c9b3e64359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesActionsTest-520379472 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178964408b17444d8a2c38c9b3e64359 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesActionsTest-520379472 Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesActionsTest-520379472-project Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 450b7ea9a4e44d149bd7ea40eaf0d31d Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesActionsTest-520379472-project Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 could not be found. Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'd07ddec6-6f84-4f94-b6a1-d47e27448dd1'} Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 could not be found. Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 could not be found. Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:16:52.396558 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 could not be found. Jul 14 15:16:52.401492 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:16:52.402578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Returning 404 to user: Instance d07ddec6-6f84-4f94-b6a1-d47e27448dd1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:16:52.420710 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ede2102c-f3de-4af6-b8d3-5e12769ca056 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1" status: 404 len: 111 microversion: 2.1 time: 0.174999 Jul 14 15:16:52.421779 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2776/5400] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:52 2022] GET /compute/v2.1/servers/d07ddec6-6f84-4f94-b6a1-d47e27448dd1 => generated 111 bytes in 183 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:16:52.533205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:52.534010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:52.555806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.557080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.558190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.558820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.916888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:52.921962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:52.950674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:52.961525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.967982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:52.974748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:52.977255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:53.072425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:53.390750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:53.417219 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc367d60-c42d-43e9-9c61-e1a291c6c2b1 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1484 microversion: 2.1 time: 0.889265 Jul 14 15:16:53.435596 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2625/5401] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:52 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1484 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:53.461508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9789e725-1bed-4abc-a563-9363b1863ae6 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Action: 'create', calling method: .version_select at 0x7fdbf2ad0dc0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-806348815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXvwkffIucPN4YLl0W2pewQVlznmCkFbkojKaXgWknMG5oqi1uWBIOYuCSy5qVCWBP2qy/SFXUBifENlGVZrc4WsLZA9DDkoKQxGRIM3xcMFreL9FIHyab3FfDQcQi23A=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:53.526218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9789e725-1bed-4abc-a563-9363b1863ae6 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Getting quotas for project 2e30ed5aa78f4ba5bdbeb80ddc88b38f. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:16:53.542402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-9789e725-1bed-4abc-a563-9363b1863ae6 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Getting quotas for user ab2ce820ae4f482283fe985fdb2fee84 and project 2e30ed5aa78f4ba5bdbeb80ddc88b38f. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:16:53.608350 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9789e725-1bed-4abc-a563-9363b1863ae6 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.171371 Jul 14 15:16:53.611098 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2626/5402] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:16:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:53.624720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-818563308", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f57468b4-14e5-453f-a8e9-10f5a9bd5efe"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:53.747333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] validate_networks() for [('f57468b4-14e5-453f-a8e9-10f5a9bd5efe', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:16:53.836453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:53.852221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b011bf4a-28b1-4aa0-b1c6-15eed24d7f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 0.946001 Jul 14 15:16:53.853278 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2777/5403] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:52 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:53.858363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:53.858908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:53.873447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:53.888113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:53.889224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:53.889866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:54.046064 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4d3957ba-25f5-44c0-a2d5-2e9f972fe82e tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "POST /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb/action" status: 202 len: 0 microversion: 2.1 time: 0.191308 Jul 14 15:16:54.049206 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2778/5404] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:16:53 2022] POST /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:16:54.058189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:54.064378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:54.079313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:54.082538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:54.086470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:54.087183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:54.691813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:54.707006 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bcfb108b-b8d6-44e3-9b37-abf67082640a tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1492 microversion: 2.1 time: 0.652573 Jul 14 15:16:54.709397 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2779/5405] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:54 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1492 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:54.880380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:54.881631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:54.897329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:54.898702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:54.904532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:54.906285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:55.255778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:55.909898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:55.925357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfbfa069-3577-4260-a54a-bf5927d76bf6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 1.049335 Jul 14 15:16:55.925961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2780/5406] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:54 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:16:55.945071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:55.945790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:55.972914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:55.973640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:55.974775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:55.975518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:56.817898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:56.833667 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ff2357a-0da6-4354-a008-8d2a4352c08b tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1492 microversion: 2.1 time: 0.905438 Jul 14 15:16:56.834945 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2781/5407] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:55 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1492 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:56.955061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:56.956016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:56.987237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:56.988621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:56.989637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:56.990593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:57.580170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:16:57.581090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:16:57.582230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:16:57.583220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:16:57.584255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:16:57.628707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:57.630911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:57.633020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:57.634502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:57.724884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Getting quotas for project 178964408b17444d8a2c38c9b3e64359. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:16:57.751570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Getting quotas for user 450b7ea9a4e44d149bd7ea40eaf0d31d and project 178964408b17444d8a2c38c9b3e64359. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:16:57.810285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:16:57.813014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:16:57.885744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e87386e-ca2b-465a-81ba-486824cf2d7c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.273043 Jul 14 15:16:57.887024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2627/5408] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:16:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 4275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:16:57.899321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:57.900431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:57.917174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:57.918298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:57.919339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:57.919976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:58.046587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:16:58.311695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:58.330404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52be37ba-0156-4b13-bb95-bc87c9abe9c7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 1.379606 Jul 14 15:16:58.331158 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2782/5409] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:56 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:58.345037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06e109c0-bc7e-4537-b8dc-87fd3e800832 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:58.345791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06e109c0-bc7e-4537-b8dc-87fd3e800832 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:58.571950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06e109c0-bc7e-4537-b8dc-87fd3e800832 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:58.586675 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06e109c0-bc7e-4537-b8dc-87fd3e800832 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1213 microversion: 2.1 time: 0.250940 Jul 14 15:16:58.587884 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2783/5410] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:58 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:58.595510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e1c68d9d-08e0-4963-b392-05c811d55b4f req-66b28471-611d-418b-8a44-495d7b1e4304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a994ae5a-a759-4e2e-94d6-4ff6acd3eef1", "tag": "d2560cf6-6a81-4353-8423-d17e0e9ff33c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:16:58.622803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e1c68d9d-08e0-4963-b392-05c811d55b4f req-66b28471-611d-418b-8a44-495d7b1e4304 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:58.628047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e1c68d9d-08e0-4963-b392-05c811d55b4f req-66b28471-611d-418b-8a44-495d7b1e4304 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:58.650883 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e1c68d9d-08e0-4963-b392-05c811d55b4f req-66b28471-611d-418b-8a44-495d7b1e4304 service nova] Creating event network-changed:d2560cf6-6a81-4353-8423-d17e0e9ff33c for instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 on n-h2-768852-23 Jul 14 15:16:58.660783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e1c68d9d-08e0-4963-b392-05c811d55b4f req-66b28471-611d-418b-8a44-495d7b1e4304 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071422 Jul 14 15:16:58.670359 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2784/5411] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:16:59.359675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:59.360429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:59.375216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:59.375956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:59.376917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:59.377513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:59.452526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:59.484240 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-324a3838-b768-4110-b9c6-95bb05f79678 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1492 microversion: 2.1 time: 1.594251 Jul 14 15:16:59.485803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2628/5412] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:57 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1492 bytes in 1598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:16:59.611054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:16:59.612000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:16:59.636538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:59.637321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:59.641963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:16:59.642793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:16:59.947842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:16:59.974844 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e8662c7-978e-491c-bf90-518961eb4d05 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1209 microversion: 2.1 time: 0.373306 Jul 14 15:16:59.993306 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2629/5413] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:59 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1209 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:00.037542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:00.057436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22bbf60a-45ee-4b53-9b31-7d147818b9c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 0.702152 Jul 14 15:17:00.077183 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2785/5414] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:16:59 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:00.519456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:00.524386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:00.573764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:00.582591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:00.587114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:00.588664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:00.811730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-94323110", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d4e05876-d8bb-4dc9-ae9f-6e514c094f39", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-806348815", "security_groups": [{"name": "tempest-secgroup-smoke-292185187"}], "networks": [{"uuid": "6f81d85e-6746-456c-9d66-680377a1eddd"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:01.440975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] validate_networks() for [('6f81d85e-6746-456c-9d66-680377a1eddd', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:17:01.463475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:01.481905 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dc9c4bfa-45a8-40cc-9cf2-aa6ddd74138d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1492 microversion: 2.1 time: 0.974562 Jul 14 15:17:01.482373 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2630/5415] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:00 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1492 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:01.516145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:01.517163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:01.532301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:01.537009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:01.538139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:01.540271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:01.746600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:01.760799 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c8ff417e-774d-45a9-ab59-ff4d146d6920 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1271 microversion: 2.1 time: 0.272197 Jul 14 15:17:01.764107 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2631/5416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:01 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:01.769839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:01.770836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:01.786365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:01.787540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:01.789224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:01.789646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:02.307620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:02.316893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37890892-2620-4d40-9569-9166aab6b19c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 0.551269 Jul 14 15:17:02.322576 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2632/5417] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:01 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:02.335115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1013040425", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:02.457598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:17:02.613735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:17:02.614629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:17:02.615259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:17:02.615909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:17:02.616314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:17:02.637582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:02.639600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:02.640527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:02.640941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:02.691432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Getting quotas for project 2e30ed5aa78f4ba5bdbeb80ddc88b38f. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:17:02.701604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Getting quotas for user ab2ce820ae4f482283fe985fdb2fee84 and project 2e30ed5aa78f4ba5bdbeb80ddc88b38f. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:17:02.826050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:17:02.829634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d4e05876-d8bb-4dc9-ae9f-6e514c094f39',volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:17:03.309480 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-578aa98e-1622-411f-86ea-88b6db19c5b5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.501971 Jul 14 15:17:03.310574 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2786/5418] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:17:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:17:03.323060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:03.323740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:03.338708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:03.338708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:03.338708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:03.343667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:03.781473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:03.800260 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e63ed55d-02af-4735-807e-4d2a2210c988 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1498 microversion: 2.1 time: 0.481987 Jul 14 15:17:03.802471 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2787/5419] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:03 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1498 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:03.828055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:03.830029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:03.851788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:03.857901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:03.863771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:03.867448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:04.250349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:04.263756 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2750c946-8cf4-45d2-a126-5865303efeca tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 0.453936 Jul 14 15:17:04.265174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2788/5420] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:03 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:04.282073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eaa206e4-e1cd-4e7a-a448-ebdb6eb53fc3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:04.283489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eaa206e4-e1cd-4e7a-a448-ebdb6eb53fc3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:04.440429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eaa206e4-e1cd-4e7a-a448-ebdb6eb53fc3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:04.514956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eaa206e4-e1cd-4e7a-a448-ebdb6eb53fc3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1096 microversion: 2.1 time: 0.231756 Jul 14 15:17:04.514956 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2789/5421] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:04 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1096 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:04.548035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:04.553788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:04.595720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:04.596680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:04.598248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:04.599089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.024715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:17:05.025389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:17:05.027900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:17:05.028783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:17:05.029417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:17:05.067750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:05.068723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.073947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:05.075294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.128320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Getting quotas for project e077c5a4c14941f28b107c91952a0de8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:17:05.145158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Getting quotas for user 3d6431ad47224fc384a9110b02b5b6bb and project e077c5a4c14941f28b107c91952a0de8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:17:05.179524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:17:05.184671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:17:05.330636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7ec665aa-c1b4-430f-b298-1ecf2fc0524f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.006188 Jul 14 15:17:05.336294 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2633/5422] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 3013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:17:05.347923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:05.356180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:05.364716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:05.365778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.367616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:05.368904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.422206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:17:05.452108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:05.492271 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1dc735c5-df22-4cb4-b6ec-6455a1fae1a9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 0.985780 Jul 14 15:17:05.521397 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2790/5423] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:04 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:05.544560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:05.546128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:05.583436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:05.600428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.611627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:05.613978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:05.873379 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2793f51b-b4fc-4c15-a733-a3ae30a3b4fb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 204 len: 0 microversion: 2.1 time: 0.534441 Jul 14 15:17:05.876653 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2634/5424] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:17:05 2022] DELETE /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 0 bytes in 539 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:05.899967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-594b145c-87b7-4ee1-85c6-65a47ed5a342 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:05.904729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-594b145c-87b7-4ee1-85c6-65a47ed5a342 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:06.362874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-594b145c-87b7-4ee1-85c6-65a47ed5a342 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:06.397164 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-594b145c-87b7-4ee1-85c6-65a47ed5a342 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1214 microversion: 2.1 time: 0.514934 Jul 14 15:17:06.411464 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2635/5425] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:05 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1214 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:06.411464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:06.411464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:06.447245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:06.448248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:06.448550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:06.449077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:06.664774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:06.685017 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-374a0bd1-8fe6-4a2c-9135-4c6cfe9ddc12 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1212 microversion: 2.1 time: 0.285126 Jul 14 15:17:06.687574 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2636/5426] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:06 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1212 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:06.705154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:06.708028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:06.727399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:06.729221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:06.732442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:06.734696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:06.948269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:06.959506 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-458651a8-fa80-4c47-882f-0a007b1b727c tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 1.444863 Jul 14 15:17:06.965718 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2791/5427] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:05 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:06.982889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:06.983548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:07.004168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:07.007426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:07.011043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:07.012512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:07.249476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:07.262325 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-84f6d845-00e3-482f-8094-a1c7a7447b88 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.571193 Jul 14 15:17:07.276134 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2637/5428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:06 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:07.427395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:07.429476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:07.443476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:07.446844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:07.451910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:07.454179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:07.661909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:07.703003 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b036d77e-3424-45ee-b7d1-f2129a6dfab6 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 0.732219 Jul 14 15:17:07.704162 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2792/5429] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:06 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:07.750026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:07.751725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:07.777307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:07.778581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:07.783013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:07.786504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:08.033714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:08.042032 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7908f11-0611-4e4a-bb30-f47011bc93e5 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1212 microversion: 2.1 time: 0.311085 Jul 14 15:17:08.046963 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2793/5430] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:07 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1212 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:08.051309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:08.070445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1258bbdb-849d-41b3-b655-c833a7ebed27 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1218 microversion: 2.1 time: 0.644583 Jul 14 15:17:08.072458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2638/5431] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:07 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1218 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:08.086699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:08.090061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:08.113217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:08.113949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:08.117289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:08.119055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:08.524275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c1b5c94a-9534-4504-8f48-45bcac4104d7 req-8cf1df5f-06e1-43dd-9bbb-2cc885331451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a994ae5a-a759-4e2e-94d6-4ff6acd3eef1", "name": "network-vif-plugged", "status": "completed", "tag": "d2560cf6-6a81-4353-8423-d17e0e9ff33c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:08.545647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c1b5c94a-9534-4504-8f48-45bcac4104d7 req-8cf1df5f-06e1-43dd-9bbb-2cc885331451 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:08.546567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c1b5c94a-9534-4504-8f48-45bcac4104d7 req-8cf1df5f-06e1-43dd-9bbb-2cc885331451 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:08.577226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c1b5c94a-9534-4504-8f48-45bcac4104d7 req-8cf1df5f-06e1-43dd-9bbb-2cc885331451 service nova] Creating event network-vif-plugged:d2560cf6-6a81-4353-8423-d17e0e9ff33c for instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 on n-h2-768852-23 Jul 14 15:17:08.592749 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c1b5c94a-9534-4504-8f48-45bcac4104d7 req-8cf1df5f-06e1-43dd-9bbb-2cc885331451 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.542081 Jul 14 15:17:08.594938 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2794/5432] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:08.612589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:08.615504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:08.639923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:08.641317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:08.644848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:08.645623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.029620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:09.053973 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80f4b77c-68ab-4673-af10-048c284e9a91 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.444058 Jul 14 15:17:09.056002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2795/5433] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:08 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:09.074986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6e448091-0df3-4300-98eb-17c7678462cf req-93196b3b-ffe1-4a4c-b768-e18302399dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dea2aad-b024-4488-88b7-fae28b93a1b7", "tag": "87f05933-d922-47f7-9505-28eb289f94cc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:09.076755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:09.121585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6e448091-0df3-4300-98eb-17c7678462cf req-93196b3b-ffe1-4a4c-b768-e18302399dd5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.121828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6297e728-80d5-4b2b-b577-786668a376c1 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 1.043972 Jul 14 15:17:09.122347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6e448091-0df3-4300-98eb-17c7678462cf req-93196b3b-ffe1-4a4c-b768-e18302399dd5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.127000 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2639/5434] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:08 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:09.160775 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6e448091-0df3-4300-98eb-17c7678462cf req-93196b3b-ffe1-4a4c-b768-e18302399dd5 service nova] Creating event network-changed:87f05933-d922-47f7-9505-28eb289f94cc for instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 on n-h1-768852-23 Jul 14 15:17:09.173761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:09.174124 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6e448091-0df3-4300-98eb-17c7678462cf req-93196b3b-ffe1-4a4c-b768-e18302399dd5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114566 Jul 14 15:17:09.174766 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2796/5435] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:09.183429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:09.189150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:09.192486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:09.218870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.221031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.222323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.225204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.237642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.239544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.247957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.251449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.900294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:09.905550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:09.917484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-790ef5af-d85c-408a-97dc-9ca689d292ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1279 microversion: 2.1 time: 0.732656 Jul 14 15:17:09.925447 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2797/5436] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:09 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1279 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:09.936879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:09.938985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:09.954529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.959205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:09.961076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:09.964103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:10.090247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:10.106367 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb7fcea7-0885-410b-93cd-fa84e85f6ede tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1266 microversion: 2.1 time: 0.173132 Jul 14 15:17:10.107096 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2798/5437] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:09 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:10.121878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:10.122519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:10.148489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:10.153278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:10.154359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:10.154828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:10.829241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:10.842104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ce5bb20-94d6-4332-bd27-1ab475c6a0e4 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 0.724163 Jul 14 15:17:10.842720 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2799/5438] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:10 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:10.861986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:10.866761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:10.874687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:10.875509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:10.876660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:10.878308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:11.497716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:11.510918 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f5343322-be21-4cfe-afc4-1216549c1bb2 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1319 microversion: 2.1 time: 2.379967 Jul 14 15:17:11.520665 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2640/5439] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:09 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1319 bytes in 2393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:11.536341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:11.540866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:11.544088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:11.556655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:11.557217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:11.558064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:11.558517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:11.650266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:11.728168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3c6944c-09ad-429d-bf05-2df32d6ca3fc tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 0.874253 Jul 14 15:17:11.732188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2800/5440] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:10 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:11.770599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:11.780605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:11.821409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:11.822774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:11.832388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:11.833833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:12.054147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:12.070260 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-01b4ed48-e312-4fc9-9ff3-4b6a33fba73f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1272 microversion: 2.1 time: 0.331272 Jul 14 15:17:12.082984 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2801/5441] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:11 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1272 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:12.373492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:12.423402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e9ff4c62-b834-49b4-8759-fbf3086cda1e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1279 microversion: 2.1 time: 0.900992 Jul 14 15:17:12.424540 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2641/5442] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:11 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1279 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:12.516015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:12.517263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:12.561625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:12.563094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:12.565971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:12.568189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:12.627576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4850e9af-506c-4939-87f0-35c795f0c101 req-72e5ff13-8b31-4cba-b6f1-1aaa281c07b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:12.651817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4850e9af-506c-4939-87f0-35c795f0c101 req-72e5ff13-8b31-4cba-b6f1-1aaa281c07b4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:12.652815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4850e9af-506c-4939-87f0-35c795f0c101 req-72e5ff13-8b31-4cba-b6f1-1aaa281c07b4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:12.659815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:12.695627 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4850e9af-506c-4939-87f0-35c795f0c101 req-72e5ff13-8b31-4cba-b6f1-1aaa281c07b4 service nova] Creating event network-changed:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:17:12.707423 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4850e9af-506c-4939-87f0-35c795f0c101 req-72e5ff13-8b31-4cba-b6f1-1aaa281c07b4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.620858 Jul 14 15:17:12.709843 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2802/5443] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:12.736065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3c166ab9-558c-4317-bb0d-661dfc43a7aa req-9a939036-5fd9-431c-8bbf-9aecb4954ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d856fda-bd21-4d44-add4-3fe0d06429cb", "name": "network-vif-unplugged", "status": "completed", "tag": "aedb7f7b-7ab7-40fc-babc-7e037e03ad51"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:12.754523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3c166ab9-558c-4317-bb0d-661dfc43a7aa req-9a939036-5fd9-431c-8bbf-9aecb4954ae9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:12.755219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3c166ab9-558c-4317-bb0d-661dfc43a7aa req-9a939036-5fd9-431c-8bbf-9aecb4954ae9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:12.772265 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3c166ab9-558c-4317-bb0d-661dfc43a7aa req-9a939036-5fd9-431c-8bbf-9aecb4954ae9 service nova] Creating event network-vif-unplugged:aedb7f7b-7ab7-40fc-babc-7e037e03ad51 for instance 2d856fda-bd21-4d44-add4-3fe0d06429cb on n-h2-768852-23 Jul 14 15:17:12.782196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3c166ab9-558c-4317-bb0d-661dfc43a7aa req-9a939036-5fd9-431c-8bbf-9aecb4954ae9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066710 Jul 14 15:17:12.784273 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2803/5444] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:12.795617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:12.797404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:12.809641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:12.810741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:12.812377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:12.813334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:13.191990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:13.211032 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-841ca97b-7e29-4097-9089-91f6c364d2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1507 microversion: 2.1 time: 0.422848 Jul 14 15:17:13.212248 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2804/5445] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:12 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1507 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:13.226952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:13.251471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:13.290390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:13.291213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:13.296120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:13.296810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:13.602651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:13.617506 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-18f6abba-9624-4bd5-9f72-6cdcac3d55c7 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1504 microversion: 2.1 time: 1.168907 Jul 14 15:17:13.631638 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2642/5446] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:12 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1504 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:13.649686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:13.653713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:13.668972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:13.669847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:13.681269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:13.683171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:13.867870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:13.904100 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47b0e555-9c81-4d92-9a41-675652937558 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 0.688423 Jul 14 15:17:13.935261 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2805/5447] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:13 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:13.947036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:13.955179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:13.969173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:13.984597 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bbd597ee-3216-4791-95e5-0befde66ef06 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1272 microversion: 2.1 time: 0.348150 Jul 14 15:17:13.987315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:13.994232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:13.995834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2643/5448] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:13 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1272 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:13.997502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:13.998642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:14.476231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:14.774250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-772a4993-6ff7-43c4-a121-fdeb9ce6c77d req-7bff9260-b693-40d6-83e9-75ad7b8158e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d856fda-bd21-4d44-add4-3fe0d06429cb", "name": "network-vif-deleted", "tag": "aedb7f7b-7ab7-40fc-babc-7e037e03ad51"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:14.814420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-772a4993-6ff7-43c4-a121-fdeb9ce6c77d req-7bff9260-b693-40d6-83e9-75ad7b8158e1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:14.830062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-772a4993-6ff7-43c4-a121-fdeb9ce6c77d req-7bff9260-b693-40d6-83e9-75ad7b8158e1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:14.876344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:14.890720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-772a4993-6ff7-43c4-a121-fdeb9ce6c77d req-7bff9260-b693-40d6-83e9-75ad7b8158e1 service nova] Creating event network-vif-deleted:aedb7f7b-7ab7-40fc-babc-7e037e03ad51 for instance 2d856fda-bd21-4d44-add4-3fe0d06429cb on n-h2-768852-23 Jul 14 15:17:14.916632 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-772a4993-6ff7-43c4-a121-fdeb9ce6c77d req-7bff9260-b693-40d6-83e9-75ad7b8158e1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.573877 Jul 14 15:17:14.920023 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7fbf852a-41cd-4ff8-96de-e8ba107add85 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1279 microversion: 2.1 time: 0.981100 Jul 14 15:17:14.921046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2806/5449] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:13 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1279 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:14.926718 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2644/5450] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:14.952932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:14.955345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:14.974443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:14.976329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:14.978193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:14.979649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:14.982966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:15.002082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:15.010352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:15.013673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:15.014788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:15.015730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:15.088603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:15.089349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:15.092207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lazy-loading 'fault' on Instance uuid 2d856fda-bd21-4d44-add4-3fe0d06429cb {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:17:15.096288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:15.111426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:15.431676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:15.450188 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a74e271d-33b6-4466-91d8-0355979b995c tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 200 len: 1303 microversion: 2.1 time: 0.520977 Jul 14 15:17:15.451068 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2645/5451] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:14 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 1303 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:15.464547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:15.465498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:15.476436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:15.476902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:15.479815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:15.480285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:16.303777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:16.321225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e941379a-cb7f-4dcc-b127-7e5321d27410 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 1.383165 Jul 14 15:17:16.322584 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2807/5452] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:14 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:16.330707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:16.331858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:16.354844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:16.355701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:16.357022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:16.357959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:16.372332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=18 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:16.995136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:17.011992 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7304126b-7519-4c85-8e27-c30de195977f tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 1.559593 Jul 14 15:17:17.012604 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2646/5453] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:15 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:17.026474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:17.027127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 2d856fda-bd21-4d44-add4-3fe0d06429cb] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:17.046235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.046728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.047626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.048074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.088270 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] HTTP exception thrown: Instance 2d856fda-bd21-4d44-add4-3fe0d06429cb could not be found. Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Request method failure captured: Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb HTTP/1.1 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DL_smzb8fOwsoN-KTgLSsGwCbMWxTF4GShaFUw3JHT7nVPn950Rk9TfTQHrm_cF6TLG2nCLjwqi1Rh63b2rW3LD0FgrbziFImt_sAXaaCBz53GKNVmOEJplf7u8xtNx0UgLTvbvuCov5-KmxgdHBwk6IGKutdfOZYbtalGIZV39kD0 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 105c133485b84b21a9b029141b5053ad Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueTestJSON-563592834 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/105c133485b84b21a9b029141b5053ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_105c133485b84b21a9b029141b5053ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/105c133485b84b21a9b029141b5053ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/105c133485b84b21a9b029141b5053ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueTestJSON-563592834 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 105c133485b84b21a9b029141b5053ad Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueTestJSON-563592834 Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueTestJSON-563592834-project Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 83513b7f5185436b8ea320c025f673af Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueTestJSON-563592834-project Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2d856fda-bd21-4d44-add4-3fe0d06429cb could not be found. Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2d856fda-bd21-4d44-add4-3fe0d06429cb'} Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d856fda-bd21-4d44-add4-3fe0d06429cb could not be found. Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d856fda-bd21-4d44-add4-3fe0d06429cb could not be found. Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:17.090002 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d856fda-bd21-4d44-add4-3fe0d06429cb could not be found. Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Returning 404 to user: Instance 2d856fda-bd21-4d44-add4-3fe0d06429cb could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-151376e8-3747-4588-af12-903ce53bffcd tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb" status: 404 len: 111 microversion: 2.1 time: 0.070876 Jul 14 15:17:17.094279 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2647/5454] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:17 2022] GET /compute/v2.1/servers/2d856fda-bd21-4d44-add4-3fe0d06429cb => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:17:17.100453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:17.100954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:17.119340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.119749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.124432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.126200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.178479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:17:17.368943 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-792f1808-e071-4dc6-a2e9-914cbe12aa00 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "DELETE /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 204 len: 0 microversion: 2.1 time: 0.271044 Jul 14 15:17:17.372733 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2648/5455] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:17:17 2022] DELETE /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:17:17.385066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:17.385815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:17.402972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.403642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.404450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.405058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.482684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:17.563300 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a03e452-c635-430b-80c6-ef6845e755f2 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1279 microversion: 2.1 time: 1.236346 Jul 14 15:17:17.564189 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2808/5456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:16 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1279 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:17.586005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:17.587069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:17.660321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:17.662027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.662598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:17.663463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:17.663909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:18.072039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:18.105041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-61360cc9-65ce-49be-9988-6f9c21f7a9ab tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1491 microversion: 2.1 time: 0.534284 Jul 14 15:17:18.107423 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2809/5457] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:17 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1491 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:18.118584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:18.123593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:18.124267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:18.139949 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13625eed-a445-4c42-ba2d-1cd07af4fc29 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 0.752941 Jul 14 15:17:18.140929 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2649/5458] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:17 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:18.149675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:18.150424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:18.152088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:18.152877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:18.473880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:18.512018 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54b6bdc8-ae0a-464c-9e10-202fe9db1446 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 0.399951 Jul 14 15:17:18.520057 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2810/5459] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:18 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:18.538812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ba1658ce-7f1c-4b8f-aedd-ca1a60e2d02a req-e59fcfc3-c24c-49b2-8cbc-fd915940c6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4", "tag": "583c1e1f-78cb-46b5-b70a-49599cfd9e1e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:18.558104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ba1658ce-7f1c-4b8f-aedd-ca1a60e2d02a req-e59fcfc3-c24c-49b2-8cbc-fd915940c6f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:18.558581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ba1658ce-7f1c-4b8f-aedd-ca1a60e2d02a req-e59fcfc3-c24c-49b2-8cbc-fd915940c6f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:18.588111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ba1658ce-7f1c-4b8f-aedd-ca1a60e2d02a req-e59fcfc3-c24c-49b2-8cbc-fd915940c6f4 service nova] Creating event network-changed:583c1e1f-78cb-46b5-b70a-49599cfd9e1e for instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 on n-h2-768852-23 Jul 14 15:17:18.589724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:18.598735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:18.602682 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ba1658ce-7f1c-4b8f-aedd-ca1a60e2d02a req-e59fcfc3-c24c-49b2-8cbc-fd915940c6f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082256 Jul 14 15:17:18.603657 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2650/5460] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:18.626802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:18.627722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:18.629070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:18.629778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.126707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:19.127464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:19.140323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.141150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.148894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.149791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.385817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:19.429833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26d4b4db-3719-4f92-bb34-2e7293efe3b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1279 microversion: 2.1 time: 0.849712 Jul 14 15:17:19.452912 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2811/5461] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:18 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1279 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:19.474960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:19.476922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:19.489943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.492014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.494201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.495358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.660916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:19.678332 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b693fb86-e3cd-4523-b849-a51ed7e141bb tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1491 microversion: 2.1 time: 0.557093 Jul 14 15:17:19.680357 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2651/5462] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:19 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1491 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:19.690678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0a4ef2e6-07a1-44bd-8e06-3919acace9fd req-cfe31b85-bc36-4bec-a1fa-f659d717e4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dea2aad-b024-4488-88b7-fae28b93a1b7", "name": "network-vif-plugged", "status": "completed", "tag": "87f05933-d922-47f7-9505-28eb289f94cc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:19.714940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0a4ef2e6-07a1-44bd-8e06-3919acace9fd req-cfe31b85-bc36-4bec-a1fa-f659d717e4ef service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.715847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0a4ef2e6-07a1-44bd-8e06-3919acace9fd req-cfe31b85-bc36-4bec-a1fa-f659d717e4ef service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.747918 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0a4ef2e6-07a1-44bd-8e06-3919acace9fd req-cfe31b85-bc36-4bec-a1fa-f659d717e4ef service nova] Creating event network-vif-plugged:87f05933-d922-47f7-9505-28eb289f94cc for instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 on n-h1-768852-23 Jul 14 15:17:19.758796 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0a4ef2e6-07a1-44bd-8e06-3919acace9fd req-cfe31b85-bc36-4bec-a1fa-f659d717e4ef service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076806 Jul 14 15:17:19.765391 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2652/5463] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:19.772759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:19.777796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:19.795351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.799537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:19.800835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:19.801393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:20.244683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:20.254990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-07f084a8-63e0-4f70-9a84-6662483730c0 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 0.799834 Jul 14 15:17:20.258323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2812/5464] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:19 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:20.393067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:20.413093 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c90ee4a-f8ab-47ca-82a5-f397bcf4863a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 0.639117 Jul 14 15:17:20.415255 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2653/5465] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:19 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:20.458561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:20.460041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:20.482568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:20.483041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:20.483992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:20.484450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:20.822304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec19101a-f840-46be-b557-09320ee201f0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Action: 'create', calling method: .version_select at 0x7fdbf1ea5700>, body: {"keypair": {"name": "tempest-TestServerBasicOps-9297144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBdfGw2WkrbARkbCLj7x/M817OXFNUv8jHtEa+lxa1bqrfXq8lS6DP0z2Rtb/+AAqj25Mrqtca7wgs99mjpcV2zRxEQpwvaQHq8LTe8DsMOc9E2FX+YkM8HosG3Wuxh0mg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:20.844808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ec19101a-f840-46be-b557-09320ee201f0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Getting quotas for project f3becca3bc96409891c05f7bd47f1601. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:17:20.854631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ec19101a-f840-46be-b557-09320ee201f0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Getting quotas for user a5636dbc7f0745bf845d714249f88de2 and project f3becca3bc96409891c05f7bd47f1601. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:17:20.900623 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec19101a-f840-46be-b557-09320ee201f0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 394 microversion: 2.1 time: 0.640938 Jul 14 15:17:20.902321 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2813/5466] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:17:20 2022] POST /compute/v2.1/os-keypairs => generated 394 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:20.908899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:20.910230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:20.920401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:20.921218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:20.922334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:20.923525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:20.997664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:21.030123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8282694-ff9b-4714-87f2-cc0154c2450b tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 0.573879 Jul 14 15:17:21.050532 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2654/5467] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:20 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:21.281265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:21.283490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:21.306712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:21.314657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:21.317569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:21.320967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:21.322693 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b8a48c5-edfc-40d8-8acd-e71306674247 tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1491 microversion: 2.1 time: 0.417842 Jul 14 15:17:21.325051 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2814/5468] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:20 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1491 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:21.325915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:21.435739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:21.436743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:21.463362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:21.470153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:21.471312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:21.472081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.214074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:22.241021 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-52a0f442-4001-4fe6-890e-0d020b07ae60 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1313 microversion: 2.1 time: 0.966299 Jul 14 15:17:22.245896 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2655/5469] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:21 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1313 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:22.277303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:22.281953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:22.321646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.331401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.337786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.345463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.617464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:22.636697 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4e5cfd2-1ac7-4909-bd62-27a0f6b42f40 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 1.206266 Jul 14 15:17:22.637855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2815/5470] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:21 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:22.653444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:22.657480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:22.681533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.682198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.684282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.685299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.771198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.772667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.773534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lazy-loading 'fault' on Instance uuid 7a0ee153-435d-4257-a56a-f1a06c96f6c7 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:17:22.775965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=100 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:22.778084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:22.807736 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45ad27a3-83c3-42e7-8dec-353e994a6f61 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 0.554910 Jul 14 15:17:22.821766 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2656/5471] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:22 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:22.838320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-5bf1443d-65c0-4dca-bb5d-527cda250a2f req-7281db06-a8fd-4fa1-b245-42dab5249db3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0ee153-435d-4257-a56a-f1a06c96f6c7", "name": "network-vif-deleted", "tag": "baf3c878-9d47-4bc9-8999-defe11674a76"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:22.915236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5bf1443d-65c0-4dca-bb5d-527cda250a2f req-7281db06-a8fd-4fa1-b245-42dab5249db3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:22.918024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-5bf1443d-65c0-4dca-bb5d-527cda250a2f req-7281db06-a8fd-4fa1-b245-42dab5249db3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:22.953649 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-5bf1443d-65c0-4dca-bb5d-527cda250a2f req-7281db06-a8fd-4fa1-b245-42dab5249db3 service nova] Creating event network-vif-deleted:baf3c878-9d47-4bc9-8999-defe11674a76 for instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 on n-h1-768852-23 Jul 14 15:17:22.990388 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-5bf1443d-65c0-4dca-bb5d-527cda250a2f req-7281db06-a8fd-4fa1-b245-42dab5249db3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159326 Jul 14 15:17:22.991589 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2657/5472] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:23.197857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83513b7f5185436b8ea320c025f673af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105c133485b84b21a9b029141b5053ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:23.210878 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-791bca68-754f-48f8-85dd-326f45df2b4f tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 200 len: 1304 microversion: 2.1 time: 0.558788 Jul 14 15:17:23.219778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2816/5473] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:22 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 1304 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:23.261622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:23.262364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:23.285297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:23.285846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:23.286713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:23.287243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:23.654440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:23.655712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:23.667684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:23.668150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:23.668957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:23.669401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:23.981908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:23.996489 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6129f793-9663-4ea2-a550-561605e34bd9 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 0.344182 Jul 14 15:17:23.997453 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2817/5474] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:23 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:24.008503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:24.009135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:24.027802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:24.028258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:24.029050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:24.029490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:24.436100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:24.451178 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eeff5019-4b29-4677-a3b6-3fcd90f7de5a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 0.452405 Jul 14 15:17:24.452084 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2818/5475] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:23 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:24.466617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:24.467246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] [instance: 7a0ee153-435d-4257-a56a-f1a06c96f6c7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:24.498208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:24.502173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:24.505740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:24.507171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:24.538703 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] HTTP exception thrown: Instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 could not be found. Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Request method failure captured: Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 HTTP/1.1 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DL_smzb8fOwsoN-KTgLSsGwCbMWxTF4GShaFUw3JHT7nVPn950Rk9TfTQHrm_cF6TLG2nCLjwqi1Rh63b2rW3LD0FgrbziFImt_sAXaaCBz53GKNVmOEJplf7u8xtNx0UgLTvbvuCov5-KmxgdHBwk6IGKutdfOZYbtalGIZV39kD0 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 105c133485b84b21a9b029141b5053ad Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerRescueTestJSON-563592834 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/105c133485b84b21a9b029141b5053ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_105c133485b84b21a9b029141b5053ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/105c133485b84b21a9b029141b5053ad"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/105c133485b84b21a9b029141b5053ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerRescueTestJSON-563592834 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 105c133485b84b21a9b029141b5053ad Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerRescueTestJSON-563592834 Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerRescueTestJSON-563592834-project Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 83513b7f5185436b8ea320c025f673af Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerRescueTestJSON-563592834-project Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 could not be found. Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '7a0ee153-435d-4257-a56a-f1a06c96f6c7'} Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 could not be found. Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 could not be found. Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:24.549016 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 could not be found. Jul 14 15:17:24.553005 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:24.553565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] Returning 404 to user: Instance 7a0ee153-435d-4257-a56a-f1a06c96f6c7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:17:24.556182 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8600b946-843d-4650-a855-2010fe25eb7d tempest-ServerRescueTestJSON-563592834 tempest-ServerRescueTestJSON-563592834-project] 10.222.0.98 "GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7" status: 404 len: 111 microversion: 2.1 time: 0.092076 Jul 14 15:17:24.556182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2819/5476] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:24 2022] GET /compute/v2.1/servers/7a0ee153-435d-4257-a56a-f1a06c96f6c7 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:17:24.820174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:24.833402 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-35648bde-3613-4f18-8e77-3d9f279c540e tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1497 microversion: 2.1 time: 1.577139 Jul 14 15:17:24.834027 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2658/5477] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:23 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1497 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:25.014730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:25.016078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:25.032361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:25.032814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:25.035312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:25.035975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:25.469532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:25.470157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:25.492085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:25.494321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:25.498396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:25.506190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:25.745408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:25.804811 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ecb4b18-c397-425d-ae14-7cb6ebe3c2a8 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 0.793662 Jul 14 15:17:25.807312 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2820/5478] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:25 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:25.914670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:25.915735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:25.928963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:25.929686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:25.934644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:25.935911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:26.029961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:17:26.048051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:26.063457 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2c26930-79f0-4626-a15c-e13733bb1c0e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 0.593683 Jul 14 15:17:26.075930 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2659/5479] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:25 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:26.148717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7e22ff80-c13d-44fc-9312-a6f63edf65ed req-562b31ac-00a2-4196-90bf-c97b47551fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4", "name": "network-vif-plugged", "status": "completed", "tag": "583c1e1f-78cb-46b5-b70a-49599cfd9e1e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:26.178395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7e22ff80-c13d-44fc-9312-a6f63edf65ed req-562b31ac-00a2-4196-90bf-c97b47551fc2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:26.178395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7e22ff80-c13d-44fc-9312-a6f63edf65ed req-562b31ac-00a2-4196-90bf-c97b47551fc2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:26.231987 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7e22ff80-c13d-44fc-9312-a6f63edf65ed req-562b31ac-00a2-4196-90bf-c97b47551fc2 service nova] Creating event network-vif-plugged:583c1e1f-78cb-46b5-b70a-49599cfd9e1e for instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 on n-h2-768852-23 Jul 14 15:17:26.232309 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5f2eaf7f-a893-4560-9f34-9f864dde8511 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 204 len: 0 microversion: 2.1 time: 0.324186 Jul 14 15:17:26.239395 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2821/5480] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:17:25 2022] DELETE /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:17:26.268310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:26.274763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:26.274973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7e22ff80-c13d-44fc-9312-a6f63edf65ed req-562b31ac-00a2-4196-90bf-c97b47551fc2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119498 Jul 14 15:17:26.276602 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2660/5481] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:17:26.323379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:26.329451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:26.333351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:26.339389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:26.483774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-316596883", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-9297144", "security_groups": [{"name": "tempest-secgroup-smoke-2144511495"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "7531406f-94a5-4abe-8dce-4277e45422f7"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:26.849055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] validate_networks() for [('7531406f-94a5-4abe-8dce-4277e45422f7', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:17:27.125461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:27.142266 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac264ca8-c988-4747-967e-a8d1074944c4 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1503 microversion: 2.1 time: 0.900924 Jul 14 15:17:27.143795 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2822/5482] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:26 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1503 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:27.166978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:27.168684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:27.181307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:27.182403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:27.185644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:27.186770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:27.485094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:27.495168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd543d94-40a4-404d-aaac-59cda2f854a0 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1314 microversion: 2.1 time: 0.349774 Jul 14 15:17:27.505384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2823/5483] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:27 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1314 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:27.513162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:27.514510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:27.521057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:27.521672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:27.522966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:27.523153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:27.889498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:27.903035 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edda6120-f388-4924-a6f4-a676f42d915e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 0.395675 Jul 14 15:17:27.905618 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2824/5484] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:27 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:27.919189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Getting quotas for project f3becca3bc96409891c05f7bd47f1601. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:17:27.926022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Getting quotas for user a5636dbc7f0745bf845d714249f88de2 and project f3becca3bc96409891c05f7bd47f1601. Resources: dict_keys(['metadata_items']) {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:17:27.941613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:17:27.942258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:17:27.942919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:17:27.944165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:17:27.944740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:17:27.958569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:27.960083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:27.965581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:27.966394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:28.017882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Getting quotas for project f3becca3bc96409891c05f7bd47f1601. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:17:28.039316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Getting quotas for user a5636dbc7f0745bf845d714249f88de2 and project f3becca3bc96409891c05f7bd47f1601. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:17:28.084383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:17:28.091188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:17:28.169781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:28.171379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:28.187746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:28.190009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:28.196571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:28.197662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:28.267795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-733aea9d-8a65-40d3-8ae0-c113821148fe tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.790994 Jul 14 15:17:28.276545 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2661/5485] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:17:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:17:28.282672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04443c73-335a-4e78-bb28-527d0749a7e4 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:28.284164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04443c73-335a-4e78-bb28-527d0749a7e4 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:28.421732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-04443c73-335a-4e78-bb28-527d0749a7e4 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:28.435182 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04443c73-335a-4e78-bb28-527d0749a7e4 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1299 microversion: 2.1 time: 0.154449 Jul 14 15:17:28.436343 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2662/5486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:28 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1299 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:28.512875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:28.513877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:28.534727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:28.538665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:28.542256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:28.543479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:29.157922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:29.184928 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4baab8c-9c54-4768-a65d-29dcf9868bd4 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1463 microversion: 2.1 time: 0.676060 Jul 14 15:17:29.212540 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2663/5487] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:28 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1463 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:29.219739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:29.220760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:29.234047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:29.235935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:29.237394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:29.238096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:29.400559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '450b7ea9a4e44d149bd7ea40eaf0d31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '178964408b17444d8a2c38c9b3e64359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:29.424436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-90ec593b-58d1-48ae-9132-c932b96ffc51 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 200 len: 1503 microversion: 2.1 time: 1.261363 Jul 14 15:17:29.436916 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2825/5488] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:28 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 1503 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:29.445972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "840e277c-8001-4118-8ceb-e6df8f4e7d49", "device": "/dev/sdb"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:29.449342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:29.458712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:29.459634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:29.461046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:29.461895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:29.913544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-83980f17-dee9-4489-8bc2-d00eb464f2e6 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "POST /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.474667 Jul 14 15:17:29.928841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2826/5489] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:17:29 2022] POST /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4/os-volume_attachments => generated 194 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:29.954065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d696b22e-8ce3-405e-94f2-7ffa1114dad1 req-2bc09b9e-6f19-4f41-af51-1bf6914ab014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dea2aad-b024-4488-88b7-fae28b93a1b7", "name": "network-vif-deleted", "tag": "87f05933-d922-47f7-9505-28eb289f94cc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:29.987086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d696b22e-8ce3-405e-94f2-7ffa1114dad1 req-2bc09b9e-6f19-4f41-af51-1bf6914ab014 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:29.989249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d696b22e-8ce3-405e-94f2-7ffa1114dad1 req-2bc09b9e-6f19-4f41-af51-1bf6914ab014 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:30.023879 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d696b22e-8ce3-405e-94f2-7ffa1114dad1 req-2bc09b9e-6f19-4f41-af51-1bf6914ab014 service nova] Creating event network-vif-deleted:87f05933-d922-47f7-9505-28eb289f94cc for instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 on n-h1-768852-23 Jul 14 15:17:30.041467 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d696b22e-8ce3-405e-94f2-7ffa1114dad1 req-2bc09b9e-6f19-4f41-af51-1bf6914ab014 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107076 Jul 14 15:17:30.050355 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2827/5490] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:30.056932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:30.058587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:30.066939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:30.069111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:30.071014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:30.071900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:30.247216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:30.269414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4760e2c8-5330-4589-a973-8b8a9a683ddd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1295 microversion: 2.1 time: 0.217348 Jul 14 15:17:30.274013 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2828/5491] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:30 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1295 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:30.446488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:30.448262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] [instance: 6dea2aad-b024-4488-88b7-fae28b93a1b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:30.466917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:30.468509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:30.471046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:30.471752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:30.521325 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] HTTP exception thrown: Instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 could not be found. Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Request method failure captured: Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 HTTP/1.1 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DM6nUq3iG8f0lbqugkUvy0EZ5LdQruw7f2xV6NWQuRBoq1bLLbuWVKr8th8iSkbjp3vwgk0GSFqZdc5P03NOoosuFxIlV3fiUU2Sb6IsFRF8rzHS4MEmK11yhnHq1xyRIp1qjYFQFgS8kaeHIDbh3kX3RuhuCZV6hGBClpEHnw3X98 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 178964408b17444d8a2c38c9b3e64359 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesActionsTest-520379472 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178964408b17444d8a2c38c9b3e64359"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_178964408b17444d8a2c38c9b3e64359"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/178964408b17444d8a2c38c9b3e64359"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/178964408b17444d8a2c38c9b3e64359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesActionsTest-520379472 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 178964408b17444d8a2c38c9b3e64359 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesActionsTest-520379472 Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesActionsTest-520379472-project Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 450b7ea9a4e44d149bd7ea40eaf0d31d Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesActionsTest-520379472-project Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 could not be found. Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6dea2aad-b024-4488-88b7-fae28b93a1b7'} Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 could not be found. Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 could not be found. Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:17:30.535326 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 could not be found. Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] Returning 404 to user: Instance 6dea2aad-b024-4488-88b7-fae28b93a1b7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b135c450-6775-4d52-8c32-0021160b7ef8 tempest-VolumesActionsTest-520379472 tempest-VolumesActionsTest-520379472-project] 10.222.0.98 "GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7" status: 404 len: 111 microversion: 2.1 time: 0.099705 Jul 14 15:17:30.542089 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2829/5492] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:30 2022] GET /compute/v2.1/servers/6dea2aad-b024-4488-88b7-fae28b93a1b7 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:17:30.846382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:30.886880 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-794deb87-5175-4be2-8725-81e62a274e7c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 1.667466 Jul 14 15:17:30.888635 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2664/5493] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:29 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:31.291198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:31.291847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:31.293884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:31.318354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:31.318818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:31.319663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:31.337714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:31.555024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:31.602530 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f73ee967-5fd1-4ff6-9ee1-febb834698b5 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1357 microversion: 2.1 time: 0.315812 Jul 14 15:17:31.603508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2830/5494] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:31 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1357 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:31.910556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:31.920093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:31.954185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:31.955525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:31.965100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:31.970216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:32.085425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:32.622904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:32.623783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:32.649294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:32.649759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:32.650553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:32.650993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:32.855333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:32.866625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:32.882590 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f9d6de8-e1c8-4426-a2f2-4207590b41bb tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1357 microversion: 2.1 time: 0.260716 Jul 14 15:17:32.892381 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1d65eb6-bf3a-4ae7-9d4f-379ae2e91d37 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 0.982640 Jul 14 15:17:32.892629 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2831/5495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:32 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1357 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:32.903218 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2665/5496] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:31 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:33.449121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4a9f48ed-9508-49c2-896b-969853449c34 req-34b6602c-df16-4f3e-920b-c0491949f98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "name": "network-vif-plugged", "status": "completed", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:33.465637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4a9f48ed-9508-49c2-896b-969853449c34 req-34b6602c-df16-4f3e-920b-c0491949f98b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:33.466148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4a9f48ed-9508-49c2-896b-969853449c34 req-34b6602c-df16-4f3e-920b-c0491949f98b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:33.486488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:33.516100 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4a9f48ed-9508-49c2-896b-969853449c34 req-34b6602c-df16-4f3e-920b-c0491949f98b service nova] Creating event network-vif-plugged:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:17:33.528852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4a9f48ed-9508-49c2-896b-969853449c34 req-34b6602c-df16-4f3e-920b-c0491949f98b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084381 Jul 14 15:17:33.530561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2832/5497] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:33.928349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:33.933159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:33.935010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:33.941553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:33.982559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:33.997345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.009208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.010547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.013712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.021834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.023800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:34.032317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:34.886934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:34.899432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3652879-af3f-4613-bac9-5b59e3f3e261 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1425 microversion: 2.1 time: 0.997671 Jul 14 15:17:34.906069 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2833/5498] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:33 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1425 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:35.508769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:35.520446 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2fb6001d-1f84-48a3-b1c6-caeffba4caf4 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1267 microversion: 2.1 time: 1.622505 Jul 14 15:17:35.538855 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2666/5499] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:33 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1267 bytes in 1642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:35.933240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:35.935601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:35.951586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:35.962984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:35.964125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:35.964796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:36.546023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:36.547109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:36.573670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:36.574135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:36.586758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:36.590941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:37.380165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:37.420205 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4b122b30-58c4-4d4c-83fb-4f675e72a94f tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1425 microversion: 2.1 time: 1.492732 Jul 14 15:17:37.425188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2834/5500] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:35 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1425 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:37.438744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2963d892-15e0-4c7b-8d09-5628f408d8df req-8fd19ce1-94ec-4a57-a772-b3df82421024 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ebbd4f1-b7e8-4973-b0bf-d762ab12695c", "tag": "f1eb8715-d53d-46c4-9c8b-641b332f746e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:37.463594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2963d892-15e0-4c7b-8d09-5628f408d8df req-8fd19ce1-94ec-4a57-a772-b3df82421024 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:37.465693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2963d892-15e0-4c7b-8d09-5628f408d8df req-8fd19ce1-94ec-4a57-a772-b3df82421024 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:37.498397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2963d892-15e0-4c7b-8d09-5628f408d8df req-8fd19ce1-94ec-4a57-a772-b3df82421024 service nova] Creating event network-changed:f1eb8715-d53d-46c4-9c8b-641b332f746e for instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c on n-h1-768852-23 Jul 14 15:17:37.519914 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2963d892-15e0-4c7b-8d09-5628f408d8df req-8fd19ce1-94ec-4a57-a772-b3df82421024 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092626 Jul 14 15:17:37.524561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2835/5501] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:37.816535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:37.831500 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5229fbd6-5c04-4e39-be26-3efc1d9bf415 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1454 microversion: 2.1 time: 1.290168 Jul 14 15:17:37.834439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2667/5502] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:36 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1454 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:37.853783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:37.855062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:37.892578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:37.902081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:37.903552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:37.904324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:38.440559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:38.442337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:38.452250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:38.455930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:38.473911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:38.477685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:38.480557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:38.488104 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:38.810255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:38.827034 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d06cd69a-68e2-45a6-b5ba-b7df2aacf44c tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1454 microversion: 2.1 time: 0.981525 Jul 14 15:17:38.837260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2836/5503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:37 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1454 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:39.479446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:39.493154 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b68c8dc-63e8-43ad-865d-b3cc6823f13e tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1425 microversion: 2.1 time: 1.056867 Jul 14 15:17:39.495746 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2668/5504] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:38 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1425 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:40.514562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:40.515250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:40.526545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:40.527000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:40.537960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:40.542436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:42.605488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:42.639526 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f71003b-91e4-4f46-9b06-9570abc1a9a1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1425 microversion: 2.1 time: 2.124605 Jul 14 15:17:42.648465 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2837/5505] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:40 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1425 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:43.672767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:43.674485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:43.696516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:43.744817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:43.756236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:43.763209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:43.764159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:43.823751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b32f1479-a357-42da-b9b0-62815b0fb8d7 req-d54cd8b5-483a-46dd-940e-021bfb75fd03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ebbd4f1-b7e8-4973-b0bf-d762ab12695c", "name": "network-vif-plugged", "status": "completed", "tag": "f1eb8715-d53d-46c4-9c8b-641b332f746e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:43.847893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b32f1479-a357-42da-b9b0-62815b0fb8d7 req-d54cd8b5-483a-46dd-940e-021bfb75fd03 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:43.848750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b32f1479-a357-42da-b9b0-62815b0fb8d7 req-d54cd8b5-483a-46dd-940e-021bfb75fd03 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:43.910196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b32f1479-a357-42da-b9b0-62815b0fb8d7 req-d54cd8b5-483a-46dd-940e-021bfb75fd03 service nova] Creating event network-vif-plugged:f1eb8715-d53d-46c4-9c8b-641b332f746e for instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c on n-h1-768852-23 Jul 14 15:17:43.928580 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b32f1479-a357-42da-b9b0-62815b0fb8d7 req-d54cd8b5-483a-46dd-940e-021bfb75fd03 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109764 Jul 14 15:17:43.932285 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2838/5506] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:44.816731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:44.829335 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d3aea9f4-e4f0-45ce-8673-71acc9e7a110 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1425 microversion: 2.1 time: 1.169368 Jul 14 15:17:44.833636 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2669/5507] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:43 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1425 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:45.854724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:45.855527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:45.881195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:45.883860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:45.890446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:45.893697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:46.681302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:46.704723 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d19f4bab-8eff-47cc-8fac-a451f73ea0b0 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1425 microversion: 2.1 time: 0.857834 Jul 14 15:17:46.706960 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2839/5508] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:45 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1425 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:47.553700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7931b632-fbd3-4427-b1ed-c9d4039857e3 req-1c11b82e-178a-47ce-9739-21b150b36eba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:47.603231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7931b632-fbd3-4427-b1ed-c9d4039857e3 req-1c11b82e-178a-47ce-9739-21b150b36eba service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:47.604212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7931b632-fbd3-4427-b1ed-c9d4039857e3 req-1c11b82e-178a-47ce-9739-21b150b36eba service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:47.642925 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7931b632-fbd3-4427-b1ed-c9d4039857e3 req-1c11b82e-178a-47ce-9739-21b150b36eba service nova] Creating event network-changed:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:17:47.651906 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7931b632-fbd3-4427-b1ed-c9d4039857e3 req-1c11b82e-178a-47ce-9739-21b150b36eba service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103728 Jul 14 15:17:47.653483 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2670/5509] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:47.726329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:47.727381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:47.763255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:47.773080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:47.779235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:47.783579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:51.098945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:51.141651 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7c8a776-de9d-45ca-bc33-63c2bf538056 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1604 microversion: 2.1 time: 3.420785 Jul 14 15:17:51.173099 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2840/5510] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:47 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1604 bytes in 3453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:51.183824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:51.184597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:51.207264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:51.223139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:51.225843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:51.229050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:52.077857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:52.086712 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-897e59a4-65f6-4e8a-b0ec-076eaf3cc018 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1604 microversion: 2.1 time: 0.908375 Jul 14 15:17:52.096937 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2671/5511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:51 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1604 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:17:52.106722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:17:52.107393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:52.112101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:17:52.175936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:52.177042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:52.180465 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:52.180931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:54.037173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:17:54.066397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-42e31020-137f-49b5-9f81-1faa559b6204 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1604 microversion: 2.1 time: 1.964558 Jul 14 15:17:54.068898 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2841/5512] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:17:52 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1604 bytes in 1968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:17:57.776526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bc6813d-9fa2-417a-8c8c-13a19c762915", "device": "/dev/sdb"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:57.777776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:17:57.793129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:57.793582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:57.794402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:57.794847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:58.456694 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf1760a5-d022-434f-9b17-6bf4bc82b611 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "POST /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684272 Jul 14 15:17:58.468616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2672/5513] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:17:57 2022] POST /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:17:58.498913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7e6e82fa-2c29-4a1e-abaa-21948a432101 req-e8c8d51c-e81b-4328-8803-c609a82ff92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:17:58.518930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7e6e82fa-2c29-4a1e-abaa-21948a432101 req-e8c8d51c-e81b-4328-8803-c609a82ff92c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:17:58.520594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7e6e82fa-2c29-4a1e-abaa-21948a432101 req-e8c8d51c-e81b-4328-8803-c609a82ff92c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:17:58.558146 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7e6e82fa-2c29-4a1e-abaa-21948a432101 req-e8c8d51c-e81b-4328-8803-c609a82ff92c service nova] Creating event network-changed:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:17:58.572196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7e6e82fa-2c29-4a1e-abaa-21948a432101 req-e8c8d51c-e81b-4328-8803-c609a82ff92c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077369 Jul 14 15:17:58.573556 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2842/5514] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:00.829718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-62f311cd-38c7-4406-b4d7-b431c27c5858 req-89e20b99-796a-4027-bca3-13814f1b6a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:00.848469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-62f311cd-38c7-4406-b4d7-b431c27c5858 req-89e20b99-796a-4027-bca3-13814f1b6a12 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:00.848930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-62f311cd-38c7-4406-b4d7-b431c27c5858 req-89e20b99-796a-4027-bca3-13814f1b6a12 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:00.897368 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-62f311cd-38c7-4406-b4d7-b431c27c5858 req-89e20b99-796a-4027-bca3-13814f1b6a12 service nova] Creating event network-changed:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:18:00.904698 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-62f311cd-38c7-4406-b4d7-b431c27c5858 req-89e20b99-796a-4027-bca3-13814f1b6a12 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079090 Jul 14 15:18:00.909853 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2673/5515] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:03.208098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-05be188f-a8d2-4799-a1d0-d5d6a40585f8 req-371f1dcb-7784-4c69-abd5-ff0e6720ce2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ebbd4f1-b7e8-4973-b0bf-d762ab12695c", "tag": "f1eb8715-d53d-46c4-9c8b-641b332f746e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:03.252854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-05be188f-a8d2-4799-a1d0-d5d6a40585f8 req-371f1dcb-7784-4c69-abd5-ff0e6720ce2d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:03.259516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-05be188f-a8d2-4799-a1d0-d5d6a40585f8 req-371f1dcb-7784-4c69-abd5-ff0e6720ce2d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:03.303477 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-05be188f-a8d2-4799-a1d0-d5d6a40585f8 req-371f1dcb-7784-4c69-abd5-ff0e6720ce2d service nova] Creating event network-changed:f1eb8715-d53d-46c4-9c8b-641b332f746e for instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c on n-h1-768852-23 Jul 14 15:18:03.345137 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-05be188f-a8d2-4799-a1d0-d5d6a40585f8 req-371f1dcb-7784-4c69-abd5-ff0e6720ce2d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137319 Jul 14 15:18:03.349151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2843/5516] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:14.917287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=9 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:14.928703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:15.264763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-732816448", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:15.387386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] validate_networks() for [('c634329c-4e6d-4980-80a1-03409d0c61da', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:18:16.979607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:18:16.980226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:18:16.980660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:18:16.981082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:18:16.981495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:18:17.000980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:17.001721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:17.002731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:17.003412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:17.056733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for project cc180baee4ea4158b008e3a5c227aac8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:18:17.063337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for user 7a00a929a3dd4608961f50265fd35caa and project cc180baee4ea4158b008e3a5c227aac8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:18:17.087946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:18:17.091831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:18:17.216793 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7432641e-678f-4e7d-8c6e-f32918f6ed46 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.340691 Jul 14 15:18:17.226239 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2674/5517] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:18:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:18:17.229607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-877750e4-3ac2-4ad6-a28b-3c5be43687b9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:17.230485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-877750e4-3ac2-4ad6-a28b-3c5be43687b9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:17.250062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=5 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:17.253010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=51 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:17.381762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-877750e4-3ac2-4ad6-a28b-3c5be43687b9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:17.391998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-877750e4-3ac2-4ad6-a28b-3c5be43687b9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1221 microversion: 2.1 time: 0.167043 Jul 14 15:18:17.395927 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2844/5518] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:17 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1221 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:17.738989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1619925336", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:18.022463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] validate_networks() for [('c634329c-4e6d-4980-80a1-03409d0c61da', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:18:21.661951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:18:21.662661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:18:21.663095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:18:21.663551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:18:21.663973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:18:21.692146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:21.693013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:21.703953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:21.708541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:21.795133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for project cc180baee4ea4158b008e3a5c227aac8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:18:21.807137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for user 7a00a929a3dd4608961f50265fd35caa and project cc180baee4ea4158b008e3a5c227aac8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:18:21.829981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:18:21.834443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:18:21.908760 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db675598-9a6d-486d-8f9d-9020e9d0ebf4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.177290 Jul 14 15:18:21.911226 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2675/5519] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:18:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 4182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:18:21.926044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26411555-a874-45c4-990d-5daf53260371 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:21.927162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26411555-a874-45c4-990d-5daf53260371 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:22.466476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26411555-a874-45c4-990d-5daf53260371 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:22.477227 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26411555-a874-45c4-990d-5daf53260371 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1222 microversion: 2.1 time: 0.560490 Jul 14 15:18:22.483389 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2845/5520] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:21 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1222 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:23.507766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:23.509561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:23.525564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:23.528448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:23.531558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:23.533639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:23.778118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:23.788338 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bdd85537-3e5e-43bf-bde7-873d2148c5d9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1218 microversion: 2.1 time: 0.290574 Jul 14 15:18:23.789432 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2676/5521] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:23 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1218 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:24.807837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:24.809202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:24.824703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:24.837850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:24.839192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:24.840171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:25.214020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:25.229841 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c3f0bb5b-0d9e-42f4-8ffc-8092e793e4fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1282 microversion: 2.1 time: 0.426586 Jul 14 15:18:25.230630 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2846/5522] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:24 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1282 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:26.274488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:26.276019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:26.318071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:26.319903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:26.323800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:26.324265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:26.779932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dfd18475-8eca-47df-a654-ef5159e6ca75 req-9ff55a6c-81d4-4c09-9a83-f2825378602e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea857aa4-0a92-4765-a7df-0645eea1dbad", "tag": "ffc67c8a-a3df-43d9-beed-d055913c17c9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:26.787991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:26.811451 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81eb3299-2cb9-49b1-a38b-5c1d30c8e359 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1280 microversion: 2.1 time: 0.558207 Jul 14 15:18:26.812882 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2677/5523] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:26 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1280 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:26.857023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dfd18475-8eca-47df-a654-ef5159e6ca75 req-9ff55a6c-81d4-4c09-9a83-f2825378602e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:26.857507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dfd18475-8eca-47df-a654-ef5159e6ca75 req-9ff55a6c-81d4-4c09-9a83-f2825378602e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:26.959762 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dfd18475-8eca-47df-a654-ef5159e6ca75 req-9ff55a6c-81d4-4c09-9a83-f2825378602e service nova] Creating event network-changed:ffc67c8a-a3df-43d9-beed-d055913c17c9 for instance ea857aa4-0a92-4765-a7df-0645eea1dbad on n-h2-768852-23 Jul 14 15:18:27.002147 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dfd18475-8eca-47df-a654-ef5159e6ca75 req-9ff55a6c-81d4-4c09-9a83-f2825378602e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.228990 Jul 14 15:18:27.011919 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2847/5524] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:27.839630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:27.841121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:27.858250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:27.860248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:27.872192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:27.873813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:28.317019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:28.386435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b98634c7-c262-4d66-acf7-80411a90d768 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1280 microversion: 2.1 time: 0.547518 Jul 14 15:18:28.394620 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2678/5525] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:27 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1280 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:28.885145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:28.886462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:28.905065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:28.914892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:28.917194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:28.920848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:28.997990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:18:29.245217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c42448f9-01fa-44f1-9288-3634e7e829ac req-2954b2aa-c7a2-4621-afd4-119c68bced5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:29.346002 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb574f44-590c-4bd7-b9bb-e852b6b564f8 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "DELETE /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 204 len: 0 microversion: 2.1 time: 0.468576 Jul 14 15:18:29.353284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c42448f9-01fa-44f1-9288-3634e7e829ac req-2954b2aa-c7a2-4621-afd4-119c68bced5d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.354193 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2848/5526] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:18:28 2022] DELETE /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:18:29.359460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c42448f9-01fa-44f1-9288-3634e7e829ac req-2954b2aa-c7a2-4621-afd4-119c68bced5d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.375700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:29.387387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:29.448096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.454514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.458802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.465643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.510803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c42448f9-01fa-44f1-9288-3634e7e829ac req-2954b2aa-c7a2-4621-afd4-119c68bced5d service nova] Creating event network-changed:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:18:29.558802 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c42448f9-01fa-44f1-9288-3634e7e829ac req-2954b2aa-c7a2-4621-afd4-119c68bced5d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.317655 Jul 14 15:18:29.562971 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2679/5527] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:29.602019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:29.606787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:29.654745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.661932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:29.665970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:29.675900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:30.302225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:30.342719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89d5c428-59bc-403c-bb8a-37f8719ba2c5 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 0.774499 Jul 14 15:18:30.343480 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2680/5528] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:29 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:30.954492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:31.041933 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d302786a-1b86-4d27-bf1b-bad02b084e19 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1579 microversion: 2.1 time: 1.681201 Jul 14 15:18:31.046419 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2849/5529] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:29 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1579 bytes in 1687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:31.376553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:31.384724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:31.407317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:31.415751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:31.417222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:31.418003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:31.776119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:31.820217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:32.075587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:32.076871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:32.089230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.096972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.099816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.105265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.477927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:32.491751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:32.541445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5778cce6-893b-41de-b5cb-ade51dc4c5fc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 1.175978 Jul 14 15:18:32.542517 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2681/5530] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:31 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:32.600845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:32.609474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:32.662155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.664076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.665924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:32.667029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:32.789125 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5be68067-e2e3-414c-b0d6-066cdbe60a89 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.227560 Jul 14 15:18:32.793201 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2682/5531] 10.222.0.98 () {58 vars in 1292 bytes} [Thu Jul 14 15:18:32 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c/os-server-password => generated 116 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:33.564101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:33.565715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:33.603311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:33.609985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:33.611651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:33.612953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:33.836680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:33.873946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c7aaeae-92ab-4b1d-a94c-2e4d429394ac tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1579 microversion: 2.1 time: 1.802093 Jul 14 15:18:33.908232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2850/5532] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:32 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1579 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:34.916851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:34.931573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:34.976103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:34.977001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:34.978526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:34.991349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:35.939508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:35.958378 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b56da48-1eb4-4959-a5fb-5ba420cccddd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 2.398396 Jul 14 15:18:35.960028 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2683/5533] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:33 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 2406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:35.982999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e74c1e03-7f27-4c5a-924b-2db6c300c120 req-027cfa35-080d-4fd8-b7dd-9dbf0eb4d62c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6a9f80-b25d-46cc-837e-964fd2c51e47", "tag": "8bda7234-6e79-411f-8bee-0530b820348a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:36.030374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e74c1e03-7f27-4c5a-924b-2db6c300c120 req-027cfa35-080d-4fd8-b7dd-9dbf0eb4d62c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:36.031561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e74c1e03-7f27-4c5a-924b-2db6c300c120 req-027cfa35-080d-4fd8-b7dd-9dbf0eb4d62c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:36.059874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e74c1e03-7f27-4c5a-924b-2db6c300c120 req-027cfa35-080d-4fd8-b7dd-9dbf0eb4d62c service nova] Creating event network-changed:8bda7234-6e79-411f-8bee-0530b820348a for instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 on n-h2-768852-23 Jul 14 15:18:36.077211 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e74c1e03-7f27-4c5a-924b-2db6c300c120 req-027cfa35-080d-4fd8-b7dd-9dbf0eb4d62c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112576 Jul 14 15:18:36.078770 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2684/5534] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:36.105625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e15e784f-46b2-4e6d-a727-c982cc548965 req-d619eaf4-a7e8-4197-bdaa-f65561600db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "name": "network-vif-unplugged", "status": "completed", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:36.134672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e15e784f-46b2-4e6d-a727-c982cc548965 req-d619eaf4-a7e8-4197-bdaa-f65561600db0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:36.135472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e15e784f-46b2-4e6d-a727-c982cc548965 req-d619eaf4-a7e8-4197-bdaa-f65561600db0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:36.200762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e15e784f-46b2-4e6d-a727-c982cc548965 req-d619eaf4-a7e8-4197-bdaa-f65561600db0 service nova] Creating event network-vif-unplugged:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:18:36.214174 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e15e784f-46b2-4e6d-a727-c982cc548965 req-d619eaf4-a7e8-4197-bdaa-f65561600db0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126623 Jul 14 15:18:36.222861 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2685/5535] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:18:36.813515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:36.852061 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4ac1528-404b-49e7-be24-5b7f944ec024 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1579 microversion: 2.1 time: 1.941518 Jul 14 15:18:36.855943 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2851/5536] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:34 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1579 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:36.979576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:36.981046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:36.996687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:36.997407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:36.998579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:36.999185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:37.598254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9b531d39-2f2c-4789-afec-ace5a050c1a7 req-20c726ea-61b4-4ec5-ac43-0a8e1dbaf0ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e", "name": "network-vif-deleted", "tag": "ba66b0e8-5c67-4b93-a1ca-f1044440e770"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:37.642477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9b531d39-2f2c-4789-afec-ace5a050c1a7 req-20c726ea-61b4-4ec5-ac43-0a8e1dbaf0ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:37.645315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9b531d39-2f2c-4789-afec-ace5a050c1a7 req-20c726ea-61b4-4ec5-ac43-0a8e1dbaf0ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:37.683876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9b531d39-2f2c-4789-afec-ace5a050c1a7 req-20c726ea-61b4-4ec5-ac43-0a8e1dbaf0ea service nova] Creating event network-vif-deleted:ba66b0e8-5c67-4b93-a1ca-f1044440e770 for instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e on n-h1-768852-23 Jul 14 15:18:37.712889 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9b531d39-2f2c-4789-afec-ace5a050c1a7 req-20c726ea-61b4-4ec5-ac43-0a8e1dbaf0ea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140951 Jul 14 15:18:37.719125 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2852/5537] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:18:37.886708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:37.892486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:37.901258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:37.948386 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-562205c9-cd51-4aaa-b4a4-bdf1e7e7c24e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 0.973696 Jul 14 15:18:37.950040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:37.952013 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2686/5538] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:36 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:37.953975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:37.959514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:37.964056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:38.318469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:38.405038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-944d1e85-bcbb-439c-9d53-5357c5a4f0f1 req-b7d4bdb3-df17-4353-b558-531e912068cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea857aa4-0a92-4765-a7df-0645eea1dbad", "name": "network-vif-plugged", "status": "completed", "tag": "ffc67c8a-a3df-43d9-beed-d055913c17c9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:38.436265 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-662d70f3-2e8f-4501-ab30-1723f9d9592f tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 0.567638 Jul 14 15:18:38.453142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2853/5539] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:37 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:38.527876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-944d1e85-bcbb-439c-9d53-5357c5a4f0f1 req-b7d4bdb3-df17-4353-b558-531e912068cc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:38.532133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-944d1e85-bcbb-439c-9d53-5357c5a4f0f1 req-b7d4bdb3-df17-4353-b558-531e912068cc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:38.586140 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-944d1e85-bcbb-439c-9d53-5357c5a4f0f1 req-b7d4bdb3-df17-4353-b558-531e912068cc service nova] Creating event network-vif-plugged:ffc67c8a-a3df-43d9-beed-d055913c17c9 for instance ea857aa4-0a92-4765-a7df-0645eea1dbad on n-h2-768852-23 Jul 14 15:18:38.593495 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-944d1e85-bcbb-439c-9d53-5357c5a4f0f1 req-b7d4bdb3-df17-4353-b558-531e912068cc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208642 Jul 14 15:18:38.599144 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2687/5540] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:18:38.979197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:38.985232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:39.016786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:39.021909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:39.024032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:39.028697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:39.512468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:39.534678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:39.568118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:39.569523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:39.571812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:39.575067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:40.004469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:40.021990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a82c6091-c01f-4306-97a5-d615f7d015f3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 0.548751 Jul 14 15:18:40.028731 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2688/5541] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:39 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:40.201968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:40.229322 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-30339506-af87-47ac-ab4e-08275c20a5ea tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 1.265949 Jul 14 15:18:40.238098 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2854/5542] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:38 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:41.044113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:41.046699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:41.078929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:41.080205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:41.082496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:41.083591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:41.259682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:41.260644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:41.270316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:41.276043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:41.277186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:41.277816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:41.360705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:41.376006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-341c6738-4319-4b35-8146-75ed83ce42b7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 0.339789 Jul 14 15:18:41.377482 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2689/5543] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:41 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:42.006999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:42.028266 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91400c92-a69e-4f66-b1fd-d95587f42b68 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 0.772479 Jul 14 15:18:42.029576 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2855/5544] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:41 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:42.240883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-24fb98b5-6fc6-4c4b-b281-b42f5aab66a3 req-72777e06-b475-46e7-8225-1d4837a4c278 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a9f80-b25d-46cc-837e-964fd2c51e47", "name": "network-vif-plugged", "status": "completed", "tag": "8bda7234-6e79-411f-8bee-0530b820348a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:42.282472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-24fb98b5-6fc6-4c4b-b281-b42f5aab66a3 req-72777e06-b475-46e7-8225-1d4837a4c278 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:42.282972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-24fb98b5-6fc6-4c4b-b281-b42f5aab66a3 req-72777e06-b475-46e7-8225-1d4837a4c278 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:42.350241 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-24fb98b5-6fc6-4c4b-b281-b42f5aab66a3 req-72777e06-b475-46e7-8225-1d4837a4c278 service nova] Creating event network-vif-plugged:8bda7234-6e79-411f-8bee-0530b820348a for instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 on n-h2-768852-23 Jul 14 15:18:42.403296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:42.415860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:42.417838 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-24fb98b5-6fc6-4c4b-b281-b42f5aab66a3 req-72777e06-b475-46e7-8225-1d4837a4c278 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187600 Jul 14 15:18:42.422015 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2690/5545] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:18:42.453144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:42.453865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:42.454984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:42.470900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:43.050408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:43.053035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:43.082267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:43.108331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:43.110065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:43.112103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:43.449702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:43.463846 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a35f989-bbb4-4eeb-a647-a62e2390368a tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 1.070382 Jul 14 15:18:43.466675 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2856/5546] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:42 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:43.700721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:43.712266 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-600344b5-5296-4c02-97ca-63a77f53fd45 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 0.669591 Jul 14 15:18:43.713501 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2691/5547] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:43 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:44.494861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:44.495788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:44.525012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:44.525487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:44.527476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:44.527923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:44.703115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:44.713754 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d216387-7b34-40d1-88d9-e0fcdaec6f56 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 0.235151 Jul 14 15:18:44.717129 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2857/5548] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:44 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:44.735645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:44.736299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:44.760245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:44.760610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:44.768624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:44.770195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:45.308060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:45.311544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=83 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:45.327091 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bdba9cbf-4ea8-4935-b237-abe824e7b1c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1322 microversion: 2.1 time: 0.595299 Jul 14 15:18:45.349206 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2692/5549] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:44 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1322 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:45.739113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:45.742828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:45.765868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:45.766687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:45.770293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:45.770888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:46.006687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:46.022337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c7d405a-c5c7-4984-9916-2113e37c269d tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 0.287435 Jul 14 15:18:46.024266 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2858/5550] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:45 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:46.366458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:46.371782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:46.409343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:46.452696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:46.453932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:46.462247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:46.463449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.048869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:47.053291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:47.059925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:47.063442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6cf494f-bd82-49ff-b112-7978d6db2ddb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1516 microversion: 2.1 time: 0.716457 Jul 14 15:18:47.077157 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2693/5551] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:46 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1516 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:47.093357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:47.100289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:47.123818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.126113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.129871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.134271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.134870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.135819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.141409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.146636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.260702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lazy-loading 'flavor' on Instance uuid ee6a9f80-b25d-46cc-837e-964fd2c51e47 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:18:47.370783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:47.603910 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ae30f600-7991-46fd-8771-332a67bafdf0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action" status: 200 len: 32 microversion: 2.1 time: 0.510983 Jul 14 15:18:47.619130 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2694/5552] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:18:47 2022] POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action => generated 32 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:18:47.660984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:47.666262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:47.696008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:47.706333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44675b5c-5276-40ca-97b2-3ea1538657a3 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1227 microversion: 2.1 time: 0.668895 Jul 14 15:18:47.707052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.707938 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2859/5553] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:47 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1227 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:47.721174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:47.722747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:47.728769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:48.692394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:48.711145 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8783c9d-ccdc-4e86-afe4-1458a53c1b3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 1.085084 Jul 14 15:18:48.712153 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2695/5554] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:47 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:48.738343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:48.739634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:48.745239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:18:48.770263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:48.770952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:48.771979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:48.772543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:48.846931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:48.848610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:48.854176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lazy-loading 'fault' on Instance uuid 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:18:48.990757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab2ce820ae4f482283fe985fdb2fee84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e30ed5aa78f4ba5bdbeb80ddc88b38f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:49.014214 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ef7c159-f61f-4332-ab81-8413b3ae930e tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 200 len: 1232 microversion: 2.1 time: 0.281549 Jul 14 15:18:49.030000 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2860/5555] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:48 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 1232 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:49.750287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:49.752377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:49.785824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:49.786876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:49.791150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:49.792098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:50.081647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:50.082337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] [instance: 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:50.106398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:50.117326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:50.120721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:50.122523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:50.166103 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] HTTP exception thrown: Instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e could not be found. Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Request method failure captured: Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e HTTP/1.1 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DH6sm7g0KYcw1T_pCjIGK7ZdknyNEUvwGUh5DMt5N8-D-oNhrpgBOH9Q8HXU1tbSaserpgAStZbD7L7guY0nLUcbd_XuYmWac54KltgPuTFKjMtnvEQoNYXS6IG6Fw5E91dVacfHkXRmXgMVTj46kQHM6IdPmSJQbgZ_v0NE2yfx1A Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 2e30ed5aa78f4ba5bdbeb80ddc88b38f Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestVolumeBackupRestore-1815380168 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e30ed5aa78f4ba5bdbeb80ddc88b38f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_2e30ed5aa78f4ba5bdbeb80ddc88b38f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/2e30ed5aa78f4ba5bdbeb80ddc88b38f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/2e30ed5aa78f4ba5bdbeb80ddc88b38f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestVolumeBackupRestore-1815380168 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 2e30ed5aa78f4ba5bdbeb80ddc88b38f Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1815380168 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestVolumeBackupRestore-1815380168-project Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ab2ce820ae4f482283fe985fdb2fee84 Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestVolumeBackupRestore-1815380168-project Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e could not be found. Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e'} Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e could not be found. Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e could not be found. Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:18:50.173158 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e could not be found. Jul 14 15:18:50.178292 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:18:50.179356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Returning 404 to user: Instance 13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:18:50.180540 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c0679bb-64b9-4f35-8713-52b54b66e391 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e" status: 404 len: 111 microversion: 2.1 time: 0.128075 Jul 14 15:18:50.183346 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2861/5556] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:50 2022] GET /compute/v2.1/servers/13a17a1d-fcee-4db1-8203-9f8cb8bbdb4e => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:18:50.570696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee53cadd-e70e-4a71-839a-452a6a85bbb7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] Calling method '.version_select at 0x7fdbf2bc3040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:50.659219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee53cadd-e70e-4a71-839a-452a6a85bbb7 tempest-TestVolumeBackupRestore-1815380168 tempest-TestVolumeBackupRestore-1815380168-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-806348815" status: 202 len: 0 microversion: 2.1 time: 0.092366 Jul 14 15:18:50.660734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:50.663800 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2862/5557] 10.222.0.98 () {58 vars in 1265 bytes} [Thu Jul 14 15:18:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-806348815 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:18:50.679116 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e8c5a1b-62bf-4e70-8996-e7b57e4a14d6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.938423 Jul 14 15:18:50.691652 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2696/5558] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:49 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:51.699542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:51.700172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:51.724570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:51.725267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:51.730577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:51.731216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:52.462725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:52.480167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b733d662-61fb-45d4-a5ed-364809dbf377 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.783505 Jul 14 15:18:52.481514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2863/5559] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:51 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:53.526365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:53.529493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:53.569066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:53.569942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:53.571175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:53.573282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:54.496425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:54.498231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:54.514226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:54.516555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:54.521365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:54.522158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:54.756129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lazy-loading 'services' on Instance uuid a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:18:55.037150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-81570b3b-4216-4d29-965c-f381cc9594b9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1/os-volume_attachments/1bc6813d-9fa2-417a-8c8c-13a19c762915" status: 202 len: 0 microversion: 2.1 time: 0.549670 Jul 14 15:18:55.037778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2864/5560] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:18:54 2022] DELETE /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1/os-volume_attachments/1bc6813d-9fa2-417a-8c8c-13a19c762915 => generated 0 bytes in 552 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:18:55.428197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:55.440786 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec9eeddd-cc73-432b-aa68-0ad7f116b1bd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 1.932748 Jul 14 15:18:55.445547 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2697/5561] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:53 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:55.552179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2013714663", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:18:55.759884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] validate_networks() for None {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:18:56.266055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:18:56.267605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:18:56.269071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:18:56.269649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:18:56.270404 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:18:56.288283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:56.289264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:56.290508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:56.291199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:56.319932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Getting quotas for project ff686edfadf043f3a0a1bdcac2eba712. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:18:56.332876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Getting quotas for user a85e467c4d684346b1a576e99229b551 and project ff686edfadf043f3a0a1bdcac2eba712. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:18:56.357161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:18:56.360559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:18:56.461165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:56.462477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:56.476396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:56.485681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:56.487698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:56.488699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:56.666876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-535c5aea-f2a7-475b-a0ed-c05258d2a43f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111460 Jul 14 15:18:56.671165 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2865/5562] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:18:56.702851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5cbdefb-659a-4456-a531-f14444872c16 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:56.716672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5cbdefb-659a-4456-a531-f14444872c16 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:57.338322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:57.358986 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12c49a0a-8c98-491b-a8ee-5295319d892e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.902761 Jul 14 15:18:57.371232 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2698/5563] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:56 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:57.695161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f5cbdefb-659a-4456-a531-f14444872c16 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:57.722467 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5cbdefb-659a-4456-a531-f14444872c16 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1215 microversion: 2.1 time: 1.027001 Jul 14 15:18:57.731830 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2866/5564] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:56 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1215 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:58.382240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:58.384736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:58.403201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:58.404022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:58.411066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:58.411839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:58.741891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:58.744074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:58.768512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:58.769459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:58.772141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:58.783173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:58.854067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:58.873615 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-df02255a-7d7f-41d3-ada1-07fe919801c3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.496257 Jul 14 15:18:58.877701 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2699/5565] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:58 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:18:58.962874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:18:58.976834 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9e62e395-aaf4-490b-9550-36d9d1543c2e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1267 microversion: 2.1 time: 0.239200 Jul 14 15:18:58.978018 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2867/5566] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:58 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1267 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:18:59.895065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:59.895738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:18:59.918115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:59.918909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:59.919994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:18:59.920625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:18:59.995838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:18:59.997102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:00.013823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:00.016032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:00.018593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:00.019962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:00.164183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:00.175802 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b252fc2c-f7cf-4bdd-85b1-a070b9994bea tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1273 microversion: 2.1 time: 0.185188 Jul 14 15:19:00.178474 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2868/5567] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:59 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1273 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:00.500363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:00.516444 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-491b7f7c-b347-414b-baa3-aeaf6ddc95b2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.625317 Jul 14 15:19:00.521859 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2700/5568] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:18:59 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:01.194598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:01.198334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:01.224827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:01.225414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:01.226355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:01.226927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:01.354333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:01.371443 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9bcbe7be-ccca-4fbc-b240-a7277ce40873 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1273 microversion: 2.1 time: 0.181034 Jul 14 15:19:01.372074 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2869/5569] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:01 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:01.543449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:01.544395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:01.557640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:01.557640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:01.557640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:01.557640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:02.388414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:02.389648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:02.423355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:02.425959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:02.426851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:02.430726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:02.504995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:02.574592 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1fab3a45-97bd-49be-a0c9-309e67779a37 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 1.034179 Jul 14 15:19:02.579109 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2701/5570] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:01 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:02.851348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:02.859951 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5db3c57c-3f56-4276-b2eb-b892332badd1 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.475401 Jul 14 15:19:02.872661 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2870/5571] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:02 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:03.606428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:03.610284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:03.647604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:03.648638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:03.650830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:03.651615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:03.886826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:03.889486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:03.922386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:03.932908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:03.943732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:03.946986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:04.473443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:04.493783 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a8e727e-c378-41fd-8c45-8e7827c4da3f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.902180 Jul 14 15:19:04.495063 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2702/5572] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:03 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:04.757917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-84e42e9d-e36a-4166-b23b-f186d4c15ffe req-8c0c29c1-3c69-41ef-8d3a-f981570ec0e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b3533e-ca85-48db-b5a6-e120e2c16901", "tag": "2bb0c347-d475-4ef2-95c8-66ede6074885"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:04.771981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-84e42e9d-e36a-4166-b23b-f186d4c15ffe req-8c0c29c1-3c69-41ef-8d3a-f981570ec0e9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:04.772990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-84e42e9d-e36a-4166-b23b-f186d4c15ffe req-8c0c29c1-3c69-41ef-8d3a-f981570ec0e9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:04.793869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-84e42e9d-e36a-4166-b23b-f186d4c15ffe req-8c0c29c1-3c69-41ef-8d3a-f981570ec0e9 service nova] Creating event network-changed:2bb0c347-d475-4ef2-95c8-66ede6074885 for instance 89b3533e-ca85-48db-b5a6-e120e2c16901 on n-h1-768852-23 Jul 14 15:19:04.793869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-84e42e9d-e36a-4166-b23b-f186d4c15ffe req-8c0c29c1-3c69-41ef-8d3a-f981570ec0e9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040422 Jul 14 15:19:04.798648 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2703/5573] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:19:04.805726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:04.817518 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6db41ee4-26f8-4c71-a30c-d24e2d04533c tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.941753 Jul 14 15:19:04.831641 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2871/5574] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:03 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:05.523706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:05.530426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:05.552349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:05.555002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:05.556645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:05.560406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:05.839958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:05.841493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:05.853958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:05.861817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:05.863101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:05.865441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:06.012887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:06.023668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bac3cb6f-d03f-4042-94f0-43a8602ebd48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.511939 Jul 14 15:19:06.024876 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2704/5575] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:05 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:06.306878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:06.367117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:06.392193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad82318f-0718-46b0-b1d4-d680995c3b6f tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.555521 Jul 14 15:19:06.406602 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2872/5576] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:05 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:07.043632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:07.043632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:07.055235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.064861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.070977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.073720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.126256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:07.126877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:07.162986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.164728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.165755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.166204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.203548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:19:07.350526 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc81c35b-a7f8-453b-92b6-b9f3132aa640 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 204 len: 0 microversion: 2.1 time: 0.249114 Jul 14 15:19:07.352846 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2873/5577] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:19:07 2022] DELETE /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:19:07.404116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:07.409228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:07.427218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.428943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.431040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.432511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.463624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:07.495223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cad2517f-8cd9-4ff9-8024-2c7388d6cbe7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.456908 Jul 14 15:19:07.495803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2705/5578] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:07 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:07.510407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:07.511055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:07.518881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.519681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.522134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:07.522808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:07.706810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:07.926717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:07.935573 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a45c8227-5f05-4237-bffe-460a750a0395 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.429243 Jul 14 15:19:07.936171 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2706/5579] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:07 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:08.135120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:08.145894 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e6f9f9a2-c4f7-4f69-820d-2b28ccd050e5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1513 microversion: 2.1 time: 0.761710 Jul 14 15:19:08.146509 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2874/5580] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:07 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1513 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:08.513047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:08.513695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:08.532850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:08.533777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:08.534975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:08.535659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:08.842491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:08.853322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f7c50c1-e648-4cb3-ae0e-6e6af732027f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.342953 Jul 14 15:19:08.872364 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2707/5581] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:08 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:08.955093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:08.955764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:08.980314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:08.981159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:08.988684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:08.989573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.164915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:09.165534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:09.185485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.186314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.187398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.188168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.218610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:09.471011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:09.491994 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-96c1b2bf-be96-4f5c-9cec-a7274f2222b7 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1513 microversion: 2.1 time: 0.330906 Jul 14 15:19:09.517329 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2708/5582] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:09 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1513 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:09.562900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:09.572688 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3221940b-4f89-41f7-a1c6-fe1fb82054d0 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.621816 Jul 14 15:19:09.573291 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2875/5583] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:08 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:09.885133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:09.886084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:09.915496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.916322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:09.917884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:09.922958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:10.528728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:10.529880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:10.561936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:10.567156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:10.568944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:10.569581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:10.639360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:10.739728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:10.779929 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d7ad691d-d30f-4e2a-a5c3-268c4f1fdb51 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.900788 Jul 14 15:19:10.793497 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2709/5584] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:09 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:10.812657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:10.813669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:10.825217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:10.829903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:10.831500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:10.832605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:11.213969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:11.226333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88f48c64-0cd0-4ab1-a495-fff9e7cff74c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1513 microversion: 2.1 time: 0.701966 Jul 14 15:19:11.227192 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2876/5585] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:10 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1513 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:11.276765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:11.294720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a850b0f-628e-4291-88be-0aeae56ccf4a tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.498706 Jul 14 15:19:11.295958 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2710/5586] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:10 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:11.415649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b4eabef3-5e2d-44eb-8b02-193c3c61d1c5 req-0d195aec-9ce5-4495-9346-f9b69b2c8137 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a994ae5a-a759-4e2e-94d6-4ff6acd3eef1", "name": "network-vif-deleted", "tag": "d2560cf6-6a81-4353-8423-d17e0e9ff33c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:11.431237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b4eabef3-5e2d-44eb-8b02-193c3c61d1c5 req-0d195aec-9ce5-4495-9346-f9b69b2c8137 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:11.432087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b4eabef3-5e2d-44eb-8b02-193c3c61d1c5 req-0d195aec-9ce5-4495-9346-f9b69b2c8137 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:11.456738 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b4eabef3-5e2d-44eb-8b02-193c3c61d1c5 req-0d195aec-9ce5-4495-9346-f9b69b2c8137 service nova] Creating event network-vif-deleted:d2560cf6-6a81-4353-8423-d17e0e9ff33c for instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 on n-h2-768852-23 Jul 14 15:19:11.476081 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b4eabef3-5e2d-44eb-8b02-193c3c61d1c5 req-0d195aec-9ce5-4495-9346-f9b69b2c8137 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064320 Jul 14 15:19:11.477265 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2877/5587] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:11.814539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:11.815903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:11.824039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:11.824778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:11.825582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:11.826733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.128094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e475e1b4-758e-4b84-ba62-78cfad340ea5 req-65a06e95-9ff4-478c-9a5e-889f55c0e1e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b3533e-ca85-48db-b5a6-e120e2c16901", "name": "network-vif-plugged", "status": "completed", "tag": "2bb0c347-d475-4ef2-95c8-66ede6074885"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:12.174490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:12.190448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e475e1b4-758e-4b84-ba62-78cfad340ea5 req-65a06e95-9ff4-478c-9a5e-889f55c0e1e7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.195957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e475e1b4-758e-4b84-ba62-78cfad340ea5 req-65a06e95-9ff4-478c-9a5e-889f55c0e1e7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.204841 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12134f5e-cd31-4763-a1b4-8e4abdbcaaf6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.397394 Jul 14 15:19:12.207632 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2711/5588] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:11 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:12.258536 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e475e1b4-758e-4b84-ba62-78cfad340ea5 req-65a06e95-9ff4-478c-9a5e-889f55c0e1e7 service nova] Creating event network-vif-plugged:2bb0c347-d475-4ef2-95c8-66ede6074885 for instance 89b3533e-ca85-48db-b5a6-e120e2c16901 on n-h1-768852-23 Jul 14 15:19:12.262685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:12.263873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:12.276740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.277569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.279037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.279991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.282944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e475e1b4-758e-4b84-ba62-78cfad340ea5 req-65a06e95-9ff4-478c-9a5e-889f55c0e1e7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162024 Jul 14 15:19:12.284830 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2878/5589] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:19:12.326394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:12.327174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:12.343082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.344084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.346061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lazy-loading 'fault' on Instance uuid a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:19:12.346260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.346670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.349761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:12.365728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:12.411158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:12.421672 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54a76a88-7aec-44d8-afed-21235a81f2f1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 200 len: 1309 microversion: 2.1 time: 0.167726 Jul 14 15:19:12.428929 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2712/5590] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:12 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 1309 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:12.980122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:12.990706 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dfa584c2-d429-44f9-9c0a-ef7ca798f025 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.669819 Jul 14 15:19:13.001729 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2879/5591] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:12 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:13.232651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:13.234636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:13.279940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.286964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:13.287988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.288518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:13.446571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:13.453800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: a994ae5a-a759-4e2e-94d6-4ff6acd3eef1] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:13.467202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.468618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:13.471900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:13.473071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:13.534113 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] HTTP exception thrown: Instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 could not be found. Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Request method failure captured: Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 HTTP/1.1 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DK5haYkeW7gxcayszPhXgU5H5bmdxPKEhKBCKbPbHTTVF_JaNc2JHiSHRoZ2sXcpCQaR2taATjX7vcddH9FFAnqvwRSVgprji1vKQO2B2qlEJRmc4s5BB50lRLCLks2NlS2y-ma-ena28hmLbf96JKX8PorODioz5dSpktGMHPxExI Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 406107b53d424678a716867f11bebae2 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesSnapshotTestJSON-109220470 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/406107b53d424678a716867f11bebae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_406107b53d424678a716867f11bebae2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/406107b53d424678a716867f11bebae2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/406107b53d424678a716867f11bebae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesSnapshotTestJSON-109220470 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 406107b53d424678a716867f11bebae2 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-109220470 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesSnapshotTestJSON-109220470-project Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: df8c67406d8f4722a1234aad34c75194 Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesSnapshotTestJSON-109220470-project Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 could not be found. Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'a994ae5a-a759-4e2e-94d6-4ff6acd3eef1'} Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 could not be found. Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 could not be found. Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:13.545224 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 could not be found. Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Returning 404 to user: Instance a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:13.555435 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4b4659a4-e361-4a87-b716-f1d43d828feb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1" status: 404 len: 111 microversion: 2.1 time: 0.114272 Jul 14 15:19:13.556730 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2880/5592] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:13 2022] GET /compute/v2.1/servers/a994ae5a-a759-4e2e-94d6-4ff6acd3eef1 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:13.714636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:13.733354 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6d972dd-c402-4706-b6f1-203fbb1e0860 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.504943 Jul 14 15:19:13.734332 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2713/5593] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:13 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:14.009188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:14.009701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:14.022230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:14.022947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:14.024254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:14.024969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:14.678664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:14.696998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b4b30a42-67e1-41c0-abd2-96a59830b191 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1315 microversion: 2.1 time: 0.692251 Jul 14 15:19:14.701349 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2881/5594] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:14 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:14.756354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:14.760860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:14.792835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:14.794144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:14.796001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:14.799358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:15.525616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:15.579528 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-348fd637-94dd-4ba3-b412-fb8249781a91 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.826079 Jul 14 15:19:15.585230 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2714/5595] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:14 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:15.721154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:15.722458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:15.740069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:15.741535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:15.744430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:15.746091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.378480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:16.390924 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54d22958-99f5-4c4b-a03f-abdaa1e8b86e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1463 microversion: 2.1 time: 0.675594 Jul 14 15:19:16.395144 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2882/5596] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:15 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1463 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:16.463733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:16.465540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:16.491891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=46 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:16.531310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.531310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.531310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.531310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.601302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:16.602222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:16.617812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.631380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.635532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:16.637126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:16.702144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:19:17.126960 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-14cd41a0-1b1b-45e3-8037-3cd1d7b31524 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "DELETE /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 204 len: 0 microversion: 2.1 time: 0.666814 Jul 14 15:19:17.133018 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2715/5597] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:19:16 2022] DELETE /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:19:17.144190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:17.144886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:17.174971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:17.184677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:17.186313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:17.187076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:17.366243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:17.411059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7018a74-5b3b-4f24-bcb1-e0524572b270 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1522 microversion: 2.1 time: 0.813699 Jul 14 15:19:17.416283 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2883/5598] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:16 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1522 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:17.876070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:17.894438 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ae6ef85-c5aa-45cf-9607-ad2433359ace tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1469 microversion: 2.1 time: 0.759235 Jul 14 15:19:17.896454 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2716/5599] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:17 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1469 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:18.443069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:18.443786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:18.462861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:18.464453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:18.465519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:18.466166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:18.914056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:18.916010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:18.937793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:18.943832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:18.945386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:18.950670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:19.451596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:19.477197 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69293d3d-a039-4268-b769-46229c6e7d5d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1502 microversion: 2.1 time: 1.038047 Jul 14 15:19:19.492940 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2884/5600] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:18 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1502 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:19.508994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:19.512334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:19.522136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:19.527487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:19.529136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:19.530697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:19.532813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:20.090839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:20.160360 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8fff4821-6be5-40f9-95ef-cea7c4df26c3 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1469 microversion: 2.1 time: 1.249358 Jul 14 15:19:20.181617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2717/5601] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:18 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1469 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:20.520592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:20.579765 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c52fb3de-8025-41cb-830f-7a2c6474b93d tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1515 microversion: 2.1 time: 1.078836 Jul 14 15:19:20.580864 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2885/5602] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:19 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1515 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:20.601776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4af75a2a-aeca-4979-83e4-e6b791c685ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:20.603180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4af75a2a-aeca-4979-83e4-e6b791c685ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: cdd01143-88d5-4094-8178-ca070ff0711b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:20.617884 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4af75a2a-aeca-4979-83e4-e6b791c685ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Instance cdd01143-88d5-4094-8178-ca070ff0711b could not be found. Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4af75a2a-aeca-4979-83e4-e6b791c685ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/cdd01143-88d5-4094-8178-ca070ff0711b/action HTTP/1.1 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 14 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: {"rescue": {}} Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance cdd01143-88d5-4094-8178-ca070ff0711b could not be found. Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'cdd01143-88d5-4094-8178-ca070ff0711b', 'body': {'rescue': {}}} Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdd01143-88d5-4094-8178-ca070ff0711b could not be found. Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdd01143-88d5-4094-8178-ca070ff0711b could not be found. Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:19:20.639255 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdd01143-88d5-4094-8178-ca070ff0711b could not be found. Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4af75a2a-aeca-4979-83e4-e6b791c685ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 404 to user: Instance cdd01143-88d5-4094-8178-ca070ff0711b could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4af75a2a-aeca-4979-83e4-e6b791c685ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/cdd01143-88d5-4094-8178-ca070ff0711b/action" status: 404 len: 111 microversion: 2.1 time: 0.048385 Jul 14 15:19:20.651442 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2718/5603] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:20 2022] POST /compute/v2.1/servers/cdd01143-88d5-4094-8178-ca070ff0711b/action => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:20.677876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:20.678879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:20.721025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-daf30773-7eea-4044-a026-ac9c3d954709 req-a19d31dd-e7ea-4291-b356-e98e64f87e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b3533e-ca85-48db-b5a6-e120e2c16901", "name": "network-vif-deleted", "tag": "2bb0c347-d475-4ef2-95c8-66ede6074885"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:20.731865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:20.734171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:20.738003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:20.738003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:20.775734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-daf30773-7eea-4044-a026-ac9c3d954709 req-a19d31dd-e7ea-4291-b356-e98e64f87e6b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:20.777774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-daf30773-7eea-4044-a026-ac9c3d954709 req-a19d31dd-e7ea-4291-b356-e98e64f87e6b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:20.815525 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-daf30773-7eea-4044-a026-ac9c3d954709 req-a19d31dd-e7ea-4291-b356-e98e64f87e6b service nova] Creating event network-vif-deleted:2bb0c347-d475-4ef2-95c8-66ede6074885 for instance 89b3533e-ca85-48db-b5a6-e120e2c16901 on n-h1-768852-23 Jul 14 15:19:20.845622 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-daf30773-7eea-4044-a026-ac9c3d954709 req-a19d31dd-e7ea-4291-b356-e98e64f87e6b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133070 Jul 14 15:19:20.846274 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2719/5604] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:19:21.016656 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c12e744-0e7b-45a2-82cf-78b13f3fe7c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action" status: 202 len: 0 microversion: 2.1 time: 0.353606 Jul 14 15:19:21.021616 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2886/5605] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:20 2022] POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:19:21.044912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:21.046248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:21.092304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:21.093508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:21.095137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:21.100083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:21.200461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:21.201380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:21.223941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:21.226834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:21.231879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:21.236072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:21.473291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:21.474234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:21.475914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lazy-loading 'fault' on Instance uuid 89b3533e-ca85-48db-b5a6-e120e2c16901 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:19:21.576276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:21.598951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95c94e22-98df-4193-b352-eb874a554f8a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1520 microversion: 2.1 time: 0.571174 Jul 14 15:19:21.603524 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2720/5606] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:21 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1520 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:21.691922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a85e467c4d684346b1a576e99229b551', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff686edfadf043f3a0a1bdcac2eba712', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:21.732799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f7bce26d-7fb2-4b29-b160-7eaf22ac5cc7 tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 200 len: 1305 microversion: 2.1 time: 0.539668 Jul 14 15:19:21.733416 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2887/5607] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:21 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 1305 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:22.618514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:22.620682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:22.650280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:22.651381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:22.652592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:22.653300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:22.752767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:22.753459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] [instance: 89b3533e-ca85-48db-b5a6-e120e2c16901] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:22.768447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:22.768905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:22.769702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:22.772149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:22.825005 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] HTTP exception thrown: Instance 89b3533e-ca85-48db-b5a6-e120e2c16901 could not be found. Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Request method failure captured: Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 HTTP/1.1 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DPab-Di50a8meXXiNG-_cVNAGKbIl-TzFL22qXXPzaj6pbvyoYeTC4J0KVwoZwi02Kf3sLstY_ewfKCc2VvgG7Og4Wgjm_Ha8Wv1-yT5R_OWZdImk1-hLhTmtO7PYpq5G-DGoy_ZGcS00K6NMBiAIgnaZr-SB0ang4mHOvvPgJUdig Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: ff686edfadf043f3a0a1bdcac2eba712 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesNegativeTest-1895899844 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ff686edfadf043f3a0a1bdcac2eba712"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_ff686edfadf043f3a0a1bdcac2eba712"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/ff686edfadf043f3a0a1bdcac2eba712"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/ff686edfadf043f3a0a1bdcac2eba712"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesNegativeTest-1895899844 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: ff686edfadf043f3a0a1bdcac2eba712 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesNegativeTest-1895899844 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesNegativeTest-1895899844-project Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a85e467c4d684346b1a576e99229b551 Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesNegativeTest-1895899844-project Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 89b3533e-ca85-48db-b5a6-e120e2c16901 could not be found. Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '89b3533e-ca85-48db-b5a6-e120e2c16901'} Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b3533e-ca85-48db-b5a6-e120e2c16901 could not be found. Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b3533e-ca85-48db-b5a6-e120e2c16901 could not be found. Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:22.837460 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b3533e-ca85-48db-b5a6-e120e2c16901 could not be found. Jul 14 15:19:22.846693 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:22.854828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] Returning 404 to user: Instance 89b3533e-ca85-48db-b5a6-e120e2c16901 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:22.857066 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a27b31c-b209-4872-a93d-75d59b56bd0e tempest-VolumesNegativeTest-1895899844 tempest-VolumesNegativeTest-1895899844-project] 10.222.0.98 "GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901" status: 404 len: 111 microversion: 2.1 time: 0.110553 Jul 14 15:19:22.866664 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2888/5608] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:22 2022] GET /compute/v2.1/servers/89b3533e-ca85-48db-b5a6-e120e2c16901 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:19:23.224795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:23.273591 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4817ed6-6a08-41eb-9965-9ea2702d88a8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1500 microversion: 2.1 time: 0.659030 Jul 14 15:19:23.274810 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2721/5609] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:22 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1500 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:23.315421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:23.322875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:23.339955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:23.341258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:23.346564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:23.349883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:23.405831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lazy-loading 'flavor' on Instance uuid ea857aa4-0a92-4765-a7df-0645eea1dbad {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:19:23.428979 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Cannot 'rescue' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state paused Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action HTTP/1.1 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 14 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: {"rescue": {}} Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'rescue' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state paused Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'ea857aa4-0a92-4765-a7df-0645eea1dbad', 'body': {'rescue': {}}} Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad in vm_state paused. Cannot rescue while the instance is in this state. Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state paused Jul 14 15:19:23.434592 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state paused Jul 14 15:19:23.446874 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:23.458946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 409 to user: Cannot 'rescue' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state paused {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:23.462182 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c53cdc1f-428d-4b33-800b-1f1fb56aeb8f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action" status: 409 len: 144 microversion: 2.1 time: 0.160627 Jul 14 15:19:23.464659 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2889/5610] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:23 2022] POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action => generated 144 bytes in 165 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:19:23.482579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:23.483622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:23.538284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:23.540588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:23.541495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:23.542112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:23.745521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8501d307-27db-46a2-95bd-27a70c113880 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action" status: 202 len: 0 microversion: 2.1 time: 0.262779 Jul 14 15:19:23.751792 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2722/5611] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:23 2022] POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:19:23.762074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:23.762783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:23.790020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:23.790971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:23.803323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:23.808174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:24.776870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:24.798874 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dc7d85f5-2bb6-40de-abea-bff2550ac8ba tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1507 microversion: 2.1 time: 1.041679 Jul 14 15:19:24.800175 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2890/5612] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:23 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1507 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:25.836095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:25.842830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:25.883900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:25.884447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:25.885513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:25.886313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:25.936114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:26.447509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:26.465847 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bef56b47-a857-45bc-863b-5bdfa6f12669 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1515 microversion: 2.1 time: 0.642907 Jul 14 15:19:26.480334 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2723/5613] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:25 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1515 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:28.606326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-957948366", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f4583239-1585-47de-a051-cdfd124b6bfb"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:28.741582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] validate_networks() for [('f4583239-1585-47de-a051-cdfd124b6bfb', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:19:30.824020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:30.824830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:30.851686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:30.852305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:30.853143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:30.868989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:30.909778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:19:30.909778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:19:30.909778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:19:30.909778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:19:30.913379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:19:30.999292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:31.005462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:31.010874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lazy-loading 'flavor' on Instance uuid ea857aa4-0a92-4765-a7df-0645eea1dbad {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:19:31.013075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:31.013804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:31.084154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Getting quotas for project 406107b53d424678a716867f11bebae2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:19:31.095786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Getting quotas for user df8c67406d8f4722a1234aad34c75194 and project 406107b53d424678a716867f11bebae2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:19:31.128328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:19:31.130761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:19:31.230060 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2984adb8-7bd7-4a31-8a6a-c99a93a49eb9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action" status: 200 len: 32 microversion: 2.1 time: 0.411647 Jul 14 15:19:31.242587 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2724/5614] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:30 2022] POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 15:19:31.263656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:31.272010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:31.295823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:31.296284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:31.297186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:31.297849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:31.316984 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d26ad61-4de4-4ae5-9e29-faa35ad5320b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.718901 Jul 14 15:19:31.324386 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2891/5615] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:19:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:19:31.352195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-968d2448-e4aa-49cd-b455-95921a9e9049 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:31.355935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-968d2448-e4aa-49cd-b455-95921a9e9049 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:31.592980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-968d2448-e4aa-49cd-b455-95921a9e9049 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:31.625317 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-968d2448-e4aa-49cd-b455-95921a9e9049 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1218 microversion: 2.1 time: 0.287385 Jul 14 15:19:31.626460 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2892/5616] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:31 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:32.050141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:32.065283 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f869e995-f286-4be3-8a80-74ecf4b67983 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.813806 Jul 14 15:19:32.070422 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2725/5617] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:31 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:32.647148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:32.653598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:32.692007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:32.692976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:32.699380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:32.704274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:33.033765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:33.055514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a61937d8-2698-4ba4-9a17-67e7ee049fb9 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1214 microversion: 2.1 time: 0.412555 Jul 14 15:19:33.056592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2893/5618] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:32 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:33.088427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:33.091623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:33.131553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:33.132301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:33.133631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:33.134564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:34.078281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:34.079331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:34.107932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:34.109776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:34.112174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:34.115187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:34.335075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:34.377304 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33d48536-b8df-4348-b177-f5b8011f96c8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1276 microversion: 2.1 time: 0.303651 Jul 14 15:19:34.378384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2894/5619] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:34 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1276 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:34.630347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:34.646264 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-183f9ced-05fc-4e80-81aa-64f813a59325 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 1.558781 Jul 14 15:19:34.649672 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2726/5620] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:33 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:35.420568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:35.422751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:35.440169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.440950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:35.442041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.442751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:35.621428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:35.642976 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7dd1d574-1c16-4798-9302-8689f6395fc5 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1276 microversion: 2.1 time: 0.242316 Jul 14 15:19:35.646425 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2895/5621] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:35 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1276 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:35.666871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:35.668829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:35.678471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.679381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:35.680415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:35.683928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:36.533800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:36.545868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32b5a5cb-2d0e-49c1-8d2a-a69e373dc6bf tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.884222 Jul 14 15:19:36.551217 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2727/5622] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:35 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:36.662953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:36.663797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:36.673219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:36.684681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:36.685491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:36.686073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:36.735899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:37.361724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:37.377480 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e69e9b33-55bf-48a9-bf78-102afe2acf32 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.718421 Jul 14 15:19:37.378646 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2896/5623] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:36 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:37.564433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:37.566046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:37.578598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.584798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:37.586176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:37.586978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.052291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:38.065547 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-871c88da-3d0c-4ccf-a1d0-bee78c02986a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.505262 Jul 14 15:19:38.082167 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2728/5624] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:37 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:38.348048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9283ab5c-8560-4923-97aa-a7ed769714b7 req-eae29ee7-46d7-4862-a9a9-f175a483ab33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96", "tag": "c30871ee-b2c0-48f1-8c95-72c2ff5e3d1d"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:38.380336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9283ab5c-8560-4923-97aa-a7ed769714b7 req-eae29ee7-46d7-4862-a9a9-f175a483ab33 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:38.381167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9283ab5c-8560-4923-97aa-a7ed769714b7 req-eae29ee7-46d7-4862-a9a9-f175a483ab33 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.408393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9283ab5c-8560-4923-97aa-a7ed769714b7 req-eae29ee7-46d7-4862-a9a9-f175a483ab33 service nova] Creating event network-changed:c30871ee-b2c0-48f1-8c95-72c2ff5e3d1d for instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 on n-h1-768852-23 Jul 14 15:19:38.413250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:38.414216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:38.423221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:38.424097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.425124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:38.425746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:38.427364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9283ab5c-8560-4923-97aa-a7ed769714b7 req-eae29ee7-46d7-4862-a9a9-f175a483ab33 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088046 Jul 14 15:19:38.431174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2897/5625] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:38.738635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:38.751768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e246b582-ccf2-476e-9889-d9b64c90dae1 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.342756 Jul 14 15:19:38.763126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2729/5626] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:38 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:39.091761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:39.092494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:39.099504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:39.099853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:39.100839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:39.101266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:39.574281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:39.592056 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c592c0fe-c7e5-4592-bceb-43c10f01dd7a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.509327 Jul 14 15:19:39.609978 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2898/5627] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:39 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:39.771995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:39.773711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:39.782593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:39.783408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:39.784205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:39.784812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:39.987201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:40.004914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa65a5bd-ddf2-42a8-873c-b323a19c5eef tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.237625 Jul 14 15:19:40.020014 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2730/5628] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:39 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:40.617446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:40.618083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:40.630416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:40.630880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:40.631706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:40.633260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:41.036760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:41.039050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:41.054633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:41.055839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:41.056406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:41.059017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:41.060279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:41.235805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:41.247521 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f8c5c80-bdf0-480e-9907-b4a6f1389633 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.219006 Jul 14 15:19:41.250428 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2731/5629] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:41 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:41.475568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:41.501218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99ac43cd-4b93-4aad-ba3c-aa2d023ebb29 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.881615 Jul 14 15:19:41.501939 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2899/5630] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:40 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:42.268855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:42.272068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:42.287496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:42.288500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:42.289943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:42.290941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:42.519380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:42.529139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:42.534003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:42.544152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:42.544951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:42.546851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:42.548051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:42.579681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:42.594056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-092002d8-14c5-420d-87cb-9b2419e6c251 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.329822 Jul 14 15:19:42.595487 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2732/5631] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:42 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:43.050643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:43.065603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfd97200-a148-4ed6-9632-5748ac137fb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.550730 Jul 14 15:19:43.066835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2900/5632] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:42 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:43.618973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:43.625652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:43.635663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:43.636363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:43.637532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:43.640317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:44.087350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:44.096034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:44.121021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:44.122117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:44.130014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:44.130517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:44.131389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:44.154374 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08920beb-c4dc-40b9-b485-eab0104e5bdb tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.545674 Jul 14 15:19:44.159727 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2733/5633] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:43 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:44.409861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9411c64e-5e0a-492b-b58c-f74c4156c6fd req-7c436623-7452-43bc-a47d-ddf0804d51ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96", "name": "network-vif-plugged", "status": "completed", "tag": "c30871ee-b2c0-48f1-8c95-72c2ff5e3d1d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:44.425365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9411c64e-5e0a-492b-b58c-f74c4156c6fd req-7c436623-7452-43bc-a47d-ddf0804d51ef service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:44.425802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9411c64e-5e0a-492b-b58c-f74c4156c6fd req-7c436623-7452-43bc-a47d-ddf0804d51ef service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:44.432529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:44.451873 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06c49cb1-f1e5-4ae1-9346-bf835e1d6625 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.369210 Jul 14 15:19:44.454623 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2901/5634] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:44 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:44.476364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9411c64e-5e0a-492b-b58c-f74c4156c6fd req-7c436623-7452-43bc-a47d-ddf0804d51ef service nova] Creating event network-vif-plugged:c30871ee-b2c0-48f1-8c95-72c2ff5e3d1d for instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 on n-h1-768852-23 Jul 14 15:19:44.493937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9411c64e-5e0a-492b-b58c-f74c4156c6fd req-7c436623-7452-43bc-a47d-ddf0804d51ef service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080530 Jul 14 15:19:44.495324 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2734/5635] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:19:45.176033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:45.176657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:45.226289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:45.226939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:45.230213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:45.230756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:45.488029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:45.494612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:45.515625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:45.537403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:45.538574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:45.541711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:46.027457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:46.040585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f09ecbf1-0ec4-4e80-a8c1-749af7c0a792 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1318 microversion: 2.1 time: 0.869960 Jul 14 15:19:46.046945 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2902/5636] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:45 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1318 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:46.413420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:46.429018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ccc1feae-7f13-4d0c-b74c-fe74a6ad9617 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.949608 Jul 14 15:19:46.431531 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2735/5637] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:45 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:47.062844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:47.064509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:47.080497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.080957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.081869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.086003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.450245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:47.451554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:47.457681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:47.487120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.487722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.488658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.490948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.646735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:47.655157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1f8b7a4c-1f92-417a-be39-ff154c143f6f tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1506 microversion: 2.1 time: 0.596208 Jul 14 15:19:47.667504 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2903/5638] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:47 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:47.694076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11781228-a7d6-4024-905e-12625825155a", "device": "/dev/sdb"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:47.700671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:47.717416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.718061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.719019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:47.721000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:47.898158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:47.921678 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-29ee9acc-9a3d-4e75-9251-6dd9656946fa tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.473409 Jul 14 15:19:47.950519 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2736/5639] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:47 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:48.220983 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-90195be7-2f3f-4a76-b800-1ba247098f7c tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "POST /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.533778 Jul 14 15:19:48.222698 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2904/5640] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:19:47 2022] POST /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96/os-volume_attachments => generated 194 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:19:48.958273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:48.959917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:48.978283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:48.981344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:48.983132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:48.985757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:49.704107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:49.718961 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9e83c2ea-dc29-47b1-a712-2986dfced76f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.765602 Jul 14 15:19:49.727418 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2737/5641] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:48 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:50.039661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:50.040950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:50.044726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:50.058368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:50.058833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:50.059692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:50.060131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:50.210323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lazy-loading 'services' on Instance uuid c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:19:50.382213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-146fe9de-80f0-473f-a9be-b3aabb484c7a tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4/os-volume_attachments/840e277c-8001-4118-8ceb-e6df8f4e7d49" status: 202 len: 0 microversion: 2.1 time: 0.348423 Jul 14 15:19:50.383102 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2905/5642] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:19:50 2022] DELETE /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4/os-volume_attachments/840e277c-8001-4118-8ceb-e6df8f4e7d49 => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:19:50.755416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:50.756300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:50.783393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:50.783858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:50.786031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:50.786475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:51.345362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:51.349137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:19:51.380503 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4df81d87-4a39-45cf-b850-294f5821e3bc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.629720 Jul 14 15:19:51.381630 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2738/5643] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:50 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:19:52.398898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:52.399662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:52.425041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:52.425486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:52.432433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:52.439575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:53.302068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:53.324144 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15d6108a-6593-4ad3-a773-2dd23ea98ce0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.929176 Jul 14 15:19:53.325215 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2906/5644] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:52 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:54.341700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:54.343075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:54.351338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.352140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.352974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.353426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.672483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:54.688709 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36a06b17-782c-4c3f-80ff-5728e1042445 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1501 microversion: 2.1 time: 0.350209 Jul 14 15:19:54.690223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2739/5645] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:54 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1501 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:54.707565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ecd1826c-0358-438c-8a66-27317e6b7c3e"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:54.709524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:54.720954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.721731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.723311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.723959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.759338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Cannot 'attach_volume' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state rescued Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/os-volume_attachments HTTP/1.1 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 74 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: {"volumeAttachment": {"volumeId": "ecd1826c-0358-438c-8a66-27317e6b7c3e"}} Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: exception: Cannot 'attach_volume' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state rescued Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': 'ea857aa4-0a92-4765-a7df-0645eea1dbad', 'body': {'volumeAttachment': {'volumeId': 'ecd1826c-0358-438c-8a66-27317e6b7c3e'}}} Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 15:19:54.762464 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state rescued Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state rescued Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 409 to user: Cannot 'attach_volume' instance ea857aa4-0a92-4765-a7df-0645eea1dbad while it is in vm_state rescued {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22730c93-eabd-4512-bcb4-2549d4137dfc tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.061366 Jul 14 15:19:54.767625 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2907/5646] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:19:54 2022] POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/os-volume_attachments => generated 152 bytes in 63 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:19:54.778124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:19:54.778776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:54.786948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.787614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.788822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.789026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.884157 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cdba3ad4-0fd4-4a54-9c25-714316d3fcb4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action" status: 202 len: 0 microversion: 2.1 time: 0.113390 Jul 14 15:19:54.885562 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2740/5647] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:19:54 2022] POST /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:19:54.894846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:54.896300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:54.905942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.907023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:54.908917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:54.909974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:55.319062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:55.337753 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5b6b33dd-c209-4000-b276-f7220a1b0242 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1509 microversion: 2.1 time: 0.447505 Jul 14 15:19:55.339891 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2908/5648] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:54 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1509 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:56.369381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:56.370144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:56.396585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:56.397162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:56.398939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:56.399676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:56.675362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:56.696879 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-06230652-b776-401e-91ab-e22a3b248ea9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1509 microversion: 2.1 time: 0.333560 Jul 14 15:19:56.697860 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2741/5649] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:56 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:57.722681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:57.723561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:57.741181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:57.741799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:57.742756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:57.743510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:58.121673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:58.135975 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9670cdcc-935e-42ba-804d-faef642c4224 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1515 microversion: 2.1 time: 0.419468 Jul 14 15:19:58.151122 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2909/5650] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:57 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1515 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:19:58.994787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:58.995404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:59.011077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:59.011474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:59.017860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:59.019921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:59.080884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:19:59.298491 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1f1b397-2eca-4f92-a4af-873bc9a7633e tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "DELETE /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 204 len: 0 microversion: 2.1 time: 0.315145 Jul 14 15:19:59.299950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2742/5651] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:19:58 2022] DELETE /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:19:59.317482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:19:59.320660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:19:59.338972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:59.339557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:59.340385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:19:59.340848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:19:59.719802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:19:59.733187 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46718e3d-db0f-4ed3-a464-37b99744ef69 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1469 microversion: 2.1 time: 0.426522 Jul 14 15:19:59.734596 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2910/5652] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:19:59 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1469 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:00.753608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:00.754928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:00.776151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:00.776676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:00.777477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:00.777917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:01.086978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:01.100993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d2a93c47-c91b-42a6-b7c3-206dd6c2a2ff tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1469 microversion: 2.1 time: 0.353410 Jul 14 15:20:01.101947 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2743/5653] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:00 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1469 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:01.656777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dbfb1482-3829-49f5-8897-5ae0dc0706ee tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'create', calling method: .version_select at 0x7fdbf2ab9ee0>, body: {"keypair": {"name": "tempest-keypair-1427105593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8G7mCjwR4dmIXhr2pG+fBIwMbnb3Z/TpMSrKy/lvHuiD74OHFv2Lh8+YLivkT+x360PhlHjmxnDvc2/lll/vw+at2RAq/ZZcuDOZIHPRZ5meBqB4L/P8s/YHFnz+NTFw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:01.675896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-dbfb1482-3829-49f5-8897-5ae0dc0706ee tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for project cc180baee4ea4158b008e3a5c227aac8. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:20:01.683067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-dbfb1482-3829-49f5-8897-5ae0dc0706ee tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for user 7a00a929a3dd4608961f50265fd35caa and project cc180baee4ea4158b008e3a5c227aac8. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:20:01.716652 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dbfb1482-3829-49f5-8897-5ae0dc0706ee tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064746 Jul 14 15:20:01.718889 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2911/5654] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:20:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:02.133427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:02.135910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:02.176222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:02.177386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:02.180141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:02.181616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:02.228480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-74e4225f-f826-45ae-a3f9-36927f782a43 req-ed4e3dbb-a095-4141-8eea-184274b4f403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4", "name": "network-vif-deleted", "tag": "583c1e1f-78cb-46b5-b70a-49599cfd9e1e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:02.243391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-74e4225f-f826-45ae-a3f9-36927f782a43 req-ed4e3dbb-a095-4141-8eea-184274b4f403 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:02.243848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-74e4225f-f826-45ae-a3f9-36927f782a43 req-ed4e3dbb-a095-4141-8eea-184274b4f403 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:02.277630 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-74e4225f-f826-45ae-a3f9-36927f782a43 req-ed4e3dbb-a095-4141-8eea-184274b4f403 service nova] Creating event network-vif-deleted:583c1e1f-78cb-46b5-b70a-49599cfd9e1e for instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 on n-h2-768852-23 Jul 14 15:20:02.285864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-74e4225f-f826-45ae-a3f9-36927f782a43 req-ed4e3dbb-a095-4141-8eea-184274b4f403 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062596 Jul 14 15:20:02.288839 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2912/5655] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:02.360282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3d6431ad47224fc384a9110b02b5b6bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e077c5a4c14941f28b107c91952a0de8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:02.373507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55f2f801-85d1-4bef-a1ad-c2e9567bf903 tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 200 len: 1427 microversion: 2.1 time: 0.253953 Jul 14 15:20:02.374886 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2744/5656] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:02 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 1427 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:03.399002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:03.402137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] [instance: c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:03.415204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:03.420518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:03.421502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:03.421965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:03.480250 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] HTTP exception thrown: Instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 could not be found. Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Request method failure captured: Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 HTTP/1.1 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DNn1Yztaudu6YtLg9HI9L3mrTlIXiybwdrNP2Pe0ih0N_EN6rx38-581Vq1JbsDZovnpCEp568etkAPN-2qXzzhhCGXRgXfuvhrfiBYGaT0pORaaQUNg1srIASRl2V-Vp7DM7460tEVPBUr1rZ-YYLzmyRBz4IQqrHOdL5kMA5Iv1k Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e077c5a4c14941f28b107c91952a0de8 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-VolumesBackupsTest-507455166 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e077c5a4c14941f28b107c91952a0de8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e077c5a4c14941f28b107c91952a0de8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e077c5a4c14941f28b107c91952a0de8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e077c5a4c14941f28b107c91952a0de8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-VolumesBackupsTest-507455166 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e077c5a4c14941f28b107c91952a0de8 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-VolumesBackupsTest-507455166 Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-VolumesBackupsTest-507455166-project Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 3d6431ad47224fc384a9110b02b5b6bb Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-VolumesBackupsTest-507455166-project Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 could not be found. Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4'} Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 could not be found. Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 could not be found. Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:20:03.485358 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 could not be found. Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] Returning 404 to user: Instance c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8ca22882-238a-44f9-8abd-075fd792ae6c tempest-VolumesBackupsTest-507455166 tempest-VolumesBackupsTest-507455166-project] 10.222.0.98 "GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4" status: 404 len: 111 microversion: 2.1 time: 0.097693 Jul 14 15:20:03.492178 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2913/5657] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:03 2022] GET /compute/v2.1/servers/c7b3995d-a7c5-4ee1-b468-366dd0a2f2c4 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:20:05.997026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-987160356", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c634329c-4e6d-4980-80a1-03409d0c61da"}], "security_groups": [{"name": "tempest-securitygroup--678844996"}], "key_name": "tempest-keypair-1427105593", "user_data": "}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:06.232778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] validate_networks() for [('c634329c-4e6d-4980-80a1-03409d0c61da', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:20:07.117906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:20:07.120783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:20:07.121867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:20:07.123706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:20:07.126225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:20:07.141160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:07.142371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:07.145173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:07.145913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:07.172782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for project cc180baee4ea4158b008e3a5c227aac8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:20:07.197600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Getting quotas for user 7a00a929a3dd4608961f50265fd35caa and project cc180baee4ea4158b008e3a5c227aac8. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:20:07.228030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:20:07.230821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:20:07.308995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74382c98-a3a7-4808-9f58-23a4f87f7995 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.316062 Jul 14 15:20:07.310000 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2745/5658] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:20:05 2022] POST /compute/v2.1/servers => generated 408 bytes in 1318 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:20:07.325215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6954625-1804-4cb3-8278-9cfa13adc834 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:07.327775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a6954625-1804-4cb3-8278-9cfa13adc834 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:07.434377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a6954625-1804-4cb3-8278-9cfa13adc834 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:07.448091 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6954625-1804-4cb3-8278-9cfa13adc834 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1245 microversion: 2.1 time: 0.128313 Jul 14 15:20:07.448960 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2914/5659] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:07 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1245 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:08.467649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:08.468423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:08.493330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:08.493797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:08.494892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:08.495538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:08.607968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:08.618661 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-983c2138-abcd-49a1-b22b-0455470b2619 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1297 microversion: 2.1 time: 0.157404 Jul 14 15:20:08.632558 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2746/5660] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:08 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1297 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:09.650643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:09.651304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:09.665138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:09.665681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:09.666562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:09.667087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:09.706484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:09.838218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:09.864078 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eea63ae4-8b43-4830-94a6-21e594d0d9ac tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1303 microversion: 2.1 time: 0.217618 Jul 14 15:20:09.875867 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2915/5661] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:09 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1303 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:10.781978 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:20:10.781978 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:20:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:20:10.882000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:10.882636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:10.893565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:10.895166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:10.896021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:10.897440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:11.205849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:11.223630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79104570-dadc-4d0a-8471-d387947681c4 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1303 microversion: 2.1 time: 0.345680 Jul 14 15:20:11.228353 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2747/5662] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:10 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1303 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:12.282875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:12.285312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:12.295497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:12.295994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:12.297398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:12.298247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:12.593663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:12.605310 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8121c05e-f48a-4a76-b9e2-2fb7a6957254 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.366367 Jul 14 15:20:12.616941 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2916/5663] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:12 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:12.761368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3a88062f-1a34-4440-bff0-60383ce1ab9e req-3836d8a8-94ba-4a9c-98e0-b1285a0bdba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81881218-89e9-42ae-9a5d-d673a59ca766", "tag": "5b695af5-27aa-4060-9f9d-0a8463a9fca9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:12.811927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3a88062f-1a34-4440-bff0-60383ce1ab9e req-3836d8a8-94ba-4a9c-98e0-b1285a0bdba0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:12.813039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3a88062f-1a34-4440-bff0-60383ce1ab9e req-3836d8a8-94ba-4a9c-98e0-b1285a0bdba0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:12.869885 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3a88062f-1a34-4440-bff0-60383ce1ab9e req-3836d8a8-94ba-4a9c-98e0-b1285a0bdba0 service nova] Creating event network-changed:5b695af5-27aa-4060-9f9d-0a8463a9fca9 for instance 81881218-89e9-42ae-9a5d-d673a59ca766 on n-h2-768852-23 Jul 14 15:20:12.891124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3a88062f-1a34-4440-bff0-60383ce1ab9e req-3836d8a8-94ba-4a9c-98e0-b1285a0bdba0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136398 Jul 14 15:20:12.894633 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2748/5664] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:20:13.633443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:13.634357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:13.664067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:13.664454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:13.668263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:13.669261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:13.866011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:13.877134 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92714b53-77de-434c-9f93-1f3c6d98374a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.258853 Jul 14 15:20:13.878355 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2917/5665] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:13 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:14.896806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:14.897588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:14.911441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:14.911904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:14.912979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:14.913439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:15.217187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:15.229428 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a04dc03-6ca5-440d-a352-91a29ebf9fef tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.337723 Jul 14 15:20:15.230050 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2749/5666] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:14 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:16.246345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:16.256206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:16.280089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:16.280780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:16.281584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:16.282005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:16.713244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:16.729419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e185b173-cf70-4ba3-9587-91ea7de67ef0 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.486343 Jul 14 15:20:16.731503 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2918/5667] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:16 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:17.748649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:17.751943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:17.763100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:17.767390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:17.783523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:17.799236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.800174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:17.801340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:17.805370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:18.227468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:18.241579 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-34dbbb95-359e-4489-9b28-f724fdb3e0da tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.497283 Jul 14 15:20:18.250260 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2750/5668] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:17 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:18.584491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-70b7e1ef-537f-4aaa-b7cc-8e05b3b1e6b4 req-1d7b480a-5a6d-4cd3-aae1-61821a1b4dad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81881218-89e9-42ae-9a5d-d673a59ca766", "name": "network-vif-plugged", "status": "completed", "tag": "5b695af5-27aa-4060-9f9d-0a8463a9fca9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:18.590808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:18.610258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-70b7e1ef-537f-4aaa-b7cc-8e05b3b1e6b4 req-1d7b480a-5a6d-4cd3-aae1-61821a1b4dad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:18.611028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-70b7e1ef-537f-4aaa-b7cc-8e05b3b1e6b4 req-1d7b480a-5a6d-4cd3-aae1-61821a1b4dad service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:18.644908 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-70b7e1ef-537f-4aaa-b7cc-8e05b3b1e6b4 req-1d7b480a-5a6d-4cd3-aae1-61821a1b4dad service nova] Creating event network-vif-plugged:5b695af5-27aa-4060-9f9d-0a8463a9fca9 for instance 81881218-89e9-42ae-9a5d-d673a59ca766 on n-h2-768852-23 Jul 14 15:20:18.665853 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-70b7e1ef-537f-4aaa-b7cc-8e05b3b1e6b4 req-1d7b480a-5a6d-4cd3-aae1-61821a1b4dad service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084789 Jul 14 15:20:18.671450 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2919/5669] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:19.273647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:19.274895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:19.316895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:19.322286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:19.323137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:19.327459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:19.661948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:19.672639 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-31b14ddd-a57d-49e9-872f-177a0b20518b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.404267 Jul 14 15:20:19.680304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2751/5670] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:19 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:20.703523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:20.704419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:20.711107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:20.729667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.730138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:20.731169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:20.731816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:21.383587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:21.392720 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe00bcbc-90a3-499b-b0dc-f901f42cd971 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1370 microversion: 2.1 time: 0.698571 Jul 14 15:20:21.402489 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2920/5671] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:20 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1370 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:22.413914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:22.415643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:22.424822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:22.425754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:22.427568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:22.428360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:22.513997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:22.762267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:22.785955 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-043a96fa-4f46-4ddb-bc7b-cc88623a3c03 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1563 microversion: 2.1 time: 0.378845 Jul 14 15:20:22.796325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2752/5672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:22 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1563 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:22.826854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:22.828818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:22.849829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:22.851030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:22.853186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:22.853759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:23.009866 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-91e55729-01bf-4439-97bd-e0d1c4fb5990 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193451 Jul 14 15:20:23.017017 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2921/5673] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:20:22 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:23.722854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:23.724088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:23.740871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:23.741679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:23.743132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:23.744214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:24.037323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lazy-loading 'services' on Instance uuid ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:20:24.264079 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d0e265d-66d7-46c4-9305-bf00a96d85b3 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96/os-volume_attachments/11781228-a7d6-4024-905e-12625825155a" status: 202 len: 0 microversion: 2.1 time: 0.543770 Jul 14 15:20:24.268639 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2753/5674] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:20:23 2022] DELETE /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96/os-volume_attachments/11781228-a7d6-4024-905e-12625825155a => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:20:24.871606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b5b7f340-a7e8-40b6-8090-a6076bf25455 req-c474dbfd-8f71-4624-a365-4d89d629777d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81881218-89e9-42ae-9a5d-d673a59ca766", "tag": "5b695af5-27aa-4060-9f9d-0a8463a9fca9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:24.917408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b5b7f340-a7e8-40b6-8090-a6076bf25455 req-c474dbfd-8f71-4624-a365-4d89d629777d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:24.923093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b5b7f340-a7e8-40b6-8090-a6076bf25455 req-c474dbfd-8f71-4624-a365-4d89d629777d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:24.960608 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b5b7f340-a7e8-40b6-8090-a6076bf25455 req-c474dbfd-8f71-4624-a365-4d89d629777d service nova] Creating event network-changed:5b695af5-27aa-4060-9f9d-0a8463a9fca9 for instance 81881218-89e9-42ae-9a5d-d673a59ca766 on n-h2-768852-23 Jul 14 15:20:24.972244 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b5b7f340-a7e8-40b6-8090-a6076bf25455 req-c474dbfd-8f71-4624-a365-4d89d629777d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119373 Jul 14 15:20:24.974469 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2922/5675] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:32.233044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:32.234565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:32.250719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:32.251588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:32.253754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:32.255996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:32.310378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:20:32.488408 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-28a8db37-5fe8-438d-a20b-4db014749b69 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 204 len: 0 microversion: 2.1 time: 0.260929 Jul 14 15:20:32.489771 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2754/5676] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:20:32 2022] DELETE /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:20:32.505446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:32.505932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:32.514343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:32.514800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:32.515619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:32.516063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:33.207596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:33.216944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a930cc9e-3ac4-433c-991f-9f3d06bfc91b tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1512 microversion: 2.1 time: 0.722815 Jul 14 15:20:33.227190 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2923/5677] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:32 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1512 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:34.235913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:34.236619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:34.274592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.275387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:34.276606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:34.277335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:35.032795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:35.048556 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d2a09d08-bc1c-4bc6-9ccf-d7e6f8283602 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1512 microversion: 2.1 time: 0.817769 Jul 14 15:20:35.050325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2755/5678] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:34 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1512 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:36.076248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:36.077077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:36.095690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:36.096553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:36.097026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:36.097555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:36.255447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:36.264432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94eb889c-3354-42c4-82ce-f8f8e6804ada tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1470 microversion: 2.1 time: 0.201313 Jul 14 15:20:36.272482 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2924/5679] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:36 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1470 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:36.673418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-45e665c8-0780-4125-8131-2635d8d74be7 req-006bb14f-444d-445f-a575-0120b5cec9cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96", "name": "network-vif-deleted", "tag": "c30871ee-b2c0-48f1-8c95-72c2ff5e3d1d"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:36.695111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-45e665c8-0780-4125-8131-2635d8d74be7 req-006bb14f-444d-445f-a575-0120b5cec9cd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:36.704828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-45e665c8-0780-4125-8131-2635d8d74be7 req-006bb14f-444d-445f-a575-0120b5cec9cd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:36.729973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-45e665c8-0780-4125-8131-2635d8d74be7 req-006bb14f-444d-445f-a575-0120b5cec9cd service nova] Creating event network-vif-deleted:c30871ee-b2c0-48f1-8c95-72c2ff5e3d1d for instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 on n-h1-768852-23 Jul 14 15:20:36.752905 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-45e665c8-0780-4125-8131-2635d8d74be7 req-006bb14f-444d-445f-a575-0120b5cec9cd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083773 Jul 14 15:20:36.756371 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2756/5680] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:20:37.284833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:37.285440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:37.305366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:37.305817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:37.306859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:37.312704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:37.398373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:37.398581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:37.400980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lazy-loading 'fault' on Instance uuid ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:20:37.517237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8c67406d8f4722a1234aad34c75194', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '406107b53d424678a716867f11bebae2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:20:37.527354 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfb2bdc3-285b-4d7e-8fe7-eafab221819a tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 200 len: 1308 microversion: 2.1 time: 0.245394 Jul 14 15:20:37.527586 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2925/5681] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:37 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:20:38.546128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:20:38.547585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] [instance: ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:38.565350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:38.567062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:38.570281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:38.571526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:38.609664 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] HTTP exception thrown: Instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 could not be found. Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Request method failure captured: Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 HTTP/1.1 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DK5haYkeW7gxcayszPhXgU5H5bmdxPKEhKBCKbPbHTTVF_JaNc2JHiSHRoZ2sXcpCQaR2taATjX7vcddH9FFAnqvwRSVgprji1vKQO2B2qlEJRmc4s5BB50lRLCLks2NlS2y-ma-ena28hmLbf96JKX8PorODioz5dSpktGMHPxExI Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 406107b53d424678a716867f11bebae2 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-VolumesSnapshotTestJSON-109220470 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/406107b53d424678a716867f11bebae2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_406107b53d424678a716867f11bebae2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/406107b53d424678a716867f11bebae2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/406107b53d424678a716867f11bebae2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-VolumesSnapshotTestJSON-109220470 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 406107b53d424678a716867f11bebae2 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-109220470 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-VolumesSnapshotTestJSON-109220470-project Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: df8c67406d8f4722a1234aad34c75194 Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-VolumesSnapshotTestJSON-109220470-project Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 could not be found. Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96'} Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 could not be found. Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 could not be found. Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:20:38.622340 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 could not be found. Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:20:38.628628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] Returning 404 to user: Instance ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:20:38.629214 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73659b02-faad-4ec5-930d-c7f8d2f57bc8 tempest-VolumesSnapshotTestJSON-109220470 tempest-VolumesSnapshotTestJSON-109220470-project] 10.222.0.98 "GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96" status: 404 len: 111 microversion: 2.1 time: 0.088964 Jul 14 15:20:38.633197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2757/5682] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:20:38 2022] GET /compute/v2.1/servers/ebadad0d-6a1b-4cff-92f0-f5f6e8f91f96 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:20:58.317096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2c1e2f05-754d-475a-8ae0-9fa1d9b45b69"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:20:58.318995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:20:58.334178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=13 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:58.335163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=57 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:20:58.343582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:58.344458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:58.345508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:20:58.346126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:20:58.947366 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a887eeb5-6c19-4d74-a4ba-45be37ebaf48 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.633507 Jul 14 15:20:58.963075 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2926/5683] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:20:58 2022] POST /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 194 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:16.493791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:16.494767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:16.498949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:16.504405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=38,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:16.521472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.522265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.523335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:16.524037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:16.590614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lazy-loading 'flavor' on Instance uuid 81881218-89e9-42ae-9a5d-d673a59ca766 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:21:16.957438 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f68740b-c360-4c52-baff-cc7939664b6f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/action" status: 200 len: 32 microversion: 2.1 time: 0.466787 Jul 14 15:21:16.959380 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2758/5684] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:21:16 2022] POST /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/action => generated 32 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:21:16.973741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:16.978089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:16.993260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:16.998096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:17.036343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:17.037243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:17.038518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:17.043637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:17.625427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:17.645040 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b52bd723-cb28-4b38-a2b6-3ffb59e3667a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.678609 Jul 14 15:21:17.655705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2927/5685] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:16 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:18.679029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:18.686363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:18.712488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:18.719415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:18.720996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:18.721808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:19.540093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:19.560361 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3dacb878-1d0e-40a6-b6f8-35a200e9625e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.891068 Jul 14 15:21:19.572343 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2759/5686] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:18 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:20.586815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:20.589227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:20.613468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:20.614620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:20.616371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:20.617701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:21.259929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:21.280249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9bef13b-3d44-497d-a506-12aa50f8dc5a tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.702234 Jul 14 15:21:21.302450 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2928/5687] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:20 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:22.300182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:22.301415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:22.321209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:22.329522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:22.330605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:22.331069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:22.754145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:22.794157 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0486dee-b6b4-4d40-b8a7-a1a2630b093e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.499114 Jul 14 15:21:22.804742 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2760/5688] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:22 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:23.830958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:23.833545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:23.866826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:23.868029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:23.871845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:23.874353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:24.639389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:24.656992 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ad50b87-7a59-4ce9-ba4e-b43b724299f2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.839263 Jul 14 15:21:24.657840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2929/5689] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:23 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:25.691129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:25.691985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:25.707708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:25.708324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:25.709581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:25.710736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:26.030201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:26.041116 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eb8995fe-dcfd-4ea9-b91f-2244533479b1 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.355189 Jul 14 15:21:26.046271 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2761/5690] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:25 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:27.066234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:27.067536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:27.083551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:27.092941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:27.094097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:27.094725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:27.674334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:27.691162 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-366995e8-5dfc-40fd-af10-a815c1f14817 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.631402 Jul 14 15:21:27.694296 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2930/5691] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:27 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:28.713944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:28.716264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:28.741591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:28.745318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:28.751319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:28.756565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:29.307641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:29.316685 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73ff5832-42fc-4bbe-b6af-79e0795187b8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.609483 Jul 14 15:21:29.317284 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2762/5692] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:28 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:30.335847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:30.337631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:30.393979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:30.396712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:30.402080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:30.403134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:30.720510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:30.742272 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-147c2a13-e4a1-4b2c-a39a-9023461271d2 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.411643 Jul 14 15:21:30.752817 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2931/5693] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:30 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:31.761580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:31.762868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:31.773545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:31.774722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:31.777570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:31.778771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:32.219248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:32.230080 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d36651f9-b033-4437-a11f-1733025a8e8e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.473183 Jul 14 15:21:32.232186 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2763/5694] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:31 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:33.261529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:33.265610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:33.282461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:33.283202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:33.287002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:33.287768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:33.660445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:33.688637 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2043157-f6aa-4372-bdc3-67c73318c71e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.443648 Jul 14 15:21:33.705232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2932/5695] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:33 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:34.722560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:34.723264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:34.733419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:34.737724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:34.739036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:34.739538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:35.302300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:35.327103 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-417bf3c5-21b7-41a7-97fd-0ef79500f425 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.608347 Jul 14 15:21:35.340128 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2764/5696] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:34 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:36.359447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:36.365314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:36.375814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:36.376865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:36.378170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:36.378812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:36.589594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:36.603896 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-680bbd76-a03e-4ecd-a97a-037880befba8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.248410 Jul 14 15:21:36.608012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2933/5697] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:36 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:37.637336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:37.637963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:37.650239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:37.653543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:37.654622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:37.657479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:38.056138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:38.075316 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0181cf3e-b6a0-457f-b033-0c5582c28487 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.441957 Jul 14 15:21:38.076656 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2765/5698] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:37 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:39.100190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:39.101080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:39.116420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:39.116889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:39.120037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:39.120566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:39.516676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:39.540016 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfda5502-7f92-4c73-94c8-2efe49331ebd tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.449409 Jul 14 15:21:39.543612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2934/5699] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:39 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:40.558638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:40.559359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:40.573661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:40.575313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:40.577179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:40.578913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:41.849753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:41.866043 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6e9e804-9d25-4b67-9040-074335157011 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 1.311723 Jul 14 15:21:41.870023 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2766/5700] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:40 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:42.885763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:42.886370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:42.906078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:42.907876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:42.910625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:42.911302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:43.271435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:43.306814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c012da7-ccb7-43b2-8b47-4bf4b9d94439 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.425135 Jul 14 15:21:43.310239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2935/5701] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:42 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:44.344438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:44.346654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:44.359579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:44.360643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:44.362020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:44.362990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:44.524667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:44.534687 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9952d345-f5a6-4845-80ea-a6b9620998fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.198152 Jul 14 15:21:44.536016 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2767/5702] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:44 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:45.557730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:45.558841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:45.577196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:45.583888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:45.584824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:45.585317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:45.946676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:45.961473 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8698a314-1ef0-43ce-b6e5-038f1ec9217f tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.410731 Jul 14 15:21:45.963189 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2936/5703] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:45 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:46.981025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:46.981828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:46.985458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=21 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:46.999324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:47.003582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:47.005241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:47.009284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:47.015388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:47.357554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:47.371937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-502cf6bc-3e3d-4666-9893-a8c7a168d066 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1734 microversion: 2.1 time: 0.395721 Jul 14 15:21:47.383839 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2768/5704] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:46 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1734 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:48.389837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:48.390460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:48.397048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=21 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:48.398660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:48.399116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:48.400455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:48.407161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:48.422494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=61 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:21:48.909086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:48.929055 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-180bde2c-44f1-41a3-ab05-08ccb228b28e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1714 microversion: 2.1 time: 0.543077 Jul 14 15:21:48.930271 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2937/5705] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:48 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1714 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:49.227586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:49.228376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:49.247219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:49.249527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:49.252251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:49.254844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:49.473377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Cannot 'detach_volume' instance 81881218-89e9-42ae-9a5d-d673a59ca766 while it is in vm_state rescued Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments/2c1e2f05-754d-475a-8ae0-9fa1d9b45b69 HTTP/1.1 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot 'detach_volume' instance 81881218-89e9-42ae-9a5d-d673a59ca766 while it is in vm_state rescued Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': '81881218-89e9-42ae-9a5d-d673a59ca766', 'id': '2c1e2f05-754d-475a-8ae0-9fa1d9b45b69'} Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 81881218-89e9-42ae-9a5d-d673a59ca766 while it is in vm_state rescued Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:21:49.474463 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:21:49.479391 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:21:49.479391 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:21:49.479391 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:21:49.479391 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:21:49.479391 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 81881218-89e9-42ae-9a5d-d673a59ca766 while it is in vm_state rescued Jul 14 15:21:49.479391 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:21:49.485801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 409 to user: Cannot 'detach_volume' instance 81881218-89e9-42ae-9a5d-d673a59ca766 while it is in vm_state rescued {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:21:49.487374 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-760b2da1-66d5-44b2-8759-633058f097fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments/2c1e2f05-754d-475a-8ae0-9fa1d9b45b69" status: 409 len: 152 microversion: 2.1 time: 0.264301 Jul 14 15:21:49.488445 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2769/5706] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:21:49 2022] DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments/2c1e2f05-754d-475a-8ae0-9fa1d9b45b69 => generated 152 bytes in 266 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:21:49.500807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:49.502548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:49.514118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:49.515019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:49.516161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:49.516905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:49.742340 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-397271de-5df9-4393-9f6b-4ea1ef51d037 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/action" status: 202 len: 0 microversion: 2.1 time: 0.247326 Jul 14 15:21:49.742840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2938/5707] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:21:49 2022] POST /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:21:49.756218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:49.756979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:49.771857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:49.779688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:49.781513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:49.787972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:50.200436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:50.213950 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b843e24-a1f1-40e6-bd87-6f687edd88fb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1722 microversion: 2.1 time: 0.465686 Jul 14 15:21:50.226131 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2770/5708] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:49 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1722 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:21:51.234211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:51.235742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:51.276736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:51.277755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:51.279662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:51.280334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:51.586672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:51.600929 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62c6334b-66bc-478d-83cb-cd816fcc78d8 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1722 microversion: 2.1 time: 0.372654 Jul 14 15:21:51.602467 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2939/5709] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:51 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:52.622226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:52.623854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:52.632450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:52.633640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:52.634738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:52.635421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:52.854110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:52.869627 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1faf78a6-81d0-4c65-a631-e5e7c9b0ea96 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1722 microversion: 2.1 time: 0.252134 Jul 14 15:21:52.870628 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2771/5710] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:52 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:21:53.886660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:53.887518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:53.900133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:53.904164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:53.907926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:53.908827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:54.228896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:21:54.249151 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f3c03598-75b1-4141-8781-35e43bf8e332 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1728 microversion: 2.1 time: 0.360759 Jul 14 15:21:54.251774 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2940/5711] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:21:53 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1728 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:21:54.276111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:21:54.276617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:21:54.296019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:54.296477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:54.297267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:54.297698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:54.541715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6551177d-688d-4d78-b4ff-58a53edf8312 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277853 Jul 14 15:21:54.542337 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2772/5712] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:21:54 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-interface => generated 284 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:57.516923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bd530a7f-4f04-4a8d-a81b-76e36ffa737e req-d2d8f591-c567-41e1-b456-f29187e535a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81881218-89e9-42ae-9a5d-d673a59ca766", "tag": "5b695af5-27aa-4060-9f9d-0a8463a9fca9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:57.530741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bd530a7f-4f04-4a8d-a81b-76e36ffa737e req-d2d8f591-c567-41e1-b456-f29187e535a9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:57.542457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bd530a7f-4f04-4a8d-a81b-76e36ffa737e req-d2d8f591-c567-41e1-b456-f29187e535a9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:57.580446 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bd530a7f-4f04-4a8d-a81b-76e36ffa737e req-d2d8f591-c567-41e1-b456-f29187e535a9 service nova] Creating event network-changed:5b695af5-27aa-4060-9f9d-0a8463a9fca9 for instance 81881218-89e9-42ae-9a5d-d673a59ca766 on n-h2-768852-23 Jul 14 15:21:57.591771 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bd530a7f-4f04-4a8d-a81b-76e36ffa737e req-d2d8f591-c567-41e1-b456-f29187e535a9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090282 Jul 14 15:21:57.600995 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2941/5713] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:21:59.620808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bc91d47c-0926-4b4e-ae8f-76e8bebb484e req-763d18ce-de49-4e08-8ff0-0202b6c80909 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81881218-89e9-42ae-9a5d-d673a59ca766", "tag": "5b695af5-27aa-4060-9f9d-0a8463a9fca9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:21:59.651606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bc91d47c-0926-4b4e-ae8f-76e8bebb484e req-763d18ce-de49-4e08-8ff0-0202b6c80909 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:21:59.677284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bc91d47c-0926-4b4e-ae8f-76e8bebb484e req-763d18ce-de49-4e08-8ff0-0202b6c80909 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:21:59.717280 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bc91d47c-0926-4b4e-ae8f-76e8bebb484e req-763d18ce-de49-4e08-8ff0-0202b6c80909 service nova] Creating event network-changed:5b695af5-27aa-4060-9f9d-0a8463a9fca9 for instance 81881218-89e9-42ae-9a5d-d673a59ca766 on n-h2-768852-23 Jul 14 15:21:59.733882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bc91d47c-0926-4b4e-ae8f-76e8bebb484e req-763d18ce-de49-4e08-8ff0-0202b6c80909 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121221 Jul 14 15:21:59.735570 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2773/5714] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:11.154544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=9 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:11.157486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:11.644503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e88a1d30-af43-4efc-9b82-ed445edf21ea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: .version_select at 0x7fdbf2af79d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1837700654", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBOgLqgDz4LwbtZzA0HXqB6ZzTW8DUvmZUO8R1XmWYa57/5+sarOdDRP2cCYvLa3I2mVV1J0Q1EfvTICmG1DCcPGQ8WaQ/Q/noyULrAvY0io5TnFw72BdRz/QrhPfs3Jw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:11.700329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e88a1d30-af43-4efc-9b82-ed445edf21ea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:22:11.707982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e88a1d30-af43-4efc-9b82-ed445edf21ea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:22:11.751534 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e88a1d30-af43-4efc-9b82-ed445edf21ea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.602244 Jul 14 15:22:11.755618 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2942/5715] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:22:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:22:25.116747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=11 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:25.119175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=29 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:25.125556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-790740600", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "6d29acc7-ed09-45e7-a125-a71872a3308e"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1837700654", "security_groups": [{"name": "tempest-secgroup-smoke-1638136366"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:25.443220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] validate_networks() for [('6d29acc7-ed09-45e7-a125-a71872a3308e', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:22:27.038803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:27.048119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:27.069571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:27.071870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:22:27.072463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:22:27.073011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:22:27.073925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:27.074069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:22:27.076214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:27.077869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:22:27.081286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.089325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:27.092637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.153499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:27.154495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.174113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:27.180940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.324370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:22:27.364413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:22:27.369195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lazy-loading 'services' on Instance uuid 81881218-89e9-42ae-9a5d-d673a59ca766 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:22:27.419758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:22:27.430122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:22:27.574824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39f68f98-ae20-4c0c-a0e6-7e98ea701bc7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments/2c1e2f05-754d-475a-8ae0-9fa1d9b45b69" status: 202 len: 0 microversion: 2.1 time: 0.544105 Jul 14 15:22:27.576404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2943/5716] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:22:27 2022] DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments/2c1e2f05-754d-475a-8ae0-9fa1d9b45b69 => generated 0 bytes in 548 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:22:27.609824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7394bca-0113-4f53-9fd5-f0671c46c500 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.494724 Jul 14 15:22:27.621583 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2774/5717] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:22:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 2508 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:22:27.640457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:27.642010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:27.651661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:27.652343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f56756a5-34fa-41e5-a8e2-41ac631ec55a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:27.652564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.654066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:27.654718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:27.656519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f56756a5-34fa-41e5-a8e2-41ac631ec55a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:27.723793 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22b83486-bd2a-4072-93a3-a5901238fb01 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108201 Jul 14 15:22:27.725972 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2944/5718] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:27 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:27.879400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f56756a5-34fa-41e5-a8e2-41ac631ec55a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:27.894074 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f56756a5-34fa-41e5-a8e2-41ac631ec55a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1266 microversion: 2.1 time: 0.268989 Jul 14 15:22:27.897787 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2775/5719] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:27 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:28.741438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:28.744803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:28.810525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:28.819790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:28.821262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:28.821722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:28.938271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c909da3-13df-4247-8a76-c66b3095182d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:28.943698 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4acd909-5ccf-4b13-99b5-0d77d97de473 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.209004 Jul 14 15:22:28.946173 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2945/5720] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:28 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:28.950806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c909da3-13df-4247-8a76-c66b3095182d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:29.327459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c909da3-13df-4247-8a76-c66b3095182d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:29.337788 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c909da3-13df-4247-8a76-c66b3095182d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1266 microversion: 2.1 time: 0.419190 Jul 14 15:22:29.354376 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2776/5721] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:28 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1266 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:29.958750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:29.959939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:29.978512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:29.992970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:29.994830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:29.996426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:30.297286 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ca2410f-92a0-44af-b62c-bb0db413156c tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.344067 Jul 14 15:22:30.300517 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2946/5722] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:29 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:30.361911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:30.363381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:30.378124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:30.379536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:30.384034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:30.384916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:30.669282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:30.741131 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b90939a-be2e-44ff-9de1-7b5d5773b914 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1318 microversion: 2.1 time: 0.375066 Jul 14 15:22:30.743700 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2777/5723] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:30 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:31.324379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:31.331253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:31.366517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:31.369179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:31.374420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:31.375603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:31.545346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cd6bc3f-79a3-42a0-afcd-f91bbbe7ed58 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.229928 Jul 14 15:22:31.549286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2947/5724] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:31 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:31.761330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:31.762799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:31.776876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:31.783165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:31.784507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:31.785294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:31.942195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:31.964465 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ce86776d-b441-44ad-9511-fe00307f8456 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1324 microversion: 2.1 time: 0.204098 Jul 14 15:22:31.967086 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2778/5725] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:31 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1324 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:32.576272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:32.589959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:32.624377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:32.628390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:32.634740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:32.635731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:32.743932 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7604774e-d9e5-4086-85dc-5f6894172b00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184308 Jul 14 15:22:32.745050 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2948/5726] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:32 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:22:32.996101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:32.997460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:33.006955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:33.007887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:33.009062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:33.009538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:33.109342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:33.120269 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa7060ba-edeb-4846-990e-964409f4e21e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1324 microversion: 2.1 time: 0.128318 Jul 14 15:22:33.126204 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2779/5727] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:32 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1324 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:33.760307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:33.761493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:33.772007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:33.772929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:33.774125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:33.774839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:33.855545 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c501ce6b-f030-42d0-85e8-44a8656a54c9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102902 Jul 14 15:22:33.860884 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2949/5728] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:33 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:34.144182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:34.145763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:34.159707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:34.162488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:34.164285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:34.167673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:34.604407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:34.617421 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ea41f9ec-c551-4528-985f-6a03d847c352 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.477162 Jul 14 15:22:34.619913 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2780/5729] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:34 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:34.870685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:34.872071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:34.888019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:34.888367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:34.893257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:34.893730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:34.950628 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-788fc34f-c980-401e-b0fc-ffcb0f607c00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085333 Jul 14 15:22:34.952037 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2950/5730] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:34 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:35.650533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:35.651516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:35.686085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:35.686909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:35.688354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:35.689695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:35.968303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:35.969963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:35.987049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:35.989066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:35.993535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:35.996534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.072839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:36.087730 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32e3485e-8a98-404a-9817-e3701566d253 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.444674 Jul 14 15:22:36.088816 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2781/5731] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:35 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:36.110096 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-40cfce43-12cc-42cc-b8ae-0fc9773b7713 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140540 Jul 14 15:22:36.117562 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2951/5732] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:35 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:22:36.472048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7a358000-734e-46b1-82cf-e8595db9278f req-222e0d93-4e64-4527-99d8-c082a8cc2b0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:36.495123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7a358000-734e-46b1-82cf-e8595db9278f req-222e0d93-4e64-4527-99d8-c082a8cc2b0c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.495123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7a358000-734e-46b1-82cf-e8595db9278f req-222e0d93-4e64-4527-99d8-c082a8cc2b0c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.495748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7a358000-734e-46b1-82cf-e8595db9278f req-222e0d93-4e64-4527-99d8-c082a8cc2b0c service nova] Creating event network-changed:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h1-768852-23 Jul 14 15:22:36.524374 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7a358000-734e-46b1-82cf-e8595db9278f req-222e0d93-4e64-4527-99d8-c082a8cc2b0c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.432379 Jul 14 15:22:36.526939 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2782/5733] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:36.697610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:36.707697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:36.730257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.731368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.733719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.736921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.777130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:22:36.927892 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7824dc45-b92e-445e-a489-ca53da24452a tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 204 len: 0 microversion: 2.1 time: 0.426829 Jul 14 15:22:36.931596 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2952/5734] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:22:36 2022] DELETE /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:36.942658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:36.943911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:36.955040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.955880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:36.957400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:36.958205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:37.108550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:37.111112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:37.125773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:37.127064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:37.129054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:37.129884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:37.236013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:37.267189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:37.281474 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-90d70fc3-1adb-45c6-a99e-19b2c6ea3dd1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1728 microversion: 2.1 time: 0.344322 Jul 14 15:22:37.282094 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2783/5735] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:36 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1728 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:37.299135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:37.300178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:37.314027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:37.314954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:37.317081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:37.318302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:37.382248 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ed028c5-3d30-4e2c-9fac-693e40d585e7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098686 Jul 14 15:22:37.386610 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2784/5736] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:37 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 197 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:37.469776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:37.490270 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38672181-833c-4faa-8426-b11347858303 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.386847 Jul 14 15:22:37.494027 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2953/5737] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:37 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:38.318081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:38.318081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.327622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.328101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.328959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.329409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.395967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:38.397744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.409576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.410357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.411334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.411923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.474902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-245d53e0-004b-4abd-a0e0-e002aa8ad267 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.083108 Jul 14 15:22:38.482315 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2954/5738] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:22:38 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:22:38.528654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:38.531467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.562713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.565759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.574102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.576114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.676347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:38.691945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e6aa2e7d-b589-4b2e-9c00-d886233f54bd tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1728 microversion: 2.1 time: 0.383184 Jul 14 15:22:38.692803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2785/5739] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:38 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1728 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:38.712709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:38.714102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.728286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.728983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.729866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.730273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.763165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Cannot 'reboot' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action HTTP/1.1 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 28 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: {"reboot": {"type": "HARD"}} Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot 'reboot' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ee6a9f80-b25d-46cc-837e-964fd2c51e47', 'body': {'reboot': {'type': 'HARD'}}} Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1038, in _action_reboot Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3497, in reboot Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1042, in _action_reboot Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:22:38.764958 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.768441 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.770748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 409 to user: Cannot 'reboot' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:38.771887 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b70c30cf-5455-49e6-943b-249a0eb979db tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action" status: 409 len: 145 microversion: 2.1 time: 0.067657 Jul 14 15:22:38.774106 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2786/5740] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:22:38 2022] POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action => generated 145 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:22:38.785123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:38.786995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.797254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.797899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.798964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.799874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.831859 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Cannot 'rebuild' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action HTTP/1.1 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 65 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: exception: Cannot 'rebuild' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ee6a9f80-b25d-46cc-837e-964fd2c51e47', 'body': {'rebuild': {'imageRef': '882b5d60-a014-41cb-b7f7-f80f1fdee9e4'}}} Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1222, in _action_rebuild Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 in vm_state rescued. Cannot rebuild while the instance is in this state. Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:22:38.833837 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1230, in _action_rebuild Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued Jul 14 15:22:38.838558 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:38.840473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 409 to user: Cannot 'rebuild' instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 while it is in vm_state rescued {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:38.841520 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-becd84fd-acf8-4a4b-98ba-5092b0e64828 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action" status: 409 len: 146 microversion: 2.1 time: 0.062846 Jul 14 15:22:38.842298 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2787/5741] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:22:38 2022] POST /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 14 15:22:38.853455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:38.854047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:38.863370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.864177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.865403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:38.866405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:38.898534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:22:39.010011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-360cf449-cb64-4ab3-8145-47d5e06833ad tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 204 len: 0 microversion: 2.1 time: 0.160905 Jul 14 15:22:39.013887 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2788/5742] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:22:38 2022] DELETE /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:22:39.030884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:39.032387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:39.039217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:39.044633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:39.045534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:39.045964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:39.046423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:39.056876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35aa212f-4dc3-446f-bea6-7f419dbd3cec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.547621 Jul 14 15:22:39.067594 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2955/5743] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:38 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:39.309916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:39.327497 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c0643482-b003-493d-a11b-afd79e3c15a6 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1688 microversion: 2.1 time: 0.305737 Jul 14 15:22:39.328580 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2789/5744] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:39 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1688 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:39.730652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:39.732820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:39.747293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:39.748524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:39.750412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:39.751498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:39.998540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:40.017169 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3b9ad82a-4061-47a2-9b6f-372275b8dce6 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1728 microversion: 2.1 time: 0.294515 Jul 14 15:22:40.019329 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2956/5745] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:39 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1728 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:40.081285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:40.084092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:40.088515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:40.104981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.106494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.110315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.112387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.345564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:40.346471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:40.370154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.370631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.371563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:40.372027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:40.388715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:40.584429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:40.600589 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a241366-0125-46d2-b1cf-8f8921e9235a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.529644 Jul 14 15:22:40.604084 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2790/5746] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:40 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:40.844467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:40.887442 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14ea2f24-f10b-4bcd-ad96-79f275be8229 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1688 microversion: 2.1 time: 0.540838 Jul 14 15:22:40.892830 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2957/5747] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:40 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1688 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:22:41.041764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:41.042963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:41.065692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:41.066486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:41.072249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:41.073202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:41.646922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:41.662445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:41.683136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:41.684438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:41.688086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:41.689147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:41.967960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5636dbc7f0745bf845d714249f88de2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3becca3bc96409891c05f7bd47f1601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:42.006103 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03dc2ba3-0e79-4c8e-8a19-06a65355ced1 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 200 len: 1728 microversion: 2.1 time: 0.971201 Jul 14 15:22:42.026722 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2791/5748] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:41 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 1728 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:42.047182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:42.049149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:42.084397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.085787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.088918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.090996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.338663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:42.350514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-65a9f2d8-9fa2-4ba7-bafa-daf3a52ae0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.723849 Jul 14 15:22:42.354869 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2958/5749] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:41 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:42.726637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-35a87709-6f99-4f12-b4bf-f24a5cc838c1 req-ddfad5b4-0a4a-4993-a4f0-d6f10f11d085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ebbd4f1-b7e8-4973-b0bf-d762ab12695c", "name": "network-vif-deleted", "tag": "f1eb8715-d53d-46c4-9c8b-641b332f746e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:42.835062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-35a87709-6f99-4f12-b4bf-f24a5cc838c1 req-ddfad5b4-0a4a-4993-a4f0-d6f10f11d085 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:42.836982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-35a87709-6f99-4f12-b4bf-f24a5cc838c1 req-ddfad5b4-0a4a-4993-a4f0-d6f10f11d085 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:42.957453 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-35a87709-6f99-4f12-b4bf-f24a5cc838c1 req-ddfad5b4-0a4a-4993-a4f0-d6f10f11d085 service nova] Creating event network-vif-deleted:f1eb8715-d53d-46c4-9c8b-641b332f746e for instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c on n-h1-768852-23 Jul 14 15:22:42.991947 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-35a87709-6f99-4f12-b4bf-f24a5cc838c1 req-ddfad5b4-0a4a-4993-a4f0-d6f10f11d085 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.631995 Jul 14 15:22:42.996691 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2959/5750] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:43.051983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:43.075447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:43.105455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:43.115558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:43.118927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:43.125442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:43.180744 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] HTTP exception thrown: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Request method failure captured: Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c HTTP/1.1 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DNgTQdmzgxpyqvWztnDXXsW60zR9NGKpWYlnPmOWpzcXKiINJD0p_qyBSuiJweoE6Dvulvggneox3k2NImTnqr6Zxp8MJn7HvA_FcD9wnKduVmqYlPQfmSKYSy0SRiDbUCqAAFLBsEYs6HeaAl6-lhHfs1XfE6tRXIRBRuMFZam3n4 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f3becca3bc96409891c05f7bd47f1601 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f3becca3bc96409891c05f7bd47f1601 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestServerBasicOps-1094179913-project Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a5636dbc7f0745bf845d714249f88de2 Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestServerBasicOps-1094179913-project Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '0ebbd4f1-b7e8-4973-b0bf-d762ab12695c'} Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:43.190386 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Returning 404 to user: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0262c32a-90a6-429c-a730-ecad38efe191 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 404 len: 111 microversion: 2.1 time: 0.147256 Jul 14 15:22:43.200850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2960/5751] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:43 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 111 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:43.374808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:43.380576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:43.407170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:43.412866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:43.414894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:43.418750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:43.603811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:43.616889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:43.621361 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aec938f6-0887-46aa-b0f9-df8e59fce3d3 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1688 microversion: 2.1 time: 1.582825 Jul 14 15:22:43.635211 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2792/5752] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:42 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1688 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:44.291577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:44.321345 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-909a4425-d15c-4283-b69b-987443ed74e3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.951193 Jul 14 15:22:44.327756 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2961/5753] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:43 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:44.642898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:44.643665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:44.687168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:44.688146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:44.697336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:44.700794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:44.944358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:44.954918 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-49210426-52c0-4de3-aaaa-feed309110ec tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1621 microversion: 2.1 time: 0.318470 Jul 14 15:22:44.957765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2793/5754] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:44 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1621 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:45.307362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-93160593-3587-44c5-bc27-f1163e477eaa req-e0e2cdf7-c0e9-46e0-ba12-5c7c83c5cb2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81881218-89e9-42ae-9a5d-d673a59ca766", "name": "network-vif-deleted", "tag": "5b695af5-27aa-4060-9f9d-0a8463a9fca9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:45.343939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:45.344451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:45.357956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-93160593-3587-44c5-bc27-f1163e477eaa req-e0e2cdf7-c0e9-46e0-ba12-5c7c83c5cb2c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.357956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-93160593-3587-44c5-bc27-f1163e477eaa req-e0e2cdf7-c0e9-46e0-ba12-5c7c83c5cb2c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.361191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.361661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.362474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.362925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.390600 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-93160593-3587-44c5-bc27-f1163e477eaa req-e0e2cdf7-c0e9-46e0-ba12-5c7c83c5cb2c service nova] Creating event network-vif-deleted:5b695af5-27aa-4060-9f9d-0a8463a9fca9 for instance 81881218-89e9-42ae-9a5d-d673a59ca766 on n-h2-768852-23 Jul 14 15:22:45.402065 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] HTTP exception thrown: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Request method failure captured: Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c HTTP/1.1 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DNgTQdmzgxpyqvWztnDXXsW60zR9NGKpWYlnPmOWpzcXKiINJD0p_qyBSuiJweoE6Dvulvggneox3k2NImTnqr6Zxp8MJn7HvA_FcD9wnKduVmqYlPQfmSKYSy0SRiDbUCqAAFLBsEYs6HeaAl6-lhHfs1XfE6tRXIRBRuMFZam3n4 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f3becca3bc96409891c05f7bd47f1601 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f3becca3bc96409891c05f7bd47f1601 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestServerBasicOps-1094179913-project Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: a5636dbc7f0745bf845d714249f88de2 Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestServerBasicOps-1094179913-project Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0ebbd4f1-b7e8-4973-b0bf-d762ab12695c'} Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:22:45.403912 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Returning 404 to user: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4fffd3f-bf0f-4bd2-8db6-e8dba6524662 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 404 len: 111 microversion: 2.1 time: 0.065628 Jul 14 15:22:45.407092 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2794/5755] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:22:45 2022] DELETE /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:45.411283 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-93160593-3587-44c5-bc27-f1163e477eaa req-e0e2cdf7-c0e9-46e0-ba12-5c7c83c5cb2c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114294 Jul 14 15:22:45.414655 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2962/5756] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:22:45.418163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:45.418882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:45.434145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.434619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.434886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:45.435473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.435939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.439765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] [instance: 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:45.464861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.476994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.478905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:45.480055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:45.514539 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] HTTP exception thrown: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Request method failure captured: Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c HTTP/1.1 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DNgTQdmzgxpyqvWztnDXXsW60zR9NGKpWYlnPmOWpzcXKiINJD0p_qyBSuiJweoE6Dvulvggneox3k2NImTnqr6Zxp8MJn7HvA_FcD9wnKduVmqYlPQfmSKYSy0SRiDbUCqAAFLBsEYs6HeaAl6-lhHfs1XfE6tRXIRBRuMFZam3n4 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f3becca3bc96409891c05f7bd47f1601 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f3becca3bc96409891c05f7bd47f1601"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f3becca3bc96409891c05f7bd47f1601 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestServerBasicOps-1094179913 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestServerBasicOps-1094179913-project Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: a5636dbc7f0745bf845d714249f88de2 Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestServerBasicOps-1094179913-project Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '0ebbd4f1-b7e8-4973-b0bf-d762ab12695c'} Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:45.517694 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. Jul 14 15:22:45.528090 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:22:45.530862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Returning 404 to user: Instance 0ebbd4f1-b7e8-4973-b0bf-d762ab12695c could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:45.532814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b402645-1e04-4832-93f0-3c55a934047c tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c" status: 404 len: 111 microversion: 2.1 time: 0.116154 Jul 14 15:22:45.534255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2963/5757] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:45 2022] GET /compute/v2.1/servers/0ebbd4f1-b7e8-4973-b0bf-d762ab12695c => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:45.766492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:45.778987 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9c0e6ea8-1c8d-4301-aea6-460b77577b12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.371376 Jul 14 15:22:45.779891 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2795/5758] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:45 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:45.892816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5e44e99f-173a-450c-8d44-dcf0a41ec366 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] Calling method '.version_select at 0x7fdbf29fc820>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:45.927380 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5e44e99f-173a-450c-8d44-dcf0a41ec366 tempest-TestServerBasicOps-1094179913 tempest-TestServerBasicOps-1094179913-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-9297144" status: 202 len: 0 microversion: 2.1 time: 0.040189 Jul 14 15:22:45.928046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2964/5759] 10.222.0.98 () {58 vars in 1244 bytes} [Thu Jul 14 15:22:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-9297144 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:22:45.984005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:45.984755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:46.005763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.006343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.010364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.013879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.097794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.098265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.104049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lazy-loading 'fault' on Instance uuid 81881218-89e9-42ae-9a5d-d673a59ca766 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:22:46.176417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:46.188205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be28e7d5-8c66-4268-a1cd-f5c8b5a268df tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 200 len: 1335 microversion: 2.1 time: 0.217582 Jul 14 15:22:46.190197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2796/5760] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:45 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 1335 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:46.800227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:46.800947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:46.824232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.824967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:46.826133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:46.826902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:47.207183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:47.208384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: 81881218-89e9-42ae-9a5d-d673a59ca766] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:47.225029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:47.227868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:47.228802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:47.229159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:47.273410 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 could not be found. Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 HTTP/1.1 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 could not be found. Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '81881218-89e9-42ae-9a5d-d673a59ca766'} Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 could not be found. Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 could not be found. Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:22:47.275552 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 could not be found. Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 404 to user: Instance 81881218-89e9-42ae-9a5d-d673a59ca766 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:22:47.284003 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be113639-bcf8-4ced-99f9-74985e0beb78 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766" status: 404 len: 111 microversion: 2.1 time: 0.074212 Jul 14 15:22:47.287977 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2797/5761] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:47 2022] GET /compute/v2.1/servers/81881218-89e9-42ae-9a5d-d673a59ca766 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:22:47.293343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad177344-af2e-4535-b1fc-e7f635c926e9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '.version_select at 0x7fdbf1eb91f0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:47.353890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad177344-af2e-4535-b1fc-e7f635c926e9 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427105593" status: 202 len: 0 microversion: 2.1 time: 0.068496 Jul 14 15:22:47.354924 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2798/5762] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:22:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427105593 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:22:47.531604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:47.548557 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8590802a-fa66-4788-bcd7-f8befc0f8893 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.749359 Jul 14 15:22:47.571490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2965/5763] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:46 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:48.560837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-51637379-0e82-4c02-9b85-c79760557006 req-3b93c3af-d144-4f28-b6c4-bec53e858eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "name": "network-vif-plugged", "status": "completed", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:48.574704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-51637379-0e82-4c02-9b85-c79760557006 req-3b93c3af-d144-4f28-b6c4-bec53e858eb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:48.575454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-51637379-0e82-4c02-9b85-c79760557006 req-3b93c3af-d144-4f28-b6c4-bec53e858eb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:48.587131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:48.589817 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-51637379-0e82-4c02-9b85-c79760557006 req-3b93c3af-d144-4f28-b6c4-bec53e858eb9 service nova] Creating event network-vif-plugged:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h1-768852-23 Jul 14 15:22:48.592255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:48.597737 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-51637379-0e82-4c02-9b85-c79760557006 req-3b93c3af-d144-4f28-b6c4-bec53e858eb9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.900436 Jul 14 15:22:48.604470 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2799/5764] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:22:48.661094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:48.661985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:48.667115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:48.667890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:49.697331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:49.727129 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20d535a7-6032-4aba-ac70-6e9ba90780da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 1.151265 Jul 14 15:22:49.743303 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2966/5765] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:48 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:50.762692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:50.763319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:50.779335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:50.784939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:50.786892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:50.787583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:51.124677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:51.139914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b9382116-1dfd-40d8-9e93-18cf398c8354 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1392 microversion: 2.1 time: 0.384957 Jul 14 15:22:51.151422 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2800/5766] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:50 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1392 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:52.159040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:52.159813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:52.170358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:52.170808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:52.176442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:52.176893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:52.525322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:52.536051 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f488a6e9-ef6c-4048-9fb7-8dc6eef48319 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1564 microversion: 2.1 time: 0.381635 Jul 14 15:22:52.561293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:52.562563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:52.566953 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2967/5767] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:52 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1564 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:52.582923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:52.583810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:52.585738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:52.587101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:53.013596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:22:53.023713 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93ffa49b-2e4b-4a72-85e4-225c740b6ba1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1564 microversion: 2.1 time: 0.467775 Jul 14 15:22:53.024325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2801/5768] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:52 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1564 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:22:59.365043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:22:59.365690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:22:59.369867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:59.371652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2a700ad2-4c2d-4725-bdb7-992bf7c34861 req-980c58cd-00ed-4e64-b503-9fb578140a35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:22:59.379005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:22:59.387454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2a700ad2-4c2d-4725-bdb7-992bf7c34861 req-980c58cd-00ed-4e64-b503-9fb578140a35 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:59.388232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2a700ad2-4c2d-4725-bdb7-992bf7c34861 req-980c58cd-00ed-4e64-b503-9fb578140a35 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:59.405650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:59.406120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:59.406394 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2a700ad2-4c2d-4725-bdb7-992bf7c34861 req-980c58cd-00ed-4e64-b503-9fb578140a35 service nova] Creating event network-changed:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h1-768852-23 Jul 14 15:22:59.406946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:22:59.407420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:22:59.430394 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2a700ad2-4c2d-4725-bdb7-992bf7c34861 req-980c58cd-00ed-4e64-b503-9fb578140a35 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063022 Jul 14 15:22:59.440103 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2802/5769] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:23:00.486076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:00.510431 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c33a031-60d9-41f8-9d92-736104c115c7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1564 microversion: 2.1 time: 1.147397 Jul 14 15:23:00.528176 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2968/5770] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:22:59 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1564 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:00.852349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:00.854238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:00.889800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:00.892759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:00.894411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:00.896107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:01.086157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:23:01.371049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-046edac2-9471-430d-9e3c-fcb4fc447ac7 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 204 len: 0 microversion: 2.1 time: 0.526443 Jul 14 15:23:01.373448 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2803/5771] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:23:00 2022] DELETE /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:01.384363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:01.385376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:01.413476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:01.416045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:01.422623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:01.428135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:02.054699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:02.071662 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c2d76830-33dd-4cf1-a30a-19eb4911c969 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1508 microversion: 2.1 time: 0.689358 Jul 14 15:23:02.074612 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2969/5772] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:01 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1508 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:03.105508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:03.106249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:03.140428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:03.141389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:03.142531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:03.143537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:03.558794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:03.574288 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca08ce42-45b5-4fb9-a2aa-c1921d63e883 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1508 microversion: 2.1 time: 0.469932 Jul 14 15:23:03.575811 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2804/5773] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:03 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1508 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:04.594306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:04.594954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:04.614655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:04.616413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:04.617827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:04.623235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:04.636473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c4979851-89b5-473f-bec7-da023d4d0f4e req-479f8374-c1b1-40e6-b67d-72168d0647b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a9f80-b25d-46cc-837e-964fd2c51e47", "name": "network-vif-deleted", "tag": "8bda7234-6e79-411f-8bee-0530b820348a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:04.650663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c4979851-89b5-473f-bec7-da023d4d0f4e req-479f8374-c1b1-40e6-b67d-72168d0647b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:04.652062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c4979851-89b5-473f-bec7-da023d4d0f4e req-479f8374-c1b1-40e6-b67d-72168d0647b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:04.693471 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c4979851-89b5-473f-bec7-da023d4d0f4e req-479f8374-c1b1-40e6-b67d-72168d0647b1 service nova] Creating event network-vif-deleted:8bda7234-6e79-411f-8bee-0530b820348a for instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 on n-h2-768852-23 Jul 14 15:23:04.715104 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c4979851-89b5-473f-bec7-da023d4d0f4e req-479f8374-c1b1-40e6-b67d-72168d0647b1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083330 Jul 14 15:23:04.717801 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2805/5774] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:23:04.824658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:04.836284 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43ae7a3d-99d4-4b0b-957f-abd5b0306613 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 200 len: 1293 microversion: 2.1 time: 0.247945 Jul 14 15:23:04.839352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2970/5775] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:04 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 1293 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:05.867724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:05.868546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ee6a9f80-b25d-46cc-837e-964fd2c51e47] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:05.876560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:05.876560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:05.877105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:05.877594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:05.892662 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 could not be found. Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 HTTP/1.1 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 could not be found. Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ee6a9f80-b25d-46cc-837e-964fd2c51e47'} Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 could not be found. Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 could not be found. Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:23:05.894375 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 could not be found. Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 404 to user: Instance ee6a9f80-b25d-46cc-837e-964fd2c51e47 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ecdce3ca-d341-4adf-912c-5a60f0c55518 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47" status: 404 len: 111 microversion: 2.1 time: 0.035367 Jul 14 15:23:05.898828 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2806/5776] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:05 2022] GET /compute/v2.1/servers/ee6a9f80-b25d-46cc-837e-964fd2c51e47 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:23:05.906836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:05.907683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:05.922649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:05.923341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:05.924551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:05.925022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:05.958948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:23:06.122381 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fc883325-193f-4cdf-9a33-f06b93ef365e tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 204 len: 0 microversion: 2.1 time: 0.219539 Jul 14 15:23:06.123339 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2971/5777] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:23:05 2022] DELETE /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:23:06.132718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:06.133530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:06.150673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:06.153093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:06.154584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:06.157278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:06.483439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:06.504470 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8c77e303-0fd4-4ab0-8b12-bf6952b8269b tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.376103 Jul 14 15:23:06.519844 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2807/5778] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:06 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:07.531312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:07.532346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:07.548118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:07.548730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:07.549815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:07.550487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:07.849689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:07.874241 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-faf316f1-c992-4fd5-a192-f81f48beb5eb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.348063 Jul 14 15:23:07.883433 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2972/5779] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:07 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:08.898519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:08.900419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:08.939683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:08.940151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:08.940948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:08.941390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:09.157079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:09.189803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ae2eb26-cfd2-40b7-8149-1b4d0f62cf00 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1521 microversion: 2.1 time: 0.297179 Jul 14 15:23:09.191526 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2808/5780] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:08 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1521 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:10.216265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:10.222132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:10.231937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:10.233438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:10.234095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:10.234553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:10.438284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a00a929a3dd4608961f50265fd35caa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc180baee4ea4158b008e3a5c227aac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:10.449931 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-03e2fc25-d028-417e-93a4-a242cb16e815 tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 200 len: 1479 microversion: 2.1 time: 0.245852 Jul 14 15:23:10.454968 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2973/5781] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:10 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 1479 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:10.470436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-862b9bc3-a75f-4935-bb31-06ae65b8d316 req-317d3db8-2ebb-4e70-a5dd-cf8c6486108b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea857aa4-0a92-4765-a7df-0645eea1dbad", "name": "network-vif-deleted", "tag": "ffc67c8a-a3df-43d9-beed-d055913c17c9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:10.501435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-862b9bc3-a75f-4935-bb31-06ae65b8d316 req-317d3db8-2ebb-4e70-a5dd-cf8c6486108b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:10.505424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-862b9bc3-a75f-4935-bb31-06ae65b8d316 req-317d3db8-2ebb-4e70-a5dd-cf8c6486108b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:10.530924 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-862b9bc3-a75f-4935-bb31-06ae65b8d316 req-317d3db8-2ebb-4e70-a5dd-cf8c6486108b service nova] Creating event network-vif-deleted:ffc67c8a-a3df-43d9-beed-d055913c17c9 for instance ea857aa4-0a92-4765-a7df-0645eea1dbad on n-h2-768852-23 Jul 14 15:23:10.551975 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-862b9bc3-a75f-4935-bb31-06ae65b8d316 req-317d3db8-2ebb-4e70-a5dd-cf8c6486108b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085181 Jul 14 15:23:10.557234 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2809/5782] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:23:11.480898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:11.481468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] [instance: ea857aa4-0a92-4765-a7df-0645eea1dbad] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:11.497984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:11.498647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:11.499773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:11.501507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:11.505476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:11.532020 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] HTTP exception thrown: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad could not be found. Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Request method failure captured: Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad HTTP/1.1 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DO2D-e_i47FNBKmT5JJT4-SI1vdw5xgB14OeJ7U5K7e5M0N7YLuHT4W4s7fr9m3My7kaKg--jOrtEhogkoL_702saIeVyl9odFJBZ0cy5Hq-P6C8abEjyw20TSk7aQ1nnm9InHqcb1B9HDgALs8hptyM6goD95uU02QzXEeypoLTew Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cc180baee4ea4158b008e3a5c227aac8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cc180baee4ea4158b008e3a5c227aac8 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-731503096 Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 7a00a929a3dd4608961f50265fd35caa Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerRescueNegativeTestJSON-731503096-project Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad could not be found. Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'ea857aa4-0a92-4765-a7df-0645eea1dbad'} Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad could not be found. Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad could not be found. Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:23:11.534290 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad could not be found. Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:23:11.538866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] Returning 404 to user: Instance ea857aa4-0a92-4765-a7df-0645eea1dbad could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:23:11.539757 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e9f72d6f-f4ec-41cb-a917-2a82678f9abb tempest-ServerRescueNegativeTestJSON-731503096 tempest-ServerRescueNegativeTestJSON-731503096-project] 10.222.0.98 "GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad" status: 404 len: 111 microversion: 2.1 time: 0.064075 Jul 14 15:23:11.540404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2974/5783] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:11 2022] GET /compute/v2.1/servers/ea857aa4-0a92-4765-a7df-0645eea1dbad => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:23:21.626632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:21.638896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:21.654497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.655856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:21.665631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:21.674637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:21.679179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:21.680440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:21.823076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f2405b83-1e80-4b15-a5d0-1245048e93e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action" status: 200 len: 24546 microversion: 2.1 time: 0.235295 Jul 14 15:23:21.823786 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2810/5784] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:23:21 2022] POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action => generated 24546 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:23:32.761449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:32.762811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:32.787152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:32.801018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:32.801689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:32.803505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:32.804202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:33.279872 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a76a04c-9a19-4215-b75b-dedc45875718 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1835 microversion: 2.1 time: 0.521667 Jul 14 15:23:33.288822 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2975/5785] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:32 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1835 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:33.308298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:33.311773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:33.320326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.322585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:23:33.342802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:33.344007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:33.345877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:33.346934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:33.619728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:33.635383 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-230f14f1-5919-4e69-94fd-47017cacc2cd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1682 microversion: 2.1 time: 0.339187 Jul 14 15:23:33.636502 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2811/5786] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:33 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1682 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:33.803038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:33.807161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:33.830060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:33.830889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:33.833380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:33.834592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:33.931570 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4816ef92-e27c-44a2-adf3-a1b8b98745d2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action" status: 200 len: 32614 microversion: 2.1 time: 0.138028 Jul 14 15:23:33.933009 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2976/5787] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:23:33 2022] POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action => generated 32614 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:23:34.100423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:34.101084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:34.118538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:34.119619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:34.123001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:34.125494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:34.224707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8353a4c231db48a9bc9e58c3f33a8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6403ba8e6e4743a1a04c575cefcc89ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:34.225348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] flavor_id is None. Assuming migration. {{(pid=125966) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 15:23:34.225803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125966) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:23:35.036750 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3994bfa-db96-458a-a099-94786438c0a2 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action" status: 202 len: 0 microversion: 2.1 time: 0.941703 Jul 14 15:23:35.039656 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2812/5788] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:23:34 2022] POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:23:35.069123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:35.071202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:35.090228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:35.091395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:35.093127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:35.094265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:35.690150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:35.703983 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-260bff7e-7944-4283-b0a3-3ac733e8d4ed tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1691 microversion: 2.1 time: 0.657950 Jul 14 15:23:35.705182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2977/5789] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:35 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1691 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:36.725149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:36.726522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:36.763253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:36.772442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:36.774838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:36.778489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:37.346797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:37.358253 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04f8cb86-f607-429a-9e2d-a7a816aa4c74 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1691 microversion: 2.1 time: 0.636712 Jul 14 15:23:37.360980 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2813/5790] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:36 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1691 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:38.381939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:38.384300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:38.414536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:38.416586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:38.421221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:38.424011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:38.951406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:38.979385 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e054368-02cf-4f32-af18-6be134338f61 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1691 microversion: 2.1 time: 0.603431 Jul 14 15:23:38.980361 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2978/5791] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:38 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1691 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:40.008321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:40.009497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:40.046125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:40.046511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:40.047367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:40.047828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:40.453788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:40.485807 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f1f3a59-911c-4e40-a01a-ab8f09a2ff4a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1691 microversion: 2.1 time: 0.486068 Jul 14 15:23:40.496515 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2814/5792] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:39 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1691 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:41.514886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:41.517049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:41.576546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:41.577247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:41.578089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:41.578546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:41.887834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:41.917097 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3db9a364-d563-4e30-ba24-c39cefb5a180 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.410769 Jul 14 15:23:41.920199 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2979/5793] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:41 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:42.945000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:42.945846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:42.962438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:42.962903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:42.963760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:42.964213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:43.533326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:43.587364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3029c5e5-2c8e-4f9b-ba7c-7839c841cc93 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.646434 Jul 14 15:23:43.588843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2815/5794] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:42 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:44.615798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:44.616698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:44.629207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:44.630400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:44.631313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:44.631936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:44.883158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:44.904795 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1af1c953-dd51-4a11-b3b6-0d4b324ef5f3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.296099 Jul 14 15:23:44.911120 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2980/5795] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:44 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:45.934094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:45.935509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:45.953065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:45.953529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:45.954542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:45.955203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:46.243070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:46.260614 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3cf7ab32-d62e-4288-86f8-f1e0eaaeee95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.330346 Jul 14 15:23:46.261823 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2816/5796] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:45 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:47.287402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:47.288467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:47.297320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:47.298134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:47.299374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:47.300290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:47.516541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:47.529238 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-319f14e6-7572-413e-bfa4-4fd176cd9214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.247246 Jul 14 15:23:47.529888 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2981/5797] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:47 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:48.557900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:48.560679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:48.575437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:48.577303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:48.579230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:48.583538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:48.916065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:48.940067 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0aa1bc89-94a4-4e9f-957b-686b4906bf38 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.394976 Jul 14 15:23:48.944997 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2817/5798] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:48 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:49.976291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:49.977564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:49.990561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:49.991084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:49.997165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:49.997941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:50.278354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:50.289514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9df5acb6-4eaf-4768-b3ea-c59cc14fc9b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.318356 Jul 14 15:23:50.301984 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2982/5799] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:49 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:51.310146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:51.310936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:51.335093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:51.335593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:51.336411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:51.336871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:51.803729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:51.821010 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5ceb8566-e833-473c-8434-c3e6e7466c0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.515484 Jul 14 15:23:51.822460 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2818/5800] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:51 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:52.854505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:52.856373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:52.877837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:52.878331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:52.879886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:52.880207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:53.215161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:53.225470 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-926535c5-2a54-4c84-b903-54c777f91bfa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.374676 Jul 14 15:23:53.229142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2983/5801] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:52 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:54.248839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:54.250133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:54.260215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:54.260929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:54.262001 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:54.262772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:54.595081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:54.604226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fee7ed23-7912-400c-9d88-797e5bafe52b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.362204 Jul 14 15:23:54.615122 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2819/5802] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:54 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:55.627848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:55.630136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:55.642859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.643918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.649397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:55.650434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:55.944467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:55.952849 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d58f0cea-31aa-47b1-bf10-10f366d5f538 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.333954 Jul 14 15:23:55.953599 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2984/5803] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:55 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:56.980932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:56.980932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:57.017359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:57.017840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:57.018707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:57.019172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:57.229912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:57.239951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d84bfd53-06a5-441d-b193-3ced68b41814 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.264721 Jul 14 15:23:57.246301 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2820/5804] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:56 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:23:58.265094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:58.268291 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:58.296970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:58.298996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:58.300941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:58.302043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:58.855605 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:23:58.873756 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3fdd9b6e-a197-41c9-b035-284bef6a7f67 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1696 microversion: 2.1 time: 0.614322 Jul 14 15:23:58.884979 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2985/5805] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:58 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1696 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:23:59.523089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b3dafe37-ee8b-4d49-b91f-095744051718 req-38bb7017-3add-47bd-a4e4-b98c83b3bac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "name": "network-vif-unplugged", "status": "completed", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:23:59.558523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b3dafe37-ee8b-4d49-b91f-095744051718 req-38bb7017-3add-47bd-a4e4-b98c83b3bac4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:59.559326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b3dafe37-ee8b-4d49-b91f-095744051718 req-38bb7017-3add-47bd-a4e4-b98c83b3bac4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:59.620919 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b3dafe37-ee8b-4d49-b91f-095744051718 req-38bb7017-3add-47bd-a4e4-b98c83b3bac4 service nova] Creating event network-vif-unplugged:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h2-768852-23 Jul 14 15:23:59.641286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-b3dafe37-ee8b-4d49-b91f-095744051718 req-38bb7017-3add-47bd-a4e4-b98c83b3bac4 service nova] Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:23:59.684816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b3dafe37-ee8b-4d49-b91f-095744051718 req-38bb7017-3add-47bd-a4e4-b98c83b3bac4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.172342 Jul 14 15:23:59.690409 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2821/5806] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:23:59.911461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:23:59.913110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:23:59.938134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:59.961058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:23:59.962442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:23:59.963116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.295776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:00.309573 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c0b6d7f4-b905-4048-b0ac-a2338f16b32c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1695 microversion: 2.1 time: 0.411005 Jul 14 15:24:00.328741 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2986/5807] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:23:59 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1695 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:00.384854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Calling method '.version_select at 0x7fdbf1fba310>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:00.385750 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:24:00.385750 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:24:00.386936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:00.388085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.406200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:00.406707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.421397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:00.422452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:00.437874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1af902e-a145-4923-93e8-87e8561ef4eb tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691 tempest-PortsAdminExtendedAttrsIpV6TestJSON-21687691-project-admin] 10.222.0.98 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.495273 Jul 14 15:24:00.439680 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2822/5808] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 15:23:59 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:01.335665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:01.336297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:01.347050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:01.347840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:01.348856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:01.349486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:01.680343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:01.702943 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-77700970-1b23-466c-9b99-5e9d201a2dec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1695 microversion: 2.1 time: 0.371695 Jul 14 15:24:01.711698 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2987/5809] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:01 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1695 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:01.732869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-712b2b08-fa47-41d0-bb80-6c8927586bc8 req-c3957c1c-9bfa-45a1-827f-23dd2f202b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:01.769911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-712b2b08-fa47-41d0-bb80-6c8927586bc8 req-c3957c1c-9bfa-45a1-827f-23dd2f202b37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:01.770498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-712b2b08-fa47-41d0-bb80-6c8927586bc8 req-c3957c1c-9bfa-45a1-827f-23dd2f202b37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:01.825307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-712b2b08-fa47-41d0-bb80-6c8927586bc8 req-c3957c1c-9bfa-45a1-827f-23dd2f202b37 service nova] Creating event network-changed:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h2-768852-23 Jul 14 15:24:01.866647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-712b2b08-fa47-41d0-bb80-6c8927586bc8 req-c3957c1c-9bfa-45a1-827f-23dd2f202b37 service nova] Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:24:01.898715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-712b2b08-fa47-41d0-bb80-6c8927586bc8 req-c3957c1c-9bfa-45a1-827f-23dd2f202b37 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.186031 Jul 14 15:24:01.908988 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2823/5810] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:24:02.734971 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:02.735832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:02.754422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:02.763169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:02.764431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:02.765184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:02.798960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=78 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:03.115979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:03.132713 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edae263a-088b-491d-92a3-843272ec0abf tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1693 microversion: 2.1 time: 0.403150 Jul 14 15:24:03.133482 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2988/5811] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:02 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1693 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:04.164000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:04.168727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:04.212832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=31 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.224834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.225606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.226922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.227716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.277793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.775464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:04.786816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2401501f-be66-4e66-9837-c6646e9dd4da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1690 microversion: 2.1 time: 0.638339 Jul 14 15:24:04.787468 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2824/5812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:04 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1690 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:04.805892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:04.807190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:04.810776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=29 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:04.827146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.828626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:04.830514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:04.831151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:05.003432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-58fa1e98-88cf-4503-8bf3-af7b1fb80d75 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action" status: 204 len: 0 microversion: 2.1 time: 0.201056 Jul 14 15:24:05.005623 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2989/5813] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:24:04 2022] POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:24:05.014263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:05.015088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:05.026582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:05.027382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:05.032239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:05.033144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:05.447407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:05.457616 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0eebe78-f0d3-472d-8e56-bc44ecaf1e55 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1690 microversion: 2.1 time: 0.447858 Jul 14 15:24:05.458235 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2825/5814] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:05 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1690 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:06.492899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:06.494373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:06.508161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.512844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:06.519347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:06.520901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.070898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:07.081781 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1237e41b-f0a0-4c56-a4ae-ee8bbd4c9e3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1690 microversion: 2.1 time: 0.609168 Jul 14 15:24:07.082486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2990/5815] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:06 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1690 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:07.645890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bb19e61f-3d14-4615-b2c6-75fa14a7233a req-8f56b5d5-bdab-44e0-8a81-079990697b5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "name": "network-vif-plugged", "status": "completed", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:07.658493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bb19e61f-3d14-4615-b2c6-75fa14a7233a req-8f56b5d5-bdab-44e0-8a81-079990697b5f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:07.659359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bb19e61f-3d14-4615-b2c6-75fa14a7233a req-8f56b5d5-bdab-44e0-8a81-079990697b5f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:07.701593 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bb19e61f-3d14-4615-b2c6-75fa14a7233a req-8f56b5d5-bdab-44e0-8a81-079990697b5f service nova] Creating event network-vif-plugged:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h2-768852-23 Jul 14 15:24:07.712207 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bb19e61f-3d14-4615-b2c6-75fa14a7233a req-8f56b5d5-bdab-44e0-8a81-079990697b5f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082488 Jul 14 15:24:07.714055 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2826/5816] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:08.099950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:08.100707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:08.109602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:08.110060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:08.111090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:08.111763 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:08.386134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:08.400021 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44067b8f-426c-4b49-a442-ea9ea3b73936 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1682 microversion: 2.1 time: 0.304041 Jul 14 15:24:08.400706 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2991/5817] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:08 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1682 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:24:28.662574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=5 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.663914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=13 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:28.678655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:28.683830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:28.697082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:28.699073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:28.700583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:28.701361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:28.804119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-592c49a8-366a-4dcf-a5b8-92ec444ee745 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action" status: 200 len: 24575 microversion: 2.1 time: 0.145004 Jul 14 15:24:28.805173 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2827/5818] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:24:28 2022] POST /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0/action => generated 24575 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:24:35.192006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:35.193004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:35.208606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=5 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.214091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:24:35.216231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:35.216693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:35.219698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:35.220180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:35.526927 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a02894d6-12f3-4678-bc1f-9e610eb672df tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1835 microversion: 2.1 time: 0.340420 Jul 14 15:24:35.527962 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2992/5819] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:35 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1835 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:37.473233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:37.476778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:37.480381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5b3b1bdd-8a74-411a-836c-e51a655506f9 req-7a401da6-d1da-430a-aae2-e8ddefca53c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:37.492977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5b3b1bdd-8a74-411a-836c-e51a655506f9 req-7a401da6-d1da-430a-aae2-e8ddefca53c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:37.493732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5b3b1bdd-8a74-411a-836c-e51a655506f9 req-7a401da6-d1da-430a-aae2-e8ddefca53c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:37.501986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:37.502451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:37.507766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:37.508237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:37.510587 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5b3b1bdd-8a74-411a-836c-e51a655506f9 req-7a401da6-d1da-430a-aae2-e8ddefca53c8 service nova] Creating event network-changed:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h2-768852-23 Jul 14 15:24:37.519404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5b3b1bdd-8a74-411a-836c-e51a655506f9 req-7a401da6-d1da-430a-aae2-e8ddefca53c8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045368 Jul 14 15:24:37.524479 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2993/5820] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:24:37.595405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:24:37.918604 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-08a3ae2e-7b24-4de7-a67e-8cfa9e213d3c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 204 len: 0 microversion: 2.1 time: 0.453552 Jul 14 15:24:37.925046 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2828/5821] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:24:37 2022] DELETE /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:24:37.941553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:37.942437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:37.968241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:37.968808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:37.974210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:37.974753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:38.440838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:38.449972 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9922c449-86e8-48b5-99ed-e2795f9cd5a4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1688 microversion: 2.1 time: 0.520620 Jul 14 15:24:38.453528 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2994/5822] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:37 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1688 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:39.482712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:39.489479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:39.531064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:39.535172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:39.537795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:39.540163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:40.261172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:40.269499 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d9b0a57-a5cc-48e6-b853-1b1d9227665a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1688 microversion: 2.1 time: 0.796669 Jul 14 15:24:40.274110 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2829/5823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:39 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1688 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:40.950574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f0733b77-a1d0-442a-9cd3-d860cf3ca19d req-148d2b8c-240b-4d1f-9a3c-b2a23921806e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2de80332-7642-4f70-9ce2-de8a82ce84a0", "name": "network-vif-deleted", "tag": "6f4bff07-024f-41a7-b40f-9a6c6cd52aaf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:40.973237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f0733b77-a1d0-442a-9cd3-d860cf3ca19d req-148d2b8c-240b-4d1f-9a3c-b2a23921806e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:40.973686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f0733b77-a1d0-442a-9cd3-d860cf3ca19d req-148d2b8c-240b-4d1f-9a3c-b2a23921806e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:41.057605 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f0733b77-a1d0-442a-9cd3-d860cf3ca19d req-148d2b8c-240b-4d1f-9a3c-b2a23921806e service nova] Creating event network-vif-deleted:6f4bff07-024f-41a7-b40f-9a6c6cd52aaf for instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 on n-h2-768852-23 Jul 14 15:24:41.070603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f0733b77-a1d0-442a-9cd3-d860cf3ca19d req-148d2b8c-240b-4d1f-9a3c-b2a23921806e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123602 Jul 14 15:24:41.074726 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2995/5824] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:24:41.304327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:41.305628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:41.330239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:41.336490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:41.345305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:41.353338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:41.459037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:41.459675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:41.460199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lazy-loading 'fault' on Instance uuid 2de80332-7642-4f70-9ce2-de8a82ce84a0 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:24:41.543545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:24:41.558440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a9a669d-6de7-4851-b776-5b70f337fe19 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 200 len: 1356 microversion: 2.1 time: 0.259565 Jul 14 15:24:41.559908 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2830/5825] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:41 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 1356 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:24:42.583973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:42.585699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 2de80332-7642-4f70-9ce2-de8a82ce84a0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:24:42.607667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:42.608789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:42.610113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:24:42.610634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:24:42.633349 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] HTTP exception thrown: Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 could not be found. Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Request method failure captured: Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 HTTP/1.1 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DShmCA9LUrKc4gE50X1sfHG-Lm_Y_o9EZxYmmvoTfSxYK9TqA6TfZtA7A5g19riBgP77kB4DblD1bneI-yKkvwowHZ7EzqlY0k1dmhhqLY7ESzr_OPGg7QZXWulDrTrTtbgddbUpBPQHIJgG97_XjGKNc8kAPkldOs2FZP1ZIqhxMQ Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: db9dcb86f53e466392563a143ee4654f Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 could not be found. Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2de80332-7642-4f70-9ce2-de8a82ce84a0'} Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 could not be found. Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 could not be found. Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:24:42.636345 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 could not be found. Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Returning 404 to user: Instance 2de80332-7642-4f70-9ce2-de8a82ce84a0 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e53d0e81-3b6a-484f-a276-209372e8aa62 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0" status: 404 len: 111 microversion: 2.1 time: 0.061851 Jul 14 15:24:42.660399 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2996/5826] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:24:42 2022] GET /compute/v2.1/servers/2de80332-7642-4f70-9ce2-de8a82ce84a0 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:24:50.498359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b21c1236-302b-452b-aadc-e154916c5b9b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '.version_select at 0x7fdbf1eb4e50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:24:50.564995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b21c1236-302b-452b-aadc-e154916c5b9b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1837700654" status: 202 len: 0 microversion: 2.1 time: 0.077789 Jul 14 15:24:50.568364 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2831/5827] 10.222.0.98 () {58 vars in 1283 bytes} [Thu Jul 14 15:24:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1837700654 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:24:50.653858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-60ef7478-7a71-426f-bb2c-ddbceb6608e9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: .version_select at 0x7fdbf33e1e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1892107154", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeAMe9hE1tuEZffz2ZrMJSecfaAe5uMIImKy5L7fVr7lAy2brK7rvZBptm/awdnmjvVhJFt9OE7uHVz8JjWwAebVToMrXeRoIt6UvUuwXSf1IUy0KPtW/8T+JC6RWaMmA=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:24:50.746816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-60ef7478-7a71-426f-bb2c-ddbceb6608e9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:24:50.759444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-60ef7478-7a71-426f-bb2c-ddbceb6608e9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:24:50.838546 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-60ef7478-7a71-426f-bb2c-ddbceb6608e9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.191170 Jul 14 15:24:50.843743 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2997/5828] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:24:50 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:25:07.243454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1480536374", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "ba3273c0-eba3-409f-8673-8922aeb3f5f6"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1892107154", "security_groups": [{"name": "tempest-secgroup-smoke-1037281849"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:07.299422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.301772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:07.813079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] validate_networks() for [('ba3273c0-eba3-409f-8673-8922aeb3f5f6', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:25:08.632890 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:25:08.633543 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:25:09.178655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:25:09.179155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:25:09.179851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:25:09.180337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:25:09.180832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:25:09.197939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:09.199352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:09.201771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:09.203852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:09.256434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:25:09.274938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:25:09.368629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:25:09.371459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:25:09.528847 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c28373e-0e32-40f1-865e-480ad4f86d5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.301925 Jul 14 15:25:09.531671 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2832/5829] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:25:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 2306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:25:09.538275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=18 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:09.539536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:09.540704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:09.548172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-68b9d026-4701-4feb-ae9e-b06ec14c3a7a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:09.555020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-68b9d026-4701-4feb-ae9e-b06ec14c3a7a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:09.746213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-68b9d026-4701-4feb-ae9e-b06ec14c3a7a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:09.759163 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-68b9d026-4701-4feb-ae9e-b06ec14c3a7a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1267 microversion: 2.1 time: 0.222692 Jul 14 15:25:09.759820 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2998/5830] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:09 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:10.799149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-24b78976-fca7-4634-8b78-58b03b22a107 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:10.800982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-24b78976-fca7-4634-8b78-58b03b22a107 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:11.084412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-24b78976-fca7-4634-8b78-58b03b22a107 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:11.102803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-24b78976-fca7-4634-8b78-58b03b22a107 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1267 microversion: 2.1 time: 0.309806 Jul 14 15:25:11.118206 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2833/5831] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:10 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1267 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:12.122015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce423725-54c4-49d9-a455-3a34e4499eea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:12.122818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce423725-54c4-49d9-a455-3a34e4499eea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:12.340511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce423725-54c4-49d9-a455-3a34e4499eea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:12.348766 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce423725-54c4-49d9-a455-3a34e4499eea tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1267 microversion: 2.1 time: 0.231526 Jul 14 15:25:12.349947 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 2999/5832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:12 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1267 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:13.369334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:13.370778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:13.385085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:13.393503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:13.394690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:13.395372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:13.485462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:13.495163 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d5df043-872c-4f0e-91cc-e0af42c5015d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1337 microversion: 2.1 time: 0.132508 Jul 14 15:25:13.496346 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2834/5833] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:13 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1337 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:14.515906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:14.517280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:14.537938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:14.540094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:14.543395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:14.544516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:15.447933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:15.475026 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e1784993-062f-4c2c-b1a5-49feb2f95a92 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1393 microversion: 2.1 time: 0.964552 Jul 14 15:25:15.476211 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3000/5834] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:14 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1393 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:16.493648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:16.494073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:16.513412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:16.513920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:16.514741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:16.515189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:16.572089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-84be6feb-47a2-4582-8575-d2c161503b1d req-4e513acd-0e98-42a9-bece-afac1aeae875 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:16.606546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-84be6feb-47a2-4582-8575-d2c161503b1d req-4e513acd-0e98-42a9-bece-afac1aeae875 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:16.607016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-84be6feb-47a2-4582-8575-d2c161503b1d req-4e513acd-0e98-42a9-bece-afac1aeae875 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:16.651547 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-84be6feb-47a2-4582-8575-d2c161503b1d req-4e513acd-0e98-42a9-bece-afac1aeae875 service nova] Creating event network-changed:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:25:16.667022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-84be6feb-47a2-4582-8575-d2c161503b1d req-4e513acd-0e98-42a9-bece-afac1aeae875 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099304 Jul 14 15:25:16.670515 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3001/5835] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:16.912978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:16.926244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73d4dfd2-2ee2-4f6e-8304-acd11da08097 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1393 microversion: 2.1 time: 0.436952 Jul 14 15:25:16.929978 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2835/5836] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:16 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1393 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:17.951985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:17.955581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:17.987952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:17.988924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:17.990589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:17.991870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:18.270818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:18.292346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0933c44d-a6bc-423e-b7a3-9f61cd88515d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1393 microversion: 2.1 time: 0.345823 Jul 14 15:25:18.293517 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3002/5837] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:17 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1393 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:19.311049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:19.312114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:19.325840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:19.328248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:19.329374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:19.330382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:19.331933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:19.642905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:19.668758 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca2451b0-6407-4826-941b-bcb06ba90ae1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1393 microversion: 2.1 time: 0.359406 Jul 14 15:25:19.670417 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2836/5838] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:19 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1393 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:20.704414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:20.706166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:20.716220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:20.719793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:20.722008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:20.723814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:20.991321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:21.007173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cceb85b2-6f22-4c14-a696-f0b49f05b170 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1393 microversion: 2.1 time: 0.321040 Jul 14 15:25:21.008294 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3003/5839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:20 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1393 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:21.616127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-95c72d5d-8f59-4b24-8c5a-981c4004a2d2 req-51da401a-530f-41f1-9551-d778723d674c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "name": "network-vif-plugged", "status": "completed", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:21.655050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:21.668656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-95c72d5d-8f59-4b24-8c5a-981c4004a2d2 req-51da401a-530f-41f1-9551-d778723d674c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:21.671366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-95c72d5d-8f59-4b24-8c5a-981c4004a2d2 req-51da401a-530f-41f1-9551-d778723d674c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:21.699547 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-95c72d5d-8f59-4b24-8c5a-981c4004a2d2 req-51da401a-530f-41f1-9551-d778723d674c service nova] Creating event network-vif-plugged:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:25:21.726475 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-95c72d5d-8f59-4b24-8c5a-981c4004a2d2 req-51da401a-530f-41f1-9551-d778723d674c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112131 Jul 14 15:25:21.728325 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2837/5840] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:22.027080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:22.027748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:22.043788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:22.044955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:22.046153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:22.046832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:22.348412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:22.380013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:22.395978 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c67d8276-b91a-402f-b055-f5f3bfcecddc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1393 microversion: 2.1 time: 0.374519 Jul 14 15:25:22.396603 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3004/5841] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:22 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1393 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:23.425039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:23.426465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:23.445337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:23.445989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:23.447002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:23.447645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:24.378930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:24.394988 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5238e2a-0ec4-4ec2-9462-9a7ff6f84371 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1565 microversion: 2.1 time: 0.976561 Jul 14 15:25:24.406661 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2838/5842] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:23 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1565 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:24.413791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:24.414791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:24.427933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:24.428472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:24.429336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:24.429880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:24.722744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:24.733337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39b000d7-4460-4b26-ab85-b6af53d77ecc tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1565 microversion: 2.1 time: 0.323411 Jul 14 15:25:24.734274 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3005/5843] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:24 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1565 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:29.670459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:25:29.671095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:29.683868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:29.684366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:29.685178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:29.685636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:29.701092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6ed55c27-39fd-4964-8e82-a08463380f2f req-c56aa1fb-ae0e-4068-aaac-b6bf24d44c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:29.756263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6ed55c27-39fd-4964-8e82-a08463380f2f req-c56aa1fb-ae0e-4068-aaac-b6bf24d44c30 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:29.756263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6ed55c27-39fd-4964-8e82-a08463380f2f req-c56aa1fb-ae0e-4068-aaac-b6bf24d44c30 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:29.790204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6ed55c27-39fd-4964-8e82-a08463380f2f req-c56aa1fb-ae0e-4068-aaac-b6bf24d44c30 service nova] Creating event network-changed:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:25:29.800438 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6ed55c27-39fd-4964-8e82-a08463380f2f req-c56aa1fb-ae0e-4068-aaac-b6bf24d44c30 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116974 Jul 14 15:25:29.807611 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3006/5844] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:25:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:25:30.254135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:25:30.274005 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfeabb75-bd98-4e2e-97d6-76c6a7c81391 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1565 microversion: 2.1 time: 0.608652 Jul 14 15:25:30.275419 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2839/5845] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:25:29 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1565 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:25:50.133795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=22 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:50.135621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:25:50.144436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:25:50.146162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:25:50.165047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:50.166760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:50.170111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:25:50.172820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:25:50.317108 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7e9c270-d671-4a8a-ac5f-8b74289071b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action" status: 200 len: 24564 microversion: 2.1 time: 0.185396 Jul 14 15:25:50.319581 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3007/5846] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:25:50 2022] POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action => generated 24564 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:01.432938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:01.434131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:01.490882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:01.492077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=34 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:01.502873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:01.528236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:01.529887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:01.530749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:02.829056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-27d5f7df-e6bc-4fe2-8e75-367b78e98a30 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1836 microversion: 2.1 time: 1.403493 Jul 14 15:26:02.831354 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2840/5847] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:01 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1836 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:02.858716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:02.867210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:02.886059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:02.887819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:02.891646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:02.892871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:02.894737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:02.896209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:03.636510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:03.654123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f91e4c55-5fe0-42f9-b7fd-3058ccd51e03 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1683 microversion: 2.1 time: 0.805004 Jul 14 15:26:03.655389 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3008/5848] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:02 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1683 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:03.860552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:03.861706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:03.886417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:03.889409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:03.890174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:03.895370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:04.032494 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-22cb9f73-d4ec-4bbb-b629-3675d62d6746 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action" status: 200 len: 32631 microversion: 2.1 time: 0.184117 Jul 14 15:26:04.040385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2841/5849] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:26:03 2022] POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action => generated 32631 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:26:04.185293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:04.185917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:04.205562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:04.206064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:04.206948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:04.207407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:04.528479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8353a4c231db48a9bc9e58c3f33a8cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6403ba8e6e4743a1a04c575cefcc89ea', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:04.529086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] flavor_id is None. Assuming migration. {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4142}} Jul 14 15:26:04.529838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:26:05.025059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-37e0a141-8269-4259-a08f-c72469145f10 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action" status: 202 len: 0 microversion: 2.1 time: 0.842922 Jul 14 15:26:05.031421 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3009/5850] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:26:04 2022] POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:26:05.037224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:05.038006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:05.073896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:05.074839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:05.075973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:05.076523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:05.482423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:05.492868 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f19052f2-7899-4106-b5a0-0bd7c782c98a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1692 microversion: 2.1 time: 0.461527 Jul 14 15:26:05.494281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2842/5851] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:05 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1692 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:06.516607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:06.517236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:06.574948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:06.575440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:06.576244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:06.576684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:07.049555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:07.072288 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c08c6275-6f76-4cca-98cb-78140acdf16d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1692 microversion: 2.1 time: 0.561198 Jul 14 15:26:07.075919 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3010/5852] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:06 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1692 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:07.542686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8172ab0b-1e09-4cdc-8c46-4af35914eb29 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1026468282", "availability_zone": "foo_zone"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:07.545877 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:07.545877 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:07.547158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.aggregate [None req-8172ab0b-1e09-4cdc-8c46-4af35914eb29 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Generated uuid 788700fc-06a7-4a6a-92fa-570fed560d0f for aggregate {{(pid=125966) create /opt/stack/nova/nova/objects/aggregate.py:298}} Jul 14 15:26:07.596561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8172ab0b-1e09-4cdc-8c46-4af35914eb29 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.772383 Jul 14 15:26:07.598632 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2843/5853] 10.222.0.98 () {60 vars in 1163 bytes} [Thu Jul 14 15:26:06 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:07.620533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-deab418c-70d6-444a-836e-9eaf599f946d tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:07.623490 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:07.623490 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 15:26:07.662628 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-deab418c-70d6-444a-836e-9eaf599f946d tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.055185 Jul 14 15:26:07.664230 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3011/5854] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 15:26:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:07.675842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8fa84f67-f15b-4f6e-b3a6-6ab6782caf1a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:07.677367 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:07.677367 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:07.679014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa84f67-f15b-4f6e-b3a6-6ab6782caf1a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:07.679518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa84f67-f15b-4f6e-b3a6-6ab6782caf1a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:07.680617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa84f67-f15b-4f6e-b3a6-6ab6782caf1a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:07.684022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fa84f67-f15b-4f6e-b3a6-6ab6782caf1a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:07.752087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8fa84f67-f15b-4f6e-b3a6-6ab6782caf1a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.080912 Jul 14 15:26:07.760306 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2844/5855] 10.222.0.98 () {58 vars in 1175 bytes} [Thu Jul 14 15:26:07 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:07.764325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c38bd9f-6d6d-4257-96cc-7aaf84514b7a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:07.765925 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:07.765925 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 15:26:07.784174 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c38bd9f-6d6d-4257-96cc-7aaf84514b7a tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.023964 Jul 14 15:26:07.784974 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3012/5856] 10.222.0.98 () {58 vars in 1142 bytes} [Thu Jul 14 15:26:07 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:26:07.797903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6eac4004-23d7-4ab0-9fde-21c35bd9d9a1 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-768852-23"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:07.799658 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:07.799658 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:07.827926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6eac4004-23d7-4ab0-9fde-21c35bd9d9a1 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:07.828675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6eac4004-23d7-4ab0-9fde-21c35bd9d9a1 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:08.091166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:08.092123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:08.107680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:08.110963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:08.114018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:08.114668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:08.818024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6eac4004-23d7-4ab0-9fde-21c35bd9d9a1 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 1.020906 Jul 14 15:26:08.826271 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2845/5857] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 15:26:07 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:08.832617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4758407b-3009-4476-a58b-d9ca85fe092f tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:08.839308 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:08.839308 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:08.880948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4758407b-3009-4476-a58b-d9ca85fe092f tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.045836 Jul 14 15:26:08.892007 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2846/5858] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 15:26:08 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:08.897670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93c41885-381a-413b-a4fb-11249a0a2f24 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1456212809", "availability_zone": "foo_zone"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:08.899582 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:08.899582 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:08.961612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93c41885-381a-413b-a4fb-11249a0a2f24 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.067622 Jul 14 15:26:08.962620 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2847/5859] 10.222.0.98 () {60 vars in 1172 bytes} [Thu Jul 14 15:26:08 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:08.999159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b5ad8db-e1d3-45a1-be93-df55392596d3 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:09.001174 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:09.001174 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:09.052274 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b5ad8db-e1d3-45a1-be93-df55392596d3 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.080447 Jul 14 15:26:09.056886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:09.059489 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2848/5860] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 15:26:08 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:09.069941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-20fc2557-8ca2-4ea8-8213-143244d00570 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1692 microversion: 2.1 time: 0.983492 Jul 14 15:26:09.073084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4cf802a-4833-44f7-bb73-399bdff76c2c tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:09.074212 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:09.074212 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:09.083599 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3013/5861] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:08 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1692 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:09.096716 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4cf802a-4833-44f7-bb73-399bdff76c2c tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.035264 Jul 14 15:26:09.097677 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2849/5862] 10.222.0.98 () {58 vars in 1151 bytes} [Thu Jul 14 15:26:09 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:09.108920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8fea8898-b7db-4328-8a22-adb58cbfe840 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-768852-23"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:09.111204 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:09.111204 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 15:26:09.126567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fea8898-b7db-4328-8a22-adb58cbfe840 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:09.127025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fea8898-b7db-4328-8a22-adb58cbfe840 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:09.634806 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8fea8898-b7db-4328-8a22-adb58cbfe840 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.527331 Jul 14 15:26:09.639092 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3014/5863] 10.222.0.98 () {60 vars in 1193 bytes} [Thu Jul 14 15:26:09 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:09.649734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f126ef3-71cb-40be-b7f9-d0ae066a8b47 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:09.651552 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:26:09.651552 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:26:09.703738 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f126ef3-71cb-40be-b7f9-d0ae066a8b47 tempest-TestAggregatesBasicOps-114923391 tempest-TestAggregatesBasicOps-114923391-project-admin] 10.222.0.98 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.057892 Jul 14 15:26:09.706818 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2850/5864] 10.222.0.98 () {58 vars in 1154 bytes} [Thu Jul 14 15:26:09 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Jul 14 15:26:10.096734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:10.097518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:10.119026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:10.119875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:10.120898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:10.121519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:10.380829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:10.390458 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-179c732c-9c3c-474d-8a9d-641ddfc94592 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.298542 Jul 14 15:26:10.391095 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3015/5865] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:10 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:26:11.411719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:11.412514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:11.437528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:11.438108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:11.440227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:11.440701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:12.196841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:12.209514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51da1a22-caef-4b1f-ac19-e06c9ed9426a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.803886 Jul 14 15:26:12.209514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2851/5866] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:11 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:13.230260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:13.231645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:13.248387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:13.250135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:13.252063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:13.253526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:14.033381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:14.055340 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-27df8b11-9b6b-481b-a2d8-d362f7a0b1b8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.831512 Jul 14 15:26:14.062813 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3016/5867] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:13 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:15.078632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:15.079881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:15.090715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:15.095004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:15.096998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:15.101785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:15.355352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:15.367058 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc5ee027-c1b4-47af-8b34-a79179c890aa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.292753 Jul 14 15:26:15.368598 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2852/5868] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:15 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:16.399507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:16.400951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:16.425146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:16.426022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:16.427093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:16.427722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:16.850027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:16.868700 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b15a158-54c2-41ef-a5e3-23a6c63c5aa8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.472909 Jul 14 15:26:16.872049 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3017/5869] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:16 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:17.902752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:17.904121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:17.908339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:17.939262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:17.948505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:17.956997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:17.963885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:18.472262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:18.484314 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97ec9788-2548-4d6e-a168-7fe5831131a0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.585471 Jul 14 15:26:18.485060 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2853/5870] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:17 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:19.508637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:19.509818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:19.541799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:19.544116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:19.550918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:19.555709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:19.858696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:19.870395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6448dfa1-7518-4e30-b12f-7d0d9ab8bfae tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.371938 Jul 14 15:26:19.881925 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3018/5871] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:19 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:20.890945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:20.891670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:20.902767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:20.904230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:20.907734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:20.909346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:21.299913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:21.311148 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5584cf27-f3c0-4f29-a184-62e484264efd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.424827 Jul 14 15:26:21.315177 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2854/5872] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:20 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:26:22.333969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:22.335912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:22.348063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:22.352096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:22.354814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:22.355998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:22.893734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:22.901854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b8003138-c98a-4dc6-b62e-d42c11a507e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.572354 Jul 14 15:26:22.905569 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3019/5873] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:22 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:23.932496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:23.934027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:23.962800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:23.964799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:23.973944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:23.975788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:24.377693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:24.390636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1352ff3-7819-4936-8fad-79929958619d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.469332 Jul 14 15:26:24.391464 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2855/5874] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:23 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:25.412295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:25.413295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:25.427875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:25.428331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:25.429130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:25.429569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:25.666158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:25.680461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc044cd7-8535-460d-bfb4-2beccec33c60 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.273557 Jul 14 15:26:25.681510 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3020/5875] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:25 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:26.698202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:26.699604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:26.712168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:26.712839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:26.713957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:26.715075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:27.023760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:27.035111 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-422f99c7-d1aa-4667-9862-3a2176505285 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1697 microversion: 2.1 time: 0.340411 Jul 14 15:26:27.044179 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2856/5876] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:26 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1697 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:26:28.062135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:28.062758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:28.090093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:28.093145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:28.097599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:28.098479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:28.566423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:28.575761 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bcf69184-156a-4b0a-9fed-365dd1c7ed4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1696 microversion: 2.1 time: 0.517438 Jul 14 15:26:28.582375 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3021/5877] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:28 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1696 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:29.120322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ec7eb83c-a466-4405-8974-c916e14e481c req-9b940951-d948-4541-ba8b-31eaf37b818f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "name": "network-vif-unplugged", "status": "completed", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:29.143045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ec7eb83c-a466-4405-8974-c916e14e481c req-9b940951-d948-4541-ba8b-31eaf37b818f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:29.146498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ec7eb83c-a466-4405-8974-c916e14e481c req-9b940951-d948-4541-ba8b-31eaf37b818f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:29.183736 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ec7eb83c-a466-4405-8974-c916e14e481c req-9b940951-d948-4541-ba8b-31eaf37b818f service nova] Creating event network-vif-unplugged:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h2-768852-23 Jul 14 15:26:29.203391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-ec7eb83c-a466-4405-8974-c916e14e481c req-9b940951-d948-4541-ba8b-31eaf37b818f service nova] Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:26:29.217551 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ec7eb83c-a466-4405-8974-c916e14e481c req-9b940951-d948-4541-ba8b-31eaf37b818f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106130 Jul 14 15:26:29.221235 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2857/5878] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:26:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:29.605080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:29.607771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:29.642290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:29.643457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:29.644906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:29.651984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:30.781710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:30.795322 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-733d4c19-2180-4a8a-87ce-7220416c5d4d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1696 microversion: 2.1 time: 1.198450 Jul 14 15:26:30.797526 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3022/5879] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:29 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1696 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:31.353399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-09bca4ae-1eca-46fd-ac66-4867bfa9d972 req-4cb883ec-47b6-4e97-9036-7e17c429ae54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:31.372736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09bca4ae-1eca-46fd-ac66-4867bfa9d972 req-4cb883ec-47b6-4e97-9036-7e17c429ae54 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:31.378991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09bca4ae-1eca-46fd-ac66-4867bfa9d972 req-4cb883ec-47b6-4e97-9036-7e17c429ae54 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:31.407931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-09bca4ae-1eca-46fd-ac66-4867bfa9d972 req-4cb883ec-47b6-4e97-9036-7e17c429ae54 service nova] Creating event network-changed:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h2-768852-23 Jul 14 15:26:31.439492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-09bca4ae-1eca-46fd-ac66-4867bfa9d972 req-4cb883ec-47b6-4e97-9036-7e17c429ae54 service nova] Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:26:31.472376 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-09bca4ae-1eca-46fd-ac66-4867bfa9d972 req-4cb883ec-47b6-4e97-9036-7e17c429ae54 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124703 Jul 14 15:26:31.476510 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2858/5880] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:31.812979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:31.813600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:31.839091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:31.839905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:31.842772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:31.847116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:32.772418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:32.783736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ace230f-13c2-4970-8415-92d091d72f6b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1696 microversion: 2.1 time: 0.972728 Jul 14 15:26:32.794109 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3023/5881] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:31 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1696 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:33.802639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:33.803392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:33.806262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:33.830863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:33.831431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:33.832390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:33.832853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:33.851816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=67 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:34.225981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:34.241522 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b0e56d1e-2612-41ad-a58f-8a5ac1ecb04d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1694 microversion: 2.1 time: 0.443460 Jul 14 15:26:34.244066 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2859/5882] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:33 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1694 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:35.268715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:35.278734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:35.344795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:35.356577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:35.357046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:35.361654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:35.361843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:35.368323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:26:35.898432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:35.915770 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-218e3611-2822-4fbe-9809-c471dc67589b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1691 microversion: 2.1 time: 0.650473 Jul 14 15:26:35.928188 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3024/5883] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:35 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1691 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:35.963890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:35.968197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:35.990600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:35.992803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:35.994921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:35.996728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:36.353752 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67b0faee-1c9b-45ff-bace-8ea766240266 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action" status: 202 len: 0 microversion: 2.1 time: 0.411591 Jul 14 15:26:36.356587 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2860/5884] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:26:35 2022] POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:26:36.367151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:36.379995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:36.433250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:36.434125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:36.445450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:36.446510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:36.883097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:36.899460 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9ecd7dd3-65a3-47c9-a051-45b5faf4d65a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.536127 Jul 14 15:26:36.902957 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3025/5885] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:36 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:37.921471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:37.922746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:37.938707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:37.939421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:37.942552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:37.945684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:38.505013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:38.524783 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e6d5dbd-2e8a-46e8-b791-402fc3c4a1da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.609033 Jul 14 15:26:38.548878 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2861/5886] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:37 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:38.772059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ce0850b3-978e-4880-9122-83cfb9fba172 req-5ea303f8-c4d3-4883-bcd9-73ef1780e763 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "name": "network-vif-plugged", "status": "completed", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:38.795696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ce0850b3-978e-4880-9122-83cfb9fba172 req-5ea303f8-c4d3-4883-bcd9-73ef1780e763 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:38.797027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ce0850b3-978e-4880-9122-83cfb9fba172 req-5ea303f8-c4d3-4883-bcd9-73ef1780e763 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:38.834138 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ce0850b3-978e-4880-9122-83cfb9fba172 req-5ea303f8-c4d3-4883-bcd9-73ef1780e763 service nova] Creating event network-vif-plugged:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h2-768852-23 Jul 14 15:26:38.844090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-ce0850b3-978e-4880-9122-83cfb9fba172 req-5ea303f8-c4d3-4883-bcd9-73ef1780e763 service nova] Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:26:38.863766 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ce0850b3-978e-4880-9122-83cfb9fba172 req-5ea303f8-c4d3-4883-bcd9-73ef1780e763 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101047 Jul 14 15:26:38.865804 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3026/5887] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:26:39.567213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:39.568442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:39.575832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:39.577194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:39.578206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:39.579031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:39.975170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:40.004590 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-324126c4-9bc1-4cfc-89a7-efe44261bd90 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.441275 Jul 14 15:26:40.006942 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2862/5888] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:39 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:26:41.025990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:41.027921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:41.045624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:41.048451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:41.049611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:41.052468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:41.508368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:41.542917 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5abe2c5e-7701-4284-bc23-0e5022f8c0cb tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.522108 Jul 14 15:26:41.544734 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3027/5889] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:41 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:26:42.563130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:42.566885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:42.588155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:42.589558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:42.593751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:42.597600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:43.271288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:43.281364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7591731c-2fac-465b-8696-b06fcea4de95 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.722742 Jul 14 15:26:43.281994 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2863/5890] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:42 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:44.304758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:44.308820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:44.332708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bec56072-520a-4892-ac88-04c075fb7b13 req-46280c1f-55a6-4124-8cdf-58c21637c080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "name": "network-vif-unplugged", "status": "completed", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:44.367156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:44.368897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:44.372166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:44.372659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:44.386006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bec56072-520a-4892-ac88-04c075fb7b13 req-46280c1f-55a6-4124-8cdf-58c21637c080 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:44.386482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bec56072-520a-4892-ac88-04c075fb7b13 req-46280c1f-55a6-4124-8cdf-58c21637c080 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:44.450847 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bec56072-520a-4892-ac88-04c075fb7b13 req-46280c1f-55a6-4124-8cdf-58c21637c080 service nova] Creating event network-vif-unplugged:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:26:44.474299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-bec56072-520a-4892-ac88-04c075fb7b13 req-46280c1f-55a6-4124-8cdf-58c21637c080 service nova] Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:26:44.503377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bec56072-520a-4892-ac88-04c075fb7b13 req-46280c1f-55a6-4124-8cdf-58c21637c080 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.178483 Jul 14 15:26:44.504029 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2864/5891] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:45.010622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:45.023678 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c38d21c-bed1-4338-8fcb-63c955cb34c2 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.728023 Jul 14 15:26:45.038821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3028/5892] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:44 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:46.056346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:46.058354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:46.091898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:46.093482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:46.095054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:46.095916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:46.553939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c34456d0-094f-4037-b215-01ad08c3be9b req-ded958e9-a5ec-4dd8-ae03-e43959393b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:46.602235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c34456d0-094f-4037-b215-01ad08c3be9b req-ded958e9-a5ec-4dd8-ae03-e43959393b45 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:46.603287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c34456d0-094f-4037-b215-01ad08c3be9b req-ded958e9-a5ec-4dd8-ae03-e43959393b45 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:46.632258 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c34456d0-094f-4037-b215-01ad08c3be9b req-ded958e9-a5ec-4dd8-ae03-e43959393b45 service nova] Creating event network-changed:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:26:46.644878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-c34456d0-094f-4037-b215-01ad08c3be9b req-ded958e9-a5ec-4dd8-ae03-e43959393b45 service nova] Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:26:46.664341 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c34456d0-094f-4037-b215-01ad08c3be9b req-ded958e9-a5ec-4dd8-ae03-e43959393b45 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121535 Jul 14 15:26:46.674031 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3029/5893] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:26:46.721329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:46.741098 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-befff3af-290f-4ed8-84d9-d14083138214 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.692629 Jul 14 15:26:46.741845 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2865/5894] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:46 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:47.768653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:47.769493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:47.790573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:47.791173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:47.793341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:47.801220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:48.235206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:48.249603 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c8e15b5-7141-4e9b-9a32-46bb84408c3d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.487332 Jul 14 15:26:48.262534 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3030/5895] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:47 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:49.270312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:49.270954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:49.286040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:49.286495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:49.287658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:49.291489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:49.594800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:49.607023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-384f3b57-2004-47f6-8109-1542925f8c10 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.342103 Jul 14 15:26:49.610368 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2866/5896] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:49 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:50.642990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:50.649628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:50.703915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:50.705152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:50.718208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:50.720797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:51.397788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:51.418079 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9302942-9555-4cc2-acd5-a11d0d10f2fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1690 microversion: 2.1 time: 0.781536 Jul 14 15:26:51.420730 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3031/5897] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:50 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1690 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:26:52.450084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:26:52.451792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:26:52.495097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:52.503255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:52.504442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:52.506279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:52.887495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:26:52.914914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2ae77a8-0564-4879-99e0-5e850d3eb724 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1683 microversion: 2.1 time: 0.470146 Jul 14 15:26:52.917341 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2867/5898] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:26:52 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1683 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:26:54.139451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f95346ac-64cb-4cce-a57b-918bee271f44 req-d15ce5e2-eb35-4818-9df0-b4fc6834cd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "name": "network-vif-plugged", "status": "completed", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:26:54.152198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f95346ac-64cb-4cce-a57b-918bee271f44 req-d15ce5e2-eb35-4818-9df0-b4fc6834cd54 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:26:54.152962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f95346ac-64cb-4cce-a57b-918bee271f44 req-d15ce5e2-eb35-4818-9df0-b4fc6834cd54 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:26:54.168957 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f95346ac-64cb-4cce-a57b-918bee271f44 req-d15ce5e2-eb35-4818-9df0-b4fc6834cd54 service nova] Creating event network-vif-plugged:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:26:54.175253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f95346ac-64cb-4cce-a57b-918bee271f44 req-d15ce5e2-eb35-4818-9df0-b4fc6834cd54 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043928 Jul 14 15:26:54.176580 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3032/5899] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:27:09.789802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b626d2d-ba71-4bad-8aa1-c3dc640c1e56 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'create', calling method: .version_select at 0x7fdbf1f8b430>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1811956804", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1cq4gBlWImr+71QlXeSv10DP+rgJlBPMV4+uBQX/RMV8ai/CdchcQeAMgfqI0s6FuNwjac9lNFdLG0OOtQZFOBl5tD7aYmk9q14TcuZU4S4GBcP7dfpGcPg6p8RVXN2w=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:09.798964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=21 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:09.800254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:09.825908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5b626d2d-ba71-4bad-8aa1-c3dc640c1e56 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:27:09.836444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-5b626d2d-ba71-4bad-8aa1-c3dc640c1e56 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for user 1f6b1118c0544aa7a263d78fd14c3552 and project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:27:09.879723 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b626d2d-ba71-4bad-8aa1-c3dc640c1e56 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.096849 Jul 14 15:27:09.880483 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2868/5900] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:27:09 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:11.554401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=17 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:11.555457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=45 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:11.564622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1730517416", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "38c6ab49-2c9c-4055-9b86-d4de321abb0b"}], "key_name": "tempest-TestNetworkBasicOps-1811956804", "security_groups": [{"name": "tempest-secgroup-smoke-721333804"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:11.757927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] validate_networks() for [('38c6ab49-2c9c-4055-9b86-d4de321abb0b', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:27:12.320966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:27:12.321397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:27:12.321879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:27:12.322292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:27:12.322702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:27:12.333144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:12.333528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:12.334328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:12.334768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:12.355234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:27:12.361647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for user 1f6b1118c0544aa7a263d78fd14c3552 and project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:27:12.379936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:27:12.382603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:27:12.447463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad098a30-4f23-45e4-92df-bfb6701824f1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.895982 Jul 14 15:27:12.448151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3033/5901] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:27:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:27:12.463033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc5a19ff-c374-4b8f-9d66-969fa5f48dfc tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:12.463860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fc5a19ff-c374-4b8f-9d66-969fa5f48dfc tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:12.542737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fc5a19ff-c374-4b8f-9d66-969fa5f48dfc tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:12.554657 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc5a19ff-c374-4b8f-9d66-969fa5f48dfc tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1249 microversion: 2.1 time: 0.096469 Jul 14 15:27:12.555624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2869/5902] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:12 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:13.579539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:13.580355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:13.590901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:13.591389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:13.592226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:13.592666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:13.960708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:13.969539 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fa7297cd-fb09-4fbd-af83-c07c7c20d49f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1301 microversion: 2.1 time: 0.395341 Jul 14 15:27:13.970168 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3034/5903] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:13 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1301 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:14.988184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:14.988886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:14.996642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:14.997205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:14.998003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:14.998438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:15.272446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:15.280891 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-50e79a72-46f2-4a41-8bf5-45f85c093160 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1374 microversion: 2.1 time: 0.297060 Jul 14 15:27:15.282447 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2870/5904] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:14 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1374 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:15.440279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5de0ad03-9516-48f6-a32e-d10d8b06a4ab req-f8514c57-58a9-467a-9e77-bad785c4803a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b1eed3-432d-480c-b7d5-e4611a5c79d9", "tag": "7437a861-1b69-4463-b0c6-681945725121"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:15.464209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5de0ad03-9516-48f6-a32e-d10d8b06a4ab req-f8514c57-58a9-467a-9e77-bad785c4803a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:15.467183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5de0ad03-9516-48f6-a32e-d10d8b06a4ab req-f8514c57-58a9-467a-9e77-bad785c4803a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:15.490304 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5de0ad03-9516-48f6-a32e-d10d8b06a4ab req-f8514c57-58a9-467a-9e77-bad785c4803a service nova] Creating event network-changed:7437a861-1b69-4463-b0c6-681945725121 for instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 on n-h1-768852-23 Jul 14 15:27:15.496794 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5de0ad03-9516-48f6-a32e-d10d8b06a4ab req-f8514c57-58a9-467a-9e77-bad785c4803a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059989 Jul 14 15:27:15.497492 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3035/5905] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:16.299005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:16.299628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:16.306888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:16.307367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:16.308147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:16.308587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:16.462710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:16.471199 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9db162aa-db70-4306-9260-b1d7eddcfef3 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1374 microversion: 2.1 time: 0.176345 Jul 14 15:27:16.471850 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2871/5906] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:16 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1374 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:17.488648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:17.489351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:17.496817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:17.497266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:17.498042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:17.498482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:17.700514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:17.708467 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f814bb77-202b-47db-996c-dbb75dbed4ae tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1374 microversion: 2.1 time: 0.224155 Jul 14 15:27:17.709729 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3036/5907] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:17 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1374 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:18.729227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:18.730267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:18.743181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:18.743928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:18.744903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:18.745346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:18.903483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:18.911981 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f8e48a0-2758-4377-8719-b48a932aa640 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1374 microversion: 2.1 time: 0.189689 Jul 14 15:27:18.912667 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2872/5908] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:18 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:19.443482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:19.445007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:19.453137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:19.453625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:19.454412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:19.454846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:19.531609 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0113d8d8-0c3f-40be-a4b5-4d64e80debcd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action" status: 200 len: 63170 microversion: 2.1 time: 0.308803 Jul 14 15:27:19.532716 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3037/5909] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:27:19 2022] POST /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723/action => generated 63170 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:27:19.930739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:19.932289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:19.941686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:19.942149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:19.942955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:19.943429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:20.103989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:20.116416 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60812de1-9cc2-45e2-a81e-1a548173df6a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1374 microversion: 2.1 time: 0.190309 Jul 14 15:27:20.117664 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2873/5910] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:19 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1374 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:20.131713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-aaa7e27e-dcf3-441e-aa3c-0d62df67684b req-7ac7d9a8-c333-4603-ab2b-7a5f4dec44a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b1eed3-432d-480c-b7d5-e4611a5c79d9", "name": "network-vif-plugged", "status": "completed", "tag": "7437a861-1b69-4463-b0c6-681945725121"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:20.149678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aaa7e27e-dcf3-441e-aa3c-0d62df67684b req-7ac7d9a8-c333-4603-ab2b-7a5f4dec44a2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:20.150493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aaa7e27e-dcf3-441e-aa3c-0d62df67684b req-7ac7d9a8-c333-4603-ab2b-7a5f4dec44a2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:20.172154 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-aaa7e27e-dcf3-441e-aa3c-0d62df67684b req-7ac7d9a8-c333-4603-ab2b-7a5f4dec44a2 service nova] Creating event network-vif-plugged:7437a861-1b69-4463-b0c6-681945725121 for instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 on n-h1-768852-23 Jul 14 15:27:20.182059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-aaa7e27e-dcf3-441e-aa3c-0d62df67684b req-7ac7d9a8-c333-4603-ab2b-7a5f4dec44a2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057636 Jul 14 15:27:20.183177 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3038/5911] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:21.136017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:21.136630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:21.143784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:21.144232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:21.145009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:21.145448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:21.304662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:21.312642 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71ed6018-00b3-478c-8da5-73d1bf97c965 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1374 microversion: 2.1 time: 0.180454 Jul 14 15:27:21.313288 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2874/5912] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:21 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1374 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:22.332312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:22.333054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:22.339768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:22.340215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:22.341845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:22.342277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:22.342825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:22.370366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:22.491390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:22.500201 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db3f162f-afec-4903-a64c-1d68561a81a4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1547 microversion: 2.1 time: 0.173159 Jul 14 15:27:22.500814 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3039/5913] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:22 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1547 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:22.517495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:22.518241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:22.525966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:22.526336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:22.527118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:22.527831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:22.550508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:22.696518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:22.704729 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2d9d88d9-b84f-401d-a913-0788ba798f84 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1547 microversion: 2.1 time: 0.191565 Jul 14 15:27:22.705347 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2875/5914] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:22 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1547 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:24.581511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-af5c7742-3482-4b1b-8376-b09a8d68eedd req-c727e1f5-108c-49b5-af9a-2f3b30467152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b1eed3-432d-480c-b7d5-e4611a5c79d9", "tag": "7437a861-1b69-4463-b0c6-681945725121"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:24.593204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-af5c7742-3482-4b1b-8376-b09a8d68eedd req-c727e1f5-108c-49b5-af9a-2f3b30467152 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:24.593983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-af5c7742-3482-4b1b-8376-b09a8d68eedd req-c727e1f5-108c-49b5-af9a-2f3b30467152 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:24.613435 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-af5c7742-3482-4b1b-8376-b09a8d68eedd req-c727e1f5-108c-49b5-af9a-2f3b30467152 service nova] Creating event network-changed:7437a861-1b69-4463-b0c6-681945725121 for instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 on n-h1-768852-23 Jul 14 15:27:24.620525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-af5c7742-3482-4b1b-8376-b09a8d68eedd req-c727e1f5-108c-49b5-af9a-2f3b30467152 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042719 Jul 14 15:27:24.623337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3040/5915] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:27:25.941061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:25.942008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:25.950553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:25.951300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:25.952300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:25.952748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:26.103584 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a557e9c9-d879-4345-b3f3-0d4f95c22de5 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1836 microversion: 2.1 time: 0.357172 Jul 14 15:27:26.104181 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2876/5916] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:25 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1836 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:27.369135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:27.369777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:27.372798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b5c58ec9-6df8-4fee-8b4f-56d1b1aee7d4 req-1f8c2586-cd79-4bba-aa08-faf79f0564b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:27.377929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.378381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.379204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.379672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.381900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b5c58ec9-6df8-4fee-8b4f-56d1b1aee7d4 req-1f8c2586-cd79-4bba-aa08-faf79f0564b7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.382436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b5c58ec9-6df8-4fee-8b4f-56d1b1aee7d4 req-1f8c2586-cd79-4bba-aa08-faf79f0564b7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.393839 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b5c58ec9-6df8-4fee-8b4f-56d1b1aee7d4 req-1f8c2586-cd79-4bba-aa08-faf79f0564b7 service nova] Creating event network-changed:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:27:27.399794 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b5c58ec9-6df8-4fee-8b4f-56d1b1aee7d4 req-1f8c2586-cd79-4bba-aa08-faf79f0564b7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032059 Jul 14 15:27:27.400679 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2877/5917] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:27.409147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:27:27.505823 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7ac858e-2585-4e13-96a7-83d1eb4da530 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 204 len: 0 microversion: 2.1 time: 0.140601 Jul 14 15:27:27.506339 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3041/5918] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:27:27 2022] DELETE /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:27:27.515586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:27.516371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:27.522885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.523536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.524410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:27.524946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:27.689310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:27.697320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-043adae4-d420-4a10-a103-a64874f4e239 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1689 microversion: 2.1 time: 0.186161 Jul 14 15:27:27.697921 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2878/5919] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:27 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:28.717676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:28.718742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:28.726987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.727467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.728275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:28.728702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:28.890036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:28.899129 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ed6a1f9-a7a7-4143-970d-00acfe05d0d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1689 microversion: 2.1 time: 0.186501 Jul 14 15:27:28.899992 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3042/5920] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:28 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1689 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:29.921844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:29.923194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:29.935361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:29.936171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:29.937619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:29.938421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:30.038168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:30.052024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-74f49367-a2cd-4786-b651-109516ef4c28 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 200 len: 1503 microversion: 2.1 time: 0.137390 Jul 14 15:27:30.053060 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2879/5921] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:29 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 1503 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:30.092760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a1002912-1832-438b-b414-850a7a25a679 req-34b428d6-6685-487c-a737-a2f892cb1dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "251f3df7-861c-4d09-83b1-87f09ebbf723", "name": "network-vif-deleted", "tag": "fe36e23e-6b32-4480-94e4-6d31058efdf2"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:30.106286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a1002912-1832-438b-b414-850a7a25a679 req-34b428d6-6685-487c-a737-a2f892cb1dc5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:30.106806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a1002912-1832-438b-b414-850a7a25a679 req-34b428d6-6685-487c-a737-a2f892cb1dc5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:30.121003 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a1002912-1832-438b-b414-850a7a25a679 req-34b428d6-6685-487c-a737-a2f892cb1dc5 service nova] Creating event network-vif-deleted:fe36e23e-6b32-4480-94e4-6d31058efdf2 for instance 251f3df7-861c-4d09-83b1-87f09ebbf723 on n-h1-768852-23 Jul 14 15:27:30.127482 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a1002912-1832-438b-b414-850a7a25a679 req-34b428d6-6685-487c-a737-a2f892cb1dc5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039249 Jul 14 15:27:30.128142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3043/5922] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:27:31.073646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:31.074923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: 251f3df7-861c-4d09-83b1-87f09ebbf723] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:31.084451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:31.085091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:31.085988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:31.086473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:31.103355 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] HTTP exception thrown: Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 could not be found. Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Request method failure captured: Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 HTTP/1.1 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DShmCA9LUrKc4gE50X1sfHG-Lm_Y_o9EZxYmmvoTfSxYK9TqA6TfZtA7A5g19riBgP77kB4DblD1bneI-yKkvwowHZ7EzqlY0k1dmhhqLY7ESzr_OPGg7QZXWulDrTrTtbgddbUpBPQHIJgG97_XjGKNc8kAPkldOs2FZP1ZIqhxMQ Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: db9dcb86f53e466392563a143ee4654f Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 could not be found. Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '251f3df7-861c-4d09-83b1-87f09ebbf723'} Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 could not be found. Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 could not be found. Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:27:31.105076 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 could not be found. Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Returning 404 to user: Instance 251f3df7-861c-4d09-83b1-87f09ebbf723 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3e0e05a-a8bf-4a52-af03-65e753bab204 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723" status: 404 len: 111 microversion: 2.1 time: 0.037485 Jul 14 15:27:31.114233 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2880/5923] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:31 2022] GET /compute/v2.1/servers/251f3df7-861c-4d09-83b1-87f09ebbf723 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:27:34.905169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02d6c45c-4da3-491e-9584-2dfc413970fa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '.version_select at 0x7fdbf1ca0af0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:34.936844 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02d6c45c-4da3-491e-9584-2dfc413970fa tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1892107154" status: 202 len: 0 microversion: 2.1 time: 0.036880 Jul 14 15:27:34.938083 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3044/5924] 10.222.0.98 () {58 vars in 1283 bytes} [Thu Jul 14 15:27:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1892107154 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:27:34.987666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-704d0dd3-3546-4312-9374-9404082e3838 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: .version_select at 0x7fdbf2a3e310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1096534470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCjzPUNbbrZYPlmYCoOkGZL4eOybTzp18N+EgyNQNp4dcMH7wOpo5s6hAnoKlc0Wpa/BUUAKKb/dy2+tZ443DIxzHzWFwhnvFdH13ejtkkxJQ6yO92T/B4TV5cT4R3MOLg=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:35.012132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-704d0dd3-3546-4312-9374-9404082e3838 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:27:35.021778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-704d0dd3-3546-4312-9374-9404082e3838 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:27:35.054670 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-704d0dd3-3546-4312-9374-9404082e3838 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.071919 Jul 14 15:27:35.055378 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2881/5925] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:27:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:42.713867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1633240794", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "98b0ed25-2167-4ce4-9692-2de70cf802fc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1096534470", "security_groups": [{"name": "tempest-secgroup-smoke-1420567795"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:42.723749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:42.724942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:42.894946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] validate_networks() for [('98b0ed25-2167-4ce4-9692-2de70cf802fc', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:27:43.422325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:27:43.422765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:27:43.423553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:27:43.424026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:27:43.424805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:27:43.436210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:43.437003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:43.437847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:43.438859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:43.464377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:27:43.471523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:27:43.488157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:27:43.492137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:27:43.551455 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-496c5e20-6f77-4150-9edb-dca0f3ea7785 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.841519 Jul 14 15:27:43.563176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1c98d85-92cd-4091-9fd4-de5a9fb19f5e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:43.564238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1c98d85-92cd-4091-9fd4-de5a9fb19f5e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:43.573126 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3045/5926] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:27:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:27:43.581906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=58 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:43.585644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:43.684720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e1c98d85-92cd-4091-9fd4-de5a9fb19f5e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:43.701539 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1c98d85-92cd-4091-9fd4-de5a9fb19f5e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1267 microversion: 2.1 time: 0.142788 Jul 14 15:27:43.702159 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2882/5927] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:43 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1267 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:44.721216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:44.723611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:44.742755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:44.743098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:44.743912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:44.744346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:44.896249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:44.915383 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edde28cb-503d-4148-8517-f38386ee534d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1319 microversion: 2.1 time: 0.201008 Jul 14 15:27:44.916720 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3046/5928] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:44 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:45.936907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:45.938025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:45.963529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:45.964353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:45.966027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:45.966800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:46.350135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:46.363626 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8c8ff3fc-9635-4d7c-a3a2-378db3b5d9c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.433270 Jul 14 15:27:46.364048 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2883/5929] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:45 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:47.109028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7ebabccd-9e5f-4b07-bd99-c2a7acce91a4 req-95bbf8a5-f06f-44b8-ac77-3d5b07a4b165 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:47.118958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7ebabccd-9e5f-4b07-bd99-c2a7acce91a4 req-95bbf8a5-f06f-44b8-ac77-3d5b07a4b165 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:47.119335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7ebabccd-9e5f-4b07-bd99-c2a7acce91a4 req-95bbf8a5-f06f-44b8-ac77-3d5b07a4b165 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:47.132726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7ebabccd-9e5f-4b07-bd99-c2a7acce91a4 req-95bbf8a5-f06f-44b8-ac77-3d5b07a4b165 service nova] Creating event network-changed:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h2-768852-23 Jul 14 15:27:47.138669 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7ebabccd-9e5f-4b07-bd99-c2a7acce91a4 req-95bbf8a5-f06f-44b8-ac77-3d5b07a4b165 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111894 Jul 14 15:27:47.139517 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3047/5930] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:47.382350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:47.383025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:47.390691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:47.391161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:47.391988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:47.392430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:47.570814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:47.579168 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70c5e31e-6311-424a-a05d-6765e87be3d0 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.201323 Jul 14 15:27:47.579790 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2884/5931] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:47 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:48.597858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:48.599468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:48.606936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:48.607443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:48.608344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:48.608774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:48.757693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:48.767050 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b95c2918-77e0-45df-82bd-a7d40d390757 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.173699 Jul 14 15:27:48.767971 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3048/5932] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:48 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:49.785006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:49.785632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:49.792880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.793343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.794168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:49.794613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:49.957242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:49.966537 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e54c8ad4-c400-488c-bb0c-4a30138ba5c4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.185386 Jul 14 15:27:49.967135 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2885/5933] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:49 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:50.984398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:50.989010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:50.991516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:50.992493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:50.999138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:50.999386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:50.999549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:50.999663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:51.000324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:51.000445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:51.000760 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:51.000888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:51.071238 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f13b2867-ee09-4f4f-b8c7-c1216d0a2d5e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9/action" status: 200 len: 24571 microversion: 2.1 time: 0.095619 Jul 14 15:27:51.072539 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3049/5934] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:27:50 2022] POST /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9/action => generated 24571 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:27:51.143871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:51.151759 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71951192-7a99-4e60-b1f1-cf1c3ff19f02 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.169894 Jul 14 15:27:51.152833 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2886/5935] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:50 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:52.170091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:52.170807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:52.178800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:52.179253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:52.180136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:52.180574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:52.320813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:52.329526 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-089634ce-3748-403c-9bbc-c3b68be6bf7c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.163831 Jul 14 15:27:52.330126 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3050/5936] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:52 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:53.346722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:53.347366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:53.354390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:53.354852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:53.355659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:53.356096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:53.509021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:53.518001 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37edc28e-2362-4f3c-a546-1c3c68571d5b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.175137 Jul 14 15:27:53.518684 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2887/5937] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:53 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:54.403401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:54.405123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:54.480714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7d3af02a-fe26-43a6-8356-b8314fc45330 req-11027894-11c8-44ae-9560-52e3a5b1a69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "name": "network-vif-plugged", "status": "completed", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:54.490778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7d3af02a-fe26-43a6-8356-b8314fc45330 req-11027894-11c8-44ae-9560-52e3a5b1a69f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:54.491229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7d3af02a-fe26-43a6-8356-b8314fc45330 req-11027894-11c8-44ae-9560-52e3a5b1a69f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:54.502824 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7d3af02a-fe26-43a6-8356-b8314fc45330 req-11027894-11c8-44ae-9560-52e3a5b1a69f service nova] Creating event network-vif-plugged:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h2-768852-23 Jul 14 15:27:54.507842 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7d3af02a-fe26-43a6-8356-b8314fc45330 req-11027894-11c8-44ae-9560-52e3a5b1a69f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110268 Jul 14 15:27:54.508483 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3051/5938] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:54.534191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:54.535002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:54.536662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:27:54.545542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:54.546860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:54.548446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:54.549097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:54.765617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:54.773450 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13c738a3-4188-4315-b022-359f8ddb2737 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.243229 Jul 14 15:27:54.774040 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2888/5939] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:54 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:27:55.795034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:55.796074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:55.805524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:55.806224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:55.807217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:55.807794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:55.965489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:55.973672 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1426f084-d2d1-4668-a683-2926d9fe029d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1393 microversion: 2.1 time: 0.186639 Jul 14 15:27:55.974406 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3052/5940] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:55 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:56.991083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:56.991758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:56.999445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:56.999895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.000664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.001099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.141498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:57.149611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3fd3b3f9-0ce3-4753-87c4-33387372d0e1 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1566 microversion: 2.1 time: 0.162352 Jul 14 15:27:57.150223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2889/5941] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:56 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:57.166429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:57.167055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:57.175315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.175762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.176552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:57.176995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:57.316082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:57.323627 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-99394758-0a7e-4446-9fe4-0ced86dccac7 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1566 microversion: 2.1 time: 0.161445 Jul 14 15:27:57.324213 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3053/5942] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:57 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:27:58.982972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:58.983650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:27:58.990782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:58.991423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:58.992285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:58.992965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:59.062246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5e0978a2-e674-4937-a422-a85ff60d8cd7 req-eb246913-86e5-4f93-960e-bbfd7e90b087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:27:59.071539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5e0978a2-e674-4937-a422-a85ff60d8cd7 req-eb246913-86e5-4f93-960e-bbfd7e90b087 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:59.072077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5e0978a2-e674-4937-a422-a85ff60d8cd7 req-eb246913-86e5-4f93-960e-bbfd7e90b087 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:59.085171 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5e0978a2-e674-4937-a422-a85ff60d8cd7 req-eb246913-86e5-4f93-960e-bbfd7e90b087 service nova] Creating event network-changed:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h2-768852-23 Jul 14 15:27:59.090404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5e0978a2-e674-4937-a422-a85ff60d8cd7 req-eb246913-86e5-4f93-960e-bbfd7e90b087 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111194 Jul 14 15:27:59.091245 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3054/5943] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:59.153436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:27:59.161436 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ade4ad63-6df0-4678-9081-6c3967bdc5c9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1566 microversion: 2.1 time: 0.184880 Jul 14 15:27:59.162305 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2890/5944] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:27:58 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:06.825861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c11e26a-fcf7-4a99-9a09-65ea15f5d867 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'create', calling method: .version_select at 0x7fdbf1ebf0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1778686133", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkNjxlL+XEBzcR2YQgAOJDCUI+CiwxDzrnYSb5mo4ArfbEOTbVwnaUcBfroBAZuQLwLdcc5MvnWvU3pX3/eScsXYz+dCN1tPem7T4vjZAub2GK9ezCnUlkBN7qtQHVN8g=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:06.841726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6c11e26a-fcf7-4a99-9a09-65ea15f5d867 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:28:06.847251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6c11e26a-fcf7-4a99-9a09-65ea15f5d867 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for user 1f6b1118c0544aa7a263d78fd14c3552 and project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:28:06.877159 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c11e26a-fcf7-4a99-9a09-65ea15f5d867 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.056093 Jul 14 15:28:06.878235 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3055/5945] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:28:06 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:08.104080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-2011177632", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "6368c986-b6ee-480c-ae62-48627f9918d6"}], "key_name": "tempest-TestNetworkBasicOps-1778686133", "security_groups": [{"name": "tempest-secgroup-smoke-964848438"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:08.223641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] validate_networks() for [('6368c986-b6ee-480c-ae62-48627f9918d6', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:28:08.840414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:28:08.840956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:28:08.841576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:28:08.842091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:28:08.842605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:28:08.852425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:08.853171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:08.853937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:08.855406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:08.875321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:28:08.881522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for user 1f6b1118c0544aa7a263d78fd14c3552 and project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:28:08.896846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:28:08.899577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:28:08.957509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b5e1d4f-14ea-4ca6-aed8-50d475b5047d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.860295 Jul 14 15:28:08.958463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2891/5946] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:28:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:28:08.977911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ccd0c6f6-2cbe-4c5a-a940-67971ea0142a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:08.979242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ccd0c6f6-2cbe-4c5a-a940-67971ea0142a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:09.056520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ccd0c6f6-2cbe-4c5a-a940-67971ea0142a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:09.064436 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ccd0c6f6-2cbe-4c5a-a940-67971ea0142a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1249 microversion: 2.1 time: 0.095401 Jul 14 15:28:09.065139 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3056/5947] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:08 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1249 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:10.083958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:10.084588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:10.093543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:10.094242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:10.095180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:10.095957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:10.171195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:10.179951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf02b1c1-f59a-432b-840d-1a76094777a0 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1309 microversion: 2.1 time: 0.101261 Jul 14 15:28:10.180749 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2892/5948] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:10 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:11.196934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:11.197875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:11.200134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=42 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:11.207571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:11.208084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:11.208861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:11.209289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:11.420113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:11.428254 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7de20b0a-bbad-4188-8555-ae5780210453 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1374 microversion: 2.1 time: 0.235125 Jul 14 15:28:11.429019 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3057/5949] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:11 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1374 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:11.711620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8b629dcd-a5db-452d-95b7-ce8813127307 req-534089a2-a846-4a7f-b2c5-0e5f1a163d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fac8e1b3-3e68-465f-8991-3621bb24be28", "tag": "4b05dcce-bc83-4b8d-897a-871fcb25a5e3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:11.742929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b629dcd-a5db-452d-95b7-ce8813127307 req-534089a2-a846-4a7f-b2c5-0e5f1a163d3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:11.743623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8b629dcd-a5db-452d-95b7-ce8813127307 req-534089a2-a846-4a7f-b2c5-0e5f1a163d3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:11.771104 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8b629dcd-a5db-452d-95b7-ce8813127307 req-534089a2-a846-4a7f-b2c5-0e5f1a163d3b service nova] Creating event network-changed:4b05dcce-bc83-4b8d-897a-871fcb25a5e3 for instance fac8e1b3-3e68-465f-8991-3621bb24be28 on n-h1-768852-23 Jul 14 15:28:11.781034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8b629dcd-a5db-452d-95b7-ce8813127307 req-534089a2-a846-4a7f-b2c5-0e5f1a163d3b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073788 Jul 14 15:28:11.782184 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2893/5950] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:12.446104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:12.446742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:12.454665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:12.455207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:12.456054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:12.456526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:12.601567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:12.609993 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b67e651-89af-4676-a4fe-268551524bd8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1374 microversion: 2.1 time: 0.168010 Jul 14 15:28:12.610631 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3058/5951] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:12 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:13.628578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:13.629301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:13.631310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:13.638554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:13.639140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:13.640109 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:13.640565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:13.644908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=59 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:13.802933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:13.812223 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-508baee5-4391-4984-9e69-9e2d9adfe6b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1374 microversion: 2.1 time: 0.189480 Jul 14 15:28:13.812839 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2894/5952] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:13 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:14.830024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:14.830641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:14.833200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:14.839027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:14.839574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:14.840345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:14.840781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:14.986221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:14.993798 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2b066265-c066-472d-92e4-fe4dd0bca875 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1374 microversion: 2.1 time: 0.167938 Jul 14 15:28:14.994395 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3059/5953] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:14 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1374 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:16.011850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:16.012541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:16.019577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:16.020027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:16.020807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:16.021310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:16.161647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:16.170280 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-72c8786e-e1ba-4c0e-8d67-10561af0da3f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1374 microversion: 2.1 time: 0.162874 Jul 14 15:28:16.170874 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2895/5954] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:16 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:16.389293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-941721a2-e5d3-4791-945e-ffc913083fef req-8f605018-9747-404a-8ac8-2136e59074f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac8e1b3-3e68-465f-8991-3621bb24be28", "name": "network-vif-plugged", "status": "completed", "tag": "4b05dcce-bc83-4b8d-897a-871fcb25a5e3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:16.399843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-941721a2-e5d3-4791-945e-ffc913083fef req-8f605018-9747-404a-8ac8-2136e59074f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:16.400290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-941721a2-e5d3-4791-945e-ffc913083fef req-8f605018-9747-404a-8ac8-2136e59074f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:16.420562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-941721a2-e5d3-4791-945e-ffc913083fef req-8f605018-9747-404a-8ac8-2136e59074f4 service nova] Creating event network-vif-plugged:4b05dcce-bc83-4b8d-897a-871fcb25a5e3 for instance fac8e1b3-3e68-465f-8991-3621bb24be28 on n-h1-768852-23 Jul 14 15:28:16.425988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-941721a2-e5d3-4791-945e-ffc913083fef req-8f605018-9747-404a-8ac8-2136e59074f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041081 Jul 14 15:28:16.426619 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3060/5955] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:17.187507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:17.188133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:17.195153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:17.195645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:17.196426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:17.196878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:17.336171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:17.344324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-848f9863-9314-4cd1-9268-1c002b08c675 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1374 microversion: 2.1 time: 0.160857 Jul 14 15:28:17.344911 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2896/5956] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:17 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:18.363180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:18.363985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:18.370609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:18.371160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:18.371918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:18.372365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:18.516279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:18.524234 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-70d69886-b8e3-4cb0-bfab-ec012aba66c1 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1547 microversion: 2.1 time: 0.166193 Jul 14 15:28:18.524756 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3061/5957] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:18 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1547 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:18.541444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:18.542952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:18.550907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:18.551403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:18.552269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:18.552677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:18.710156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:18.718801 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-feff1b3b-a9d2-4f38-9171-b0db04b7d05f tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1547 microversion: 2.1 time: 0.181684 Jul 14 15:28:18.719441 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2897/5958] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:18 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1547 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:20.732869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:20.733961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:20.735999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:20.742412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:20.742867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:20.744057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:20.744183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:20.812551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-36d693d3-3d20-49ff-955c-9ba210ea3c04 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action" status: 200 len: 24565 microversion: 2.1 time: 0.083447 Jul 14 15:28:20.813251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3062/5959] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:20 2022] POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action => generated 24565 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:31.885921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:31.886524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:31.888425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:31.889092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:31.889821 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=7 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:31.890511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=23 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:31.897114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:31.897568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:31.898350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:31.898783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.044747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:32.053477 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2ff6f98-de2c-4496-a41d-65029e72ca5f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1685 microversion: 2.1 time: 0.171783 Jul 14 15:28:32.054090 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2898/5960] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:31 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:32.152934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:32.153998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:32.157341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=7 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:32.158123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=30 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:32.166012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.167131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.167995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.168449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.242944 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-79f5577d-ca80-4507-abfa-a1bae31b6599 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action" status: 200 len: 32628 microversion: 2.1 time: 0.094857 Jul 14 15:28:32.243689 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3063/5961] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:32 2022] POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action => generated 32628 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:32.410454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:32.410993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:32.417333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.417790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.418579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.419025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.567537 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e493e1a5-2f9b-4302-b5c4-87e911df995e tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1838 microversion: 2.1 time: 0.160846 Jul 14 15:28:32.568168 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2899/5962] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:32 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1838 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:32.593078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:32.594350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:32.602070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.602516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.603316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:32.604043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:32.638279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lazy-loading 'flavor' on Instance uuid d9ee1d34-cb3e-43aa-a349-a9f38032d06e {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:28:32.651667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Going to try to live migrate instance to another host {{(pid=125965) live_migrate /opt/stack/nova/nova/compute/api.py:5349}} Jul 14 15:28:34.203864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-657bfa51-9d54-4aaf-8ba7-97aa47f318d1 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action" status: 202 len: 0 microversion: 2.1 time: 1.615317 Jul 14 15:28:34.210088 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3064/5963] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:32 2022] POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action => generated 0 bytes in 1623 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:28:34.224724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:34.226806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:34.237009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.237730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.238690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:34.239156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:34.410394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:34.419435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d477ef85-40a8-46d2-b897-8e525f745281 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.201949 Jul 14 15:28:34.420122 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2900/5964] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:34 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:28:35.442030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:35.443300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:35.457718 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:35.458537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:35.459975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:35.460756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:35.628264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-728229b2-81a5-4b11-9a24-8c77f226deae req-7f775468-2083-412f-8220-b3076c0be5f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "name": "network-vif-unplugged", "status": "completed", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:35.639582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-728229b2-81a5-4b11-9a24-8c77f226deae req-7f775468-2083-412f-8220-b3076c0be5f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:35.640037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-728229b2-81a5-4b11-9a24-8c77f226deae req-7f775468-2083-412f-8220-b3076c0be5f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:35.654702 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-728229b2-81a5-4b11-9a24-8c77f226deae req-7f775468-2083-412f-8220-b3076c0be5f4 service nova] Creating event network-vif-unplugged:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h2-768852-23 Jul 14 15:28:35.660195 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-728229b2-81a5-4b11-9a24-8c77f226deae req-7f775468-2083-412f-8220-b3076c0be5f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038398 Jul 14 15:28:35.661063 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2901/5965] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:35.792485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:35.804065 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac941dcf-6127-4c24-bc71-b92e5c6e61e4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.368962 Jul 14 15:28:35.805109 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3065/5966] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:35 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:36.827195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:36.827846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:36.834362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:36.834813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:36.835623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:36.836059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:36.986218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:36.995514 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-670af383-5b36-482f-85b0-02d0242e30b4 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.174697 Jul 14 15:28:36.996116 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2902/5967] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:36 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:37.684602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3ad0de45-63c3-4891-be89-bf8d452f6aa2 req-07935b39-a21b-47d2-a046-956e594c13fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:37.694606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3ad0de45-63c3-4891-be89-bf8d452f6aa2 req-07935b39-a21b-47d2-a046-956e594c13fc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:37.695045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3ad0de45-63c3-4891-be89-bf8d452f6aa2 req-07935b39-a21b-47d2-a046-956e594c13fc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:37.706740 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3ad0de45-63c3-4891-be89-bf8d452f6aa2 req-07935b39-a21b-47d2-a046-956e594c13fc service nova] Creating event network-changed:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h2-768852-23 Jul 14 15:28:37.712108 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3ad0de45-63c3-4891-be89-bf8d452f6aa2 req-07935b39-a21b-47d2-a046-956e594c13fc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031775 Jul 14 15:28:37.712873 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3066/5968] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:38.013221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:38.013971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:38.021836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.022288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.023080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:38.023554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:38.274521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:38.283472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-83358fcb-4ebc-4381-93ab-bdc9c8066721 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.274245 Jul 14 15:28:38.284352 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2903/5969] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:38 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:39.303337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.304160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:39.311625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.312075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.312855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:39.313289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:39.469692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:39.478346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43384e80-7da4-422d-9665-9c67e5d42358 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.180073 Jul 14 15:28:39.478974 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3067/5970] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:39 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:40.496769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:40.497435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:40.504806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:40.505256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:40.506039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:40.506476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:40.652515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:40.660483 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-80e6f4e4-db7b-49af-ab63-f12d606582b5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.168462 Jul 14 15:28:40.661085 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2904/5971] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:40 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:41.682749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:41.683419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:41.690962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:41.691596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:41.692259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:41.692704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:41.848846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:41.858297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b0869a5d-977f-4332-8600-6d6be52b37fd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.180094 Jul 14 15:28:41.858902 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3068/5972] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:41 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:42.049709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f81eeff8-32ac-4e10-a33e-cea7bd617dcd req-fa295b63-f98f-4cd9-8b6a-256f21f6988d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "name": "network-vif-unplugged", "status": "completed", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:42.060192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f81eeff8-32ac-4e10-a33e-cea7bd617dcd req-fa295b63-f98f-4cd9-8b6a-256f21f6988d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:42.060876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f81eeff8-32ac-4e10-a33e-cea7bd617dcd req-fa295b63-f98f-4cd9-8b6a-256f21f6988d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:42.078009 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f81eeff8-32ac-4e10-a33e-cea7bd617dcd req-fa295b63-f98f-4cd9-8b6a-256f21f6988d service nova] Creating event network-vif-unplugged:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h2-768852-23 Jul 14 15:28:42.084715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f81eeff8-32ac-4e10-a33e-cea7bd617dcd req-fa295b63-f98f-4cd9-8b6a-256f21f6988d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038739 Jul 14 15:28:42.085688 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2905/5973] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:42.878027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:42.878743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:42.886963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:42.887500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:42.888293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:42.888752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:43.132659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:43.138423 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-82daecb4-78c4-4c38-938f-3f3a0599bf68 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1695 microversion: 2.1 time: 0.264209 Jul 14 15:28:43.139351 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3069/5974] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:42 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1695 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:44.158974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:44.159793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:44.167365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.167892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.168607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.169450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.319631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:44.328368 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1620f603-03c0-4c8c-9845-3402e9733263 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1685 microversion: 2.1 time: 0.174880 Jul 14 15:28:44.329021 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2906/5975] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:44 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:44.346942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:44.347595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:44.355632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.356065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.356880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.358516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.497097 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6354ac6f-49fc-47f0-8d4e-ebca0ba56758 tempest-TestNetworkAdvancedServerOps-1620064729 tempest-TestNetworkAdvancedServerOps-1620064729-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1838 microversion: 2.1 time: 0.155332 Jul 14 15:28:44.497746 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3070/5976] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:44 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1838 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:44.514088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:44.514633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:44.520998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.521555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.522403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.522857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.672993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:44.681669 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-465203a1-8f04-49f2-843a-01848dbe2e4f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1685 microversion: 2.1 time: 0.171317 Jul 14 15:28:44.682248 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2907/5977] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:44 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:44.778961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:44.779849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:44.785934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.786378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:44.787127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:44.787716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:45.066684 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b78495f5-3727-43e4-8779-d4c2a6237f8c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action" status: 200 len: 38656 microversion: 2.1 time: 0.291883 Jul 14 15:28:45.067318 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3071/5978] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:28:44 2022] POST /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e/action => generated 38656 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:46.045190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:46.045709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:46.048664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2d7f25c5-d518-4d1b-a016-e7d6c8798ad3 req-bc90f565-0e1e-41cd-b7c4-f37adc1f4b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:46.052957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:46.053402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:46.054173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:46.054997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:46.059304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2d7f25c5-d518-4d1b-a016-e7d6c8798ad3 req-bc90f565-0e1e-41cd-b7c4-f37adc1f4b19 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:46.059640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2d7f25c5-d518-4d1b-a016-e7d6c8798ad3 req-bc90f565-0e1e-41cd-b7c4-f37adc1f4b19 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:46.072237 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2d7f25c5-d518-4d1b-a016-e7d6c8798ad3 req-bc90f565-0e1e-41cd-b7c4-f37adc1f4b19 service nova] Creating event network-changed:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h1-768852-23 Jul 14 15:28:46.077920 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2d7f25c5-d518-4d1b-a016-e7d6c8798ad3 req-bc90f565-0e1e-41cd-b7c4-f37adc1f4b19 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033452 Jul 14 15:28:46.078555 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3072/5979] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:46.085087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:28:46.166628 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-edf92de1-5583-46dc-913c-064612502ef6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 204 len: 0 microversion: 2.1 time: 0.124804 Jul 14 15:28:46.167894 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2908/5980] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:46 2022] DELETE /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:28:46.177190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:46.178064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:46.184821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:46.185396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:46.186292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:46.186964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:46.346010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:46.354252 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e8aa964-950c-43fb-adaf-5836be7e5d52 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1691 microversion: 2.1 time: 0.181174 Jul 14 15:28:46.354903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3073/5981] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:46 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:47.376395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:47.377450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:47.391482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:47.392825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:47.393832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:47.394503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:47.485611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:47.494481 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-231ff955-9695-4726-a1f6-37e5c2ee903c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 200 len: 1623 microversion: 2.1 time: 0.121767 Jul 14 15:28:47.495509 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2909/5982] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:47 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 1623 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:47.537603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d569cac5-dcba-4377-94b4-b3b73d3a9690 req-e4f003c1-7b3f-4b95-a40f-11dde57a5a46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9ee1d34-cb3e-43aa-a349-a9f38032d06e", "name": "network-vif-deleted", "tag": "e7a72954-a7c9-4ca2-a02c-905f81297478"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:47.549154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d569cac5-dcba-4377-94b4-b3b73d3a9690 req-e4f003c1-7b3f-4b95-a40f-11dde57a5a46 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:47.549588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d569cac5-dcba-4377-94b4-b3b73d3a9690 req-e4f003c1-7b3f-4b95-a40f-11dde57a5a46 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:47.574001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d569cac5-dcba-4377-94b4-b3b73d3a9690 req-e4f003c1-7b3f-4b95-a40f-11dde57a5a46 service nova] Creating event network-vif-deleted:e7a72954-a7c9-4ca2-a02c-905f81297478 for instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e on n-h1-768852-23 Jul 14 15:28:47.579342 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d569cac5-dcba-4377-94b4-b3b73d3a9690 req-e4f003c1-7b3f-4b95-a40f-11dde57a5a46 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045438 Jul 14 15:28:47.580390 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3074/5983] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:48.512442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:48.513075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: d9ee1d34-cb3e-43aa-a349-a9f38032d06e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:48.520389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:48.520848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:48.521636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:48.522074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:48.537025 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] HTTP exception thrown: Instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e could not be found. Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Request method failure captured: Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e HTTP/1.1 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DShmCA9LUrKc4gE50X1sfHG-Lm_Y_o9EZxYmmvoTfSxYK9TqA6TfZtA7A5g19riBgP77kB4DblD1bneI-yKkvwowHZ7EzqlY0k1dmhhqLY7ESzr_OPGg7QZXWulDrTrTtbgddbUpBPQHIJgG97_XjGKNc8kAPkldOs2FZP1ZIqhxMQ Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: db9dcb86f53e466392563a143ee4654f Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e could not be found. Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd9ee1d34-cb3e-43aa-a349-a9f38032d06e'} Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e could not be found. Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e could not be found. Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:28:48.538720 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e could not be found. Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Returning 404 to user: Instance d9ee1d34-cb3e-43aa-a349-a9f38032d06e could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:48.544653 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ec902dd-5ffa-45f3-8b1d-80648844f10a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e" status: 404 len: 111 microversion: 2.1 time: 0.031760 Jul 14 15:28:48.545489 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2910/5984] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:48 2022] GET /compute/v2.1/servers/d9ee1d34-cb3e-43aa-a349-a9f38032d06e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:49.441203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:49.442568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:49.449769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:49.450647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:49.451638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:49.452257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:49.481944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:28:49.594241 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1dc19a1e-3a25-479c-8aaa-116b8d7db5df tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 204 len: 0 microversion: 2.1 time: 0.158185 Jul 14 15:28:49.598190 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3075/5985] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:49 2022] DELETE /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:28:49.608035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:49.608629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:49.622401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:49.624435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:49.626277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:49.626839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:49.815559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:49.835494 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8090809-2902-4334-ae1c-2f9557691845 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1553 microversion: 2.1 time: 0.235605 Jul 14 15:28:49.846797 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2911/5986] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:49 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1553 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:50.857464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:50.860661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:50.872199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:50.872968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:50.874085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:50.874828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:51.054078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:51.069686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-706a31ed-4ead-4525-abf6-c3a6c469c078 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1553 microversion: 2.1 time: 0.218904 Jul 14 15:28:51.081484 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3076/5987] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:50 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1553 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:52.089190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:52.090585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:52.101209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f6a1122-5fd9-4cfc-a788-4191b0faac12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '.version_select at 0x7fdbf1ba89d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:52.120839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:52.121238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:52.122013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:52.122449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:52.134896 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7f6a1122-5fd9-4cfc-a788-4191b0faac12 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1096534470" status: 202 len: 0 microversion: 2.1 time: 0.037872 Jul 14 15:28:52.144747 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3077/5988] 10.222.0.98 () {58 vars in 1283 bytes} [Thu Jul 14 15:28:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1096534470 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:28:52.170051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cb75e24a-70a4-4071-a22b-eb41b322f5d3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: .version_select at 0x7fdbf1bcc670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-508748630", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDsf7Nd7C/y/FMp28iNzsgZEhDlxsKyvY0ZGQ5+JvKS+pHOzBSoCw8Nk/i8Y4vOBLCskmbkzeHVIrE9M4ISwijEVW329gGtf2aFdjoixrB9Hf3jC18eKJ1IVIsS5bDdgg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:52.210920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-cb75e24a-70a4-4071-a22b-eb41b322f5d3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:28:52.219145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:52.219446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-cb75e24a-70a4-4071-a22b-eb41b322f5d3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:28:52.234873 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1126498b-63e6-43a3-a5ad-efc0094c20c6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 200 len: 1486 microversion: 2.1 time: 0.151412 Jul 14 15:28:52.235628 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2912/5989] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:52 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 1486 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:28:52.245175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f00e406f-1b51-436f-a798-b0ec9b2ea116 req-d8282b88-bee1-494d-a6e3-494817028734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fac8e1b3-3e68-465f-8991-3621bb24be28", "name": "network-vif-deleted", "tag": "4b05dcce-bc83-4b8d-897a-871fcb25a5e3"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:52.250290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f00e406f-1b51-436f-a798-b0ec9b2ea116 req-d8282b88-bee1-494d-a6e3-494817028734 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:52.250825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f00e406f-1b51-436f-a798-b0ec9b2ea116 req-d8282b88-bee1-494d-a6e3-494817028734 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:52.254488 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cb75e24a-70a4-4071-a22b-eb41b322f5d3 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.091789 Jul 14 15:28:52.260493 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3078/5990] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:28:52 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:52.263692 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f00e406f-1b51-436f-a798-b0ec9b2ea116 req-d8282b88-bee1-494d-a6e3-494817028734 service nova] Creating event network-vif-deleted:4b05dcce-bc83-4b8d-897a-871fcb25a5e3 for instance fac8e1b3-3e68-465f-8991-3621bb24be28 on n-h1-768852-23 Jul 14 15:28:52.282284 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f00e406f-1b51-436f-a798-b0ec9b2ea116 req-d8282b88-bee1-494d-a6e3-494817028734 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044354 Jul 14 15:28:52.282979 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2913/5991] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:53.255251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:53.255897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: fac8e1b3-3e68-465f-8991-3621bb24be28] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:53.269905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:53.270437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:53.271349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:53.271864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:53.287744 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] HTTP exception thrown: Instance fac8e1b3-3e68-465f-8991-3621bb24be28 could not be found. Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Request method failure captured: Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 HTTP/1.1 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DXE9y4QPzCRTlWFYackR9KuObt6_ho95KxprqjP3MMZ4eoHkOPb-rcjPRy2yNElbvtIWWFjluqe7Gnwt75B5wPvgi7tOHRlidxVd-LtFXuqIjIZ5CM25m5OjnpXS21eHKVhb7ch0QlC2p9inxRibEy5sr4B-W4UY2JMGCauv325ErI Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f6adb0fee95b42cfaf64826cad196bf0 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestNetworkBasicOps-865870426 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestNetworkBasicOps-865870426 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f6adb0fee95b42cfaf64826cad196bf0 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestNetworkBasicOps-865870426 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestNetworkBasicOps-865870426-project Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 1f6b1118c0544aa7a263d78fd14c3552 Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestNetworkBasicOps-865870426-project Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance fac8e1b3-3e68-465f-8991-3621bb24be28 could not be found. Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fac8e1b3-3e68-465f-8991-3621bb24be28'} Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fac8e1b3-3e68-465f-8991-3621bb24be28 could not be found. Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fac8e1b3-3e68-465f-8991-3621bb24be28 could not be found. Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:28:53.289582 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fac8e1b3-3e68-465f-8991-3621bb24be28 could not be found. Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Returning 404 to user: Instance fac8e1b3-3e68-465f-8991-3621bb24be28 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7eb2762b-b255-452c-9540-9f9ff7ed499b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28" status: 404 len: 111 microversion: 2.1 time: 0.043180 Jul 14 15:28:53.298425 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3079/5992] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:53 2022] GET /compute/v2.1/servers/fac8e1b3-3e68-465f-8991-3621bb24be28 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:28:53.466298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d34e61fd-784e-4488-92f6-691bfa6ebf8a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '.version_select at 0x7fdbf1f8c280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:53.492984 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d34e61fd-784e-4488-92f6-691bfa6ebf8a tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1778686133" status: 202 len: 0 microversion: 2.1 time: 0.032295 Jul 14 15:28:53.493694 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2914/5993] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:28:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1778686133 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:28:56.177126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:56.178217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:56.182921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-24716331-e58d-47f7-a0b8-37b6d22c4c22 req-d4d020c7-b77a-4c1e-b525-27aa94934a12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0b1eed3-432d-480c-b7d5-e4611a5c79d9", "tag": "7437a861-1b69-4463-b0c6-681945725121"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:56.187514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:56.188151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:56.189162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:56.191060 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:56.199343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-24716331-e58d-47f7-a0b8-37b6d22c4c22 req-d4d020c7-b77a-4c1e-b525-27aa94934a12 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:56.199801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-24716331-e58d-47f7-a0b8-37b6d22c4c22 req-d4d020c7-b77a-4c1e-b525-27aa94934a12 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:56.224036 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-24716331-e58d-47f7-a0b8-37b6d22c4c22 req-d4d020c7-b77a-4c1e-b525-27aa94934a12 service nova] Creating event network-changed:7437a861-1b69-4463-b0c6-681945725121 for instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 on n-h1-768852-23 Jul 14 15:28:56.224386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:28:56.241200 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-24716331-e58d-47f7-a0b8-37b6d22c4c22 req-d4d020c7-b77a-4c1e-b525-27aa94934a12 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063764 Jul 14 15:28:56.242361 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2915/5994] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:56.281679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:56.349364 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73862c00-43c7-4be2-9846-e2f6b3e5f0db tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 204 len: 0 microversion: 2.1 time: 0.174259 Jul 14 15:28:56.350656 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3080/5995] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:28:56 2022] DELETE /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:28:56.360805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:56.362730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:56.371332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:56.372092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:56.373188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:56.374063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:56.549609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:56.559053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-90b1d30d-15d1-4a68-8175-a88c54fd7966 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1671 microversion: 2.1 time: 0.203000 Jul 14 15:28:56.563320 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2916/5996] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:56 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:57.578370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:57.580069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:57.601712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:57.604811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:57.622076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:57.623145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:58.024126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:58.035374 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5718e363-df15-4ffa-a39b-726938786da4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1671 microversion: 2.1 time: 0.461780 Jul 14 15:28:58.035914 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3081/5997] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:57 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1671 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:59.053218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:59.054409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:28:59.063066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f1f532e4-8dd9-434c-8737-39930c9d478e req-7a507838-164d-419a-b794-b59e0c046fab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0b1eed3-432d-480c-b7d5-e4611a5c79d9", "name": "network-vif-deleted", "tag": "7437a861-1b69-4463-b0c6-681945725121"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:59.063859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:59.064512 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:59.065668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:59.066178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:59.073324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:59.074442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f1f532e4-8dd9-434c-8737-39930c9d478e req-7a507838-164d-419a-b794-b59e0c046fab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:28:59.074988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f1f532e4-8dd9-434c-8737-39930c9d478e req-7a507838-164d-419a-b794-b59e0c046fab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:28:59.099229 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f1f532e4-8dd9-434c-8737-39930c9d478e req-7a507838-164d-419a-b794-b59e0c046fab service nova] Creating event network-vif-deleted:7437a861-1b69-4463-b0c6-681945725121 for instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 on n-h1-768852-23 Jul 14 15:28:59.107022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f1f532e4-8dd9-434c-8737-39930c9d478e req-7a507838-164d-419a-b794-b59e0c046fab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048158 Jul 14 15:28:59.108310 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3082/5998] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:59.160929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:28:59.173377 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b194bf1-a25e-4338-aaf9-82337bee0f65 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 200 len: 1486 microversion: 2.1 time: 0.123025 Jul 14 15:28:59.184143 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2917/5999] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:28:59 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 1486 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:59.660294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1394277442", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "7bd63b34-ab79-4028-8ca9-2c655448a8c4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-508748630", "security_groups": [{"name": "tempest-secgroup-smoke-901787457"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:59.786960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] validate_networks() for [('7bd63b34-ab79-4028-8ca9-2c655448a8c4', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:29:00.192027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:00.193012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: d0b1eed3-432d-480c-b7d5-e4611a5c79d9] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:00.209188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:00.210153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:00.211100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:00.211770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:00.231487 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] HTTP exception thrown: Instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 could not be found. Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Request method failure captured: Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 HTTP/1.1 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DXE9y4QPzCRTlWFYackR9KuObt6_ho95KxprqjP3MMZ4eoHkOPb-rcjPRy2yNElbvtIWWFjluqe7Gnwt75B5wPvgi7tOHRlidxVd-LtFXuqIjIZ5CM25m5OjnpXS21eHKVhb7ch0QlC2p9inxRibEy5sr4B-W4UY2JMGCauv325ErI Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: f6adb0fee95b42cfaf64826cad196bf0 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestNetworkBasicOps-865870426 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestNetworkBasicOps-865870426 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: f6adb0fee95b42cfaf64826cad196bf0 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestNetworkBasicOps-865870426 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestNetworkBasicOps-865870426-project Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 1f6b1118c0544aa7a263d78fd14c3552 Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestNetworkBasicOps-865870426-project Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 could not be found. Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd0b1eed3-432d-480c-b7d5-e4611a5c79d9'} Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 could not be found. Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 could not be found. Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:00.233424 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 could not be found. Jul 14 15:29:00.238252 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:29:00.245412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Returning 404 to user: Instance d0b1eed3-432d-480c-b7d5-e4611a5c79d9 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:00.246412 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-922e23ec-001d-487e-8516-d3afc0912849 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9" status: 404 len: 111 microversion: 2.1 time: 0.058477 Jul 14 15:29:00.248015 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2918/6000] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:00 2022] GET /compute/v2.1/servers/d0b1eed3-432d-480c-b7d5-e4611a5c79d9 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:29:00.255218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:29:00.255734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:29:00.256267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:29:00.256753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:29:00.257296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:29:00.267066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:00.267699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:00.269047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:00.269284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:00.290047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:00.297203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Getting quotas for user db9dcb86f53e466392563a143ee4654f and project e4d5f64edea14cbab1392d17e3be9de9. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:00.311923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:29:00.314388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:29:00.370801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eeaa3659-f9b1-48a1-91cc-38af5e0f92f9 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.715853 Jul 14 15:29:00.373286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3083/6001] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:28:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:29:00.387899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3269b195-e12a-486c-be59-8f58cbe8315c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:00.389357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3269b195-e12a-486c-be59-8f58cbe8315c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:00.494944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3269b195-e12a-486c-be59-8f58cbe8315c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:00.515806 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3269b195-e12a-486c-be59-8f58cbe8315c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1266 microversion: 2.1 time: 0.134763 Jul 14 15:29:00.516645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-08c0a05f-50ac-4aee-9dc2-17f0eeb9878e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '.version_select at 0x7fdbf1c50e50>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:00.516814 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2919/6002] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:00 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1266 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:00.544622 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-08c0a05f-50ac-4aee-9dc2-17f0eeb9878e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1811956804" status: 202 len: 0 microversion: 2.1 time: 0.039060 Jul 14 15:29:00.549444 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3084/6003] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:29:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1811956804 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:29:01.535549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:01.537137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:01.566713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:01.567771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:01.569091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:01.569926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:01.964553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:01.985558 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70992159-8244-4dc5-b4dd-ab9a2cc2e3db tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1318 microversion: 2.1 time: 0.456563 Jul 14 15:29:01.996211 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2920/6004] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:01 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1318 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:03.004147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:03.004776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:03.007013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:03.015660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:03.016224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:03.017167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:03.017797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:03.169233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:03.178655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-78a62d75-9a56-4d21-95de-0acfb1791020 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.179277 Jul 14 15:29:03.179288 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3085/6005] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:02 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:04.196203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:04.196914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:04.200810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:04.218708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:04.219237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:04.220099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:04.225029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:04.422433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b729a9fc-74c7-4e02-a567-1c35967627f1 req-12e9c245-50c5-4204-8d23-76a3d8204b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:04.438311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b729a9fc-74c7-4e02-a567-1c35967627f1 req-12e9c245-50c5-4204-8d23-76a3d8204b19 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:04.439535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b729a9fc-74c7-4e02-a567-1c35967627f1 req-12e9c245-50c5-4204-8d23-76a3d8204b19 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:04.488840 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b729a9fc-74c7-4e02-a567-1c35967627f1 req-12e9c245-50c5-4204-8d23-76a3d8204b19 service nova] Creating event network-changed:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:29:04.523043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b729a9fc-74c7-4e02-a567-1c35967627f1 req-12e9c245-50c5-4204-8d23-76a3d8204b19 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105414 Jul 14 15:29:04.524495 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3086/6006] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:29:04.612228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:04.632037 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-47d14f3e-dbdb-4801-be8c-4943d687a6c5 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.440409 Jul 14 15:29:04.643068 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2921/6007] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:04 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:05.661426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:05.662147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:05.671220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:05.671587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:05.672387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:05.673002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:05.828178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:05.835991 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dd705f96-f9ec-4d6f-a7fb-65511d6264ec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.179269 Jul 14 15:29:05.836598 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3087/6008] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:05 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:06.854459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:06.855110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:06.863081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:06.863578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:06.864386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:06.864837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:07.465413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:07.473247 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1683a064-b3fc-4164-9d73-38c48d8ba44b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.623393 Jul 14 15:29:07.473835 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2922/6009] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:06 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:08.491506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:08.492349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:08.506175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:08.506883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:08.508132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:08.509196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:08.842497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:08.850729 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd56e2eb-7265-4463-8559-a113654a174d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.363663 Jul 14 15:29:08.851821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3088/6010] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:08 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:09.868948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:09.870501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:09.878384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:09.879229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:09.880295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:09.880967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:10.081659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:10.099699 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6f05c4c7-068d-4ed7-9575-ddd91eed833d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.235187 Jul 14 15:29:10.101277 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2923/6011] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:09 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:10.957740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7c8bfe48-9dd0-49b5-b51b-a23d006cbbb6 req-1879cc26-54f1-42df-9d43-62f48c09627b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "name": "network-vif-plugged", "status": "completed", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:10.963482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:10.965032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:10.972445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7c8bfe48-9dd0-49b5-b51b-a23d006cbbb6 req-1879cc26-54f1-42df-9d43-62f48c09627b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:10.972981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7c8bfe48-9dd0-49b5-b51b-a23d006cbbb6 req-1879cc26-54f1-42df-9d43-62f48c09627b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:10.992064 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7c8bfe48-9dd0-49b5-b51b-a23d006cbbb6 req-1879cc26-54f1-42df-9d43-62f48c09627b service nova] Creating event network-vif-plugged:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:29:10.997768 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7c8bfe48-9dd0-49b5-b51b-a23d006cbbb6 req-1879cc26-54f1-42df-9d43-62f48c09627b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046475 Jul 14 15:29:10.999143 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3089/6012] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:11.121636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:11.122886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:11.128805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:11.132998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:11.133766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:11.134737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:11.135633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:11.369400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:11.400531 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-53c5328b-31d6-41c1-a10e-a8368504d50f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.283384 Jul 14 15:29:11.401916 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2924/6013] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:11 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:12.201302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-541cd106-d120-45dd-b088-2c5538911988 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'create', calling method: .version_select at 0x7fdbf1ba80d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1791809391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8S/lGnB0Wr8pCP4iyrwasgXoBb9+PfBBjUKksNp8fEM7gATha3NPsRL03sNqv8/5IT2H+f8xdDKCv8jTuArsvhcGy70/pBI35UrTwkuJcptGR4eE733ax4S9BTwhzDVw=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:12.220171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-541cd106-d120-45dd-b088-2c5538911988 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:12.227944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-541cd106-d120-45dd-b088-2c5538911988 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for user 1f6b1118c0544aa7a263d78fd14c3552 and project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:12.265401 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-541cd106-d120-45dd-b088-2c5538911988 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.069949 Jul 14 15:29:12.266782 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3090/6014] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:29:12 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:12.418826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:12.420363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:12.436587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:12.437435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:12.438493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:12.439370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:12.705890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:12.724688 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6fd7c824-fb07-47d0-b26c-4197e2d9753f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1391 microversion: 2.1 time: 0.308739 Jul 14 15:29:12.726736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2925/6015] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:12 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1391 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:13.610749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1927728584", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f94c66b4-ad29-4d58-8ba0-fc42023d3dfa"}], "key_name": "tempest-TestNetworkBasicOps-1791809391", "security_groups": [{"name": "tempest-secgroup-smoke-212996385"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:13.734075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] validate_networks() for [('f94c66b4-ad29-4d58-8ba0-fc42023d3dfa', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:29:13.743956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:13.750583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:13.761759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:13.762691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:13.763311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:13.763750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:13.947459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:13.962869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b412ec8-0beb-4a0b-9c4f-555abe5968da tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1562 microversion: 2.1 time: 0.223309 Jul 14 15:29:13.963610 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2926/6016] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:13 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1562 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:29:13.981271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:13.982195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:13.988834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:13.989287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:13.990077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:13.990522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:14.222503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:14.235488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36ba39c6-d7f6-4de8-a59e-1ce59b331e0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1562 microversion: 2.1 time: 0.258652 Jul 14 15:29:14.246444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:29:14.246444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:29:14.246444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:29:14.246444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:29:14.246444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:29:14.247714 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2927/6017] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:13 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1562 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:14.255694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:14.256036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:14.257130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:14.258164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:14.280172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:29:14.286671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Getting quotas for user 1f6b1118c0544aa7a263d78fd14c3552 and project f6adb0fee95b42cfaf64826cad196bf0. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:29:14.305156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:29:14.308329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:29:14.387032 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c6d4e4d-0018-41f8-8429-4977fa793b66 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.780410 Jul 14 15:29:14.387747 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3091/6018] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:29:13 2022] POST /compute/v2.1/servers => generated 405 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:29:14.398635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eb5de618-19b1-4925-b76b-cd4f7b42c969 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:14.399356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eb5de618-19b1-4925-b76b-cd4f7b42c969 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:14.494668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eb5de618-19b1-4925-b76b-cd4f7b42c969 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:14.502226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eb5de618-19b1-4925-b76b-cd4f7b42c969 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1249 microversion: 2.1 time: 0.107401 Jul 14 15:29:14.506492 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2928/6019] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:14 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1249 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:15.519070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:15.519699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:15.528036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:15.528486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:15.529267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:15.529705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:15.594658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:15.604320 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e003dee-3ad1-467b-a560-3fd39fe98a01 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1301 microversion: 2.1 time: 0.089081 Jul 14 15:29:15.604953 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3092/6020] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:15 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1301 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:16.621939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:16.622699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:16.631501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:16.631856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:16.632647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:16.633119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:16.750565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:16.760357 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d3d1ac5-31a8-4325-b1fc-6046549fb10b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1307 microversion: 2.1 time: 0.142553 Jul 14 15:29:16.760965 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2929/6021] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:16 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1307 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:17.197442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:17.198624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:17.203934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-dc80562a-f05d-474b-8203-11ede6bb7823 req-ddffa0d5-7332-4e2e-ad84-602d394d790c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:17.224243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:17.224931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:17.226009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:17.230930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dc80562a-f05d-474b-8203-11ede6bb7823 req-ddffa0d5-7332-4e2e-ad84-602d394d790c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:17.231427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-dc80562a-f05d-474b-8203-11ede6bb7823 req-ddffa0d5-7332-4e2e-ad84-602d394d790c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:17.238940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:17.248914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-dc80562a-f05d-474b-8203-11ede6bb7823 req-ddffa0d5-7332-4e2e-ad84-602d394d790c service nova] Creating event network-changed:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:29:17.254629 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-dc80562a-f05d-474b-8203-11ede6bb7823 req-ddffa0d5-7332-4e2e-ad84-602d394d790c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063317 Jul 14 15:29:17.255646 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2930/6022] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:17.402496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:17.416366 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c252dff2-f4b3-40cf-ae18-6d694f963789 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1562 microversion: 2.1 time: 0.230346 Jul 14 15:29:17.417861 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3093/6023] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:17 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1562 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:17.781749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:17.783710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:17.791537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:17.792436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:17.793744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:17.794455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:18.179402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:18.190095 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e9c7a823-f14a-47e2-9e18-8fa08683ac79 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1374 microversion: 2.1 time: 0.415659 Jul 14 15:29:18.191036 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2931/6024] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:17 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1374 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:29:19.208020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:19.208782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:19.216126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:19.216585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:19.217364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:19.217804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:19.289114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e5b9b8a1-3eba-4bc8-8e33-7d2960442f6b req-087a7389-ff60-4c8e-a859-3c7f75852004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec", "tag": "f5c079d2-a611-4874-9fe2-70761fdc6bdf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:19.299173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e5b9b8a1-3eba-4bc8-8e33-7d2960442f6b req-087a7389-ff60-4c8e-a859-3c7f75852004 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:19.299739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e5b9b8a1-3eba-4bc8-8e33-7d2960442f6b req-087a7389-ff60-4c8e-a859-3c7f75852004 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:19.315037 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e5b9b8a1-3eba-4bc8-8e33-7d2960442f6b req-087a7389-ff60-4c8e-a859-3c7f75852004 service nova] Creating event network-changed:f5c079d2-a611-4874-9fe2-70761fdc6bdf for instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec on n-h1-768852-23 Jul 14 15:29:19.320200 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e5b9b8a1-3eba-4bc8-8e33-7d2960442f6b req-087a7389-ff60-4c8e-a859-3c7f75852004 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035426 Jul 14 15:29:19.320876 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2932/6025] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:19.368833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:19.377123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-59f0567f-1c34-40de-8259-be1d196e6caa tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1374 microversion: 2.1 time: 0.173090 Jul 14 15:29:19.377743 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3094/6026] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:19 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1374 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:20.396593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:20.397409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:20.404176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:20.404621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:20.405396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:20.405829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:20.756559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:20.765872 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c7c7f8b2-3f71-4e3d-8fb5-a6f29c5465fe tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1374 microversion: 2.1 time: 0.374401 Jul 14 15:29:20.771388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2933/6027] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:20 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1374 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:21.789122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:21.789697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:21.797261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:21.797714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:21.798497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:21.798933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:21.940804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:21.949450 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e58e8473-86ea-4771-a93c-9db7ba4ac7de tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1374 microversion: 2.1 time: 0.170662 Jul 14 15:29:21.950051 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3095/6028] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:21 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:22.848250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-42ac0c18-0267-4b8c-a2ec-e1473c81135a req-331247f3-0e05-4176-af46-e35998fff27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec", "name": "network-vif-plugged", "status": "completed", "tag": "f5c079d2-a611-4874-9fe2-70761fdc6bdf"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:22.858469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-42ac0c18-0267-4b8c-a2ec-e1473c81135a req-331247f3-0e05-4176-af46-e35998fff27b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:22.858924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-42ac0c18-0267-4b8c-a2ec-e1473c81135a req-331247f3-0e05-4176-af46-e35998fff27b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:22.870803 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-42ac0c18-0267-4b8c-a2ec-e1473c81135a req-331247f3-0e05-4176-af46-e35998fff27b service nova] Creating event network-vif-plugged:f5c079d2-a611-4874-9fe2-70761fdc6bdf for instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec on n-h1-768852-23 Jul 14 15:29:22.875920 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-42ac0c18-0267-4b8c-a2ec-e1473c81135a req-331247f3-0e05-4176-af46-e35998fff27b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031402 Jul 14 15:29:22.876533 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2934/6029] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:22.966790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:22.967352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:22.974405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:22.974852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:22.975654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:22.976111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:23.122318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:23.130860 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb8e74a3-6451-4df9-a2bf-94266f9d6ab4 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1374 microversion: 2.1 time: 0.168113 Jul 14 15:29:23.131515 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3096/6030] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:22 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1374 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:24.150925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:24.151957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:24.160390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:24.161135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:24.162318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:24.162969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:24.315302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:24.323586 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c42430ea-f8cb-4387-ada5-574af884528c tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1374 microversion: 2.1 time: 0.179118 Jul 14 15:29:24.324177 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2935/6031] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:24 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1374 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:25.340827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:25.341451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:25.344280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.344966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.351578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:25.352082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:25.352923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:25.353368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:25.495504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:25.503322 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6658ac13-45db-4fa8-ab04-f40fe7bb3d49 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1545 microversion: 2.1 time: 0.166407 Jul 14 15:29:25.503933 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3097/6032] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:25 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:25.519666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:25.520290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:25.522252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:25.529230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:25.529716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:25.530451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:25.530885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:25.673968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:25.683227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa2c0dfb-147d-483d-a1aa-d1ac5809d97d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1545 microversion: 2.1 time: 0.167363 Jul 14 15:29:25.683915 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2936/6033] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:25 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1545 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:27.333530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7869f819-d390-4c9f-b0d7-4abafc2c6448 req-e9ec80ef-a140-4d12-b2bc-bb1b79e06e90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec", "tag": "f5c079d2-a611-4874-9fe2-70761fdc6bdf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:27.356534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7869f819-d390-4c9f-b0d7-4abafc2c6448 req-e9ec80ef-a140-4d12-b2bc-bb1b79e06e90 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:27.356986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7869f819-d390-4c9f-b0d7-4abafc2c6448 req-e9ec80ef-a140-4d12-b2bc-bb1b79e06e90 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:27.359939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:27.371892 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7869f819-d390-4c9f-b0d7-4abafc2c6448 req-e9ec80ef-a140-4d12-b2bc-bb1b79e06e90 service nova] Creating event network-changed:f5c079d2-a611-4874-9fe2-70761fdc6bdf for instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec on n-h1-768852-23 Jul 14 15:29:27.377934 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7869f819-d390-4c9f-b0d7-4abafc2c6448 req-e9ec80ef-a140-4d12-b2bc-bb1b79e06e90 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047682 Jul 14 15:29:27.378567 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3098/6034] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:37.828531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:37.829477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:37.832366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=33 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:37.833126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=90 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:37.840451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:37.840909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:37.841712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:37.842158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:37.913973 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15e2779b-6697-4e1a-aff9-979a0f2c6c49 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a/action" status: 200 len: 24571 microversion: 2.1 time: 0.089193 Jul 14 15:29:37.915157 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2937/6035] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:29:37 2022] POST /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a/action => generated 24571 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:29:44.295311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:44.296734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:44.299790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:44.307699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.308186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.308954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.309388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.391005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:29:44.391463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:29:44.391936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:29:44.392345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:29:44.392765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:29:44.453676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:44.462037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.462785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.463643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.464110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.495937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5144b9a1-146d-4827-8aa2-e018575abc0a tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a/action" status: 202 len: 1135 microversion: 2.1 time: 0.205433 Jul 14 15:29:44.496973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3099/6036] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:29:44 2022] POST /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a/action => generated 1135 bytes in 207 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Jul 14 15:29:44.512591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:44.514473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:44.522876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.523976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.524739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:44.525174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:44.918481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:44.926382 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-893baa42-be95-4162-b1cf-335dc17c3f5c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.418714 Jul 14 15:29:44.926962 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2938/6037] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:44 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:45.944095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:45.944732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:45.952299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:45.952868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:45.953626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:45.954058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:46.092416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:46.102144 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb7ed3a0-9f16-4c4d-8ecc-d1f11524f81d tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.161086 Jul 14 15:29:46.102856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3100/6038] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:45 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:47.121195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:47.121772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:47.129881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:47.130327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:47.131138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:47.131589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:47.274781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:47.282615 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-586459d2-d506-4a65-9328-40addf713594 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.165835 Jul 14 15:29:47.283295 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2939/6039] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:47 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:48.300914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:48.301803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:48.309133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:48.309584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:48.310355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:48.310787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:48.453236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:48.460965 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-def6e03e-354b-48a3-b27b-516b92b6d095 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.163997 Jul 14 15:29:48.461552 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3101/6040] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:48 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:49.477986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:49.478710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:49.486036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:49.486489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:49.487260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:49.487723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:49.628404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:49.636545 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b518940f-83b2-4201-8546-b2fd3b0b2a3f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.162448 Jul 14 15:29:49.637121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2940/6041] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:49 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:50.654059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:50.654669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:50.661737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:50.662182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:50.662949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:50.663412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:50.802988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:50.811198 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15e4d713-ec32-49a6-aef0-c8e18ed6552f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.161029 Jul 14 15:29:50.811834 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3102/6042] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:50 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:51.828521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:51.829176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:51.837229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:51.837681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:51.838502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:51.838945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:51.977735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:51.985801 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05953a88-5189-4b5a-af95-492eef9b78c8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.161091 Jul 14 15:29:51.986404 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2941/6043] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:51 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:52.593089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:52.594100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:52.601903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:52.602357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:52.603395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:52.604096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:52.680445 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd1cad3c-3295-4ef0-90ec-779a76c7770b tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec/action" status: 200 len: 24571 microversion: 2.1 time: 0.091288 Jul 14 15:29:52.681130 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3103/6044] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:29:52 2022] POST /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec/action => generated 24571 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:29:53.006701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:53.008489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:53.021225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:53.022020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:53.023437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:53.024207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:53.219215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:53.228381 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-302580ee-8bbc-4a42-98d9-a91ac0a9cdec tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.229185 Jul 14 15:29:53.228995 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2942/6045] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:52 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:29:54.255621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:54.256438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:54.264411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:54.264866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:54.265620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:54.266054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:54.401405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:54.409165 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-09b17634-b7d2-475d-83c4-f201e85c3c0c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.157788 Jul 14 15:29:54.409759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3104/6046] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:54 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:55.426446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:55.427086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:55.434318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:55.434764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:55.435554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:55.435993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:55.568717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:55.577524 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6f3ac96-efa5-4865-853f-20bc5470027b tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.154833 Jul 14 15:29:55.578175 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2943/6047] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:55 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:56.596382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:56.597003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:56.604977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:56.605423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:56.606190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:56.606621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:56.745078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:56.752550 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35ee5a8d-bfe1-48cc-9ddd-5578ce3ad8f8 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1688 microversion: 2.1 time: 0.160340 Jul 14 15:29:56.753135 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3105/6048] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:56 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:57.770472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:57.771100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:57.778284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:57.778735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:57.779541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:57.779973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:57.921481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:57.929201 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6e36e154-cf75-4590-98d6-faa75e72dabd tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1694 microversion: 2.1 time: 0.162639 Jul 14 15:29:57.929782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2944/6049] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:57 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:29:58.945999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:58.946642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:29:58.956214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:58.956983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:58.958014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:29:58.958527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:29:59.091957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:29:59.099648 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8603ea4c-74a4-404a-b72c-2093f1065240 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1694 microversion: 2.1 time: 0.157554 Jul 14 15:29:59.100428 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3106/6050] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:29:58 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:00.118167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:00.118991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:00.126244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:00.126691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:00.127508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:00.127940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:00.268788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:00.277305 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4856b0b7-677a-419d-a20d-d5c3048c5261 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1679 microversion: 2.1 time: 0.163162 Jul 14 15:30:00.278463 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2945/6051] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:00 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:01.047987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b2667ec2-ae2f-4a06-ae8e-fe772ce9d371 req-22cf06dc-571e-4c01-b00f-46738f07d228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "name": "network-vif-unplugged", "status": "completed", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:01.057454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b2667ec2-ae2f-4a06-ae8e-fe772ce9d371 req-22cf06dc-571e-4c01-b00f-46738f07d228 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:01.057943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b2667ec2-ae2f-4a06-ae8e-fe772ce9d371 req-22cf06dc-571e-4c01-b00f-46738f07d228 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:01.071661 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b2667ec2-ae2f-4a06-ae8e-fe772ce9d371 req-22cf06dc-571e-4c01-b00f-46738f07d228 service nova] Creating event network-vif-unplugged:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:30:01.077442 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b2667ec2-ae2f-4a06-ae8e-fe772ce9d371 req-22cf06dc-571e-4c01-b00f-46738f07d228 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033110 Jul 14 15:30:01.078080 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3107/6052] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:03.095775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7e2d0722-1b3e-44a6-a605-2a3d636ee3bb req-c8a01b89-1c7d-40ad-80d0-901cb120949c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "name": "network-vif-plugged", "status": "completed", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:03.105434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7e2d0722-1b3e-44a6-a605-2a3d636ee3bb req-c8a01b89-1c7d-40ad-80d0-901cb120949c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:03.105935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7e2d0722-1b3e-44a6-a605-2a3d636ee3bb req-c8a01b89-1c7d-40ad-80d0-901cb120949c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:03.117352 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7e2d0722-1b3e-44a6-a605-2a3d636ee3bb req-c8a01b89-1c7d-40ad-80d0-901cb120949c service nova] Creating event network-vif-plugged:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:30:03.122446 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7e2d0722-1b3e-44a6-a605-2a3d636ee3bb req-c8a01b89-1c7d-40ad-80d0-901cb120949c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Jul 14 15:30:03.123128 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2946/6053] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:03.878658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:03.879823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:03.887750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:03.888210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:03.888994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:03.889434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:03.957961 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7954ff9a-2a6d-48f2-af57-2e6ced67bdb6 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "POST /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec/action" status: 200 len: 32644 microversion: 2.1 time: 0.083749 Jul 14 15:30:03.958897 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3108/6054] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:30:03 2022] POST /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec/action => generated 32644 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:30:05.062410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-637a8040-ed2b-428b-be0e-9ca0cdd20520 req-47dbf1b0-7ed0-4807-99dc-7de10e46ef0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec", "tag": "f5c079d2-a611-4874-9fe2-70761fdc6bdf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:05.064508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:05.065178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:05.078776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:05.078776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:05.079489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:05.079759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-637a8040-ed2b-428b-be0e-9ca0cdd20520 req-47dbf1b0-7ed0-4807-99dc-7de10e46ef0e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:05.080211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-637a8040-ed2b-428b-be0e-9ca0cdd20520 req-47dbf1b0-7ed0-4807-99dc-7de10e46ef0e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:05.080634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:05.092581 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-637a8040-ed2b-428b-be0e-9ca0cdd20520 req-47dbf1b0-7ed0-4807-99dc-7de10e46ef0e service nova] Creating event network-changed:f5c079d2-a611-4874-9fe2-70761fdc6bdf for instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec on n-h1-768852-23 Jul 14 15:30:05.097708 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-637a8040-ed2b-428b-be0e-9ca0cdd20520 req-47dbf1b0-7ed0-4807-99dc-7de10e46ef0e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045326 Jul 14 15:30:05.098335 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3109/6055] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:05.110866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:30:05.200207 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-409f72c8-ef89-4e7e-9f1c-0e217a40bcee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "DELETE /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 204 len: 0 microversion: 2.1 time: 0.150215 Jul 14 15:30:05.205774 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2947/6056] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:30:05 2022] DELETE /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:30:05.212169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:05.213305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:05.221646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:05.222116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:05.223230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:05.223910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:05.378756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:05.387501 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f08222e6-f613-4f70-bce3-9f4f3e0aabee tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1669 microversion: 2.1 time: 0.179573 Jul 14 15:30:05.388119 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3110/6057] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:05 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1669 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:06.410335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:06.411529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:06.422213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:06.422682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:06.423504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:06.423953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:06.643292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:06.652287 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6dd4c90b-1b37-48a3-a9ba-43d0a7ba87b8 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1669 microversion: 2.1 time: 0.250182 Jul 14 15:30:06.652903 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2948/6058] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:06 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1669 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:07.356827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2f532e52-35e5-439e-8f3e-f363827f218a req-986d5587-d042-4671-885d-9794a0b2e71b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec", "name": "network-vif-deleted", "tag": "f5c079d2-a611-4874-9fe2-70761fdc6bdf"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:07.373271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2f532e52-35e5-439e-8f3e-f363827f218a req-986d5587-d042-4671-885d-9794a0b2e71b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.374264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2f532e52-35e5-439e-8f3e-f363827f218a req-986d5587-d042-4671-885d-9794a0b2e71b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.389422 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2f532e52-35e5-439e-8f3e-f363827f218a req-986d5587-d042-4671-885d-9794a0b2e71b service nova] Creating event network-vif-deleted:f5c079d2-a611-4874-9fe2-70761fdc6bdf for instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec on n-h1-768852-23 Jul 14 15:30:07.395558 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2f532e52-35e5-439e-8f3e-f363827f218a req-986d5587-d042-4671-885d-9794a0b2e71b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042344 Jul 14 15:30:07.396369 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3111/6059] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:07.673649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:07.674669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:07.683241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.683742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.684540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.684980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.721701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:07.722155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:07.722822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lazy-loading 'fault' on Instance uuid 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:30:07.791568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f6b1118c0544aa7a263d78fd14c3552', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6adb0fee95b42cfaf64826cad196bf0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:07.802009 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5e95765-68bf-478e-ad5e-f6125960825e tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 200 len: 1339 microversion: 2.1 time: 0.134690 Jul 14 15:30:07.812683 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2949/6060] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:07 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 1339 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:08.829144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:08.829840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] [instance: 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:08.836933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:08.837377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:08.838264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:08.838633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:08.853406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] HTTP exception thrown: Instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec could not be found. Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Request method failure captured: Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec HTTP/1.1 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DXE9y4QPzCRTlWFYackR9KuObt6_ho95KxprqjP3MMZ4eoHkOPb-rcjPRy2yNElbvtIWWFjluqe7Gnwt75B5wPvgi7tOHRlidxVd-LtFXuqIjIZ5CM25m5OjnpXS21eHKVhb7ch0QlC2p9inxRibEy5sr4B-W4UY2JMGCauv325ErI Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: f6adb0fee95b42cfaf64826cad196bf0 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestNetworkBasicOps-865870426 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/f6adb0fee95b42cfaf64826cad196bf0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestNetworkBasicOps-865870426 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: f6adb0fee95b42cfaf64826cad196bf0 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestNetworkBasicOps-865870426 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestNetworkBasicOps-865870426-project Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 1f6b1118c0544aa7a263d78fd14c3552 Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestNetworkBasicOps-865870426-project Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec could not be found. Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec'} Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec could not be found. Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec could not be found. Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:08.855108 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec could not be found. Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Returning 404 to user: Instance 790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5846b1a-bc77-49d1-ad75-33ba7760cd3d tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec" status: 404 len: 111 microversion: 2.1 time: 0.032565 Jul 14 15:30:08.861062 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3112/6061] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:08 2022] GET /compute/v2.1/servers/790f7a71-d3ef-4c8b-9ec7-2a870e6f75ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:30:09.057767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c62db49c-d454-44b4-876c-acc3ad60faa2 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] Calling method '.version_select at 0x7fdbf1f47d30>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:09.068412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:09.085606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c62db49c-d454-44b4-876c-acc3ad60faa2 tempest-TestNetworkBasicOps-865870426 tempest-TestNetworkBasicOps-865870426-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1791809391" status: 202 len: 0 microversion: 2.1 time: 0.033638 Jul 14 15:30:09.091105 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2950/6062] 10.222.0.98 () {58 vars in 1256 bytes} [Thu Jul 14 15:30:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1791809391 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:30:11.666374 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:30:11.667466 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:30:16.050965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a0a1f3e-dacb-4b80-b2f0-875f416edef7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Action: 'create', calling method: .version_select at 0x7fdbf1d05430>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2110336833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5kdDS71yIQ8mwCkKPPrSLJJlZ8sBq1a4HKBBCXoa44j13EH0BYBeRS6P52UQjfsGJnLJulAWEoQ0eEoG7ULD2KGfxBCrHd6rM+EUIRd6OOw2sRuC6jyk4b7KXSzvo5gQ=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:16.055794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=33 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:16.070802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-0a0a1f3e-dacb-4b80-b2f0-875f416edef7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Getting quotas for project 08b5350c62be4829b0b7a8807d35daed. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:30:16.077746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-0a0a1f3e-dacb-4b80-b2f0-875f416edef7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Getting quotas for user fe98bedc23e84fe4b25bd4790e983611 and project 08b5350c62be4829b0b7a8807d35daed. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:30:16.124496 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a0a1f3e-dacb-4b80-b2f0-875f416edef7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.259352 Jul 14 15:30:16.125275 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3113/6063] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:30:15 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:21.769125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.770272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:21.780250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-500816839-access_point-94705152", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "024f263f-7393-4be2-9ef1-74f25150d97e"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2110336833", "security_groups": [{"name": "tempest-secgroup_access--726541549"}, {"name": "tempest-secgroup_general--1345318466"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:21.997170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] validate_networks() for [('024f263f-7393-4be2-9ef1-74f25150d97e', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:30:22.484658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:30:22.485156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:30:22.485719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:30:22.486188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:30:22.486676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:30:22.498207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:22.498716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:22.499588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:22.500024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:22.518593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Getting quotas for project 08b5350c62be4829b0b7a8807d35daed. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:30:22.525304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Getting quotas for user fe98bedc23e84fe4b25bd4790e983611 and project 08b5350c62be4829b0b7a8807d35daed. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:30:22.539814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:30:22.541891 n-d-768852-23 devstack@n-api.service[125966]: WARNING nova.utils [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-500816839-access_point-94705152 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-500816839-acc Jul 14 15:30:22.542625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:30:22.601022 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4faf765-f17c-4072-a5f2-545d6c5622ad tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 0.837247 Jul 14 15:30:22.602448 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2951/6064] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:30:21 2022] POST /compute/v2.1/servers => generated 457 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:30:22.610318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:22.623729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1c6ee2e3-12e7-4705-8aee-6ba78048dbef tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:22.626020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1c6ee2e3-12e7-4705-8aee-6ba78048dbef tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:22.692912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1c6ee2e3-12e7-4705-8aee-6ba78048dbef tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:22.703231 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1c6ee2e3-12e7-4705-8aee-6ba78048dbef tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1292 microversion: 2.1 time: 0.094382 Jul 14 15:30:22.704074 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3114/6065] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:22 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:23.722681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:23.724188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:23.735201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:23.736002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:23.737008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:23.737449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:23.836804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:23.845409 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b8a41b1-e027-4f29-878d-d09e0f7c48c5 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1344 microversion: 2.1 time: 0.128113 Jul 14 15:30:23.846228 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2952/6066] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:23 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1344 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:24.484346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:24.485777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:24.501146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:24.502094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:24.503089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:24.503865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:24.578270 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e46e2376-2097-495b-b5d2-f93f6a5452b6 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "POST /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a/action" status: 200 len: 24570 microversion: 2.1 time: 0.099510 Jul 14 15:30:24.585778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3115/6067] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:30:24 2022] POST /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a/action => generated 24570 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:30:24.862197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:24.862954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:24.871187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:24.871949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:24.872962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:24.873390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:25.067563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:25.076573 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd1e5474-abe2-4034-956e-baef22519adf tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.218298 Jul 14 15:30:25.077338 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2953/6068] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:24 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:25.592853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-04cb1d30-5dfa-438c-b4c0-31469342b7d0 req-9645ab2f-c030-4fe9-84c8-3105f7052606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3590adb-eb2b-4579-b835-315c856cdebc", "tag": "5af75a2e-a348-49b6-b128-d82cc9d06af4"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:25.627961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-04cb1d30-5dfa-438c-b4c0-31469342b7d0 req-9645ab2f-c030-4fe9-84c8-3105f7052606 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:25.629117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-04cb1d30-5dfa-438c-b4c0-31469342b7d0 req-9645ab2f-c030-4fe9-84c8-3105f7052606 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:25.646326 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-04cb1d30-5dfa-438c-b4c0-31469342b7d0 req-9645ab2f-c030-4fe9-84c8-3105f7052606 service nova] Creating event network-changed:5af75a2e-a348-49b6-b128-d82cc9d06af4 for instance f3590adb-eb2b-4579-b835-315c856cdebc on n-h1-768852-23 Jul 14 15:30:25.651882 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-04cb1d30-5dfa-438c-b4c0-31469342b7d0 req-9645ab2f-c030-4fe9-84c8-3105f7052606 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074028 Jul 14 15:30:25.652618 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3116/6069] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:26.093566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:26.094197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:26.101557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:26.102015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:26.102801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:26.103246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:26.250186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:26.257888 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-363ab5bf-0755-45bf-a80b-d1f296ab91e6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.168364 Jul 14 15:30:26.258471 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2954/6070] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:26 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:27.276194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:27.276892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:27.283132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:27.283620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:27.284381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:27.284818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:27.533281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:27.541088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0beef4b2-1665-4996-84c8-9337300588f6 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.270725 Jul 14 15:30:27.541678 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3117/6071] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:27 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:28.558120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:28.560113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:28.568243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:28.569187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:28.569963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:28.570429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:28.714658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:28.722353 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f18a570-ab22-46c7-83ae-db4c339ac937 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.168210 Jul 14 15:30:28.722936 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2955/6072] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:28 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:30:29.739052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:29.739680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:29.747385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:29.747835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:29.748600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:29.749305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:29.888497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:29.896072 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69f90e46-8b7b-49a7-9652-7ca31aee001f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.160939 Jul 14 15:30:29.896647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3118/6073] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:29 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:30.912963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:30.913582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:30.920551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:30.921007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:30.921798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:30.922235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:31.065773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:31.074922 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95925d29-9b49-4645-b662-8cd53c4b8159 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.166008 Jul 14 15:30:31.075546 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2956/6074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:30 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:31.115107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b5cf75eb-897e-4023-ba49-f426ce702242 req-c196d172-da73-44b6-8831-21f4ff7a989b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3590adb-eb2b-4579-b835-315c856cdebc", "name": "network-vif-plugged", "status": "completed", "tag": "5af75a2e-a348-49b6-b128-d82cc9d06af4"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:31.124791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b5cf75eb-897e-4023-ba49-f426ce702242 req-c196d172-da73-44b6-8831-21f4ff7a989b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:31.125243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b5cf75eb-897e-4023-ba49-f426ce702242 req-c196d172-da73-44b6-8831-21f4ff7a989b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:31.137847 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b5cf75eb-897e-4023-ba49-f426ce702242 req-c196d172-da73-44b6-8831-21f4ff7a989b service nova] Creating event network-vif-plugged:5af75a2e-a348-49b6-b128-d82cc9d06af4 for instance f3590adb-eb2b-4579-b835-315c856cdebc on n-h1-768852-23 Jul 14 15:30:31.142736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b5cf75eb-897e-4023-ba49-f426ce702242 req-c196d172-da73-44b6-8831-21f4ff7a989b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031432 Jul 14 15:30:31.143376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3119/6075] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:30:32.091718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:32.092320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:32.099294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:32.100207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:32.100639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:32.101483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:32.246502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:32.254233 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a4c3aab-c795-47d2-942c-47d914f792d4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1469 microversion: 2.1 time: 0.167146 Jul 14 15:30:32.254815 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2957/6076] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:32 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:33.268626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:33.273092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:33.273799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:33.280563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.281013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.281778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.282216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.426905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:33.434535 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c327bf25-b07a-4615-83f0-13f5639055cc tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1640 microversion: 2.1 time: 0.168302 Jul 14 15:30:33.435113 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3120/6077] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:33 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1640 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:33.450409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:33.451020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:33.452915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:33.453576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:33.461335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.461781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.462543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.462979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.863985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:33.871659 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-476d2807-5e6f-4fe8-9803-491c66ff2e4f tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1640 microversion: 2.1 time: 0.424998 Jul 14 15:30:33.872291 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2958/6078] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:33 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1640 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:33.888093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:33.888766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:33.894982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.895480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:33.896345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:33.897278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:34.145427 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2c8637c6-f0cf-4b36-8be6-7d72aae624c8 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1793 microversion: 2.1 time: 0.261220 Jul 14 15:30:34.146027 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3121/6079] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:33 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1793 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:36.090584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-381d6a1f-e1c4-41f6-b8b1-194bd09c6b04 req-620b8946-5c92-4f6d-8700-6820c1efdbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3590adb-eb2b-4579-b835-315c856cdebc", "tag": "5af75a2e-a348-49b6-b128-d82cc9d06af4"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:36.109088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-381d6a1f-e1c4-41f6-b8b1-194bd09c6b04 req-620b8946-5c92-4f6d-8700-6820c1efdbf8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:36.109773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-381d6a1f-e1c4-41f6-b8b1-194bd09c6b04 req-620b8946-5c92-4f6d-8700-6820c1efdbf8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:36.130408 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-381d6a1f-e1c4-41f6-b8b1-194bd09c6b04 req-620b8946-5c92-4f6d-8700-6820c1efdbf8 service nova] Creating event network-changed:5af75a2e-a348-49b6-b128-d82cc9d06af4 for instance f3590adb-eb2b-4579-b835-315c856cdebc on n-h1-768852-23 Jul 14 15:30:36.136715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-381d6a1f-e1c4-41f6-b8b1-194bd09c6b04 req-620b8946-5c92-4f6d-8700-6820c1efdbf8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049874 Jul 14 15:30:36.137760 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2959/6080] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:36.818125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:36.819378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:36.835664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:36.836775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-cadf7841-ce07-4c28-96b4-a8828c275f48 req-874a1ce3-2452-4af7-8312-8772b124cfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:36.845658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cadf7841-ce07-4c28-96b4-a8828c275f48 req-874a1ce3-2452-4af7-8312-8772b124cfe6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:36.846362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:36.847259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:36.847799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:36.850407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cadf7841-ce07-4c28-96b4-a8828c275f48 req-874a1ce3-2452-4af7-8312-8772b124cfe6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:36.864719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-cadf7841-ce07-4c28-96b4-a8828c275f48 req-874a1ce3-2452-4af7-8312-8772b124cfe6 service nova] Creating event network-changed:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:30:36.870706 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-cadf7841-ce07-4c28-96b4-a8828c275f48 req-874a1ce3-2452-4af7-8312-8772b124cfe6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041290 Jul 14 15:30:36.871349 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2960/6081] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 14 15:30:36.879094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:30:36.991049 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6839b4a4-b567-4bcc-baea-fc557752210f tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 204 len: 0 microversion: 2.1 time: 0.176495 Jul 14 15:30:36.992052 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3122/6082] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:30:36 2022] DELETE /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:30:37.000661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:37.001379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:37.008480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:37.008941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:37.009735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:37.010183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:37.192954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:37.202198 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e9c1519-efe5-48b3-8f61-e4c37f15936c tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1685 microversion: 2.1 time: 0.205738 Jul 14 15:30:37.202800 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2961/6083] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:36 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1685 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:38.219924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:38.220721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:38.227837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:38.228281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:38.229040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:38.229468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:38.363494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:38.371508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-71549b92-94bf-439d-bb9a-d7249d9a7d21 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1685 microversion: 2.1 time: 0.155799 Jul 14 15:30:38.372054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3123/6084] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:38 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:38.981377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-72ea4919-3220-4257-82ad-2631f2ac856b req-615a92e3-93d7-4823-a6af-07677d78b020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade5e7a7-44b6-4973-8c38-173fe6b8789a", "name": "network-vif-deleted", "tag": "c434673b-14ae-4bb4-b93c-1133858f9d84"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:30:38.990592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-72ea4919-3220-4257-82ad-2631f2ac856b req-615a92e3-93d7-4823-a6af-07677d78b020 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:38.991037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-72ea4919-3220-4257-82ad-2631f2ac856b req-615a92e3-93d7-4823-a6af-07677d78b020 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:39.002273 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-72ea4919-3220-4257-82ad-2631f2ac856b req-615a92e3-93d7-4823-a6af-07677d78b020 service nova] Creating event network-vif-deleted:c434673b-14ae-4bb4-b93c-1133858f9d84 for instance ade5e7a7-44b6-4973-8c38-173fe6b8789a on n-h2-768852-23 Jul 14 15:30:39.008482 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-72ea4919-3220-4257-82ad-2631f2ac856b req-615a92e3-93d7-4823-a6af-07677d78b020 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030648 Jul 14 15:30:39.009240 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2962/6085] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:39.388798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:39.390015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:39.397571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:39.398028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:39.398806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:39.399245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:39.431498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:39.431954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:39.432509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lazy-loading 'fault' on Instance uuid ade5e7a7-44b6-4973-8c38-173fe6b8789a {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:30:39.474987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db9dcb86f53e466392563a143ee4654f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4d5f64edea14cbab1392d17e3be9de9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:30:39.483169 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29ad3092-cdf3-4f1e-8320-56077bfffc26 tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 200 len: 1356 microversion: 2.1 time: 0.098220 Jul 14 15:30:39.484151 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3124/6086] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:39 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 1356 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:40.503607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:40.504294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] [instance: ade5e7a7-44b6-4973-8c38-173fe6b8789a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:30:40.511030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:40.511503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:40.512255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:30:40.512684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:30:40.526440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] HTTP exception thrown: Instance ade5e7a7-44b6-4973-8c38-173fe6b8789a could not be found. Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Request method failure captured: Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a HTTP/1.1 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DShmCA9LUrKc4gE50X1sfHG-Lm_Y_o9EZxYmmvoTfSxYK9TqA6TfZtA7A5g19riBgP77kB4DblD1bneI-yKkvwowHZ7EzqlY0k1dmhhqLY7ESzr_OPGg7QZXWulDrTrTtbgddbUpBPQHIJgG97_XjGKNc8kAPkldOs2FZP1ZIqhxMQ Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/e4d5f64edea14cbab1392d17e3be9de9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: e4d5f64edea14cbab1392d17e3be9de9 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1009898076 Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: db9dcb86f53e466392563a143ee4654f Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1009898076-project Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ade5e7a7-44b6-4973-8c38-173fe6b8789a could not be found. Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ade5e7a7-44b6-4973-8c38-173fe6b8789a'} Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade5e7a7-44b6-4973-8c38-173fe6b8789a could not be found. Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade5e7a7-44b6-4973-8c38-173fe6b8789a could not be found. Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:30:40.528085 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade5e7a7-44b6-4973-8c38-173fe6b8789a could not be found. Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Returning 404 to user: Instance ade5e7a7-44b6-4973-8c38-173fe6b8789a could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfa9930d-b804-4892-87a5-b65f1b4bf28e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a" status: 404 len: 111 microversion: 2.1 time: 0.031137 Jul 14 15:30:40.533761 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2963/6087] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:30:40 2022] GET /compute/v2.1/servers/ade5e7a7-44b6-4973-8c38-173fe6b8789a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:30:43.775247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39772288-b931-4d33-82f7-78967bb3a20e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] Calling method '.version_select at 0x7fdbf1b2b310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:43.799039 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39772288-b931-4d33-82f7-78967bb3a20e tempest-TestNetworkAdvancedServerOps-1009898076 tempest-TestNetworkAdvancedServerOps-1009898076-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-508748630" status: 202 len: 0 microversion: 2.1 time: 0.027777 Jul 14 15:30:43.799899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3125/6088] 10.222.0.98 () {58 vars in 1280 bytes} [Thu Jul 14 15:30:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-508748630 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:31:19.024260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1314679663", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "d9e17f9f-9ef7-4fa9-88fa-7ec6fc94da31"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2110336833", "security_groups": []}, "os:scheduler_hints": {"different_host": ["f3590adb-eb2b-4579-b835-315c856cdebc"]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:19.031714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:19.032384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=58 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:19.372972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] validate_networks() for [('d9e17f9f-9ef7-4fa9-88fa-7ec6fc94da31', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:31:19.844056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:31:19.844484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:31:19.844997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:31:19.845413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:31:19.845834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:31:19.856200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.856641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.857457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:19.858055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:19.876604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Getting quotas for project 08b5350c62be4829b0b7a8807d35daed. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:31:19.882488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Getting quotas for user fe98bedc23e84fe4b25bd4790e983611 and project 08b5350c62be4829b0b7a8807d35daed. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:31:19.899063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:31:19.901973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:31:19.952031 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a910f57-6998-4eb5-b2f5-5d5246a365be tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.931686 Jul 14 15:31:19.953004 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2964/6089] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:31:19 2022] POST /compute/v2.1/servers => generated 361 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:31:19.964047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cff433ff-a685-4c98-85e8-81cde5531272 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:19.965163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cff433ff-a685-4c98-85e8-81cde5531272 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:19.974867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:19.975922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:20.196516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cff433ff-a685-4c98-85e8-81cde5531272 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:20.205232 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cff433ff-a685-4c98-85e8-81cde5531272 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1242 microversion: 2.1 time: 0.245220 Jul 14 15:31:20.206173 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3126/6090] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:19 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1242 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:21.222133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed2f45f5-19f2-4d90-92b9-376a82324faa tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:21.222728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed2f45f5-19f2-4d90-92b9-376a82324faa tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:21.288197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ed2f45f5-19f2-4d90-92b9-376a82324faa tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:21.295237 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed2f45f5-19f2-4d90-92b9-376a82324faa tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1242 microversion: 2.1 time: 0.077111 Jul 14 15:31:21.296458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2965/6091] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:21 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:22.314879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:22.316167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:22.325042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:22.325412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:22.326204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:22.326650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:22.400241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:22.407697 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-71159de4-98d1-4765-b61c-7bca0b37f00d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.097896 Jul 14 15:31:22.408287 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3127/6092] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:22 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:23.425660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:23.426292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:23.433458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:23.433964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:23.434802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:23.435244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:23.529788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:23.537686 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e7af560-1288-4893-ad48-8c502adc533d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.115879 Jul 14 15:31:23.538285 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2966/6093] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:23 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:23.546870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-befbf21c-f45e-4b23-8896-12f4df993b4a req-5a7eb59f-977d-4bab-b04e-f27aa2feec99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4ccc114-cc11-417a-a216-2363a6dba787", "tag": "ed5fed3d-fd70-499f-89d7-4d65342120b6"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:23.561155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-befbf21c-f45e-4b23-8896-12f4df993b4a req-5a7eb59f-977d-4bab-b04e-f27aa2feec99 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:23.562724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-befbf21c-f45e-4b23-8896-12f4df993b4a req-5a7eb59f-977d-4bab-b04e-f27aa2feec99 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:23.576187 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-befbf21c-f45e-4b23-8896-12f4df993b4a req-5a7eb59f-977d-4bab-b04e-f27aa2feec99 service nova] Creating event network-changed:ed5fed3d-fd70-499f-89d7-4d65342120b6 for instance d4ccc114-cc11-417a-a216-2363a6dba787 on n-h2-768852-23 Jul 14 15:31:23.581458 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-befbf21c-f45e-4b23-8896-12f4df993b4a req-5a7eb59f-977d-4bab-b04e-f27aa2feec99 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039828 Jul 14 15:31:23.582081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3128/6094] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:24.554731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:24.555293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:24.562470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:24.562928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:24.563828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:24.564274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:24.652668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:24.661208 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89919c5b-aa04-46ae-b885-c3a493169673 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.110494 Jul 14 15:31:24.661818 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2967/6095] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:24 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:25.680114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:25.680836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:25.687383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:25.687835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:25.688607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:25.689040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:25.778374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:25.786573 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ebe09570-f49f-4749-a08f-6b23db782dd0 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.111850 Jul 14 15:31:25.787157 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3129/6096] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:25 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:26.804405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:26.805021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:26.812565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:26.813018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:26.813789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:26.814238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:26.899444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:26.907154 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ce19a4a-3815-4e77-8bb4-e4422fd0d80d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.107157 Jul 14 15:31:26.907784 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2968/6097] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:26 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:27.925554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:27.926301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:27.933698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:27.934151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:27.934914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:27.935374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:28.024402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:28.033526 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-46aebd3a-2b48-400b-b06c-50828d78ed1c tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.111788 Jul 14 15:31:28.034220 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3130/6098] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:27 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:29.058711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:29.059350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:29.066401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:29.066847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:29.067636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:29.068071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:29.151491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:29.158978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-988f4d4d-e4ff-482f-9157-0b71e322de49 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.104212 Jul 14 15:31:29.159677 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2969/6099] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:29 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:29.428823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-22280ff1-2be1-4831-83c4-d000607ebce2 req-a4b34cff-19e4-4932-a720-f78eb84adc00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ccc114-cc11-417a-a216-2363a6dba787", "name": "network-vif-plugged", "status": "completed", "tag": "ed5fed3d-fd70-499f-89d7-4d65342120b6"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:29.440092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-22280ff1-2be1-4831-83c4-d000607ebce2 req-a4b34cff-19e4-4932-a720-f78eb84adc00 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:29.440898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-22280ff1-2be1-4831-83c4-d000607ebce2 req-a4b34cff-19e4-4932-a720-f78eb84adc00 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:29.453737 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-22280ff1-2be1-4831-83c4-d000607ebce2 req-a4b34cff-19e4-4932-a720-f78eb84adc00 service nova] Creating event network-vif-plugged:ed5fed3d-fd70-499f-89d7-4d65342120b6 for instance d4ccc114-cc11-417a-a216-2363a6dba787 on n-h2-768852-23 Jul 14 15:31:29.460334 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-22280ff1-2be1-4831-83c4-d000607ebce2 req-a4b34cff-19e4-4932-a720-f78eb84adc00 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035283 Jul 14 15:31:29.460975 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3131/6100] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:30.177947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:30.178570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:30.180503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:30.186299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:30.186760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:30.187581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:30.188022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:30.275122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:30.282732 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-27283607-74d4-43ed-af51-4d54c1368506 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1300 microversion: 2.1 time: 0.109479 Jul 14 15:31:30.283328 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2970/6101] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:30 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:31.300948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:31.301661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:31.303728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:31.310021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.310471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.311238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.311699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.396857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:31.404570 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc25326e-3cd8-419d-8168-35ce584dcde4 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1473 microversion: 2.1 time: 0.107964 Jul 14 15:31:31.405155 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3132/6102] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:31 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1473 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:31:31.421609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:31.422260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:31.425012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:31.430722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.431161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.431966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.432411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.515213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:31.524634 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07cf02fe-6492-488d-bd19-deedf380ca78 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1473 microversion: 2.1 time: 0.107581 Jul 14 15:31:31.525245 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2971/6103] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:31 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1473 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:31.540387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:31.541007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:31.547702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.548152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.548930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.549375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.643758 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df12e64f-89d2-4be2-abe0-ea80abd49a20 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1626 microversion: 2.1 time: 0.106900 Jul 14 15:31:31.644483 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3133/6104] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:31 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1626 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:31.661121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:31.661744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:31.668649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.669094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.669868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.670311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.824135 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8196aac9-e728-42cb-8fe0-32e277eefc48 tempest-TestSecurityGroupsBasicOps-95467224 tempest-TestSecurityGroupsBasicOps-95467224-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1911 microversion: 2.1 time: 0.166864 Jul 14 15:31:31.824812 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2972/6105] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:31 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1911 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:31:31.890501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:31.891002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:31.897335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.897787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.898559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:31.899024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:31.925374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:31:32.012192 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0114cb0f-c4cc-4056-836d-80823694a9b7 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 204 len: 0 microversion: 2.1 time: 0.125259 Jul 14 15:31:32.012817 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3134/6106] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:31:31 2022] DELETE /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:31:32.021582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:32.022189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:32.028363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:32.028818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:32.029573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:32.030005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:32.119060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:32.126671 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6faea4d-098e-443b-8663-c2596798d1b3 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1479 microversion: 2.1 time: 0.109332 Jul 14 15:31:32.127245 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2973/6107] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:32 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1479 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:33.145126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:33.145856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:33.152929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:33.153381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:33.154161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:33.154598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:33.240659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:33.248365 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23ef98e2-d90a-4185-a73e-56adc5887ead tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1479 microversion: 2.1 time: 0.107647 Jul 14 15:31:33.248953 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3135/6108] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:33 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1479 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:33.908579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a4ac6a40-04df-4fb1-8eba-af95bb0afb15 req-4936f819-0fcb-4e51-a743-a65617e3bcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4ccc114-cc11-417a-a216-2363a6dba787", "name": "network-vif-deleted", "tag": "ed5fed3d-fd70-499f-89d7-4d65342120b6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:33.918984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a4ac6a40-04df-4fb1-8eba-af95bb0afb15 req-4936f819-0fcb-4e51-a743-a65617e3bcc8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:33.919453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a4ac6a40-04df-4fb1-8eba-af95bb0afb15 req-4936f819-0fcb-4e51-a743-a65617e3bcc8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:33.932404 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a4ac6a40-04df-4fb1-8eba-af95bb0afb15 req-4936f819-0fcb-4e51-a743-a65617e3bcc8 service nova] Creating event network-vif-deleted:ed5fed3d-fd70-499f-89d7-4d65342120b6 for instance d4ccc114-cc11-417a-a216-2363a6dba787 on n-h2-768852-23 Jul 14 15:31:33.939209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a4ac6a40-04df-4fb1-8eba-af95bb0afb15 req-4936f819-0fcb-4e51-a743-a65617e3bcc8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036687 Jul 14 15:31:33.940636 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2974/6109] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:34.265577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:34.266216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:34.273933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:34.274373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:34.275147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:34.275610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:34.309407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:34.309849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:34.310299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lazy-loading 'fault' on Instance uuid d4ccc114-cc11-417a-a216-2363a6dba787 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:31:34.355071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:34.362827 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-34814607-e57a-4665-9b0d-33391438e3e8 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 200 len: 1332 microversion: 2.1 time: 0.101164 Jul 14 15:31:34.363692 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3136/6110] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:34 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:35.380551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:35.381276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: d4ccc114-cc11-417a-a216-2363a6dba787] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:35.388626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:35.389077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:35.389854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:35.390294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:35.404170 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] HTTP exception thrown: Instance d4ccc114-cc11-417a-a216-2363a6dba787 could not be found. Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Request method failure captured: Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 HTTP/1.1 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DaGqjGJQCIb4MfqQWnbTX7Ky1ekaWtblTeZPyseJgrs5rBTuo6pUzsfVgdbZ1XLxzpaJiGyGCBR9uJ5QzVTFq6ETXtQse31czaWqv6PWqdVNZCWq_d69Plw-7-m3TtYJoWFGomyRdoBJH-6RnEYzyXc2Z2xaPAwQfeaFk0fEwFkPwM Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 08b5350c62be4829b0b7a8807d35daed Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-500816839 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestSecurityGroupsBasicOps-500816839 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 08b5350c62be4829b0b7a8807d35daed Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-500816839 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestSecurityGroupsBasicOps-500816839-project Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: fe98bedc23e84fe4b25bd4790e983611 Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestSecurityGroupsBasicOps-500816839-project Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance d4ccc114-cc11-417a-a216-2363a6dba787 could not be found. Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'd4ccc114-cc11-417a-a216-2363a6dba787'} Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4ccc114-cc11-417a-a216-2363a6dba787 could not be found. Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4ccc114-cc11-417a-a216-2363a6dba787 could not be found. Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:31:35.405872 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4ccc114-cc11-417a-a216-2363a6dba787 could not be found. Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Returning 404 to user: Instance d4ccc114-cc11-417a-a216-2363a6dba787 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1962fddf-9aba-4a20-88f5-92fc52206761 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787" status: 404 len: 111 microversion: 2.1 time: 0.031087 Jul 14 15:31:35.412455 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2975/6111] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:35 2022] GET /compute/v2.1/servers/d4ccc114-cc11-417a-a216-2363a6dba787 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:31:39.419082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:39.420091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:39.420877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-afae2131-1ff2-4c4f-992d-896113c8e0f0 req-0fb0ba4d-6fee-46f2-a363-480ceb8b8d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3590adb-eb2b-4579-b835-315c856cdebc", "tag": "5af75a2e-a348-49b6-b128-d82cc9d06af4"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:39.431764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:39.432661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:39.434043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:39.435032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:39.435749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-afae2131-1ff2-4c4f-992d-896113c8e0f0 req-0fb0ba4d-6fee-46f2-a363-480ceb8b8d8c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:39.436464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-afae2131-1ff2-4c4f-992d-896113c8e0f0 req-0fb0ba4d-6fee-46f2-a363-480ceb8b8d8c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:39.455774 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-afae2131-1ff2-4c4f-992d-896113c8e0f0 req-0fb0ba4d-6fee-46f2-a363-480ceb8b8d8c service nova] Creating event network-changed:5af75a2e-a348-49b6-b128-d82cc9d06af4 for instance f3590adb-eb2b-4579-b835-315c856cdebc on n-h1-768852-23 Jul 14 15:31:39.464244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-afae2131-1ff2-4c4f-992d-896113c8e0f0 req-0fb0ba4d-6fee-46f2-a363-480ceb8b8d8c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050062 Jul 14 15:31:39.465669 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2976/6112] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:39.481477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:31:39.567282 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c69366b4-3771-4480-b307-52c94ba71a88 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 204 len: 0 microversion: 2.1 time: 0.154531 Jul 14 15:31:39.568878 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3137/6113] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:31:39 2022] DELETE /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:31:39.578490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:39.579662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:39.588158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:39.588867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:39.590110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:39.590913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:39.746221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:39.754525 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d5e776dd-2d44-4396-99da-e7ee4c44d187 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1764 microversion: 2.1 time: 0.180494 Jul 14 15:31:39.755105 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2977/6114] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:39 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1764 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:40.772835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:40.773531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:40.780357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:40.780807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:40.781563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:40.781998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:40.979778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:40.987412 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-504f909e-05c5-4eb0-9572-dad19aa3dfdb tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1764 microversion: 2.1 time: 0.219398 Jul 14 15:31:40.988492 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3138/6115] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:40 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1764 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:41.650160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-10131416-2cf6-4b4f-a8e1-47cd217385ec req-2c84ec24-7531-47e7-89e1-7e4f2a53751c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3590adb-eb2b-4579-b835-315c856cdebc", "name": "network-vif-deleted", "tag": "5af75a2e-a348-49b6-b128-d82cc9d06af4"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:41.660240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-10131416-2cf6-4b4f-a8e1-47cd217385ec req-2c84ec24-7531-47e7-89e1-7e4f2a53751c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:41.660699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-10131416-2cf6-4b4f-a8e1-47cd217385ec req-2c84ec24-7531-47e7-89e1-7e4f2a53751c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:41.672923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-10131416-2cf6-4b4f-a8e1-47cd217385ec req-2c84ec24-7531-47e7-89e1-7e4f2a53751c service nova] Creating event network-vif-deleted:5af75a2e-a348-49b6-b128-d82cc9d06af4 for instance f3590adb-eb2b-4579-b835-315c856cdebc on n-h1-768852-23 Jul 14 15:31:41.678258 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-10131416-2cf6-4b4f-a8e1-47cd217385ec req-2c84ec24-7531-47e7-89e1-7e4f2a53751c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031780 Jul 14 15:31:41.678922 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2978/6116] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:42.005199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:42.006005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:42.013396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:42.013851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:42.014633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:42.015076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:42.048632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:42.049090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:42.049550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lazy-loading 'fault' on Instance uuid f3590adb-eb2b-4579-b835-315c856cdebc {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:31:42.100128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe98bedc23e84fe4b25bd4790e983611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08b5350c62be4829b0b7a8807d35daed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:42.108099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a9cdebd3-2034-4d07-873c-7f3e5ddebd0b tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 200 len: 1382 microversion: 2.1 time: 0.106956 Jul 14 15:31:42.108852 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3139/6117] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:41 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 1382 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:43.127220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:43.127939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] [instance: f3590adb-eb2b-4579-b835-315c856cdebc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:43.134877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:43.135359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:43.136116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:43.136547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:43.149673 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] HTTP exception thrown: Instance f3590adb-eb2b-4579-b835-315c856cdebc could not be found. Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Request method failure captured: Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc HTTP/1.1 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DaGqjGJQCIb4MfqQWnbTX7Ky1ekaWtblTeZPyseJgrs5rBTuo6pUzsfVgdbZ1XLxzpaJiGyGCBR9uJ5QzVTFq6ETXtQse31czaWqv6PWqdVNZCWq_d69Plw-7-m3TtYJoWFGomyRdoBJH-6RnEYzyXc2Z2xaPAwQfeaFk0fEwFkPwM Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 08b5350c62be4829b0b7a8807d35daed Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-500816839 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/08b5350c62be4829b0b7a8807d35daed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestSecurityGroupsBasicOps-500816839 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 08b5350c62be4829b0b7a8807d35daed Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-500816839 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestSecurityGroupsBasicOps-500816839-project Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: fe98bedc23e84fe4b25bd4790e983611 Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestSecurityGroupsBasicOps-500816839-project Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f3590adb-eb2b-4579-b835-315c856cdebc could not be found. Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f3590adb-eb2b-4579-b835-315c856cdebc'} Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3590adb-eb2b-4579-b835-315c856cdebc could not be found. Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3590adb-eb2b-4579-b835-315c856cdebc could not be found. Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:31:43.151294 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3590adb-eb2b-4579-b835-315c856cdebc could not be found. Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Returning 404 to user: Instance f3590adb-eb2b-4579-b835-315c856cdebc could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73e5d5fd-bf59-4e45-a033-a4187de3eb5d tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc" status: 404 len: 111 microversion: 2.1 time: 0.030586 Jul 14 15:31:43.156544 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2979/6118] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:43 2022] GET /compute/v2.1/servers/f3590adb-eb2b-4579-b835-315c856cdebc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:31:46.681222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-800ced9b-befc-48ad-a02a-864d30ac7a93 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] Calling method '.version_select at 0x7fdbf1d05940>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:46.703128 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-800ced9b-befc-48ad-a02a-864d30ac7a93 tempest-TestSecurityGroupsBasicOps-500816839 tempest-TestSecurityGroupsBasicOps-500816839-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2110336833" status: 202 len: 0 microversion: 2.1 time: 0.025915 Jul 14 15:31:46.703759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3140/6119] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 15:31:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2110336833 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:31:51.325257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1479872797", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "bbe6bed4-992a-41d5-bb72-f526e8869484"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:51.332113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:51.377445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] validate_networks() for [('bbe6bed4-992a-41d5-bb72-f526e8869484', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:31:51.737303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:31:51.738414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:31:51.738886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:31:51.739326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:31:51.739751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:31:51.748694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:51.749144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:51.749988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:51.750433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:51.757283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=67 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:51.768630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Getting quotas for project 4b9390a34c364bf7a58635f7f3e7fc7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:31:51.774006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Getting quotas for user d0ec70daaa7c4babbadcb96a5fe16f44 and project 4b9390a34c364bf7a58635f7f3e7fc7b. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:31:51.788250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:31:51.790565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:31:51.835555 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3eec2b50-bd77-4203-989b-78068a40ee96 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630695 Jul 14 15:31:51.836312 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2980/6120] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:31:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:31:51.847804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-524702ba-2737-41fb-b7c5-7200ba9e6eb0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:51.848432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-524702ba-2737-41fb-b7c5-7200ba9e6eb0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:51.854205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:51.904443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-524702ba-2737-41fb-b7c5-7200ba9e6eb0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:51.912398 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-524702ba-2737-41fb-b7c5-7200ba9e6eb0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1215 microversion: 2.1 time: 0.070069 Jul 14 15:31:51.913177 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3141/6121] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:51 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:52.933053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:52.933740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:52.943144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:52.944308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:52.945668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:52.947181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:53.022853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:53.030431 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56cfc369-d427-4de4-879f-4b31fb26cf13 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1285 microversion: 2.1 time: 0.103857 Jul 14 15:31:53.031007 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2981/6122] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:52 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:54.047389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:54.048784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:54.052633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:31:54.058001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:54.058695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:54.059638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:54.060021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:54.203702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:54.212376 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5b8a3d9d-0f02-4422-8d2e-14816118f339 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.169115 Jul 14 15:31:54.213164 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3142/6123] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:54 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:54.382299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-69aa29df-a118-4e24-94f9-e9637d3da80e req-aa5841c2-0f07-4793-887d-2f1fba1f6d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b4dc241-2907-4acb-ab1e-ac63175fa964", "tag": "d99d7054-509d-43b7-abf4-30d0db275ea5"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:31:54.394866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-69aa29df-a118-4e24-94f9-e9637d3da80e req-aa5841c2-0f07-4793-887d-2f1fba1f6d37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:54.395480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-69aa29df-a118-4e24-94f9-e9637d3da80e req-aa5841c2-0f07-4793-887d-2f1fba1f6d37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:54.407548 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-69aa29df-a118-4e24-94f9-e9637d3da80e req-aa5841c2-0f07-4793-887d-2f1fba1f6d37 service nova] Creating event network-changed:d99d7054-509d-43b7-abf4-30d0db275ea5 for instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 on n-h1-768852-23 Jul 14 15:31:54.412285 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-69aa29df-a118-4e24-94f9-e9637d3da80e req-aa5841c2-0f07-4793-887d-2f1fba1f6d37 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033869 Jul 14 15:31:54.412880 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2982/6124] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:31:55.229336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:55.229954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:55.236931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:55.237409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:55.238174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:55.238612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:55.371331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:55.378901 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53e44bb8-0b06-497b-a1e5-47fb1b440eb9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.153484 Jul 14 15:31:55.379524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3143/6125] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:55 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:31:56.396674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:56.397322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:56.403677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:56.404133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:56.405358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:56.406648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:56.545358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:56.553035 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94c5a73a-96c7-4b6e-9c4a-b05952ac4c20 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.161510 Jul 14 15:31:56.553624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2983/6126] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:56 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:57.569838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:57.570427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:57.577434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:57.577882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:57.578655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:57.579088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:57.728995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:57.736964 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e14f205-1fb2-47cc-968e-b9447217f602 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.171054 Jul 14 15:31:57.737605 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3144/6127] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:57 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:58.754117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:58.754720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:58.761542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:58.761984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:58.762743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:58.763176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:58.892664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:31:58.900768 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f091e9d-907b-42c3-883d-3ebe79beb084 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.150828 Jul 14 15:31:58.901360 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2984/6128] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:58 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:31:59.918574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:31:59.919370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:31:59.926931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:59.927414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:31:59.928189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:31:59.928790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:00.078722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:00.086908 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62646c88-d6ea-4334-8219-27bff7df78a0 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.172599 Jul 14 15:32:00.087645 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3145/6129] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:31:59 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:01.104637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:01.105242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:01.111824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:01.112272 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:01.113536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:01.113967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:01.251392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:01.259756 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-665a9908-041c-48bd-bc0f-c918c7ec93ba tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.159315 Jul 14 15:32:01.260360 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2985/6130] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:01 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:01.508188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e406057d-c263-4c25-8d14-1ab00c4fbf7e req-e7035d89-b9b2-471e-b9c1-167ba3c5f6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4dc241-2907-4acb-ab1e-ac63175fa964", "name": "network-vif-plugged", "status": "completed", "tag": "d99d7054-509d-43b7-abf4-30d0db275ea5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:01.521023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e406057d-c263-4c25-8d14-1ab00c4fbf7e req-e7035d89-b9b2-471e-b9c1-167ba3c5f6af service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:01.521502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e406057d-c263-4c25-8d14-1ab00c4fbf7e req-e7035d89-b9b2-471e-b9c1-167ba3c5f6af service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:01.533790 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e406057d-c263-4c25-8d14-1ab00c4fbf7e req-e7035d89-b9b2-471e-b9c1-167ba3c5f6af service nova] Creating event network-vif-plugged:d99d7054-509d-43b7-abf4-30d0db275ea5 for instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 on n-h1-768852-23 Jul 14 15:32:01.539408 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e406057d-c263-4c25-8d14-1ab00c4fbf7e req-e7035d89-b9b2-471e-b9c1-167ba3c5f6af service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035173 Jul 14 15:32:01.540285 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3146/6131] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:02.276702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:02.277331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:02.279497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:02.280354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:02.287313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:02.287768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:02.288563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:02.289003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:02.427228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:02.435496 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7e809ab9-a273-45b6-af8c-76bc96411e80 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1315 microversion: 2.1 time: 0.162665 Jul 14 15:32:02.436133 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2986/6132] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:02 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:03.450365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:03.455554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:03.456269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:03.462933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.463415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.464190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.464625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.607678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:03.619421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a54486e-daae-47e9-9af1-f36a446c249e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1503 microversion: 2.1 time: 0.169710 Jul 14 15:32:03.620041 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3147/6133] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:03 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:03.636368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:03.636986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:03.644360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.644815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.645599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.646040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.788579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:03.796530 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aa7216d0-102a-4e0f-b04f-34bc8209c56a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1503 microversion: 2.1 time: 0.164034 Jul 14 15:32:03.797126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2987/6134] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:03 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:32:03.813647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:03.814193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:03.822788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.823235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.824066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.824498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.849023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lazy-loading 'flavor' on Instance uuid 7b4dc241-2907-4acb-ab1e-ac63175fa964 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:32:03.922452 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8a98757d-6189-4034-813c-1019d03f1699 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action" status: 202 len: 0 microversion: 2.1 time: 0.112592 Jul 14 15:32:03.923537 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3148/6135] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:32:03 2022] POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:32:03.936015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:03.937302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:03.947611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.948415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:03.949683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:03.950197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:04.086467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:04.094236 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dff1ea9c-4fb0-4ad4-abe4-84173e8bb835 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1511 microversion: 2.1 time: 0.165383 Jul 14 15:32:04.094821 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2988/6136] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:03 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:05.112212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:05.112923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:05.120402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:05.120854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:05.121625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:05.122065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:05.266984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:05.276019 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3e925be9-b98b-4ad5-95d2-39dbf06bf10f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1494 microversion: 2.1 time: 0.167985 Jul 14 15:32:05.276720 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3149/6137] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:05 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1494 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:05.293660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:05.294385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:05.301847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:05.302395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:05.303177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:05.303654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:05.373970 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cba97514-d2d0-4ad0-a04c-5d39fa8d1316 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action" status: 202 len: 0 microversion: 2.1 time: 0.084281 Jul 14 15:32:05.374546 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2989/6138] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:32:05 2022] POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:32:05.383296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:05.383933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:05.389982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:05.390553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:05.391422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:05.391943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:05.528799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:05.536676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-279353b1-2f3a-403a-8d5d-4326a58cfec3 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1500 microversion: 2.1 time: 0.157246 Jul 14 15:32:05.537272 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3150/6139] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:05 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1500 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:32:06.556703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:06.557385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:06.564251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:06.564708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:06.566076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:06.566528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:06.708087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:06.716575 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-570507ed-85b0-4abc-9733-b8fd94b2027f tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1500 microversion: 2.1 time: 0.165536 Jul 14 15:32:06.717186 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2990/6140] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:06 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:07.734306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:07.734959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:07.742681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:07.743127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:07.743935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:07.744370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:07.881520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:07.889321 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce910253-ca30-4bf6-b721-297b8f30d2e1 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1503 microversion: 2.1 time: 0.158946 Jul 14 15:32:07.889948 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3151/6141] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:07 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:32:07.906402 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:07.907209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:07.914627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:07.915089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:07.915925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:07.916369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:07.941228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lazy-loading 'flavor' on Instance uuid 7b4dc241-2907-4acb-ab1e-ac63175fa964 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:32:08.008169 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed603e25-62cf-492a-a8c1-a5d68c10a684 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action" status: 202 len: 0 microversion: 2.1 time: 0.105416 Jul 14 15:32:08.008771 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2991/6142] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:32:07 2022] POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:32:08.017039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:08.017795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:08.024813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:08.025614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:08.026636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:08.027081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:08.164502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:08.172532 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85a6aa5f-7c1e-424f-98d7-36bf1e2ce845 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1511 microversion: 2.1 time: 0.159356 Jul 14 15:32:08.175207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3152/6143] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:08 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1511 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:09.191494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:09.192224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:09.198730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:09.199183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:09.199986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:09.200425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:09.677862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:09.685397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a286027-aba0-4fe6-baf4-c620712812d9 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1494 microversion: 2.1 time: 0.499216 Jul 14 15:32:09.685976 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2992/6144] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:09 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1494 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:09.701764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:09.702296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:09.709122 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:09.709566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:09.710326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:09.710759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:09.776570 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b8f85b6-fb8c-437b-b4ac-48a179b6d093 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action" status: 202 len: 0 microversion: 2.1 time: 0.078571 Jul 14 15:32:09.777217 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3153/6145] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:32:09 2022] POST /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:32:09.785855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:09.786473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:09.792673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:09.793384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:09.794169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:09.794604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:09.978586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:09.986238 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4293b916-831a-427f-b86c-29e0135683fe tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1500 microversion: 2.1 time: 0.204772 Jul 14 15:32:09.986945 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2993/6146] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:09 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1500 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:11.005892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:11.006603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:11.012958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:11.013402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:11.014162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:11.014592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:11.147680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:11.157225 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c5bc096-9724-4c5e-895a-fe968b5e959a tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1500 microversion: 2.1 time: 0.157088 Jul 14 15:32:11.157802 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3154/6147] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:10 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1500 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:12.175736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:12.176348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:12.183311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:12.183768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:12.184531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:12.184970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:12.319038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:12.327193 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01714596-097f-4f7f-96fd-0fce17670d3e tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1503 microversion: 2.1 time: 0.156340 Jul 14 15:32:12.327811 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2994/6148] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:12 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:12.343728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:12.344475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:12.352418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:12.352789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:12.353559 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:12.353996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:12.379856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:32:12.407557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:12.461959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f81ae41-0432-4fcd-b01f-59d543c35b12 tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "DELETE /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 204 len: 0 microversion: 2.1 time: 0.121459 Jul 14 15:32:12.462820 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3155/6149] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:32:12 2022] DELETE /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:32:12.473661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:12.474287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:12.480906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:12.481362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:12.482199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:12.482642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:12.501572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:12.626061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:12.634052 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d9f2000-c388-4ce1-b745-e0c6278f9cea tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1509 microversion: 2.1 time: 0.165303 Jul 14 15:32:12.634670 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2995/6150] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:12 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:13.652725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:13.653475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:13.660515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:13.660966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:13.661730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:13.662172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:13.807818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:13.816112 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1fef8045-bf93-48bb-83fe-8647b32f4e9c tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1509 microversion: 2.1 time: 0.167165 Jul 14 15:32:13.816709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3156/6151] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:13 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:14.834810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:14.835443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:14.843021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:14.843523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:14.844297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:14.844733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:15.099977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd0ec70daaa7c4babbadcb96a5fe16f44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b9390a34c364bf7a58635f7f3e7fc7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:32:15.107813 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1ca53db-f89d-4bbf-b855-a3030db9267b tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 200 len: 1509 microversion: 2.1 time: 0.278053 Jul 14 15:32:15.108414 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2996/6152] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:14 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 1509 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:15.303946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9adc9b25-2d2b-48da-9024-0ed3df620ca2 req-6e441fd2-57c3-4a02-aa8e-8a84e4d03182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b4dc241-2907-4acb-ab1e-ac63175fa964", "name": "network-vif-deleted", "tag": "d99d7054-509d-43b7-abf4-30d0db275ea5"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:15.313354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9adc9b25-2d2b-48da-9024-0ed3df620ca2 req-6e441fd2-57c3-4a02-aa8e-8a84e4d03182 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:15.313800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9adc9b25-2d2b-48da-9024-0ed3df620ca2 req-6e441fd2-57c3-4a02-aa8e-8a84e4d03182 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:15.325719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9adc9b25-2d2b-48da-9024-0ed3df620ca2 req-6e441fd2-57c3-4a02-aa8e-8a84e4d03182 service nova] Creating event network-vif-deleted:d99d7054-509d-43b7-abf4-30d0db275ea5 for instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 on n-h1-768852-23 Jul 14 15:32:15.330616 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9adc9b25-2d2b-48da-9024-0ed3df620ca2 req-6e441fd2-57c3-4a02-aa8e-8a84e4d03182 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030192 Jul 14 15:32:15.332470 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3157/6153] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:16.125932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:16.126544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] [instance: 7b4dc241-2907-4acb-ab1e-ac63175fa964] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:16.133381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:16.133839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:16.134605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:16.135042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:16.149011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] HTTP exception thrown: Instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 could not be found. Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Request method failure captured: Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 HTTP/1.1 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dblo-jQc22nir3Q_YOpJI64PvEIh9uo1RY480P-ufnv82MyUpPh0OXLgDyy_w8J3TcdhCoToIQlQpxOBmwRcuqWdk8Obuz4F8BFFzltrh8yqmvIepPeS_9HFXhV4GL3KCKAprw059dYfO-w93r_laEEGUjzr0LlWvJ_r1GAnV6kU-g Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4b9390a34c364bf7a58635f7f3e7fc7b Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestServerAdvancedOps-349358194 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4b9390a34c364bf7a58635f7f3e7fc7b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4b9390a34c364bf7a58635f7f3e7fc7b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4b9390a34c364bf7a58635f7f3e7fc7b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4b9390a34c364bf7a58635f7f3e7fc7b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestServerAdvancedOps-349358194 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4b9390a34c364bf7a58635f7f3e7fc7b Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestServerAdvancedOps-349358194 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestServerAdvancedOps-349358194-project Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: d0ec70daaa7c4babbadcb96a5fe16f44 Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestServerAdvancedOps-349358194-project Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 could not be found. Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '7b4dc241-2907-4acb-ab1e-ac63175fa964'} Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 could not be found. Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 could not be found. Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:32:16.150654 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 could not be found. Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] Returning 404 to user: Instance 7b4dc241-2907-4acb-ab1e-ac63175fa964 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dff95a92-e201-4bbc-a83b-74c039abea8d tempest-TestServerAdvancedOps-349358194 tempest-TestServerAdvancedOps-349358194-project] 10.222.0.98 "GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964" status: 404 len: 111 microversion: 2.1 time: 0.031088 Jul 14 15:32:16.155641 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2997/6154] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:16 2022] GET /compute/v2.1/servers/7b4dc241-2907-4acb-ab1e-ac63175fa964 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:32:28.123153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:28.124384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:28.277169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7eef4998-88f1-4547-8089-9b344277bde6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:28.278015 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:32:28.278015 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 15:32:28.279150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eef4998-88f1-4547-8089-9b344277bde6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:28.279683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eef4998-88f1-4547-8089-9b344277bde6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:28.280481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eef4998-88f1-4547-8089-9b344277bde6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:28.280953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eef4998-88f1-4547-8089-9b344277bde6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:28.306770 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7eef4998-88f1-4547-8089-9b344277bde6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.190386 Jul 14 15:32:28.307433 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3158/6155] 10.222.0.98 () {58 vars in 1184 bytes} [Thu Jul 14 15:32:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:28.411600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-596507105", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "availability_zone": "nova:n-h2-768852-23", "networks": [{"uuid": "86ee0131-ba4c-47fc-880a-38ed46908451"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:28.419248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:28.419973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=11 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:28.479565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] validate_networks() for [('86ee0131-ba4c-47fc-880a-38ed46908451', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:32:28.932033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:32:28.932463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:32:28.932946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:32:28.933361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:32:28.933780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:32:28.945735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:28.946190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:28.947005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:28.947549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:28.965893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Getting quotas for project 41ea61afe615407c8558fd6e3d2e3b62. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:32:28.971735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Getting quotas for user ebf6e9548bd64ae0802f6700f434b8b6 and project 41ea61afe615407c8558fd6e3d2e3b62. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:32:28.985649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:32:28.988684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:32:29.037214 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0e4af5f-cffa-476b-acc7-e2a3604c4bb5 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.630715 Jul 14 15:32:29.037884 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2998/6156] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:32:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:32:29.048418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6fd6f93a-4f10-43c9-b560-997d01f18611 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:29.049668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6fd6f93a-4f10-43c9-b560-997d01f18611 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:29.112311 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6fd6f93a-4f10-43c9-b560-997d01f18611 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1328 microversion: 2.1 time: 0.067267 Jul 14 15:32:29.113094 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3159/6157] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:29 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1328 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:30.135446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:30.136275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:30.149771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:30.150235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:30.151024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:30.152117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:30.251770 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-014282f8-e112-42d3-bcad-73f1c90b34e2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1425 microversion: 2.1 time: 0.122838 Jul 14 15:32:30.253281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 2999/6158] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:30 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1425 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:31.271522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:31.273277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:31.284788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:31.286846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:31.287941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:31.288561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:31.525041 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d7607e2-71ad-4175-9355-21a593165f9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.258681 Jul 14 15:32:31.525855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3160/6159] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:31 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:31.574212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-b4b563e2-d535-47fe-b09a-a404882ebc79 req-6e66e1de-80c4-4160-9093-7ea3999bb0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec", "tag": "f4be0855-6627-44ef-a84b-0816affe56ec"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:31.601837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b4b563e2-d535-47fe-b09a-a404882ebc79 req-6e66e1de-80c4-4160-9093-7ea3999bb0d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:31.604331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-b4b563e2-d535-47fe-b09a-a404882ebc79 req-6e66e1de-80c4-4160-9093-7ea3999bb0d8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:31.628995 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-b4b563e2-d535-47fe-b09a-a404882ebc79 req-6e66e1de-80c4-4160-9093-7ea3999bb0d8 service nova] Creating event network-changed:f4be0855-6627-44ef-a84b-0816affe56ec for instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec on n-h2-768852-23 Jul 14 15:32:31.635543 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-b4b563e2-d535-47fe-b09a-a404882ebc79 req-6e66e1de-80c4-4160-9093-7ea3999bb0d8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069639 Jul 14 15:32:31.636179 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3000/6160] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:32.542218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:32.543198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:32.551366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:32.551952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:32.552851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:32.554571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:32.705931 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcf08f20-2278-4a05-8601-9efa0e48a264 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.166978 Jul 14 15:32:32.706533 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3161/6161] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:32 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:33.724842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:33.725662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:33.733389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:33.734003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:33.734803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:33.735339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:33.871057 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-708ef68a-5652-49e6-b675-77868653f0b2 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.151922 Jul 14 15:32:33.871683 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3001/6162] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:33 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:34.888186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:34.888759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:34.896458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:34.896903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:34.897698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:34.898126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:35.031662 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7f52cacd-373c-4ae8-a13b-d18eeb2f2db8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.147291 Jul 14 15:32:35.032260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3162/6163] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:34 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:36.049389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:36.049943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:36.056968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:36.057420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:36.058190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:36.058635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:36.191668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d2a65d9-c30c-41ff-8c3d-33bc66662c5c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.146018 Jul 14 15:32:36.192267 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3002/6164] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:36 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:37.211591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:37.212210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:37.219757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:37.220213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:37.221622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:37.222078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:37.356491 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b849d518-7380-40cd-816a-d4fe9f6d8acf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.148731 Jul 14 15:32:37.357090 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3163/6165] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:37 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:37.642691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-edae26dc-56d8-4261-b670-7c6dd4681cef req-172ebbc9-fbdb-4c6a-a621-f130ec837099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec", "name": "network-vif-plugged", "status": "completed", "tag": "f4be0855-6627-44ef-a84b-0816affe56ec"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:37.653438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edae26dc-56d8-4261-b670-7c6dd4681cef req-172ebbc9-fbdb-4c6a-a621-f130ec837099 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:37.653893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edae26dc-56d8-4261-b670-7c6dd4681cef req-172ebbc9-fbdb-4c6a-a621-f130ec837099 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:37.669542 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-edae26dc-56d8-4261-b670-7c6dd4681cef req-172ebbc9-fbdb-4c6a-a621-f130ec837099 service nova] Creating event network-vif-plugged:f4be0855-6627-44ef-a84b-0816affe56ec for instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec on n-h2-768852-23 Jul 14 15:32:37.675157 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-edae26dc-56d8-4261-b670-7c6dd4681cef req-172ebbc9-fbdb-4c6a-a621-f130ec837099 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038035 Jul 14 15:32:37.675995 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3003/6166] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:38.373049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:38.373592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:38.376295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:38.381741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:38.382190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:38.382957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:38.383434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:38.523102 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-394483b7-3e7f-4b56-b9b9-0f4023145409 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1465 microversion: 2.1 time: 0.153772 Jul 14 15:32:38.523737 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3164/6167] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:38 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:39.537811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:39.538612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:39.543261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:39.543996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:39.552213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:39.552661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:39.553431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:39.553866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:39.687714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-729fa6e2-8081-441a-8a98-f095e5ba1b19 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1650 microversion: 2.1 time: 0.151521 Jul 14 15:32:39.688310 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3004/6168] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:39 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1650 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:39.703613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:39.704231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:39.706137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:39.712681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:39.713136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:39.713925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:39.714365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:39.841001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e3f379a-8fab-4d2d-8e22-95f6694d4d9c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1650 microversion: 2.1 time: 0.141036 Jul 14 15:32:39.841585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3165/6169] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:39 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1650 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:39.857241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:39.857863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:39.864571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:39.865023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:39.865795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:39.866233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:39.991729 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0618843d-8404-4258-9d1d-663880eab09d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1650 microversion: 2.1 time: 0.138319 Jul 14 15:32:39.992299 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3005/6170] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:39 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1650 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:40.045299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-2002924137", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "availability_zone": "nova:n-h1-768852-23", "networks": [{"uuid": "86ee0131-ba4c-47fc-880a-38ed46908451"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:40.103932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] validate_networks() for [('86ee0131-ba4c-47fc-880a-38ed46908451', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:32:40.602357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:32:40.602849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:32:40.603357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:32:40.603776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:32:40.604194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:32:40.615335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:40.615788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:40.616585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:40.617022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:40.634035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Getting quotas for project 41ea61afe615407c8558fd6e3d2e3b62. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:32:40.639377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Getting quotas for user ebf6e9548bd64ae0802f6700f434b8b6 and project 41ea61afe615407c8558fd6e3d2e3b62. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:32:40.652171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:32:40.654479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:32:40.700003 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a03eef50-35bf-4cf8-b23e-8fac821f83b0 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.658700 Jul 14 15:32:40.700663 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3166/6171] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:32:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:32:40.710332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81c47ee9-7d89-4d2a-b1b8-6a47c2a79e38 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:40.710939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81c47ee9-7d89-4d2a-b1b8-6a47c2a79e38 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:40.771564 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81c47ee9-7d89-4d2a-b1b8-6a47c2a79e38 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1329 microversion: 2.1 time: 0.064779 Jul 14 15:32:40.772180 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3006/6172] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:40 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1329 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:41.788698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:41.790020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:41.801696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:41.803871 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:41.804685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:41.805143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:41.883617 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6723698f-276e-42d2-9a1f-585263bac5c1 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1436 microversion: 2.1 time: 0.099183 Jul 14 15:32:41.884412 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3167/6173] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:41 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1436 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:42.901013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:42.901564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:42.909953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:42.910408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:42.911197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:42.911671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:43.170150 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3481e82-f408-4902-84e6-9e7be4bf6d2e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.273078 Jul 14 15:32:43.170751 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3007/6174] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:42 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:43.288728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-03c023b1-60ac-4c52-a9e9-7d98e161f0a5 req-45ee1d03-97c6-4e61-9859-44d8e88b754a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1bbaea3-32cf-4491-9830-1f48fd28334a", "tag": "b337d6cc-f8cd-4a28-9aa0-af8ec99ae5a3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:43.311784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-03c023b1-60ac-4c52-a9e9-7d98e161f0a5 req-45ee1d03-97c6-4e61-9859-44d8e88b754a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:43.312709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-03c023b1-60ac-4c52-a9e9-7d98e161f0a5 req-45ee1d03-97c6-4e61-9859-44d8e88b754a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:43.332639 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-03c023b1-60ac-4c52-a9e9-7d98e161f0a5 req-45ee1d03-97c6-4e61-9859-44d8e88b754a service nova] Creating event network-changed:b337d6cc-f8cd-4a28-9aa0-af8ec99ae5a3 for instance a1bbaea3-32cf-4491-9830-1f48fd28334a on n-h1-768852-23 Jul 14 15:32:43.337995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-03c023b1-60ac-4c52-a9e9-7d98e161f0a5 req-45ee1d03-97c6-4e61-9859-44d8e88b754a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057209 Jul 14 15:32:43.338877 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3168/6175] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:32:44.187911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:44.188528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:44.196322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:44.196764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:44.197524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:44.197953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:44.327447 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd3dab08-4cfb-40f5-bb4f-ceeef5031cde tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.143174 Jul 14 15:32:44.328038 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3008/6176] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:44 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:45.347043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:45.347826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:45.354020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:45.354463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:45.355601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:45.356056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:45.481516 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-69a95a9d-fb7f-49a9-837f-a22a0ed19140 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.140253 Jul 14 15:32:45.482095 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3169/6177] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:45 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:46.498176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:46.498808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:46.506253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:46.506705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:46.507513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:46.507953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:46.645206 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7546884-f497-4098-9128-d4827006a9bf tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.150686 Jul 14 15:32:46.645787 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3009/6178] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:46 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:47.663048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:47.663697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:47.671185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:47.671687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:47.672466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:47.672905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:47.807998 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e4978a4-df1e-4305-b224-4570e4bccd94 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.148936 Jul 14 15:32:47.808586 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3170/6179] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:47 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:48.826362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:48.826903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:48.834043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:48.834506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:48.835301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:48.835737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:48.977458 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4598d219-765e-4c32-b28c-5913135b9d42 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.156539 Jul 14 15:32:48.978073 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3010/6180] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:48 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:49.715509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d47ac34b-053a-4f00-8ad3-18c0cc20b95c req-b2255a52-cf9e-4a32-9a03-0ed6438cc390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bbaea3-32cf-4491-9830-1f48fd28334a", "name": "network-vif-plugged", "status": "completed", "tag": "b337d6cc-f8cd-4a28-9aa0-af8ec99ae5a3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:49.727724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d47ac34b-053a-4f00-8ad3-18c0cc20b95c req-b2255a52-cf9e-4a32-9a03-0ed6438cc390 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:49.728182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d47ac34b-053a-4f00-8ad3-18c0cc20b95c req-b2255a52-cf9e-4a32-9a03-0ed6438cc390 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:49.741923 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d47ac34b-053a-4f00-8ad3-18c0cc20b95c req-b2255a52-cf9e-4a32-9a03-0ed6438cc390 service nova] Creating event network-vif-plugged:b337d6cc-f8cd-4a28-9aa0-af8ec99ae5a3 for instance a1bbaea3-32cf-4491-9830-1f48fd28334a on n-h1-768852-23 Jul 14 15:32:49.747729 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d47ac34b-053a-4f00-8ad3-18c0cc20b95c req-b2255a52-cf9e-4a32-9a03-0ed6438cc390 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036661 Jul 14 15:32:49.748472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3171/6181] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:49.995350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:49.996080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:50.004469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:50.005008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:50.005859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:50.006381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:50.146140 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e585e5c6-fecd-4bdd-8cdf-fe8b2e6805aa tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1466 microversion: 2.1 time: 0.154824 Jul 14 15:32:50.146836 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3011/6182] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:49 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1466 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:51.166047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:51.166753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:51.169116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:51.169999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:51.179513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.180310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.181310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.181752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.322527 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5774d9ef-e418-4826-86e9-f1383542dae9 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1650 microversion: 2.1 time: 0.162510 Jul 14 15:32:51.323244 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3172/6183] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:51 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1650 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:51.339307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:51.340225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:51.342157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:51.348916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.349368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.350156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.350599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.582069 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8932cec1-da16-4a48-9088-9a3b4a4bec30 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1650 microversion: 2.1 time: 0.246495 Jul 14 15:32:51.582689 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3012/6184] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:51 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1650 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:32:51.599129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:51.600216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:51.607551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.608108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.608901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.609337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.744622 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4bd878e-3b6f-4c58-8100-9e0f75e075b6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1650 microversion: 2.1 time: 0.149873 Jul 14 15:32:51.745430 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3173/6185] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:51 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1650 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:51.761511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:51.762321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:51.769498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.769957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.770751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.771428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.797367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:32:51.885674 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a829c2a0-e7c7-4164-aa5f-2bae195b98e8 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "DELETE /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 204 len: 0 microversion: 2.1 time: 0.127827 Jul 14 15:32:51.886617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3013/6186] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:32:51 2022] DELETE /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:32:51.895224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:51.895883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:51.902893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.903381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:51.904162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:51.904598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:52.037004 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c45b487-ec62-4dc0-a318-6d818d76466d tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1656 microversion: 2.1 time: 0.146090 Jul 14 15:32:52.037587 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3174/6187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:51 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1656 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:53.054784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:53.055479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:53.062862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:53.063378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:53.064160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:53.064601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:53.212612 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ab73347-3315-4ebb-a534-81a0319d6bf3 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1656 microversion: 2.1 time: 0.161955 Jul 14 15:32:53.212612 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3014/6188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:53 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:54.001306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d364d087-4876-4392-b7df-578652ee6af9 req-35756e78-3eb3-430c-86a4-f4d404f6ab61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1bbaea3-32cf-4491-9830-1f48fd28334a", "name": "network-vif-deleted", "tag": "b337d6cc-f8cd-4a28-9aa0-af8ec99ae5a3"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:54.011997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d364d087-4876-4392-b7df-578652ee6af9 req-35756e78-3eb3-430c-86a4-f4d404f6ab61 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:54.012442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d364d087-4876-4392-b7df-578652ee6af9 req-35756e78-3eb3-430c-86a4-f4d404f6ab61 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:54.027035 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d364d087-4876-4392-b7df-578652ee6af9 req-35756e78-3eb3-430c-86a4-f4d404f6ab61 service nova] Creating event network-vif-deleted:b337d6cc-f8cd-4a28-9aa0-af8ec99ae5a3 for instance a1bbaea3-32cf-4491-9830-1f48fd28334a on n-h1-768852-23 Jul 14 15:32:54.032327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d364d087-4876-4392-b7df-578652ee6af9 req-35756e78-3eb3-430c-86a4-f4d404f6ab61 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150347 Jul 14 15:32:54.033795 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3175/6189] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:54.229738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:54.230355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:54.238039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:54.238495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:54.239291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:54.239745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:54.273215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:54.273671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:54.274146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lazy-loading 'fault' on Instance uuid a1bbaea3-32cf-4491-9830-1f48fd28334a {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:32:54.277105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:54.325911 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c12c215b-4853-4ddf-92ab-37324e55f82e tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 200 len: 1456 microversion: 2.1 time: 0.100196 Jul 14 15:32:54.326490 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3015/6190] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:54 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 1456 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:55.345019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:55.345694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: a1bbaea3-32cf-4491-9830-1f48fd28334a] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:55.355632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:55.356078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:55.357026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:55.357613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:55.372240 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] HTTP exception thrown: Instance a1bbaea3-32cf-4491-9830-1f48fd28334a could not be found. Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Request method failure captured: Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a HTTP/1.1 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DcMAUZEIOiF2gPSDu5qEPL_dpvi3tABfpqrVumsg1ydFtBj7R40TZwVM_9Bdhp_XJ6PIDTS45Q48JROd85Z8Xw1L44wQyLXZjZVi2BR9Y3RAw3-2kA7X4qmHBt-Dp-7XCRU-8846MnfvFHwlHPSrMb4ndMTXrt5wWb28j_tQUWtdng Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 41ea61afe615407c8558fd6e3d2e3b62 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestServerMultinode-672618587 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestServerMultinode-672618587 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 41ea61afe615407c8558fd6e3d2e3b62 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestServerMultinode-672618587 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestServerMultinode-672618587-project-admin Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ebf6e9548bd64ae0802f6700f434b8b6 Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestServerMultinode-672618587-project-admin Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance a1bbaea3-32cf-4491-9830-1f48fd28334a could not be found. Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'a1bbaea3-32cf-4491-9830-1f48fd28334a'} Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1bbaea3-32cf-4491-9830-1f48fd28334a could not be found. Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1bbaea3-32cf-4491-9830-1f48fd28334a could not be found. Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:32:55.373919 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1bbaea3-32cf-4491-9830-1f48fd28334a could not be found. Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Returning 404 to user: Instance a1bbaea3-32cf-4491-9830-1f48fd28334a could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-74a51cf3-d805-453c-aafd-fe9777bae515 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a" status: 404 len: 111 microversion: 2.1 time: 0.035434 Jul 14 15:32:55.380197 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3176/6191] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:55 2022] GET /compute/v2.1/servers/a1bbaea3-32cf-4491-9830-1f48fd28334a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:32:55.385240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:55.385751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:55.392794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:55.393245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:55.394017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:55.394464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:55.420874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:32:55.499999 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d4984ae-9f22-4e08-97a8-f5afeafa2eda tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "DELETE /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 204 len: 0 microversion: 2.1 time: 0.118359 Jul 14 15:32:55.500723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3016/6192] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:32:55 2022] DELETE /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:32:55.511684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:55.512330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:55.518855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:55.519239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:55.520051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:55.520492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:55.652045 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0f850501-aa15-4888-a6ea-a1f4f1e0d155 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1656 microversion: 2.1 time: 0.144086 Jul 14 15:32:55.652658 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3177/6193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:55 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1656 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:56.671135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:56.671896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:56.679676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:56.680122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:56.680891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:56.681322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:56.811589 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-62850705-366b-407d-aafb-bc353cfaf28c tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1656 microversion: 2.1 time: 0.144680 Jul 14 15:32:56.812182 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3017/6194] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:56 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1656 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:32:57.482762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-47ffd8e4-eda4-4984-b1a7-b70adeba17d1 req-acb028ca-ef56-40d2-a1a7-a3b439c81f18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec", "name": "network-vif-deleted", "tag": "f4be0855-6627-44ef-a84b-0816affe56ec"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:32:57.497278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-47ffd8e4-eda4-4984-b1a7-b70adeba17d1 req-acb028ca-ef56-40d2-a1a7-a3b439c81f18 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:57.497724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-47ffd8e4-eda4-4984-b1a7-b70adeba17d1 req-acb028ca-ef56-40d2-a1a7-a3b439c81f18 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:57.513426 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-47ffd8e4-eda4-4984-b1a7-b70adeba17d1 req-acb028ca-ef56-40d2-a1a7-a3b439c81f18 service nova] Creating event network-vif-deleted:f4be0855-6627-44ef-a84b-0816affe56ec for instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec on n-h2-768852-23 Jul 14 15:32:57.519726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-47ffd8e4-eda4-4984-b1a7-b70adeba17d1 req-acb028ca-ef56-40d2-a1a7-a3b439c81f18 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044282 Jul 14 15:32:57.520209 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3178/6195] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:32:57.829170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:57.829855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:57.837202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:57.837659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:57.838447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:57.838892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:57.878563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:57.878932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:57.879435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lazy-loading 'fault' on Instance uuid 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:32:57.939172 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98d613fd-e4ba-41c6-a2a3-46c75e120fa6 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 200 len: 1455 microversion: 2.1 time: 0.113775 Jul 14 15:32:57.940564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3018/6196] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:57 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 1455 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:32:58.958198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:32:58.958914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] [instance: 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:32:58.960938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:58.967348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:58.967813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:58.968726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:32:58.969045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:32:58.972954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=93 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:32:58.985383 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] HTTP exception thrown: Instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec could not be found. Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Request method failure captured: Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec HTTP/1.1 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DcMAUZEIOiF2gPSDu5qEPL_dpvi3tABfpqrVumsg1ydFtBj7R40TZwVM_9Bdhp_XJ6PIDTS45Q48JROd85Z8Xw1L44wQyLXZjZVi2BR9Y3RAw3-2kA7X4qmHBt-Dp-7XCRU-8846MnfvFHwlHPSrMb4ndMTXrt5wWb28j_tQUWtdng Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 41ea61afe615407c8558fd6e3d2e3b62 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestServerMultinode-672618587 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/41ea61afe615407c8558fd6e3d2e3b62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestServerMultinode-672618587 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 41ea61afe615407c8558fd6e3d2e3b62 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestServerMultinode-672618587 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestServerMultinode-672618587-project-admin Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: ebf6e9548bd64ae0802f6700f434b8b6 Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestServerMultinode-672618587-project-admin Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec could not be found. Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec'} Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec could not be found. Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec could not be found. Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:32:58.987595 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec could not be found. Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] Returning 404 to user: Instance 309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a0960f30-1a7a-4e4d-bcd6-81b782729f26 tempest-TestServerMultinode-672618587 tempest-TestServerMultinode-672618587-project-admin] 10.222.0.98 "GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec" status: 404 len: 111 microversion: 2.1 time: 0.035867 Jul 14 15:32:58.992847 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3179/6197] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:32:58 2022] GET /compute/v2.1/servers/309ae1ca-03d7-4d6b-bf35-c4d6b16e3aec => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:33:20.071941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1333165189", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "898efef4-ff57-48eb-8c90-31fc2cff3823", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:33:20.081048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:20.081719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:20.397543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:33:20.885092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:33:20.885522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:33:20.885998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:33:20.886408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:33:20.886822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:33:20.895950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:20.896393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:20.897185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:20.897614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:20.915352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:33:20.920799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:33:20.987915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:33:20.990020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='898efef4-ff57-48eb-8c90-31fc2cff3823',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:33:21.133588 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a2e5dd85-edac-48c6-a5b4-ccdc64a5d6cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065549 Jul 14 15:33:21.140514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3019/6198] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:33:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:33:21.147636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4bc6e31c-a92e-4f82-9db9-93ca560a99f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:21.148480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4bc6e31c-a92e-4f82-9db9-93ca560a99f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:21.150770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:21.151444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:21.358489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4bc6e31c-a92e-4f82-9db9-93ca560a99f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:21.366209 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4bc6e31c-a92e-4f82-9db9-93ca560a99f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1057 microversion: 2.1 time: 0.223629 Jul 14 15:33:21.367111 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3180/6199] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:21 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1057 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:22.386870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:22.388233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:22.402877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:22.403516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:22.414232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:22.414800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:22.650918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:22.664087 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-feec64d6-96bc-4cab-b17a-8001cbe4b392 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1173 microversion: 2.1 time: 0.283183 Jul 14 15:33:22.666112 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3020/6200] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:22 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1173 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:23.695335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:23.698317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:23.714282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:23.715604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:23.718446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:23.719124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:23.929322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:23.940054 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-629ed6f9-c172-4136-99d1-9e8d2d282871 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1215 microversion: 2.1 time: 0.261460 Jul 14 15:33:23.940556 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3181/6201] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:23 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1215 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:24.249895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-09631830-48f4-4bee-8cdc-188f3835a7c0 req-e3ffb1ad-60f8-406a-a758-88de8da73938 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c353cb-e9ac-4243-b973-6c43ad9201e4", "tag": "1767d74f-ac7d-4d12-855f-c08f8f6ae1a7"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:33:24.272894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09631830-48f4-4bee-8cdc-188f3835a7c0 req-e3ffb1ad-60f8-406a-a758-88de8da73938 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:24.275360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-09631830-48f4-4bee-8cdc-188f3835a7c0 req-e3ffb1ad-60f8-406a-a758-88de8da73938 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:24.294587 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-09631830-48f4-4bee-8cdc-188f3835a7c0 req-e3ffb1ad-60f8-406a-a758-88de8da73938 service nova] Creating event network-changed:1767d74f-ac7d-4d12-855f-c08f8f6ae1a7 for instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 on n-h1-768852-23 Jul 14 15:33:24.307693 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-09631830-48f4-4bee-8cdc-188f3835a7c0 req-e3ffb1ad-60f8-406a-a758-88de8da73938 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063573 Jul 14 15:33:24.308397 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3021/6202] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:33:24.958561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:24.959348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:24.970717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:24.971573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:24.973316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:24.973840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:25.137790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:25.148591 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef0209ed-c4f2-4e53-ac12-8efbb1bb1f8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1215 microversion: 2.1 time: 0.194369 Jul 14 15:33:25.149291 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3182/6203] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:24 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1215 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:26.167722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:26.168431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:26.175890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:26.176345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:26.177122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:26.177560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:26.316932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:26.325340 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-30cc8ca8-0c7b-449f-a573-6e9048b7adf3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1215 microversion: 2.1 time: 0.163002 Jul 14 15:33:26.326038 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3022/6204] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:26 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:27.342004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:27.342733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:27.350125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:27.350580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:27.351393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:27.351831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:27.493354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:27.501895 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0933ac95-46e0-4540-8756-fae5b021d65c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1215 microversion: 2.1 time: 0.163730 Jul 14 15:33:27.502492 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3183/6205] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:27 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:28.519235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:28.519882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:28.526790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:28.527249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:28.528049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:28.528494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:28.656967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:28.664878 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d12d4948-a93a-4dc2-89c2-f2eff7d77124 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.150131 Jul 14 15:33:28.665458 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3023/6206] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:28 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:29.682133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:29.682781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:29.689825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:29.690282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:29.691047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:29.691522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:29.820210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:29.828120 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73dc28aa-0205-46ff-b46d-84b6f8a956f3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.149611 Jul 14 15:33:29.829209 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3184/6207] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:29 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:30.846376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:30.846939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:30.853501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:30.853946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:30.854740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:30.855179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:30.905593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:30.929415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:30.991749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:30.999296 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-107eea52-06e9-4d94-b428-2abdda64f73d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.157972 Jul 14 15:33:30.999876 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3024/6208] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:30 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:32.016716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:32.017352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:32.020294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:33:32.026203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:32.026657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:32.027497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:32.027937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:32.168676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:32.176605 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7cf4de7-be59-4509-b0c7-61f4a964f411 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.164282 Jul 14 15:33:32.177217 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3185/6209] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:32 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:33.192392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:33.193026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:33.200137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:33.200592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:33.201356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:33.201797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:33.334417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:33.342076 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-46e622fb-009a-4c5b-9d81-a0d6675068a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.153658 Jul 14 15:33:33.342652 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3025/6210] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:33 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:34.359159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:34.359807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:34.366705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:34.367147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:34.367932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:34.368362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:34.501830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:34.509376 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c1479fd-f11c-4135-bce0-3f1d70d761bf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.154130 Jul 14 15:33:34.509961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3186/6211] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:34 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:35.526493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:35.527101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:35.534004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:35.534456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:35.535223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:35.535689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:35.672898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:35.680630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-602ba77d-60d7-467b-b9e0-5c1b7d6ed08e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.158087 Jul 14 15:33:35.681209 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3026/6212] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:35 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:36.697996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:36.698639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:36.706179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:36.706625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:36.707420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:36.707854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:36.834245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:36.841626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a90444e8-7b3e-4a93-a5c2-6ed84a1aa8c1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.147532 Jul 14 15:33:36.842197 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3187/6213] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:36 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:37.857916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:37.858535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:37.865635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:37.866088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:37.866859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:37.867351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:37.978932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-9e31bf01-6fd2-4ee4-accf-c429054205af req-33411440-f4d1-454a-9309-21b1c68fdbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c353cb-e9ac-4243-b973-6c43ad9201e4", "name": "network-vif-plugged", "status": "completed", "tag": "1767d74f-ac7d-4d12-855f-c08f8f6ae1a7"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:33:37.987563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e31bf01-6fd2-4ee4-accf-c429054205af req-33411440-f4d1-454a-9309-21b1c68fdbee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:37.988006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-9e31bf01-6fd2-4ee4-accf-c429054205af req-33411440-f4d1-454a-9309-21b1c68fdbee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:38.002777 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-9e31bf01-6fd2-4ee4-accf-c429054205af req-33411440-f4d1-454a-9309-21b1c68fdbee service nova] Creating event network-vif-plugged:1767d74f-ac7d-4d12-855f-c08f8f6ae1a7 for instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 on n-h1-768852-23 Jul 14 15:33:38.007923 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-9e31bf01-6fd2-4ee4-accf-c429054205af req-33411440-f4d1-454a-9309-21b1c68fdbee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115693 Jul 14 15:33:38.008544 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3188/6214] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:33:38.009681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:38.018125 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1237b97b-a98f-4f91-a346-1d2233341937 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.164011 Jul 14 15:33:38.018701 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3027/6215] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:37 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:39.035998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:39.036698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:39.043221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:39.043695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:39.044472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:39.044891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:39.180667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:39.188452 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac6c6416-f335-4606-bb1a-95550e3be326 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1203 microversion: 2.1 time: 0.158126 Jul 14 15:33:39.189039 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3189/6216] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:39 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:40.207295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:40.208240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:40.215343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.215738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.216572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.217006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.353968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:40.361952 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-17ded7aa-d3e9-4fc6-bdf8-3784e2ffcdfe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1390 microversion: 2.1 time: 0.160041 Jul 14 15:33:40.362548 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3028/6217] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:40 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1390 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:40.377868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:40.378479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:40.385554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.386002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.386768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.387203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.521023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:40.528739 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f805c8e1-44cd-4627-8cb6-ac8b8d3d5c07 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1390 microversion: 2.1 time: 0.154704 Jul 14 15:33:40.529324 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3190/6218] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:40 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:40.544585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:40.545224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:40.551411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.551864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.552627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.553066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.696914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:40.705584 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6910b404-a704-4f7d-850a-03ae6a3d6c52 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1390 microversion: 2.1 time: 0.165095 Jul 14 15:33:40.706197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3029/6219] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:40 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:40.721733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:40.722147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:40.728575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.729024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.729804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.730242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.757240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:33:40.842192 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-80441ff3-c7c7-4ee2-b107-43ee6fd8b149 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 204 len: 0 microversion: 2.1 time: 0.123913 Jul 14 15:33:40.843110 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3191/6220] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:33:40 2022] DELETE /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:33:40.852628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:40.853274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:40.861071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.861530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:40.862314 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:40.862752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:41.007443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:41.015321 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c492c56-6d9b-4a7c-ba80-912d165a4718 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1396 microversion: 2.1 time: 0.166604 Jul 14 15:33:41.015977 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3030/6221] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:40 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1396 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:42.032542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:42.033242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:42.040154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:42.040594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:42.041348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:42.042034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:42.174492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:42.182525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05adcf05-5f32-4ed3-b1c1-675735ea42e9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1396 microversion: 2.1 time: 0.154379 Jul 14 15:33:42.183112 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3192/6222] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:42 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1396 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:43.014900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-53a817b1-7f13-45af-99b0-7a0797a7b06d req-8e6194d6-1b39-417e-bacc-579ae8ea2ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c353cb-e9ac-4243-b973-6c43ad9201e4", "name": "network-vif-deleted", "tag": "1767d74f-ac7d-4d12-855f-c08f8f6ae1a7"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:33:43.026928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-53a817b1-7f13-45af-99b0-7a0797a7b06d req-8e6194d6-1b39-417e-bacc-579ae8ea2ff7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:43.028021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-53a817b1-7f13-45af-99b0-7a0797a7b06d req-8e6194d6-1b39-417e-bacc-579ae8ea2ff7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:43.043558 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-53a817b1-7f13-45af-99b0-7a0797a7b06d req-8e6194d6-1b39-417e-bacc-579ae8ea2ff7 service nova] Creating event network-vif-deleted:1767d74f-ac7d-4d12-855f-c08f8f6ae1a7 for instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 on n-h1-768852-23 Jul 14 15:33:43.050865 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-53a817b1-7f13-45af-99b0-7a0797a7b06d req-8e6194d6-1b39-417e-bacc-579ae8ea2ff7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039612 Jul 14 15:33:43.051525 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3031/6223] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:33:43.200500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:43.201246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:43.208833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:43.209372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:43.210171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:43.210601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:43.282709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:43.290903 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ce809ea1-b8f5-4741-addc-5f048640ed05 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1188 microversion: 2.1 time: 0.094277 Jul 14 15:33:43.291787 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3193/6224] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:43 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:44.308618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:44.309319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:44.316582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:44.317032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:44.318210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:44.318647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:44.384326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:44.392450 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5160ee3a-574d-4da0-87df-9a25e97af93d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1188 microversion: 2.1 time: 0.088049 Jul 14 15:33:44.393044 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3032/6225] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:44 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:45.409415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:45.410032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:45.417368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:45.417827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:45.418636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:45.419070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:45.482978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:45.491784 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7f8a5e46-0a18-4748-9024-ddc77c1148bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1188 microversion: 2.1 time: 0.086361 Jul 14 15:33:45.492394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3194/6226] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:45 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:46.509964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:46.510757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:46.519212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:46.519689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:46.520513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:46.520952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:46.587747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:46.598538 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-09eb9b55-63fc-446d-a246-6e188f8a4efb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1188 microversion: 2.1 time: 0.092577 Jul 14 15:33:46.599131 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3033/6227] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:46 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1188 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:33:47.615397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:47.616015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:47.622724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:47.623175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:47.623972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:47.624412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:47.659501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:47.659951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:47.660400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lazy-loading 'fault' on Instance uuid 90c353cb-e9ac-4243-b973-6c43ad9201e4 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:33:47.701578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:33:47.709378 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f46d0514-c2d0-4481-a3d1-483ce78a35b3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 200 len: 1193 microversion: 2.1 time: 0.097919 Jul 14 15:33:47.709961 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3195/6228] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:47 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 1193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:33:48.725598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:33:48.726194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 90c353cb-e9ac-4243-b973-6c43ad9201e4] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:33:48.733146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:48.733611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:48.734993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:33:48.735454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:33:48.749309 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 could not be found. Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 HTTP/1.1 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 could not be found. Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '90c353cb-e9ac-4243-b973-6c43ad9201e4'} Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 could not be found. Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 could not be found. Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:33:48.750922 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 could not be found. Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 90c353cb-e9ac-4243-b973-6c43ad9201e4 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4007c2dd-0744-4483-ab9a-4ed1bf36c79a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4" status: 404 len: 111 microversion: 2.1 time: 0.030749 Jul 14 15:33:48.759182 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3034/6229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:33:48 2022] GET /compute/v2.1/servers/90c353cb-e9ac-4243-b973-6c43ad9201e4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:34:09.619110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-135097410", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "3136ade4-dfca-44c4-8409-904d42457574", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:09.628017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:09.628683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:09.711580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:34:10.072751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:34:10.073108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:34:10.073579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:34:10.073984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:34:10.074392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:34:10.083826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:10.084421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:10.085343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:10.085778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:10.103476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:34:10.109198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:34:10.121690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:34:10.123737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='3136ade4-dfca-44c4-8409-904d42457574',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:34:10.198582 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-feecbf71-d326-427c-8180-c070578b71a3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.583272 Jul 14 15:34:10.199445 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3196/6230] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:34:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:34:10.215589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7cf3d21b-638e-4ed8-a079-a098c7f9bb8f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:10.216460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7cf3d21b-638e-4ed8-a079-a098c7f9bb8f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:10.219668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:10.220322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=80 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:10.284985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7cf3d21b-638e-4ed8-a079-a098c7f9bb8f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:10.292335 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7cf3d21b-638e-4ed8-a079-a098c7f9bb8f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1056 microversion: 2.1 time: 0.082673 Jul 14 15:34:10.292917 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3035/6231] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:10 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1056 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:11.311051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:11.312247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:11.318571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:11.319350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:11.320424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:11.320867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:11.388350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:11.398171 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4672313f-854a-4204-90b4-13c37210adb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1126 microversion: 2.1 time: 0.092101 Jul 14 15:34:11.403317 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3197/6232] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:11 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1126 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:12.414926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:12.415758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:12.424889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:12.425935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:12.426768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:12.427213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:12.617495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:12.627461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fa432d7-bbe9-4d2d-a6f4-7eb5c0c333c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.216556 Jul 14 15:34:12.637434 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3036/6233] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:12 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:12.943409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-54a183b0-360e-4d9b-b00e-7b17fc97e309 req-4fc0b424-512c-4646-8c59-6d824c61d705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6becd4f2-7f41-48c0-9565-2d6705546d2b", "tag": "ed46cdf7-de52-4b9d-925f-fee4bbdf1238"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:12.956321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-54a183b0-360e-4d9b-b00e-7b17fc97e309 req-4fc0b424-512c-4646-8c59-6d824c61d705 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:12.957097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-54a183b0-360e-4d9b-b00e-7b17fc97e309 req-4fc0b424-512c-4646-8c59-6d824c61d705 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:12.978087 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-54a183b0-360e-4d9b-b00e-7b17fc97e309 req-4fc0b424-512c-4646-8c59-6d824c61d705 service nova] Creating event network-changed:ed46cdf7-de52-4b9d-925f-fee4bbdf1238 for instance 6becd4f2-7f41-48c0-9565-2d6705546d2b on n-h1-768852-23 Jul 14 15:34:12.984722 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-54a183b0-360e-4d9b-b00e-7b17fc97e309 req-4fc0b424-512c-4646-8c59-6d824c61d705 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119785 Jul 14 15:34:12.986068 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3198/6234] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:13.645141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:13.645916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:13.655353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:13.655960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:13.656755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:13.657203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:13.874715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:13.883779 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-147d23fb-fcd5-4c32-8ec7-00319a7407e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.243543 Jul 14 15:34:13.884390 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3037/6235] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:13 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:14.903263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:14.906137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:14.913302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:14.913781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:14.914675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:14.915127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:15.082369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:15.094569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-711dda3c-7188-4e9d-9921-3141c600d743 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.196498 Jul 14 15:34:15.096768 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3199/6236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:14 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:16.120132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:16.121181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:16.135241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:16.136615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:16.138413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:16.138718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:16.358013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:16.367938 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26183dd9-837e-46ec-978a-401b7d5c4438 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.254106 Jul 14 15:34:16.368535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3038/6237] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:16 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:17.387028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:17.387801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:17.394750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:17.395203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:17.395998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:17.396444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:17.574294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:17.582846 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9742524b-92a0-402d-b810-24dad5ecf18f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.199656 Jul 14 15:34:17.583681 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3200/6238] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:17 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:18.602125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:18.602965 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:18.611585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:18.612105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:18.612891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:18.613337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:18.784702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:18.793058 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d3e1ab2-d02b-49e5-b18b-71bb79bd410e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.194870 Jul 14 15:34:18.804537 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3039/6239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:18 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:19.810433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:19.810988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:19.819755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:19.820196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:19.820956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:19.821384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:19.954770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:19.963210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a41c15c9-dccc-4b05-87fe-991b5305f46b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.157063 Jul 14 15:34:19.963896 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3201/6240] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:19 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:20.979962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:20.980799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:20.983293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:20.988947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:20.989334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:20.990129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:20.990549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:21.412876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:21.421611 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a090a710-e4c1-4f03-a41e-e3b0b832d71d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.445516 Jul 14 15:34:21.422197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3040/6241] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:20 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:22.439256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:22.439845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:22.441806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:22.442487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:22.449085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:22.449534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:22.450303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:22.450738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:22.590491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:22.598880 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c9e35ba-9d1c-4b2f-8177-6798453893c2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.164096 Jul 14 15:34:22.599665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3202/6242] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:22 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:23.616448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:23.617255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:23.626860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:23.627794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:23.629483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:23.630147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:23.764977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:23.772963 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af8fc941-7ace-4bd6-9850-c5f3048f1f04 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.160824 Jul 14 15:34:23.773552 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3041/6243] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:23 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:24.789837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:24.790486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:24.797780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:24.798232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:24.798997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:24.799464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:24.935125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:24.943428 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84785335-c3f6-4283-871d-31c64a48c0dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1168 microversion: 2.1 time: 0.157440 Jul 14 15:34:24.944033 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3203/6244] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:24 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:25.960906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:25.961644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:25.969642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:25.970191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:25.971130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:25.971872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:26.108900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:26.116654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f71a1d33-36ca-47b8-976b-07d5d89689fa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.159646 Jul 14 15:34:26.117309 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3042/6245] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:25 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:27.133866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:27.134487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:27.141492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:27.141946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:27.143401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:27.143848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:27.597489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:27.605183 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44fbea94-c9e4-4fef-a20b-8f1df053f384 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.475474 Jul 14 15:34:27.605779 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3204/6246] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:27 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:28.622570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:28.623141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:28.630068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:28.630521 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:28.631307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:28.631756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:28.762993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:28.771006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d9061e3-2109-4cf7-9cca-4f4c479dfa4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.152465 Jul 14 15:34:28.771614 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3043/6247] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:28 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:34:29.788264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:29.788855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:29.796183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:29.797132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:29.797885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:29.798317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:29.927961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:29.935427 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb8179ab-5dc9-4816-a432-982e6616133f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.150956 Jul 14 15:34:29.936009 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3205/6248] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:29 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:30.951944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:30.952570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:30.959976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:30.960421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:30.961187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:30.961621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:31.097024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:31.104945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c2b53897-4688-4892-9fa4-0ec497752aaa tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.156773 Jul 14 15:34:31.105554 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3044/6249] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:30 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:32.123325 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:32.123962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:32.131360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:32.131813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:32.132571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:32.133003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:32.281894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:32.289712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c49c937e-54b1-42d3-91cd-2afb97686b29 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.170789 Jul 14 15:34:32.290302 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3206/6250] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:32 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:33.306016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:33.306642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:33.313530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:33.313986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:33.314757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:33.315201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:33.450120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:33.458203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-58a0180b-906d-4257-b979-36d24af9d659 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.156147 Jul 14 15:34:33.458784 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3045/6251] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:33 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:34.475772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:34.476476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:34.485023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:34.486207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:34.487374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:34.487815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:34.622320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:34.630008 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-251ca91e-9360-4b48-a287-4732e9c28538 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.158081 Jul 14 15:34:34.630592 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3207/6252] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:34 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:35.646598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:35.647202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:35.654257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:35.654716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:35.655507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:35.655947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:35.784457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:35.792272 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57f28963-94be-4dfe-ae47-a8c69927fcdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.149616 Jul 14 15:34:35.792846 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3046/6253] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:35 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:36.276875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7e8767a2-ac7f-43d1-b2c3-50fff5bdc49e req-5e4c8573-0a0e-4621-a964-91b041ac0cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6becd4f2-7f41-48c0-9565-2d6705546d2b", "name": "network-vif-plugged", "status": "completed", "tag": "ed46cdf7-de52-4b9d-925f-fee4bbdf1238"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:36.285608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7e8767a2-ac7f-43d1-b2c3-50fff5bdc49e req-5e4c8573-0a0e-4621-a964-91b041ac0cec service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:36.286049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7e8767a2-ac7f-43d1-b2c3-50fff5bdc49e req-5e4c8573-0a0e-4621-a964-91b041ac0cec service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:36.297339 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7e8767a2-ac7f-43d1-b2c3-50fff5bdc49e req-5e4c8573-0a0e-4621-a964-91b041ac0cec service nova] Creating event network-vif-plugged:ed46cdf7-de52-4b9d-925f-fee4bbdf1238 for instance 6becd4f2-7f41-48c0-9565-2d6705546d2b on n-h1-768852-23 Jul 14 15:34:36.302445 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7e8767a2-ac7f-43d1-b2c3-50fff5bdc49e req-5e4c8573-0a0e-4621-a964-91b041ac0cec service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080116 Jul 14 15:34:36.303081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3208/6254] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:36.809575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:36.810171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:36.817174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:36.817623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:36.818488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:36.818920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:36.946921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:36.955089 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7ef9ef2e-8559-479c-b299-95408b84b8e2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1202 microversion: 2.1 time: 0.149381 Jul 14 15:34:36.955704 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3047/6255] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:36 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:37.972872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:37.973756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:37.980865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:37.981316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:37.982087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:37.982521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.118632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:38.129209 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7dfb38a7-21dd-4533-aade-14491b5c034e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1389 microversion: 2.1 time: 0.161177 Jul 14 15:34:38.129850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3209/6256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:37 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:38.145566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:38.146201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:38.153170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.153620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.154393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.154829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.284995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:38.292796 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4d8ca7a-f346-45a5-b11b-3de7fa02a11f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1389 microversion: 2.1 time: 0.151076 Jul 14 15:34:38.293364 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3048/6257] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:38 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1389 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:38.308237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:38.308854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:38.315479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.315932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.316701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.317143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.446312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:38.454447 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f838cd6d-38c3-45d5-bb1b-764a2d3cc8f9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1389 microversion: 2.1 time: 0.150161 Jul 14 15:34:38.455386 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3210/6258] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:38 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1389 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:38.523849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:38.524342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:38.530910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.531395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.532160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.532596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.567374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:34:38.649578 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2af131f-f9a6-4bcc-912d-3fe7e420b274 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 204 len: 0 microversion: 2.1 time: 0.129004 Jul 14 15:34:38.650220 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3049/6259] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:34:38 2022] DELETE /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:34:38.659134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:38.659777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:38.666219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.666669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.667499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:38.667937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:38.810692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:38.820387 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c27ccd21-0633-4304-9e21-ec01da7fe90d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1395 microversion: 2.1 time: 0.165203 Jul 14 15:34:38.820990 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3211/6260] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:38 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1395 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:34:39.837990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:39.838695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:39.845752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:39.846205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:39.846989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:39.847461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:39.996037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:40.000208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:40.005748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c319caf3-527a-40d2-852e-87ae080d4978 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1395 microversion: 2.1 time: 0.171932 Jul 14 15:34:40.006337 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3050/6261] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:39 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1395 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:40.903610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6830f742-c27c-4261-865a-9a34c6dbe773 req-e50027dd-b67e-49cc-8ba3-c94403e7fd50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6becd4f2-7f41-48c0-9565-2d6705546d2b", "name": "network-vif-deleted", "tag": "ed46cdf7-de52-4b9d-925f-fee4bbdf1238"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:34:40.910523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:40.915444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6830f742-c27c-4261-865a-9a34c6dbe773 req-e50027dd-b67e-49cc-8ba3-c94403e7fd50 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:40.916154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6830f742-c27c-4261-865a-9a34c6dbe773 req-e50027dd-b67e-49cc-8ba3-c94403e7fd50 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:40.919423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=85 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:40.930847 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6830f742-c27c-4261-865a-9a34c6dbe773 req-e50027dd-b67e-49cc-8ba3-c94403e7fd50 service nova] Creating event network-vif-deleted:ed46cdf7-de52-4b9d-925f-fee4bbdf1238 for instance 6becd4f2-7f41-48c0-9565-2d6705546d2b on n-h1-768852-23 Jul 14 15:34:40.936418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6830f742-c27c-4261-865a-9a34c6dbe773 req-e50027dd-b67e-49cc-8ba3-c94403e7fd50 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036533 Jul 14 15:34:40.937077 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3212/6262] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:41.023320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:41.024018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:41.027259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:41.041043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:41.041506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:41.042309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:41.042754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:41.116752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:41.125472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5206395-5023-4ee4-8bdf-e87d0265f2af tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1187 microversion: 2.1 time: 0.106333 Jul 14 15:34:41.126199 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3051/6263] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:41 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1187 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:42.144224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:42.144845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:42.151423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:42.151878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:42.152661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:42.153100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:42.224411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:42.232647 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-88ded4b9-5120-41fb-b998-99a80fd1c7d7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1187 microversion: 2.1 time: 0.094190 Jul 14 15:34:42.233259 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3213/6264] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:42 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1187 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:43.250973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:43.251616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:43.258824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:43.259427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:43.260337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:43.261044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:43.335665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:43.344188 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6c497e64-ace2-4aae-aeb7-81f885fbfede tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1187 microversion: 2.1 time: 0.096461 Jul 14 15:34:43.349755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3052/6265] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:43 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1187 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:44.360949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:44.361566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:44.368097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:44.368516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:44.369281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:44.369716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:44.433364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:44.441974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-054b6cf0-0317-4993-9aa2-247d148ee2ae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1187 microversion: 2.1 time: 0.085046 Jul 14 15:34:44.442684 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3214/6266] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:44 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:45.458576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:45.459199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:45.466256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:45.466708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:45.467504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:45.467950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:45.499517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:45.499973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:45.500435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lazy-loading 'fault' on Instance uuid 6becd4f2-7f41-48c0-9565-2d6705546d2b {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:34:45.542173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:34:45.550077 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f63244cb-eef4-4763-9576-f5be99eb18d1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 200 len: 1192 microversion: 2.1 time: 0.095344 Jul 14 15:34:45.551755 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3053/6267] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:45 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 1192 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:46.566638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:46.567259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:46.574419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.574870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:46.575677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:46.576116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:46.590807 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b HTTP/1.1 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6becd4f2-7f41-48c0-9565-2d6705546d2b'} Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:46.592569 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0dec62be-14b2-417d-b879-d2b77cf25503 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 404 len: 111 microversion: 2.1 time: 0.031969 Jul 14 15:34:46.597472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3215/6268] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:46 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:34:48.742876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:48.743773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:48.752756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:48.753343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:48.754175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:48.754642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:48.769954 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b HTTP/1.1 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6becd4f2-7f41-48c0-9565-2d6705546d2b'} Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:34:48.771751 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-29413890-75e8-4e05-b9a4-97483b5e0c28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 404 len: 111 microversion: 2.1 time: 0.037174 Jul 14 15:34:48.778136 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3054/6269] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:34:48 2022] DELETE /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:34:48.787587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:48.788787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 6becd4f2-7f41-48c0-9565-2d6705546d2b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:34:48.801114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:48.801574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:48.802356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:48.802796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:48.817095 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b HTTP/1.1 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '6becd4f2-7f41-48c0-9565-2d6705546d2b'} Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:34:48.818674 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 6becd4f2-7f41-48c0-9565-2d6705546d2b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-817dbcc0-6d68-433b-8871-ff52ac1f695d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b" status: 404 len: 111 microversion: 2.1 time: 0.037541 Jul 14 15:34:48.823255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3216/6270] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:34:48 2022] GET /compute/v2.1/servers/6becd4f2-7f41-48c0-9565-2d6705546d2b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:35:09.641096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1841185227", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dcb4812f-e4c4-4ff2-95f0-a2aa00d3ab61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:09.649265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=9 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:09.649953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=22 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:09.705478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:35:10.076239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:35:10.076650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:35:10.077706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:35:10.078123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:35:10.078531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:35:10.091026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:10.091509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:10.092316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:10.092754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:10.112055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:35:10.117354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:35:10.175810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:35:10.177935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dcb4812f-e4c4-4ff2-95f0-a2aa00d3ab61',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:35:10.305290 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d9a1a7b-ff03-4548-91f6-f53865cd3c0c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668902 Jul 14 15:35:10.305944 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3055/6271] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:35:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:35:10.316462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e2a05142-b0da-4993-92b8-e74a372e270d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:10.317210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e2a05142-b0da-4993-92b8-e74a372e270d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:10.320331 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=9 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:10.321025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=17 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:10.378817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e2a05142-b0da-4993-92b8-e74a372e270d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:10.388098 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e2a05142-b0da-4993-92b8-e74a372e270d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1071 microversion: 2.1 time: 0.075509 Jul 14 15:35:10.388689 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3217/6272] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:10 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1071 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:10.811305 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:35:10.811852 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:35:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:35:11.407980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:11.408651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:11.414999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:11.415743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:11.416529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:11.416977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:11.520941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:11.528983 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a0d9c25-4527-4e10-b475-762bd8202b11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1177 microversion: 2.1 time: 0.127018 Jul 14 15:35:11.529588 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3056/6273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:11 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1177 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:12.547081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:12.547944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:12.555461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:12.556001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:12.556883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:12.557490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:12.724207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:12.744204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3af29177-904f-4192-a437-80e5cb2b01ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1229 microversion: 2.1 time: 0.201580 Jul 14 15:35:12.756012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3218/6274] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:12 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1229 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:12.906651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0ea42536-3f49-4126-adf1-45cfd51d17f4 req-41314970-3687-4444-83b7-b978d97fa49a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbdd834b-f2e6-4162-9e27-59b481c571d0", "tag": "8a1b9925-54e3-489c-a6de-891da0b069a0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:12.928251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0ea42536-3f49-4126-adf1-45cfd51d17f4 req-41314970-3687-4444-83b7-b978d97fa49a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:12.928695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0ea42536-3f49-4126-adf1-45cfd51d17f4 req-41314970-3687-4444-83b7-b978d97fa49a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:12.957534 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0ea42536-3f49-4126-adf1-45cfd51d17f4 req-41314970-3687-4444-83b7-b978d97fa49a service nova] Creating event network-changed:8a1b9925-54e3-489c-a6de-891da0b069a0 for instance dbdd834b-f2e6-4162-9e27-59b481c571d0 on n-h1-768852-23 Jul 14 15:35:12.965272 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0ea42536-3f49-4126-adf1-45cfd51d17f4 req-41314970-3687-4444-83b7-b978d97fa49a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063729 Jul 14 15:35:12.965844 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3057/6275] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:13.762211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:13.763470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:13.770554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:13.771008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:13.772019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:13.772470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:13.918686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:13.927556 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5466444-fcb9-43f2-ac66-676f3e32abeb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1229 microversion: 2.1 time: 0.168903 Jul 14 15:35:13.928262 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3219/6276] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:13 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:14.945873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:14.946702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:14.954063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:14.954507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:14.955293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:14.955738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:15.096731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:15.105295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7aa6b10-7f9f-4f5a-a7a4-f7e659f13fbe tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1229 microversion: 2.1 time: 0.164568 Jul 14 15:35:15.105894 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3058/6277] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:14 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1229 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:16.126696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:16.127451 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:16.134892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:16.135369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:16.136155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:16.136590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:16.281229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:16.289854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9355a3c0-7bec-47fc-af7f-ada242b89eb3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1229 microversion: 2.1 time: 0.167989 Jul 14 15:35:16.290731 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3220/6278] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:16 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1229 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:17.307588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:17.308197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:17.314996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:17.315477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:17.316229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:17.316658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:17.450544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:17.458187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60b50fbb-671f-4384-af59-5bbe11a79a68 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.154480 Jul 14 15:35:17.458779 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3059/6279] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:17 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:18.475855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:18.476413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:18.482957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:18.483443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:18.484199 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:18.484634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:18.623128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:18.631443 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a02a8b09-fefc-4d8a-89fa-d32c8dccfb25 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.159570 Jul 14 15:35:18.632025 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3221/6280] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:18 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:19.648020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:19.648630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:19.655895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:19.656341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:19.657106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:19.657540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:19.788381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:19.796553 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78ca881b-017f-4f69-b3bd-bb233eb0ad85 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.152529 Jul 14 15:35:19.797126 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3060/6281] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:19 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:20.813349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:20.814700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:20.817365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:20.823038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:20.823515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:20.824280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:20.824713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:20.952801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:20.960452 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9dc1e17f-d516-4dd7-b2ac-98aaca7c6823 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.151099 Jul 14 15:35:20.961051 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3222/6282] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:20 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:21.977444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:21.978058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:21.980053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:21.980857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:21.988603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:21.989048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:21.989807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:21.990244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:22.127101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:22.135171 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-23461895-0925-4a91-9291-049954e47390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.161479 Jul 14 15:35:22.135829 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3061/6283] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:21 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:23.151521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:23.152143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:23.159115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:23.159598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:23.160368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:23.160808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:23.295695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:23.303156 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02426542-33de-4b8f-964d-99d8bf22150a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.155657 Jul 14 15:35:23.303767 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3223/6284] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:23 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:24.321037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:24.321635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:24.329373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:24.329820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:24.330580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:24.331014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:24.461153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:24.468961 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5f3adbec-c4a4-4db0-8f56-4a85e1c739c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.152027 Jul 14 15:35:24.469636 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3062/6285] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:24 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:25.486493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:25.487172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:25.493915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:25.494359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:25.495112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:25.495640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:25.628934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:25.636451 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16f41807-67b3-4989-ab06-775664c0154a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.154693 Jul 14 15:35:25.637027 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3224/6286] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:25 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:26.477367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7db322d0-c224-422d-9415-81c5323770f2 req-ad2a74e9-fd0c-4aa9-ae51-3ad64b89b5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdd834b-f2e6-4162-9e27-59b481c571d0", "name": "network-vif-plugged", "status": "completed", "tag": "8a1b9925-54e3-489c-a6de-891da0b069a0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:26.487445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7db322d0-c224-422d-9415-81c5323770f2 req-ad2a74e9-fd0c-4aa9-ae51-3ad64b89b5bd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:26.487898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7db322d0-c224-422d-9415-81c5323770f2 req-ad2a74e9-fd0c-4aa9-ae51-3ad64b89b5bd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:26.499199 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7db322d0-c224-422d-9415-81c5323770f2 req-ad2a74e9-fd0c-4aa9-ae51-3ad64b89b5bd service nova] Creating event network-vif-plugged:8a1b9925-54e3-489c-a6de-891da0b069a0 for instance dbdd834b-f2e6-4162-9e27-59b481c571d0 on n-h1-768852-23 Jul 14 15:35:26.504795 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7db322d0-c224-422d-9415-81c5323770f2 req-ad2a74e9-fd0c-4aa9-ae51-3ad64b89b5bd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031630 Jul 14 15:35:26.505399 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3063/6287] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:35:26.653028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:26.653637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:26.660619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:26.661068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:26.661829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:26.662261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:26.792364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:26.800497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b35107c1-e8f3-4719-a7b6-978641ca217a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1217 microversion: 2.1 time: 0.151303 Jul 14 15:35:26.801086 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3225/6288] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:26 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:27.819749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:27.820465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:27.827383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:27.827831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:27.828614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:27.829047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:27.969096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:27.976830 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e06446de-d947-4994-a439-39fbe8e4fd6a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1404 microversion: 2.1 time: 0.162208 Jul 14 15:35:27.977418 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3064/6289] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:27 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1404 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:27.992974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:27.993590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:28.000502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:28.000950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:28.002375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:28.002901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:28.137212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:28.145022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a81e101e-f117-44d8-ade1-c3d04e7aed79 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1404 microversion: 2.1 time: 0.155915 Jul 14 15:35:28.145609 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3226/6290] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:27 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1404 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:35:28.161024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1163951413"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:28.162051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:28.168713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:28.169243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:28.169941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:28.170382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:28.267487 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Attempting to quiesce instance before volume snapshot. Jul 14 15:35:28.339218 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Jul 14 15:35:28.413544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Creating snapshot from volume dcb4812f-e4c4-4ff2-95f0-a2aa00d3ab61. {{(pid=125966) snapshot_instance /opt/stack/nova/nova/compute/api.py:3454}} Jul 14 15:35:29.380235 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d843cfa-aea8-40ae-99c4-f718e2033f11 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0/action" status: 202 len: 0 microversion: 2.1 time: 1.223131 Jul 14 15:35:29.381053 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3065/6291] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:35:28 2022] POST /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0/action => generated 0 bytes in 1225 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 15:35:30.530998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-536958154", "imageRef": "6925ecc9-1e29-46b5-bc74-01a68cf6fc50", "flavorRef": "452", "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:30.586530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:35:31.049573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:35:31.049991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:35:31.050458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:35:31.050862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:35:31.051287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:35:31.060786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:31.061226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:31.062012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:31.062444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:31.082321 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:35:31.087657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:35:31.100617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:35:31.103152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='e43f42ab-f8cd-4420-9071-5ef998fa84d0',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:35:31.179642 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15196a67-2aec-471a-9cdc-da15e258dded tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652320 Jul 14 15:35:31.185667 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3227/6292] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:35:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:35:31.193503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfffef8f-29c6-4d52-bba6-6b7c0d7331d3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:31.194217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfffef8f-29c6-4d52-bba6-6b7c0d7331d3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:31.248797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dfffef8f-29c6-4d52-bba6-6b7c0d7331d3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:31.256364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfffef8f-29c6-4d52-bba6-6b7c0d7331d3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1229 microversion: 2.1 time: 0.068892 Jul 14 15:35:31.257153 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3066/6293] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:31 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1229 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:32.274715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:32.276414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:32.282987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:32.283565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:32.284351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:32.284797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:32.360445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:32.368134 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e4d3fec-4886-4930-b946-7b4d828d7a0a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1299 microversion: 2.1 time: 0.098481 Jul 14 15:35:32.368716 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3228/6294] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:32 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:33.385921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:33.386738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:33.395487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:33.396277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:33.397366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:33.398064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:33.543500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:33.555384 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ca8a859f-7ce6-4696-991a-5e8938c3ab54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.173161 Jul 14 15:35:33.555993 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3067/6295] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:33 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:33.971391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-2cb91000-b0f1-40ab-b04f-e0f9cd685b53 req-2ccdede9-c528-4fa2-a7cf-500ce01b4e3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e0e609-c521-4eab-b2d1-3a63570bd3b2", "tag": "92a1113d-4ef9-434b-9f89-250b013d33ee"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:33.982053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2cb91000-b0f1-40ab-b04f-e0f9cd685b53 req-2ccdede9-c528-4fa2-a7cf-500ce01b4e3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:33.982793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-2cb91000-b0f1-40ab-b04f-e0f9cd685b53 req-2ccdede9-c528-4fa2-a7cf-500ce01b4e3f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:33.996298 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-2cb91000-b0f1-40ab-b04f-e0f9cd685b53 req-2ccdede9-c528-4fa2-a7cf-500ce01b4e3f service nova] Creating event network-changed:92a1113d-4ef9-434b-9f89-250b013d33ee for instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 on n-h2-768852-23 Jul 14 15:35:34.003056 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-2cb91000-b0f1-40ab-b04f-e0f9cd685b53 req-2ccdede9-c528-4fa2-a7cf-500ce01b4e3f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107727 Jul 14 15:35:34.004355 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3229/6296] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:34.573294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:34.573920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:34.581613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.582073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.582853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:34.583326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:34.726679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:34.734834 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-33d90d0e-8280-4f1a-a696-7a06f33ff926 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.165493 Jul 14 15:35:34.735749 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3068/6297] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:34 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:35.754085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:35.754803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:35.761161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:35.761611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:35.762377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:35.762819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:35.910688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:35.918898 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2e60412-c3c7-497f-95eb-f7be73a3cdf8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.170543 Jul 14 15:35:35.919619 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3230/6298] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:35 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:36.940222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:36.941596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:36.948996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:36.949578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:36.950365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:36.950884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:37.116053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:37.125773 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-574aafe1-0956-40e5-8cc8-bbad801599ed tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.191473 Jul 14 15:35:37.127619 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3069/6299] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:36 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:38.144691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:38.145324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:38.156220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:38.156598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:38.158317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:38.158990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:38.352391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:38.366902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52973416-98e2-4f57-877e-e003890b94ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.226472 Jul 14 15:35:38.367762 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3231/6300] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:38 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:39.385234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:39.386054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:39.396695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:39.397455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:39.399686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:39.401058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:39.564898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:39.574955 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-44efbffd-f64c-4b6b-bdc2-8d7f9e042695 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.193380 Jul 14 15:35:39.575623 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3070/6301] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:39 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:40.593823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:40.595645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:40.598546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:40.604214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:40.605015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:40.606086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:40.606719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:40.610969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=77 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:40.746915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:40.755742 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7fa4cdad-6849-475f-b33d-41d54ad7e10f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.166686 Jul 14 15:35:40.756328 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3232/6302] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:40 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:41.772915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:41.773532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:41.776410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.777213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.783471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:41.783936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:41.784676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:41.785120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:41.790273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:41.925050 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:41.932710 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a73045ea-b55d-4ddf-b2d8-c150c76fe4f4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.163713 Jul 14 15:35:41.933312 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3071/6303] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:41 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:42.950659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:42.951318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:42.953163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:42.953983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:35:42.961728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:42.962161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:42.963011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:42.963488 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:43.097296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:43.105687 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d4bbcd5b-3da1-4f42-8166-1102d740bbba tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.158962 Jul 14 15:35:43.106286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3233/6304] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:42 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:44.122461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:44.123253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:44.130074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:44.130540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:44.131360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:44.131816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:44.280583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:44.289522 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec609c55-44ac-439c-b13e-9c2733859b28 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.171158 Jul 14 15:35:44.290519 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3072/6305] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:44 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:45.313415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:45.314620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:45.322624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:45.323100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:45.324005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:45.324441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:45.490713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:45.498383 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c24d191-5727-4f3e-8a88-684d20a552c3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.190215 Jul 14 15:35:45.498875 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3234/6306] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:45 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:46.516122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:46.516741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:46.524697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:46.525162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:46.525983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:46.526507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:46.676924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:46.684922 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-426f71fc-58f8-45a3-8b7c-33eab6eb2977 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1341 microversion: 2.1 time: 0.172826 Jul 14 15:35:46.685602 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3073/6307] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:46 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:47.702287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:47.702929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:47.710130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:47.710600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:47.711413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:47.711867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:47.850059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:47.858868 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5689c9c8-7ce5-47df-8c34-16ce068c244a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.160667 Jul 14 15:35:47.859496 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3235/6308] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:47 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:48.877781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:48.878337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:48.885664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:48.886128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:48.886939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:48.887418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:49.018846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:49.026540 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b289f246-0a8d-4909-ba6f-49078bbe4fe1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.153316 Jul 14 15:35:49.027117 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3074/6309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:48 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:50.044735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:50.045349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:50.052777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:50.053159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:50.053941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:50.054385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:50.203925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:50.212678 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-525d5220-ea33-4906-8fe0-df23868ffa82 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.172671 Jul 14 15:35:50.213285 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3236/6310] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:50 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:51.229681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:51.230347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:51.237866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:51.238333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:51.239112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:51.239587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:51.374547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:51.382257 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-650f4f15-7d92-41da-8e92-4a0d18856809 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.156595 Jul 14 15:35:51.382840 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3075/6311] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:51 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:52.398098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:52.398740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:52.406284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:52.406738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:52.407627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:52.408188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:52.552514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:52.560404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b0b172eb-21a1-44c3-bb05-fa106cd7d69b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.166339 Jul 14 15:35:52.561060 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3237/6312] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:52 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:53.579190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:53.579894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:53.589132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:53.589695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:53.590873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:53.591408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:53.741096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:53.751103 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eba6fc20-62ca-4d2d-872d-c56f2cdb67c0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.176849 Jul 14 15:35:53.751752 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3076/6313] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:53 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:54.768263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:54.768866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:54.775795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:54.776241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:54.776998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:54.777423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:54.905898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:54.913404 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aaf4e9f4-f304-4b61-a1b0-9680908d2735 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.149064 Jul 14 15:35:54.913986 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3238/6314] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:54 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:55.930928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:55.931710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:55.939034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:55.939528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:55.940299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:55.940745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:56.081173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:56.088845 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec86c360-b31a-478e-8cb2-76461388b5bd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.161801 Jul 14 15:35:56.089427 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3077/6315] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:55 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:57.107782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:57.108340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:57.115728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:57.116182 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:57.116957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:57.117400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:57.278130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:57.286817 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c614222-9fc5-444b-9bb8-010167ff5cec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.184478 Jul 14 15:35:57.287552 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3239/6316] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:57 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:58.303586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:58.304219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:58.311240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:58.311734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:58.312511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:58.312964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:58.456962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:58.465142 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-009f6f8f-5311-4e88-9e20-5729b6e1f757 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.165422 Jul 14 15:35:58.465736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3078/6317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:58 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:35:58.720040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c9821ef1-c3d3-4f30-81ec-ce8f26a7ab73 req-9336b75a-ade7-48de-84d2-d9b2a9e8ad11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e0e609-c521-4eab-b2d1-3a63570bd3b2", "name": "network-vif-plugged", "status": "completed", "tag": "92a1113d-4ef9-434b-9f89-250b013d33ee"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:35:58.729717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c9821ef1-c3d3-4f30-81ec-ce8f26a7ab73 req-9336b75a-ade7-48de-84d2-d9b2a9e8ad11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:58.730110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c9821ef1-c3d3-4f30-81ec-ce8f26a7ab73 req-9336b75a-ade7-48de-84d2-d9b2a9e8ad11 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:58.743025 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c9821ef1-c3d3-4f30-81ec-ce8f26a7ab73 req-9336b75a-ade7-48de-84d2-d9b2a9e8ad11 service nova] Creating event network-vif-plugged:92a1113d-4ef9-434b-9f89-250b013d33ee for instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 on n-h2-768852-23 Jul 14 15:35:58.748974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c9821ef1-c3d3-4f30-81ec-ce8f26a7ab73 req-9336b75a-ade7-48de-84d2-d9b2a9e8ad11 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033200 Jul 14 15:35:58.749913 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3240/6318] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:35:59.483414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:35:59.484155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:35:59.491607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:59.492069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:59.492838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:59.493285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:59.647692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:35:59.661225 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-509cf833-3133-4f80-86e1-6d801adaabdf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1375 microversion: 2.1 time: 0.181818 Jul 14 15:35:59.662122 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3079/6319] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:35:59 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1375 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:00.681600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:00.682403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:00.689717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:00.690922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:00.691047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:00.691625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:00.854069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:00.864649 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7192a3a-e754-4b70-a31c-5733175e8ea8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1561 microversion: 2.1 time: 0.187958 Jul 14 15:36:00.865287 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3241/6320] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:00 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:00.884868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:00.885499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:00.895537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:00.896071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:00.896870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:00.897330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:01.033876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:01.042191 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94cbc9d6-9519-4aee-80c1-3fff1bb18f45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1561 microversion: 2.1 time: 0.161875 Jul 14 15:36:01.042785 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3080/6321] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:00 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1561 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:01.116094 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:01.116664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:01.122797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:01.123239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:01.124047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:01.124480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:01.151395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:36:01.236190 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e61ea8a9-6bcb-4ed3-9246-90d1b43d4fda tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 204 len: 0 microversion: 2.1 time: 0.123545 Jul 14 15:36:01.238365 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3242/6322] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:36:01 2022] DELETE /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:01.245200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:01.246105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:01.252799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:01.253270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:01.254066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:01.254522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:01.398804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:01.406772 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11d41298-5051-43b3-b27c-133b9971de2c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1567 microversion: 2.1 time: 0.165536 Jul 14 15:36:01.408076 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3081/6323] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:01 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:02.426297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:02.427009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:02.434018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:02.434467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:02.435409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:02.435856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:02.568561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:02.576284 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5520b53c-638b-46d8-988c-31f75f88ddd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1567 microversion: 2.1 time: 0.155022 Jul 14 15:36:02.576862 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3243/6324] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:02 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:03.340481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6a185d9d-f715-4e23-9779-8ab3c6829a43 req-ea090896-a596-40ea-bbab-29ce7c29e035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e0e609-c521-4eab-b2d1-3a63570bd3b2", "name": "network-vif-deleted", "tag": "92a1113d-4ef9-434b-9f89-250b013d33ee"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:03.355110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a185d9d-f715-4e23-9779-8ab3c6829a43 req-ea090896-a596-40ea-bbab-29ce7c29e035 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:03.355916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a185d9d-f715-4e23-9779-8ab3c6829a43 req-ea090896-a596-40ea-bbab-29ce7c29e035 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:03.379339 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6a185d9d-f715-4e23-9779-8ab3c6829a43 req-ea090896-a596-40ea-bbab-29ce7c29e035 service nova] Creating event network-vif-deleted:92a1113d-4ef9-434b-9f89-250b013d33ee for instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 on n-h2-768852-23 Jul 14 15:36:03.384705 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6a185d9d-f715-4e23-9779-8ab3c6829a43 req-ea090896-a596-40ea-bbab-29ce7c29e035 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048456 Jul 14 15:36:03.385517 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3082/6325] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:36:03.593649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:03.594245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:03.602170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:03.602620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:03.603433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:03.603870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:03.670390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:03.678864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-241b8c14-4a81-42f4-b4ec-c294d6d4b454 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1360 microversion: 2.1 time: 0.089227 Jul 14 15:36:03.679404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3244/6326] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:03 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1360 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:04.698445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:04.699196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:04.706023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:04.706481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:04.707262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:04.707743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:04.786003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:04.798771 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3c54f92c-50ae-49c0-93d7-1be2b94b8845 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1360 microversion: 2.1 time: 0.105509 Jul 14 15:36:04.799888 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3083/6327] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:04 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1360 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:05.816354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:05.816995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:05.824701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:05.825164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:05.825953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:05.826392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:05.896759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:05.906466 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-703e6c9c-b823-4606-9cb9-18bc9c28e855 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1360 microversion: 2.1 time: 0.094376 Jul 14 15:36:05.907101 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3245/6328] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:05 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1360 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:06.924198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:06.924838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:06.932141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:06.932612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:06.933420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:06.933875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:07.003553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:07.011592 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d360023b-d035-40cf-9ffd-0d3250f16fa7 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1360 microversion: 2.1 time: 0.091429 Jul 14 15:36:07.012192 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3084/6329] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:06 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1360 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:08.031553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:08.032768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:08.040767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:08.041225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:08.042001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:08.042440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:08.080672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:08.081293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:08.081820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lazy-loading 'fault' on Instance uuid 11e0e609-c521-4eab-b2d1-3a63570bd3b2 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:36:08.136392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:08.146319 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-76619d7f-e35f-4ff1-b292-1d7c1bee4da9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 200 len: 1365 microversion: 2.1 time: 0.120602 Jul 14 15:36:08.146924 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3246/6330] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:08 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:09.164935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:09.165442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:09.173264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:09.173740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:09.174560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:09.175020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:09.190628 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 HTTP/1.1 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '11e0e609-c521-4eab-b2d1-3a63570bd3b2'} Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:09.192250 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6398316d-20b4-4907-9717-e99e7a348828 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 404 len: 111 microversion: 2.1 time: 0.033441 Jul 14 15:36:09.197507 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3085/6331] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:09 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:13.504092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:13.504606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:13.507440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.512878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:13.513318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:13.514076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:13.514508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:13.519732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.542224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:36:13.617589 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5123577-a5bf-4457-9e12-7a13761afa8e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 204 len: 0 microversion: 2.1 time: 0.116783 Jul 14 15:36:13.618272 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3247/6332] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:36:13 2022] DELETE /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:36:13.626666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:13.627442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:13.630385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=30 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.635748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:13.636213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:13.637005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:13.637454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:13.642333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=82 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:13.767586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:13.775364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d01f4e3-34ad-42e6-b064-63144ce71b81 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1410 microversion: 2.1 time: 0.152511 Jul 14 15:36:13.775872 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3086/6333] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:13 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:14.792415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:14.793154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:14.800397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:14.800856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:14.801638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:14.802077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:14.938320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:14.946544 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e54ed908-2630-40bc-bf2a-f81e67c3fde9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1410 microversion: 2.1 time: 0.158982 Jul 14 15:36:14.947130 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3248/6334] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:14 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1410 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:15.913233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c0fe4632-6e37-429e-b4da-00622c00ba1c req-a8146d83-4d3d-44ea-bfb2-a497333fd3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbdd834b-f2e6-4162-9e27-59b481c571d0", "name": "network-vif-deleted", "tag": "8a1b9925-54e3-489c-a6de-891da0b069a0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:15.922868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c0fe4632-6e37-429e-b4da-00622c00ba1c req-a8146d83-4d3d-44ea-bfb2-a497333fd3b3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.923360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c0fe4632-6e37-429e-b4da-00622c00ba1c req-a8146d83-4d3d-44ea-bfb2-a497333fd3b3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:15.935242 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c0fe4632-6e37-429e-b4da-00622c00ba1c req-a8146d83-4d3d-44ea-bfb2-a497333fd3b3 service nova] Creating event network-vif-deleted:8a1b9925-54e3-489c-a6de-891da0b069a0 for instance dbdd834b-f2e6-4162-9e27-59b481c571d0 on n-h1-768852-23 Jul 14 15:36:15.940889 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c0fe4632-6e37-429e-b4da-00622c00ba1c req-a8146d83-4d3d-44ea-bfb2-a497333fd3b3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031329 Jul 14 15:36:15.941507 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3087/6335] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:15.963350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:15.964329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:15.972552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.972996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:15.973807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:15.974264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:16.040773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:16.049091 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-001dde01-64f9-4e70-8091-777b10e89377 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1202 microversion: 2.1 time: 0.089585 Jul 14 15:36:16.049691 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3249/6336] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:15 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:17.068653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:17.069378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:17.076590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:17.076884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:17.077673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:17.078133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:17.149196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:17.164910 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f621b164-a164-4772-af80-6a685eeee9b9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1202 microversion: 2.1 time: 0.101433 Jul 14 15:36:17.166047 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3088/6337] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:17 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:18.191995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:18.192575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:18.199611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:18.200059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:18.200833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:18.201270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:18.270008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:18.277926 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f3f3999-ed0c-46eb-8618-a70dc9572433 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1202 microversion: 2.1 time: 0.090702 Jul 14 15:36:18.278531 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3250/6338] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:18 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1202 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:19.295795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:19.296432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:19.304688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:19.305157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:19.305962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:19.306420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:19.372904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:19.381633 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a13a8bd-29f7-4c8f-95bb-7f1b83a5f2d9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1202 microversion: 2.1 time: 0.090170 Jul 14 15:36:19.382222 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3089/6339] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:19 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1202 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:20.398075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:20.398884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:20.406078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:20.406461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:20.407322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:20.407714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:20.441808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:20.442258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:20.442723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lazy-loading 'fault' on Instance uuid dbdd834b-f2e6-4162-9e27-59b481c571d0 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:36:20.501071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:20.511374 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d57f5920-3c94-40cd-a7e0-8536f292b07e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 200 len: 1207 microversion: 2.1 time: 0.117128 Jul 14 15:36:20.511986 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3251/6340] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:20 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 1207 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:21.528979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:21.529625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:21.537408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:21.537877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:21.538676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:21.539128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:21.554054 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 HTTP/1.1 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'dbdd834b-f2e6-4162-9e27-59b481c571d0'} Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:21.555920 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8dc3cb70-f1dc-443e-be66-58b9b50cd16e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 404 len: 111 microversion: 2.1 time: 0.032453 Jul 14 15:36:21.560874 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3090/6341] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:21 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:23.695628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:23.696236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:23.703579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:23.704596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:23.705370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:23.705803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:23.720342 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 HTTP/1.1 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '11e0e609-c521-4eab-b2d1-3a63570bd3b2'} Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:36:23.722104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32aefc19-9afb-4843-a883-e0689e96252f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 404 len: 111 microversion: 2.1 time: 0.031777 Jul 14 15:36:23.727438 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3252/6342] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:36:23 2022] DELETE /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:23.732064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:23.732882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 11e0e609-c521-4eab-b2d1-3a63570bd3b2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:23.740003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:23.740466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:23.741251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:23.741696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:23.759124 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 HTTP/1.1 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '11e0e609-c521-4eab-b2d1-3a63570bd3b2'} Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:23.760862 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 11e0e609-c521-4eab-b2d1-3a63570bd3b2 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:23.765577 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d3ece64c-207e-4be1-9432-c2521959a70c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2" status: 404 len: 111 microversion: 2.1 time: 0.034041 Jul 14 15:36:23.766821 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3091/6343] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:23 2022] GET /compute/v2.1/servers/11e0e609-c521-4eab-b2d1-3a63570bd3b2 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:24.138425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:24.139175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:24.145334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:24.145795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:24.146550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:24.146998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:24.160371 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 HTTP/1.1 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'dbdd834b-f2e6-4162-9e27-59b481c571d0'} Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:36:24.161929 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f98b63cf-013c-4fdf-98ec-613521141ae8 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 404 len: 111 microversion: 2.1 time: 0.029046 Jul 14 15:36:24.166939 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3253/6344] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:36:24 2022] DELETE /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:24.173570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:24.174417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: dbdd834b-f2e6-4162-9e27-59b481c571d0] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:24.180526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:24.181061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:24.181992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:24.182468 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:24.197218 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 HTTP/1.1 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'dbdd834b-f2e6-4162-9e27-59b481c571d0'} Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:24.198897 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance dbdd834b-f2e6-4162-9e27-59b481c571d0 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b344ee9a-bed8-4c00-8ae7-eac7fd1bf9ea tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0" status: 404 len: 111 microversion: 2.1 time: 0.031684 Jul 14 15:36:24.204746 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3092/6345] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:24 2022] GET /compute/v2.1/servers/dbdd834b-f2e6-4162-9e27-59b481c571d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:24.276838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-334852fb-fa60-4c3e-802d-08da1d9717df tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: .version_select at 0x7fdbf1b68af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-675563424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMLLSjaTRjl31BXRGeNEj8veUpopn4QI/6cKedOIxsu3KlVuLBrfCWFKnJGfldXxJgbCKtgVnfIzN4y9R3lvVagq5dNKl4cF/fZNhSGjEEaHxZVFkg3rwxOK8CyCAH7NNg=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:24.291948 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-334852fb-fa60-4c3e-802d-08da1d9717df tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:24.297422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-334852fb-fa60-4c3e-802d-08da1d9717df tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:24.312818 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [None req-334852fb-fa60-4c3e-802d-08da1d9717df tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [c943a4f5-696c-4c72-ae35-41046e16efdf] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:36:25.321267 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [None req-334852fb-fa60-4c3e-802d-08da1d9717df tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [c943a4f5-696c-4c72-ae35-41046e16efdf] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 38432. Jul 14 15:36:25.335942 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-334852fb-fa60-4c3e-802d-08da1d9717df tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 1.062989 Jul 14 15:36:25.336556 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3254/6346] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:36:24 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:41.795832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1443913102", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-675563424", "security_groups": [{"name": "tempest-secgroup-smoke-1514504017"}], "block_device_mapping_v2": [{"uuid": "9eee0cbe-b37c-41be-b5e4-51f0bef0e6c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:41.805211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=13 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.805880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=25 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:41.909226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:36:42.351861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:36:42.352296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:36:42.352790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:36:42.353239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:36:42.353664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:36:42.363254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:42.363733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:42.364531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:42.364979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:42.381331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:42.386456 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:42.444485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:36:42.446631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9eee0cbe-b37c-41be-b5e4-51f0bef0e6c2',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:36:42.573488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d12a064c-8760-4cef-b215-dfde653310ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.781792 Jul 14 15:36:42.574200 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3093/6347] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:36:42.583086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:42.584417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:42.585759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:42.590967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5465c3c-04e0-4155-a2f6-314bc392fb98 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:42.592484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5465c3c-04e0-4155-a2f6-314bc392fb98 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:42.651683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e5465c3c-04e0-4155-a2f6-314bc392fb98 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:42.659058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5465c3c-04e0-4155-a2f6-314bc392fb98 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1094 microversion: 2.1 time: 0.078228 Jul 14 15:36:42.659737 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3255/6348] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:42 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:43.682477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:43.683106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:43.690899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:43.691186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:43.691987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:43.692435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:43.757263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:43.764890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1f140408-3227-4d87-87ad-139cf4ae986b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1210 microversion: 2.1 time: 0.087319 Jul 14 15:36:43.765477 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3094/6349] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:43 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:44.783561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:44.785091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:44.792571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:44.793360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:44.794147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:44.794589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:45.018855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:45.028166 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-017995d3-be33-4318-b5d7-5397fb8cae8c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1278 microversion: 2.1 time: 0.249440 Jul 14 15:36:45.030447 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3256/6350] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:44 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:45.133633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-51e74e67-9c15-4deb-85db-2d2e660feca8 req-2e8c8a9b-6795-4c43-adcf-c21681cec5dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87ad96e-90da-4673-b7c2-4740059c7df8", "tag": "ec1d859b-a211-4819-b39e-15e185f5e0f8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:45.153149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-51e74e67-9c15-4deb-85db-2d2e660feca8 req-2e8c8a9b-6795-4c43-adcf-c21681cec5dc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:45.153699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-51e74e67-9c15-4deb-85db-2d2e660feca8 req-2e8c8a9b-6795-4c43-adcf-c21681cec5dc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:45.167830 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-51e74e67-9c15-4deb-85db-2d2e660feca8 req-2e8c8a9b-6795-4c43-adcf-c21681cec5dc service nova] Creating event network-changed:ec1d859b-a211-4819-b39e-15e185f5e0f8 for instance b87ad96e-90da-4673-b7c2-4740059c7df8 on n-h2-768852-23 Jul 14 15:36:45.173979 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-51e74e67-9c15-4deb-85db-2d2e660feca8 req-2e8c8a9b-6795-4c43-adcf-c21681cec5dc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044175 Jul 14 15:36:45.174736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3095/6351] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:36:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:46.046409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:46.047011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:46.054782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:46.055235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:46.061653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:46.061653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:46.532957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:46.542498 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0bc27d2a-0b05-45c0-bba7-5e8f9fcd613e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1278 microversion: 2.1 time: 0.500146 Jul 14 15:36:46.543125 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3257/6352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:46 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1278 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:47.560367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:47.561137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:47.568397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:47.568847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:47.569628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:47.570082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:47.714976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:47.723355 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55e0f0dc-b160-47ab-bf33-61d573c8ffcf tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1278 microversion: 2.1 time: 0.167950 Jul 14 15:36:47.723965 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3096/6353] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:47 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1278 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:48.740071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:48.740791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:48.747555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:48.748021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:48.748909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:48.749332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:48.880737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:48.888330 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ab284101-d6fd-4b44-9f70-8a05f1185f9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.152293 Jul 14 15:36:48.888898 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3258/6354] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:48 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:49.905922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:49.906554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:49.913721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:49.914378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:49.915171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:49.915788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:50.051325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:50.059254 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e4091297-1aa9-41f3-b1f5-3cc02408fbfc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.157346 Jul 14 15:36:50.059870 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3097/6355] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:49 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:51.076633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:51.077253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:51.084263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:51.084709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:51.085470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:51.085908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:51.220467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:51.228010 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8e58a52e-f6c6-4956-ab76-7d9df55d183c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.155299 Jul 14 15:36:51.228580 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3259/6356] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:51 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:52.244705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:52.245369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:52.252925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:52.253061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:52.253797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:52.254344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:52.372879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:52.389004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:52.392904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:52.397783 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3c8f780-b977-43b6-aaaf-c386f050d4a1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.157068 Jul 14 15:36:52.398361 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3098/6357] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:52 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:53.414530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:53.415141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:53.417849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:53.423363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:53.423811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:53.424567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:53.424999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:53.554373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:53.561959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-27f6ee00-257b-4014-ac73-c6b03b531196 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.151664 Jul 14 15:36:53.562541 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3260/6358] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:53 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:54.579441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:54.579994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:54.586794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:54.587253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:54.588055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:54.588506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:54.722177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:54.729809 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-69647cb0-d76e-47d0-98ae-3003bf7e6c57 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.154619 Jul 14 15:36:54.730394 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3099/6359] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:54 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:55.745931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:55.746550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:55.754023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:55.754473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:55.755236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:55.755699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:55.889749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:55.897814 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b371cf81-8904-4ee7-a27e-7e36396214bc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.155791 Jul 14 15:36:55.898388 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3261/6360] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:55 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:56.914870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:56.915689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:56.923552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:56.924027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:56.924830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:56.925284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:57.065334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:57.073165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-57e73fc5-ce60-47e7-a395-d020bf49852f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.162796 Jul 14 15:36:57.073782 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3100/6361] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:56 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:58.090125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:58.090737 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:58.097915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.098460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:58.099307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.099733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:58.230277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:58.238025 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-02fdb8f0-e75c-4976-a8d0-8b31c9780984 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.151883 Jul 14 15:36:58.238609 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3262/6362] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:58 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:59.007390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-57aef3b5-fa41-484c-9771-ec6e7bb3095b req-3ebc84e6-9c9e-4889-805d-088db625ec4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87ad96e-90da-4673-b7c2-4740059c7df8", "name": "network-vif-plugged", "status": "completed", "tag": "ec1d859b-a211-4819-b39e-15e185f5e0f8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:59.017053 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57aef3b5-fa41-484c-9771-ec6e7bb3095b req-3ebc84e6-9c9e-4889-805d-088db625ec4c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:59.017564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-57aef3b5-fa41-484c-9771-ec6e7bb3095b req-3ebc84e6-9c9e-4889-805d-088db625ec4c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:59.029320 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-57aef3b5-fa41-484c-9771-ec6e7bb3095b req-3ebc84e6-9c9e-4889-805d-088db625ec4c service nova] Creating event network-vif-plugged:ec1d859b-a211-4819-b39e-15e185f5e0f8 for instance b87ad96e-90da-4673-b7c2-4740059c7df8 on n-h2-768852-23 Jul 14 15:36:59.034332 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-57aef3b5-fa41-484c-9771-ec6e7bb3095b req-3ebc84e6-9c9e-4889-805d-088db625ec4c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030745 Jul 14 15:36:59.034946 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3101/6363] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:36:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:59.254516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:59.255130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:59.262100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:59.262552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:59.263335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:59.263772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:59.402221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:59.410427 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de7f2f04-9601-49e3-b3d5-7363bd1d987b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1266 microversion: 2.1 time: 0.160434 Jul 14 15:36:59.411016 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3263/6364] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:59 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:00.430099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:00.430809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:00.437229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.437693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.438482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.438940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.578811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:00.586490 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-faf20381-c73f-4565-ba45-e3751fe3db4a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1452 microversion: 2.1 time: 0.161533 Jul 14 15:37:00.587064 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3102/6365] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:00 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:00.603382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:00.603993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:00.610910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.611392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.612156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.612588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.742588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:00.750297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-afbbb74a-4be6-4035-b12f-068d0a94e675 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1452 microversion: 2.1 time: 0.151006 Jul 14 15:37:00.750879 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3264/6366] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:00 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:02.332352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-269cab15-f929-4338-9b49-4678099e7772 req-1e3496a4-4c24-4792-ab3e-e89860448031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87ad96e-90da-4673-b7c2-4740059c7df8", "tag": "ec1d859b-a211-4819-b39e-15e185f5e0f8"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:02.341365 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-269cab15-f929-4338-9b49-4678099e7772 req-1e3496a4-4c24-4792-ab3e-e89860448031 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:02.341910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-269cab15-f929-4338-9b49-4678099e7772 req-1e3496a4-4c24-4792-ab3e-e89860448031 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:02.353053 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-269cab15-f929-4338-9b49-4678099e7772 req-1e3496a4-4c24-4792-ab3e-e89860448031 service nova] Creating event network-changed:ec1d859b-a211-4819-b39e-15e185f5e0f8 for instance b87ad96e-90da-4673-b7c2-4740059c7df8 on n-h2-768852-23 Jul 14 15:37:02.358362 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-269cab15-f929-4338-9b49-4678099e7772 req-1e3496a4-4c24-4792-ab3e-e89860448031 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029715 Jul 14 15:37:02.359209 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3103/6367] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:28.659467 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:38:28.660123 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:38:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:38:30.820914 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:38:30.821559 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:38:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:38:53.188498 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:38:53.189144 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:38:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:38:58.488243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=22 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.488998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=54 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.543395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:58.543978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:58.551247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.551756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.552634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.553070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.579966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:38:58.662418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32f7641a-3a6f-4ce6-a74c-50c9b1ba9f2e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 204 len: 0 microversion: 2.1 time: 0.175759 Jul 14 15:38:58.666548 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3265/6368] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:38:58 2022] DELETE /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:38:58.670217 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] AMQP server on 10.222.0.98:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 15:38:58.671421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.672768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=50 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:58.677358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:58.678082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:58.685690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.686152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.687021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.687482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.881037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:58.888715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4f395f0f-6ec1-45e0-8ad7-55d42218abe0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1576 microversion: 2.1 time: 0.220459 Jul 14 15:38:58.889294 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3104/6369] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:58 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1576 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:59.907260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:59.907994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:59.916510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.916954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.917736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.918173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:00.112138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:00.120461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f08c5a29-509b-49ea-aef1-43b053d34fdd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1576 microversion: 2.1 time: 0.217848 Jul 14 15:39:00.121065 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3266/6370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:59 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:01.138391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:01.139030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:01.152909 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 38726. Jul 14 15:39:01.155330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.155819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.156608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.157052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.223122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:01.231850 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ee4fd28-6d69-44b7-8c9f-d39d2f5ded5a tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1508 microversion: 2.1 time: 0.097553 Jul 14 15:39:01.232455 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3105/6371] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:01 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1508 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:01.337577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dcf01c79-f8b8-4e11-863f-b0539bb5c460 req-b5a58194-7c12-4c1a-a805-dd03b070cc49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87ad96e-90da-4673-b7c2-4740059c7df8", "name": "network-vif-deleted", "tag": "ec1d859b-a211-4819-b39e-15e185f5e0f8"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:01.347627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dcf01c79-f8b8-4e11-863f-b0539bb5c460 req-b5a58194-7c12-4c1a-a805-dd03b070cc49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.348174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dcf01c79-f8b8-4e11-863f-b0539bb5c460 req-b5a58194-7c12-4c1a-a805-dd03b070cc49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.362194 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dcf01c79-f8b8-4e11-863f-b0539bb5c460 req-b5a58194-7c12-4c1a-a805-dd03b070cc49 service nova] Creating event network-vif-deleted:ec1d859b-a211-4819-b39e-15e185f5e0f8 for instance b87ad96e-90da-4673-b7c2-4740059c7df8 on n-h2-768852-23 Jul 14 15:39:01.369000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dcf01c79-f8b8-4e11-863f-b0539bb5c460 req-b5a58194-7c12-4c1a-a805-dd03b070cc49 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037467 Jul 14 15:39:01.370100 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3267/6372] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:39:02.250380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:02.251029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:02.260081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.260780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.261666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.262349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.345887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:02.354991 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c495fba1-bf2c-43a6-a8ac-7ae4aaf42f37 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1225 microversion: 2.1 time: 0.108800 Jul 14 15:39:02.355937 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3106/6373] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:02 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:03.377363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:03.378073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:03.388883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:03.389326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:03.390099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:03.391433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:03.467254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:03.476181 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5be3bf4d-2e31-4795-826a-8f8cc6ddaa44 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1225 microversion: 2.1 time: 0.107255 Jul 14 15:39:03.476947 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3268/6374] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:03 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1225 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:04.492935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:04.493661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:04.500615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:04.501068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:04.501851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:04.502298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:04.573387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:04.582249 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b69fae8d-f90e-4a1c-95d6-c1cf569cca2f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1225 microversion: 2.1 time: 0.093124 Jul 14 15:39:04.582843 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3107/6375] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:04 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:05.598875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:05.599516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:05.607716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.608156 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.608977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.609410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.684701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:05.692849 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef998581-0e48-4b21-a7c8-da318cd36a9e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 200 len: 1225 microversion: 2.1 time: 0.097635 Jul 14 15:39:05.693456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3269/6376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:05 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:06.709977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:06.710598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:06.717498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.717951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.719478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.719926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.733131 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 HTTP/1.1 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b87ad96e-90da-4673-b7c2-4740059c7df8'} Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:39:06.734776 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0239861-35ef-4baa-822a-de8107bb4593 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 404 len: 111 microversion: 2.1 time: 0.030232 Jul 14 15:39:06.740551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3108/6377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:06 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:39:06.784082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-718916767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-675563424", "security_groups": [{"name": "tempest-secgroup-smoke-1514504017"}], "block_device_mapping_v2": [{"uuid": "9eee0cbe-b37c-41be-b5e4-51f0bef0e6c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:06.900396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:39:07.276913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:39:07.277347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:39:07.277824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:39:07.278235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:39:07.278651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:39:07.289016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.289463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.290256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.290693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.308098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:39:07.313996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:39:07.371657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:39:07.373889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9eee0cbe-b37c-41be-b5e4-51f0bef0e6c2',volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:39:07.503728 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9e1fec72-3c97-4841-b333-f81bda253844 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.724083 Jul 14 15:39:07.504554 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3270/6378] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:39:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:39:07.514605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d79489a-48df-42bd-9ceb-1b905f790e06 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:07.515239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d79489a-48df-42bd-9ceb-1b905f790e06 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:07.569191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d79489a-48df-42bd-9ceb-1b905f790e06 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:07.576049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d79489a-48df-42bd-9ceb-1b905f790e06 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1093 microversion: 2.1 time: 0.065340 Jul 14 15:39:07.576628 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3109/6379] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:07 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:08.593819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:08.594437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:08.600850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:08.601301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:08.602072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:08.602509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:08.667916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:08.676120 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b54f5339-bd46-4a60-bf39-df2fafeaf6a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1199 microversion: 2.1 time: 0.087499 Jul 14 15:39:08.676728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3271/6380] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:08 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1199 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:09.694138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:09.694919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:09.704063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.704543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.705340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.705796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.937197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:09.945343 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-71f766f5-3880-487e-a467-0f4c72ee06db tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1277 microversion: 2.1 time: 0.256059 Jul 14 15:39:09.946032 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3110/6381] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:09 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1277 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:10.251676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a942c870-da87-4296-b623-7e7ab97a7cee req-a76d5cdf-19fe-4b07-b4ba-06f821a75e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11710e5-f9cc-4f89-a121-687698790a32", "tag": "de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:10.266625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a942c870-da87-4296-b623-7e7ab97a7cee req-a76d5cdf-19fe-4b07-b4ba-06f821a75e33 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:10.267501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a942c870-da87-4296-b623-7e7ab97a7cee req-a76d5cdf-19fe-4b07-b4ba-06f821a75e33 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:10.286891 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a942c870-da87-4296-b623-7e7ab97a7cee req-a76d5cdf-19fe-4b07-b4ba-06f821a75e33 service nova] Creating event network-changed:de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a for instance f11710e5-f9cc-4f89-a121-687698790a32 on n-h1-768852-23 Jul 14 15:39:10.295421 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a942c870-da87-4296-b623-7e7ab97a7cee req-a76d5cdf-19fe-4b07-b4ba-06f821a75e33 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047969 Jul 14 15:39:10.296834 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3272/6382] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:10.963613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:10.964496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:10.972230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:10.972676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:10.973841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:10.974442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:11.203252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:11.211472 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9501fc0e-4e30-4bad-84f4-0a823e992dce tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1277 microversion: 2.1 time: 0.251788 Jul 14 15:39:11.212258 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3111/6383] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:10 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1277 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:12.229893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:12.230524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:12.237588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.238083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.238853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.239312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.381647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:12.389255 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fea4e60-6035-4853-9d3b-8d8a50a28a45 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1277 microversion: 2.1 time: 0.164603 Jul 14 15:39:12.390095 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3273/6384] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:12 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:13.406122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:13.406873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:13.415056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:13.415543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:13.416338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:13.416812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:13.577663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:13.585993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-85794a4d-4c7d-47b7-bb4b-9eb8ca38d7d5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1277 microversion: 2.1 time: 0.183692 Jul 14 15:39:13.586847 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3112/6385] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:13 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:14.603786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:14.604308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:14.611828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:14.612281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:14.613040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:14.613469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:14.747979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:14.756213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5e0ddab-1859-4ab2-984a-015981aafa02 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.156826 Jul 14 15:39:14.756807 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3274/6386] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:14 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:15.773376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:15.774002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:15.781686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:15.782144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:15.782921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:15.783400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:15.926820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:15.935823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4341ce96-aa78-462d-b018-334f5bbf2390 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.166217 Jul 14 15:39:15.936424 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3113/6387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:15 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:16.954196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:16.954808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:16.961536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:16.961987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:16.962743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:16.963167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.101117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:17.109149 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3456eab4-806a-433e-a5c3-136446155462 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.159414 Jul 14 15:39:17.109748 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3275/6388] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:16 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:18.127209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:18.127774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:18.130627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:18.136364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:18.136986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:18.137785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:18.138233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:18.281021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:18.289184 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e9ea718e-6a55-4080-a3b3-43c13acbea9f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.166492 Jul 14 15:39:18.289771 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3114/6389] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:18 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:19.305836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:19.306455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:19.308476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:19.309210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:19.317318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:19.317843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:19.318804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:19.319314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:19.741895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:19.749640 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ccbc2b0e-6352-4a8a-8490-2c0fc0e40f64 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.447603 Jul 14 15:39:19.750239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3276/6390] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:19 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:20.770854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:20.772096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:20.781929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:20.782408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:20.783205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:20.783697 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:20.923994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:20.931603 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8875c3dc-4998-4f31-99b9-6d3fc05b02c9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.168224 Jul 14 15:39:20.932188 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3115/6391] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:20 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:21.949378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:21.950176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:21.959662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:21.960107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:21.960916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:21.961353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:22.109180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:22.116939 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9d81c941-97d4-4243-9819-be325fab068c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.171873 Jul 14 15:39:22.117523 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3277/6392] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:21 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:23.135533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:23.136151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:23.143952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:23.144416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:23.145202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:23.145648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:23.284939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:23.292836 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dc596ad2-0140-4e66-aef3-cdaf6de743dc tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.161412 Jul 14 15:39:23.293420 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3116/6393] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:23 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:23.928509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a25ca019-1680-4ba4-91ae-4b4b2f6c7ef8 req-945f4543-1755-4615-ac49-e5400eb16242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11710e5-f9cc-4f89-a121-687698790a32", "name": "network-vif-plugged", "status": "completed", "tag": "de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:23.938207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a25ca019-1680-4ba4-91ae-4b4b2f6c7ef8 req-945f4543-1755-4615-ac49-e5400eb16242 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:23.938629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a25ca019-1680-4ba4-91ae-4b4b2f6c7ef8 req-945f4543-1755-4615-ac49-e5400eb16242 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:23.950291 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a25ca019-1680-4ba4-91ae-4b4b2f6c7ef8 req-945f4543-1755-4615-ac49-e5400eb16242 service nova] Creating event network-vif-plugged:de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a for instance f11710e5-f9cc-4f89-a121-687698790a32 on n-h1-768852-23 Jul 14 15:39:23.957723 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a25ca019-1680-4ba4-91ae-4b4b2f6c7ef8 req-945f4543-1755-4615-ac49-e5400eb16242 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030879 Jul 14 15:39:23.958492 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3278/6394] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:24.310519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:24.311150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:24.319338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:24.319808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:24.320604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:24.321102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:24.468849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:24.476791 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ef7cc50-a4e4-4517-9904-510d3c7a9166 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1265 microversion: 2.1 time: 0.170854 Jul 14 15:39:24.477394 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3117/6395] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:24 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:25.496423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:25.497044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:25.503435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:25.503888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:25.504704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:25.505143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:25.652310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:25.659956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-95b27bcf-1eaa-4d16-b3e9-10d73843fecb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1451 microversion: 2.1 time: 0.168789 Jul 14 15:39:25.660555 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3279/6396] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:25 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:25.675908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:25.676536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:25.683447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:25.683912 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:25.684688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:25.685135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:26.096940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:26.104725 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3144293b-c24b-40ba-a9ba-1ba4a69c912b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1451 microversion: 2.1 time: 0.432590 Jul 14 15:39:26.105314 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3118/6397] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:25 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1451 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:28.071652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bd872684-a2fc-475c-b49b-bbfca7635b1b req-990f949e-e2de-4022-8853-26db0f6d427c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11710e5-f9cc-4f89-a121-687698790a32", "tag": "de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:28.080362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bd872684-a2fc-475c-b49b-bbfca7635b1b req-990f949e-e2de-4022-8853-26db0f6d427c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.080807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bd872684-a2fc-475c-b49b-bbfca7635b1b req-990f949e-e2de-4022-8853-26db0f6d427c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.091974 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bd872684-a2fc-475c-b49b-bbfca7635b1b req-990f949e-e2de-4022-8853-26db0f6d427c service nova] Creating event network-changed:de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a for instance f11710e5-f9cc-4f89-a121-687698790a32 on n-h1-768852-23 Jul 14 15:39:28.097679 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bd872684-a2fc-475c-b49b-bbfca7635b1b req-990f949e-e2de-4022-8853-26db0f6d427c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029813 Jul 14 15:39:28.098711 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3280/6398] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:09.182835 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 15:41:09.183472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=32 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:09.184245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=80 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:09.188507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1370190646", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-675563424", "security_groups": [{"name": "tempest-secgroup-smoke-1514504017"}], "block_device_mapping_v2": [{"uuid": "0dbae014-8974-4667-a70f-e8d1a565d0b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3900c9b8-1b7a-4338-b401-532ac075a072"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:09.305454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] validate_networks() for [('3900c9b8-1b7a-4338-b401-532ac075a072', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:41:09.736152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:41:09.736715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:41:09.737191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:41:09.737639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:41:09.738058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:41:09.747426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:09.747889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:09.748696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:09.749145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:09.766746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:41:09.772177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Getting quotas for user 8bb893892edc491d9f3df8f82b3c9952 and project 4165c8dc427140468645e52deac8d496. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:41:09.845070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:41:09.847150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0dbae014-8974-4667-a70f-e8d1a565d0b0',volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:41:09.994893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0ad0c71d-f91e-4b3b-9973-5f9bbafb4640 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814233 Jul 14 15:41:09.995596 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3119/6399] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:41:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:41:10.004679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:10.005768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:10.010428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-330ad560-0328-4ee2-968f-1b40f8965be5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:10.011161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-330ad560-0328-4ee2-968f-1b40f8965be5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:10.074513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-330ad560-0328-4ee2-968f-1b40f8965be5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:10.082200 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-330ad560-0328-4ee2-968f-1b40f8965be5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1094 microversion: 2.1 time: 0.080080 Jul 14 15:41:10.082787 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3281/6400] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:10 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:11.101196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:11.101850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:11.110756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:11.111219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.112041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:11.112493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.118595 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 38912. Jul 14 15:41:11.193323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:11.201536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-97e11a12-7b7a-460d-b545-0dc6b2d960f6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1200 microversion: 2.1 time: 0.105353 Jul 14 15:41:11.212723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3120/6401] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:11 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1200 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:12.219851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:12.220564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:12.229014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:12.229370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:12.230347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:12.230796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:12.444620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:12.453885 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9246ed94-7574-4c7b-9bfe-e3d4c10ba45d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1278 microversion: 2.1 time: 0.237966 Jul 14 15:41:12.463575 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3282/6402] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:12 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1278 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:12.817432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-8d7b3ed5-3b3a-42cc-8bd1-be64f0aaea39 req-abe220d6-779c-4ee1-9e0a-c59cfd1b9f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa38393-3829-493b-b6f2-71d2dd711f60", "tag": "245ee401-c882-42fd-9e40-8e80bdce70c6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:12.828381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8d7b3ed5-3b3a-42cc-8bd1-be64f0aaea39 req-abe220d6-779c-4ee1-9e0a-c59cfd1b9f3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:12.830663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-8d7b3ed5-3b3a-42cc-8bd1-be64f0aaea39 req-abe220d6-779c-4ee1-9e0a-c59cfd1b9f3b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:12.850274 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-8d7b3ed5-3b3a-42cc-8bd1-be64f0aaea39 req-abe220d6-779c-4ee1-9e0a-c59cfd1b9f3b service nova] Creating event network-changed:245ee401-c882-42fd-9e40-8e80bdce70c6 for instance 1aa38393-3829-493b-b6f2-71d2dd711f60 on n-h2-768852-23 Jul 14 15:41:12.865133 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-8d7b3ed5-3b3a-42cc-8bd1-be64f0aaea39 req-abe220d6-779c-4ee1-9e0a-c59cfd1b9f3b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131908 Jul 14 15:41:12.865797 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3121/6403] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:13.471803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:13.472477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:13.483118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:13.484092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:13.485270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:13.485955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:13.786714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:13.795264 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2b661d2d-d8df-4467-9cdd-9d35e18b8dd5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1278 microversion: 2.1 time: 0.327514 Jul 14 15:41:13.795998 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3283/6404] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:13 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1278 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:14.815503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:14.816571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:14.823560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:14.824057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:14.824887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:14.825334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:14.964787 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:14.972466 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c6c809db-16b2-4c2b-99ae-a7597d221f8d tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1278 microversion: 2.1 time: 0.163762 Jul 14 15:41:14.973048 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3122/6405] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:14 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:15.990351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:15.990864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:15.997845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:15.998290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:15.999062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:15.999519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:16.144419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:16.153883 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-41dc8a3e-1074-48d7-9b12-a4b4e549c9f1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1278 microversion: 2.1 time: 0.167532 Jul 14 15:41:16.154611 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3284/6406] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:15 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:17.171927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:17.172553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:17.179462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:17.179990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:17.180762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:17.181211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:17.317765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:17.326026 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9eeffdc7-3f6b-428b-95d0-171a3412a712 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.158543 Jul 14 15:41:17.326605 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3123/6407] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:17 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:18.342460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:18.343072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:18.349829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.350272 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.351023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.351512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.483811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:18.491306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-de7fe9e9-ca47-4314-9f30-755d99148e65 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.153183 Jul 14 15:41:18.491876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3285/6408] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:18 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:19.508517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:19.509146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:19.516949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:19.517410 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.518239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:19.518639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.652641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:19.660776 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1446769-9584-48a3-bc70-23ede3e8efa0 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.155949 Jul 14 15:41:19.661451 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3124/6409] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:19 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:20.677303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:20.677922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:20.680677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:20.686942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.687424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.688197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.688640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.825984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:20.834226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b8332f22-7f74-458e-90ad-30404b50d9a6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.160762 Jul 14 15:41:20.834850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3286/6410] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:20 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:21.852615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:21.853446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:21.857568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:21.858359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:21.865033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.865594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.866553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.867398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:22.037520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:22.046092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a914d1b0-f28e-452c-847c-d0edc31f0fae tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.198337 Jul 14 15:41:22.046868 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3125/6411] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:21 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:23.065243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:23.065808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:23.072840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.073302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.074090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.074535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.225474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:23.236881 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a958311f-1821-4c12-b26d-8c2c71b104ca tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.175414 Jul 14 15:41:23.237692 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3287/6412] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:23 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:24.257246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:24.257878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:24.269570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.270828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.270994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.271342 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.422796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:24.433024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04aebc36-2057-447a-857e-3b1f7ec1dad9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.180494 Jul 14 15:41:24.433658 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3126/6413] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:24 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:25.450334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:25.451056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:25.458216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.458734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.459532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.459979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.593844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:25.602191 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7e5e253-6f28-4c09-a71b-5148f573cf3b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.155698 Jul 14 15:41:25.602813 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3288/6414] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:25 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:26.264680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-67c71c21-1642-4560-9bb5-8be86c40e1b5 req-3923eff9-580c-43f1-9923-9397b96420b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa38393-3829-493b-b6f2-71d2dd711f60", "name": "network-vif-plugged", "status": "completed", "tag": "245ee401-c882-42fd-9e40-8e80bdce70c6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:26.281536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-67c71c21-1642-4560-9bb5-8be86c40e1b5 req-3923eff9-580c-43f1-9923-9397b96420b9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.282297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-67c71c21-1642-4560-9bb5-8be86c40e1b5 req-3923eff9-580c-43f1-9923-9397b96420b9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.293740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-67c71c21-1642-4560-9bb5-8be86c40e1b5 req-3923eff9-580c-43f1-9923-9397b96420b9 service nova] Creating event network-vif-plugged:245ee401-c882-42fd-9e40-8e80bdce70c6 for instance 1aa38393-3829-493b-b6f2-71d2dd711f60 on n-h2-768852-23 Jul 14 15:41:26.299038 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-67c71c21-1642-4560-9bb5-8be86c40e1b5 req-3923eff9-580c-43f1-9923-9397b96420b9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106724 Jul 14 15:41:26.300033 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3127/6415] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:26.619767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:26.620418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:26.627575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.628033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.628820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.629264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.767345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:26.775195 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53fdc866-ec63-4d0a-bb38-c51cbc6399ec tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1266 microversion: 2.1 time: 0.159548 Jul 14 15:41:26.775815 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3289/6416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:26 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:27.794731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:27.795488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:27.803059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.803554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.804358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.804811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.944804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:27.952744 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aae6b7fb-2739-49ab-9f0d-d7b8bdc5c892 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1453 microversion: 2.1 time: 0.162801 Jul 14 15:41:27.953354 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3128/6417] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:27 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:27.971496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:27.972267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:27.979119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.979592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.981002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.981435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:28.115813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:28.124193 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-736f996b-48d5-4213-8d15-32bb7fd2f3cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1453 microversion: 2.1 time: 0.156689 Jul 14 15:41:28.124775 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3290/6418] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:27 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:29.804882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f1bc6137-4ed5-4c62-8894-9a28baafafc9 req-4555b9be-17bb-465c-b1a7-31ea42e3da72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa38393-3829-493b-b6f2-71d2dd711f60", "tag": "245ee401-c882-42fd-9e40-8e80bdce70c6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:29.814983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f1bc6137-4ed5-4c62-8894-9a28baafafc9 req-4555b9be-17bb-465c-b1a7-31ea42e3da72 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:29.815796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f1bc6137-4ed5-4c62-8894-9a28baafafc9 req-4555b9be-17bb-465c-b1a7-31ea42e3da72 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:29.829364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f1bc6137-4ed5-4c62-8894-9a28baafafc9 req-4555b9be-17bb-465c-b1a7-31ea42e3da72 service nova] Creating event network-changed:245ee401-c882-42fd-9e40-8e80bdce70c6 for instance 1aa38393-3829-493b-b6f2-71d2dd711f60 on n-h2-768852-23 Jul 14 15:41:29.834576 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f1bc6137-4ed5-4c62-8894-9a28baafafc9 req-4555b9be-17bb-465c-b1a7-31ea42e3da72 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033500 Jul 14 15:41:29.835415 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3129/6419] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:41:48.595130 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:41:48.595858 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:41:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:41:48.668608 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:41:48.668815 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:41:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:41:50.830251 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:41:50.830941 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:41:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:42:13.197163 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:42:13.197841 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:42:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:43:09.262311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:09.265148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=22 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:09.266370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=54 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:09.268080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=50 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:09.274143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:09.278570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f26b18ea-deab-465e-a777-c0642dd54477 req-7e821a23-0997-4b14-8459-dfe6938c942d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1aa38393-3829-493b-b6f2-71d2dd711f60", "tag": "245ee401-c882-42fd-9e40-8e80bdce70c6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:09.279303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:09.286749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.287306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.288166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.288687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.297852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f26b18ea-deab-465e-a777-c0642dd54477 req-7e821a23-0997-4b14-8459-dfe6938c942d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.298315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f26b18ea-deab-465e-a777-c0642dd54477 req-7e821a23-0997-4b14-8459-dfe6938c942d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.311511 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f26b18ea-deab-465e-a777-c0642dd54477 req-7e821a23-0997-4b14-8459-dfe6938c942d service nova] Creating event network-changed:245ee401-c882-42fd-9e40-8e80bdce70c6 for instance 1aa38393-3829-493b-b6f2-71d2dd711f60 on n-h2-768852-23 Jul 14 15:43:09.316873 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f26b18ea-deab-465e-a777-c0642dd54477 req-7e821a23-0997-4b14-8459-dfe6938c942d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057022 Jul 14 15:43:09.317368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:43:09.318081 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3130/6420] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:09.407654 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9d7bbc0d-7c87-4dfc-9759-5aef89ff5649 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 204 len: 0 microversion: 2.1 time: 0.149598 Jul 14 15:43:09.412932 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3291/6421] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:43:09 2022] DELETE /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:43:09.418998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:09.419904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:09.428070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.428752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.429883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.430397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.570497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:09.584063 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b510e25-a58a-4f7b-899b-b0cb7f131a4f tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1578 microversion: 2.1 time: 0.169500 Jul 14 15:43:09.584674 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3131/6422] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:09 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:10.602668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:10.603358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:10.615497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.615954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.616753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.617190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.758058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:10.767588 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29854334-4265-4904-b98d-f7fa7f9eb0cd tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1578 microversion: 2.1 time: 0.169584 Jul 14 15:43:10.768427 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3292/6423] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:10 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:11.706900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-cdd3b629-85c9-4dd8-90d8-a9c485127f25 req-740e00d1-799d-4b02-a6c7-20e76504ccfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1aa38393-3829-493b-b6f2-71d2dd711f60", "name": "network-vif-deleted", "tag": "245ee401-c882-42fd-9e40-8e80bdce70c6"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:11.715599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cdd3b629-85c9-4dd8-90d8-a9c485127f25 req-740e00d1-799d-4b02-a6c7-20e76504ccfe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.716082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cdd3b629-85c9-4dd8-90d8-a9c485127f25 req-740e00d1-799d-4b02-a6c7-20e76504ccfe service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.728715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-cdd3b629-85c9-4dd8-90d8-a9c485127f25 req-740e00d1-799d-4b02-a6c7-20e76504ccfe service nova] Creating event network-vif-deleted:245ee401-c882-42fd-9e40-8e80bdce70c6 for instance 1aa38393-3829-493b-b6f2-71d2dd711f60 on n-h2-768852-23 Jul 14 15:43:11.733882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-cdd3b629-85c9-4dd8-90d8-a9c485127f25 req-740e00d1-799d-4b02-a6c7-20e76504ccfe service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098305 Jul 14 15:43:11.734812 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3132/6424] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:11.786947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:11.788455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:11.794842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.795351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.796193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.796625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.863001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:11.871086 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-548577d6-3099-4f79-ac66-8e37b02216a4 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1225 microversion: 2.1 time: 0.088925 Jul 14 15:43:11.871728 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3293/6425] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:11 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:12.888222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:12.888929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:12.896642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.897188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.897941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.898435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.976129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:12.984943 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d0e2db28-2615-4143-ac08-c2006d0807e3 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1225 microversion: 2.1 time: 0.100900 Jul 14 15:43:12.985588 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3133/6426] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:12 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1225 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:14.007560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:14.009808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:14.022674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:14.023567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:14.025280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:14.026328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:14.142669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:14.165338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-609265ad-a7a7-4004-9dfb-60503395ea46 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1225 microversion: 2.1 time: 0.165174 Jul 14 15:43:14.179313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3294/6427] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:13 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1225 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:15.197877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:15.199734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:15.211993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:15.212861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:15.213814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:15.214516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:15.323289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:15.332040 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8be63af0-8bdb-4881-8959-9b651562821c tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1225 microversion: 2.1 time: 0.144183 Jul 14 15:43:15.332668 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3134/6428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:15 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:16.351295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:16.352062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:16.359365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.359746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.360544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.360980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.395076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.395785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.396332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lazy-loading 'fault' on Instance uuid 1aa38393-3829-493b-b6f2-71d2dd711f60 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:43:16.440341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:16.449053 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9673e1db-de35-4741-868a-286da9ba44ff tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 200 len: 1230 microversion: 2.1 time: 0.103528 Jul 14 15:43:16.449636 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3295/6429] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:16 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:17.466868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:17.467508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: 1aa38393-3829-493b-b6f2-71d2dd711f60] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:17.475003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:17.475492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:17.476265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:17.476710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:17.490120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance 1aa38393-3829-493b-b6f2-71d2dd711f60 could not be found. Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 HTTP/1.1 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 1aa38393-3829-493b-b6f2-71d2dd711f60 could not be found. Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '1aa38393-3829-493b-b6f2-71d2dd711f60'} Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1aa38393-3829-493b-b6f2-71d2dd711f60 could not be found. Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1aa38393-3829-493b-b6f2-71d2dd711f60 could not be found. Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:17.491831 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1aa38393-3829-493b-b6f2-71d2dd711f60 could not be found. Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance 1aa38393-3829-493b-b6f2-71d2dd711f60 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aba945bc-919d-4152-8cf0-420f33a22a54 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60" status: 404 len: 111 microversion: 2.1 time: 0.030287 Jul 14 15:43:17.495486 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3135/6430] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:17 2022] GET /compute/v2.1/servers/1aa38393-3829-493b-b6f2-71d2dd711f60 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:23.717313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:23.717821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:23.719060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a0180c3b-53c7-4cc1-9488-59ebbf60d02f req-d7cea4c0-173e-40e2-be99-2e4a4be84091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f11710e5-f9cc-4f89-a121-687698790a32", "tag": "de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:23.725556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.726261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.727109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.727661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.729163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a0180c3b-53c7-4cc1-9488-59ebbf60d02f req-d7cea4c0-173e-40e2-be99-2e4a4be84091 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.729619 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a0180c3b-53c7-4cc1-9488-59ebbf60d02f req-d7cea4c0-173e-40e2-be99-2e4a4be84091 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.743758 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a0180c3b-53c7-4cc1-9488-59ebbf60d02f req-d7cea4c0-173e-40e2-be99-2e4a4be84091 service nova] Creating event network-changed:de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a for instance f11710e5-f9cc-4f89-a121-687698790a32 on n-h1-768852-23 Jul 14 15:43:23.749720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a0180c3b-53c7-4cc1-9488-59ebbf60d02f req-d7cea4c0-173e-40e2-be99-2e4a4be84091 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034345 Jul 14 15:43:23.750324 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3136/6431] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:43:23.755827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:43:23.846887 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e0a8b748-72e3-40a9-80bf-6d0d650e8ff6 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 204 len: 0 microversion: 2.1 time: 0.132100 Jul 14 15:43:23.847978 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3296/6432] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:43:23 2022] DELETE /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:43:23.857437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:23.858364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:23.865879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.866293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.867081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.867561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:24.007637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:24.015358 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-45295e81-e855-4b80-ab92-a18fbf433be2 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1576 microversion: 2.1 time: 0.162126 Jul 14 15:43:24.015950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3137/6433] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:23 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:25.034671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:25.035318 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:25.042181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:25.042631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:25.043428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:25.043869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:25.187656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:25.197747 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28d41054-2f7b-4c48-bca8-18caf761cec5 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1576 microversion: 2.1 time: 0.168101 Jul 14 15:43:25.198524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3297/6434] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:25 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:26.218168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:26.218795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:26.226529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:26.226990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:26.227936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:26.228379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:26.364691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:26.372601 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-febf3cd6-0551-4e6d-a313-234380b12c1e tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1457 microversion: 2.1 time: 0.158388 Jul 14 15:43:26.373184 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3138/6435] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:26 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1457 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:26.678109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5bde383c-22c6-4885-9f6c-092e22e9bca9 req-8f7c5e1e-f34c-41ad-839a-5479e0922cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f11710e5-f9cc-4f89-a121-687698790a32", "name": "network-vif-deleted", "tag": "de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:26.688132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5bde383c-22c6-4885-9f6c-092e22e9bca9 req-8f7c5e1e-f34c-41ad-839a-5479e0922cf3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:26.688568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5bde383c-22c6-4885-9f6c-092e22e9bca9 req-8f7c5e1e-f34c-41ad-839a-5479e0922cf3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:26.701574 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5bde383c-22c6-4885-9f6c-092e22e9bca9 req-8f7c5e1e-f34c-41ad-839a-5479e0922cf3 service nova] Creating event network-vif-deleted:de9b5a3e-5ee5-4b8a-b2a7-1576a6a0ff3a for instance f11710e5-f9cc-4f89-a121-687698790a32 on n-h1-768852-23 Jul 14 15:43:26.708653 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5bde383c-22c6-4885-9f6c-092e22e9bca9 req-8f7c5e1e-f34c-41ad-839a-5479e0922cf3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034052 Jul 14 15:43:26.709836 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3298/6436] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:27.388864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:27.389485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:27.397304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:27.397759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:27.398534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:27.398978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:27.473149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:27.480931 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd7e2b1f-cfd8-408c-b2ee-7a0e4cb4ec97 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1224 microversion: 2.1 time: 0.095955 Jul 14 15:43:27.481514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3139/6437] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:27 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:28.499157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:28.499909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:28.507130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:28.507623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:28.508399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:28.508842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:28.573425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:28.581466 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eda78622-d546-40a5-9288-8ce1221a90a9 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1224 microversion: 2.1 time: 0.087782 Jul 14 15:43:28.582116 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3299/6438] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:28 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:29.598408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:29.599004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:29.606781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:29.607302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:29.608180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:29.608695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:29.679390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:29.687422 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-235ec72b-caa4-4d75-8fc6-92bfbe712489 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1224 microversion: 2.1 time: 0.093223 Jul 14 15:43:29.688011 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3140/6439] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:29 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:30.705452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:30.706243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:30.713597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:30.714051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:30.714835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:30.715296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:30.788723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bb893892edc491d9f3df8f82b3c9952', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4165c8dc427140468645e52deac8d496', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:30.796466 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35e51ab2-0602-4f9c-8d25-1728bf73df84 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 200 len: 1224 microversion: 2.1 time: 0.094985 Jul 14 15:43:30.797054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3300/6440] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:30 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:31.693030 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:43:31.693597 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:43:31.814728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:31.815389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: f11710e5-f9cc-4f89-a121-687698790a32] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:31.822059 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:31.822518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:31.823312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:31.823765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:31.839939 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance f11710e5-f9cc-4f89-a121-687698790a32 could not be found. Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 HTTP/1.1 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f11710e5-f9cc-4f89-a121-687698790a32 could not be found. Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f11710e5-f9cc-4f89-a121-687698790a32'} Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f11710e5-f9cc-4f89-a121-687698790a32 could not be found. Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f11710e5-f9cc-4f89-a121-687698790a32 could not be found. Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:31.841813 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f11710e5-f9cc-4f89-a121-687698790a32 could not be found. Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance f11710e5-f9cc-4f89-a121-687698790a32 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cfa65b81-ee22-472a-955e-fad010e4424b tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32" status: 404 len: 111 microversion: 2.1 time: 0.032825 Jul 14 15:43:31.847914 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3141/6441] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:31 2022] GET /compute/v2.1/servers/f11710e5-f9cc-4f89-a121-687698790a32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:32.308196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:32.308721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:32.316185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:32.316629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:32.317414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:32.318006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:32.331507 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 HTTP/1.1 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'b87ad96e-90da-4673-b7c2-4740059c7df8'} Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:43:32.333178 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7f6572ed-0d53-4b9d-be39-86c4276814eb tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 404 len: 111 microversion: 2.1 time: 0.030345 Jul 14 15:43:32.337430 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3301/6442] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:43:32 2022] DELETE /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:32.343475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:32.344122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] [instance: b87ad96e-90da-4673-b7c2-4740059c7df8] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:32.350245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:32.350701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:32.351495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:32.351945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:32.365842 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] HTTP exception thrown: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Request method failure captured: Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 HTTP/1.1 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dc4RnbHvsgsK8f9eoT_g2f-16B1jkgoFyhPVIhl4aEW6alkpSzO4vpYFP9XP6o4dGVKUW9M1ii9GIz5FcD5TaqlsAqUx1fitttJAZcYrvAX7MYRlAW5ACNxEnfDhd2yIKoV4ZzFU7kuEnrzIaa7TTdJ1SzovB5TWSvzi1QvxsCRzds Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_4165c8dc427140468645e52deac8d496"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/4165c8dc427140468645e52deac8d496"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/4165c8dc427140468645e52deac8d496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 4165c8dc427140468645e52deac8d496 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestVolumeBootPattern-897586073 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 8bb893892edc491d9f3df8f82b3c9952 Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestVolumeBootPattern-897586073-project Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b87ad96e-90da-4673-b7c2-4740059c7df8'} Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:32.367465 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Returning 404 to user: Instance b87ad96e-90da-4673-b7c2-4740059c7df8 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-050e6917-c0bb-4511-9400-eb994cd66b43 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8" status: 404 len: 111 microversion: 2.1 time: 0.029398 Jul 14 15:43:32.371143 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3142/6443] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:32 2022] GET /compute/v2.1/servers/b87ad96e-90da-4673-b7c2-4740059c7df8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:43:35.775572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a02b17c3-a48f-40aa-bd1d-999c14a51ae1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] Calling method '.version_select at 0x7fdbf1b8e040>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:35.801221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a02b17c3-a48f-40aa-bd1d-999c14a51ae1 tempest-TestVolumeBootPattern-897586073 tempest-TestVolumeBootPattern-897586073-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-675563424" status: 202 len: 0 microversion: 2.1 time: 0.029563 Jul 14 15:43:35.802034 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3302/6444] 10.222.0.98 () {58 vars in 1259 bytes} [Thu Jul 14 15:43:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-675563424 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:43:54.159417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=26 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:54.160506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=54 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:54.299511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-594005972", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:54.349530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] validate_networks() for None {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:43:54.620915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:43:54.621502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:43:54.621984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:43:54.622403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:43:54.622829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:43:54.632620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:54.633070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:54.633866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:54.634307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:54.652285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Getting quotas for project 5df07bd7198c479ca95b593f2a44ca80. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:43:54.658791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Getting quotas for user 2becebb58dc94c19ad687577b7a1ec9a and project 5df07bd7198c479ca95b593f2a44ca80. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:43:54.672228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:43:54.674499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:43:54.721401 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03e5fe4f-18f1-4a26-9f5c-dc5182533d44 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563987 Jul 14 15:43:54.722278 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3143/6445] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:43:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:43:54.734551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:54.738259 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:54.742826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3475ee3-1b23-4ce9-b84a-2771c7470142 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:54.743348 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3475ee3-1b23-4ce9-b84a-2771c7470142 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:54.803637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b3475ee3-1b23-4ce9-b84a-2771c7470142 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:54.810659 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3475ee3-1b23-4ce9-b84a-2771c7470142 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1221 microversion: 2.1 time: 0.081613 Jul 14 15:43:54.811187 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3303/6446] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:54 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1221 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:55.829429 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:55.830716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:55.837154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:55.837620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:55.838426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:55.838855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:55.906256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:55.915071 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8a64b293-27d1-4a7b-b3e7-3bfae2bcb470 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1281 microversion: 2.1 time: 0.090308 Jul 14 15:43:55.915704 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3144/6447] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:55 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:56.933121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:56.933840 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:56.941408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:56.941853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:56.942620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:56.943057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.176044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:57.184069 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38def37c-fbf0-4ce0-83f7-b123408766b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.254783 Jul 14 15:43:57.184666 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3304/6448] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:56 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:58.009492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-1fc1e6b1-67cc-4774-bad5-9904c516e98a req-f70b3ef3-21b1-422a-8b35-80aa017641aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e80ff27c-ba30-432b-aa2b-9601751fabc2", "tag": "095fb1c8-af50-4f17-8629-e95e98d11a0e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:58.021878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1fc1e6b1-67cc-4774-bad5-9904c516e98a req-f70b3ef3-21b1-422a-8b35-80aa017641aa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.022328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-1fc1e6b1-67cc-4774-bad5-9904c516e98a req-f70b3ef3-21b1-422a-8b35-80aa017641aa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.044354 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-1fc1e6b1-67cc-4774-bad5-9904c516e98a req-f70b3ef3-21b1-422a-8b35-80aa017641aa service nova] Creating event network-changed:095fb1c8-af50-4f17-8629-e95e98d11a0e for instance e80ff27c-ba30-432b-aa2b-9601751fabc2 on n-h1-768852-23 Jul 14 15:43:58.049979 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-1fc1e6b1-67cc-4774-bad5-9904c516e98a req-f70b3ef3-21b1-422a-8b35-80aa017641aa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045329 Jul 14 15:43:58.050577 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3145/6449] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:58.201527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:58.202138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:58.209028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.209474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.210422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.210861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.436275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:58.443735 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9a9b6d0f-99dd-462c-846d-5bf3a91ad933 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.246071 Jul 14 15:43:58.444321 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3305/6450] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:58 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:59.462428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:59.463143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:59.469459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:59.470515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:59.471324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:59.471780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:59.716675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:59.724500 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d06e3d9a-4d02-4b9f-b25b-95c5dc762e5f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.267053 Jul 14 15:43:59.725116 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3146/6451] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:59 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:00.741706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:00.742313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:00.749626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:00.750077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:00.750847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:00.751300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:00.944616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:00.952294 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-695c5fdd-2291-42a4-8581-e8e04d4517b7 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.214439 Jul 14 15:44:00.952885 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3306/6452] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:00 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:01.970551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:01.971158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:01.977664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.978125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.978890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.979360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.109472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:02.117563 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dde687b3-7231-4ae8-86fe-bddb1638dad8 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.151562 Jul 14 15:44:02.118173 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3147/6453] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:01 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:03.134986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:03.135712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:03.144383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.144838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.145624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.146067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.234875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4f5db12f-6122-4fb0-9f21-d3d4e404a4d8 req-a3d0a3e0-8eaf-463a-b9d5-7129b85143b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80ff27c-ba30-432b-aa2b-9601751fabc2", "name": "network-vif-plugged", "status": "completed", "tag": "095fb1c8-af50-4f17-8629-e95e98d11a0e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:03.247839 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4f5db12f-6122-4fb0-9f21-d3d4e404a4d8 req-a3d0a3e0-8eaf-463a-b9d5-7129b85143b0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.248384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4f5db12f-6122-4fb0-9f21-d3d4e404a4d8 req-a3d0a3e0-8eaf-463a-b9d5-7129b85143b0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.266826 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4f5db12f-6122-4fb0-9f21-d3d4e404a4d8 req-a3d0a3e0-8eaf-463a-b9d5-7129b85143b0 service nova] Creating event network-vif-plugged:095fb1c8-af50-4f17-8629-e95e98d11a0e for instance e80ff27c-ba30-432b-aa2b-9601751fabc2 on n-h1-768852-23 Jul 14 15:44:03.271887 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4f5db12f-6122-4fb0-9f21-d3d4e404a4d8 req-a3d0a3e0-8eaf-463a-b9d5-7129b85143b0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040140 Jul 14 15:44:03.273592 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3148/6454] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:03.290230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:03.298248 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-01251ff5-4532-4a37-b1b6-a853286f758c tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.167851 Jul 14 15:44:03.299531 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3307/6455] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:03 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:04.318488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:04.319209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:04.326394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.326864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.327691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.328145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.643499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:04.666843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:04.750618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:04.758185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66278175-6a04-44d4-a67f-aa226ed00f3f tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1321 microversion: 2.1 time: 0.444657 Jul 14 15:44:04.758779 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3149/6456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:04 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1321 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:05.774463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:05.775096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:05.777847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:05.783634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.784090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.784866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.785295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.914937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:05.922550 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dcf655d4-db52-48dc-8c1a-3820e60f23b3 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1470 microversion: 2.1 time: 0.152130 Jul 14 15:44:05.923119 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3308/6457] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:05 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:05.987754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd7ab976-083c-4062-82fb-46edd798ef50 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Calling method '.version_select at 0x7fdbf1c25c10>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.053571 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fd7ab976-083c-4062-82fb-46edd798ef50 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/9ece3acc922146e197d68067a104d363" status: 200 len: 371 microversion: 2.1 time: 0.116053 Jul 14 15:44:06.054155 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3150/6458] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:44:05 2022] GET /compute/v2.1/os-quota-sets/9ece3acc922146e197d68067a104d363 => generated 371 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:06.064570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc54d3b4-2395-46ef-91ce-bdc0ffe48ff2 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2099728296", "id": 1067472059, "os-flavor-access:is_public": "True"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:06.066717 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:44:06.066717 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 15:44:06.082068 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc54d3b4-2395-46ef-91ce-bdc0ffe48ff2 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021266 Jul 14 15:44:06.082678 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3309/6459] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:44:06 2022] POST /compute/v2.1/flavors => generated 438 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:06.093666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1067472059"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:06.094710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.100925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.101383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.102176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.102620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.237075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2ab88548976946e8850cd556c3a5cb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ece3acc922146e197d68067a104d363', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:06.243715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2099728296 {{(pid=125966) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:44:06.250481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.250934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.251803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.252248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.274538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Getting quotas for project 5df07bd7198c479ca95b593f2a44ca80. Resources: {'ram', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:44:06.279827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Getting quotas for user 2becebb58dc94c19ad687577b7a1ec9a and project 5df07bd7198c479ca95b593f2a44ca80. Resources: {'ram', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:44:06.292610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] ram quota exceeded for 9ece3acc922146e197d68067a104d363, tried to resize instance. Jul 14 15:44:06.293420 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Request method failure captured: Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2/action HTTP/1.1 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 39 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dm5znl8A429wU67WYr0OmovtcfV8A9yHD0fCrMljhwhiI1nJ6FgG47Jaz-JcKNxF61oL-5Sg6ZbPgVbLJINYUC_V-YWV68IClGAzBV31f3vCgYNZYK69OUVAQOxD2sUkc-tL6RTjN63HKZbn_-4XUd2jBMmLcTHxJBFZQ_hu70JYgE Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 9ece3acc922146e197d68067a104d363 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1914585646 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Role: admin,member,reader Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: admin,member,reader Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9ece3acc922146e197d68067a104d363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_9ece3acc922146e197d68067a104d363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9ece3acc922146e197d68067a104d363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/9ece3acc922146e197d68067a104d363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1914585646 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 9ece3acc922146e197d68067a104d363 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1914585646 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersAdminNegativeTestJSON-1914585646-project-admin Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 2ab88548976946e8850cd556c3a5cb94 Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1914585646-project-admin Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: {"resize": {"flavorRef": "1067472059"}} Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e80ff27c-ba30-432b-aa2b-9601751fabc2', 'body': {'resize': {'flavorRef': '1067472059'}}} Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:44:06.312345 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1058, in _resize Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19405670-edce-4351-9cfe-7d8c95aa0b06 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2/action" status: 403 len: 118 microversion: 2.1 time: 0.224284 Jul 14 15:44:06.315956 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3151/6460] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:44:06 2022] POST /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2/action => generated 118 bytes in 225 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:06.322972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-928d86a2-f456-4024-94e2-be7b268bad81 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.323859 n-d-768852-23 devstack@n-api.service[125965]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:44:06.323859 n-d-768852-23 devstack@n-api.service[125965]: warnings.warn(msg) Jul 14 15:44:06.340398 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-928d86a2-f456-4024-94e2-be7b268bad81 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1067472059" status: 202 len: 0 microversion: 2.1 time: 0.020987 Jul 14 15:44:06.340995 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3310/6461] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 15:44:06 2022] DELETE /compute/v2.1/flavors/1067472059 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:44:06.349826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a2b75b19-9e64-4cfc-9be1-c2e9dbbc684a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.369860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a2b75b19-9e64-4cfc-9be1-c2e9dbbc684a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024117 Jul 14 15:44:06.370443 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3152/6462] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:06.387090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-79a7e6ba-eaf5-4e90-b659-a6c1dff1ea59 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Calling method '.version_select at 0x7fdbf1b49310>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.460305 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-79a7e6ba-eaf5-4e90-b659-a6c1dff1ea59 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "GET /compute/v2.1/os-quota-sets/9ece3acc922146e197d68067a104d363" status: 200 len: 371 microversion: 2.1 time: 0.076910 Jul 14 15:44:06.460893 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3311/6463] 10.222.0.98 () {58 vars in 1241 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/os-quota-sets/9ece3acc922146e197d68067a104d363 => generated 371 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:06.472731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f1434ec4-414d-4eef-8cd1-79b8e66211fb tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1109061712", "id": 1937639185, "os-flavor-access:is_public": "True"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:06.474379 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:44:06.474379 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:44:06.490471 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f1434ec4-414d-4eef-8cd1-79b8e66211fb tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.022949 Jul 14 15:44:06.491111 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3153/6464] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:44:06 2022] POST /compute/v2.1/flavors => generated 437 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:06.502178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1937639185"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:06.503202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.509457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.509984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.510713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.511141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.644135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '2ab88548976946e8850cd556c3a5cb94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ece3acc922146e197d68067a104d363', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:06.650824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1109061712 {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:44:06.657562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.658925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.659753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.660355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.682510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Getting quotas for project 5df07bd7198c479ca95b593f2a44ca80. Resources: {'ram', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:44:06.687748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Getting quotas for user 2becebb58dc94c19ad687577b7a1ec9a and project 5df07bd7198c479ca95b593f2a44ca80. Resources: {'ram', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:44:06.701004 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.compute.api [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] cores quota exceeded for 9ece3acc922146e197d68067a104d363, tried to resize instance. Jul 14 15:44:06.701541 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Request method failure captured: Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2/action HTTP/1.1 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 39 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dm5znl8A429wU67WYr0OmovtcfV8A9yHD0fCrMljhwhiI1nJ6FgG47Jaz-JcKNxF61oL-5Sg6ZbPgVbLJINYUC_V-YWV68IClGAzBV31f3vCgYNZYK69OUVAQOxD2sUkc-tL6RTjN63HKZbn_-4XUd2jBMmLcTHxJBFZQ_hu70JYgE Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 9ece3acc922146e197d68067a104d363 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1914585646 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Role: admin,member,reader Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: admin,member,reader Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9ece3acc922146e197d68067a104d363"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_9ece3acc922146e197d68067a104d363"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/9ece3acc922146e197d68067a104d363"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/9ece3acc922146e197d68067a104d363"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1914585646 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 9ece3acc922146e197d68067a104d363 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1914585646 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersAdminNegativeTestJSON-1914585646-project-admin Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2ab88548976946e8850cd556c3a5cb94 Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1914585646-project-admin Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: {"resize": {"flavorRef": "1937639185"}} Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e80ff27c-ba30-432b-aa2b-9601751fabc2', 'body': {'resize': {'flavorRef': '1937639185'}}} Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3821, in _check_quota_for_upsize Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:44:06.703541 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4190, in resize Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3839, in _check_quota_for_upsize Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1058, in _resize Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c26084de-4cc3-4387-b0dd-2514ec6a8a8a tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "POST /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2/action" status: 403 len: 113 microversion: 2.1 time: 0.206796 Jul 14 15:44:06.708104 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3312/6465] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:44:06 2022] POST /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2/action => generated 113 bytes in 209 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:06.714427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15e797b3-a7df-4de7-bc92-e28c8a4971fa tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.715187 n-d-768852-23 devstack@n-api.service[125966]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:44:06.715187 n-d-768852-23 devstack@n-api.service[125966]: warnings.warn(msg) Jul 14 15:44:06.731688 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15e797b3-a7df-4de7-bc92-e28c8a4971fa tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "DELETE /compute/v2.1/flavors/1937639185" status: 202 len: 0 microversion: 2.1 time: 0.020892 Jul 14 15:44:06.732259 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3154/6466] 10.222.0.98 () {58 vars in 1160 bytes} [Thu Jul 14 15:44:06 2022] DELETE /compute/v2.1/flavors/1937639185 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:44:06.740471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22659213-8201-4a5d-a4ea-1770c8bd6231 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.759487 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22659213-8201-4a5d-a4ea-1770c8bd6231 tempest-ServersAdminNegativeTestJSON-1914585646 tempest-ServersAdminNegativeTestJSON-1914585646-project-admin] 10.222.0.98 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022661 Jul 14 15:44:06.760068 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3313/6467] 10.222.0.98 () {58 vars in 1145 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:06.777442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.777970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.785239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.785730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.786542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.786991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.812096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:44:06.890504 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab1b528c-11f4-49c5-aa30-41160a1346aa tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 204 len: 0 microversion: 2.1 time: 0.116653 Jul 14 15:44:06.890989 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3155/6468] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:44:06 2022] DELETE /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:44:06.899424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.900059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.907378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.907837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.908865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.909320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.039012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:07.046628 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a81b5e05-f0ca-4766-99eb-668832ff1798 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1476 microversion: 2.1 time: 0.151319 Jul 14 15:44:07.047205 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3314/6469] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:08.066037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:08.066748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:08.073533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.073991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.074753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.075195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.209461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:08.217451 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9e17e866-3a67-44eb-a235-ce2ca0b1e9df tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1476 microversion: 2.1 time: 0.156279 Jul 14 15:44:08.218227 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3156/6470] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:08 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1476 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:08.879173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3586ab5e-1654-46ae-8488-1c298138bb1b req-fe39ede9-1518-4813-af85-06afa1b82156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e80ff27c-ba30-432b-aa2b-9601751fabc2", "name": "network-vif-deleted", "tag": "095fb1c8-af50-4f17-8629-e95e98d11a0e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:08.890184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3586ab5e-1654-46ae-8488-1c298138bb1b req-fe39ede9-1518-4813-af85-06afa1b82156 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.890626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3586ab5e-1654-46ae-8488-1c298138bb1b req-fe39ede9-1518-4813-af85-06afa1b82156 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.904806 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3586ab5e-1654-46ae-8488-1c298138bb1b req-fe39ede9-1518-4813-af85-06afa1b82156 service nova] Creating event network-vif-deleted:095fb1c8-af50-4f17-8629-e95e98d11a0e for instance e80ff27c-ba30-432b-aa2b-9601751fabc2 on n-h1-768852-23 Jul 14 15:44:08.912968 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3586ab5e-1654-46ae-8488-1c298138bb1b req-fe39ede9-1518-4813-af85-06afa1b82156 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038614 Jul 14 15:44:08.913598 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3315/6471] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:09.234870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:09.235531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:09.241873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.242331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.243114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.243593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.279700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.280164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.280624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lazy-loading 'fault' on Instance uuid e80ff27c-ba30-432b-aa2b-9601751fabc2 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:44:09.326642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2becebb58dc94c19ad687577b7a1ec9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5df07bd7198c479ca95b593f2a44ca80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:09.334787 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8be49776-efa9-416d-9f59-059065285655 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 200 len: 1311 microversion: 2.1 time: 0.104660 Jul 14 15:44:09.335824 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3157/6472] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:09 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:10.353375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:10.354081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] [instance: e80ff27c-ba30-432b-aa2b-9601751fabc2] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:10.361338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.361786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:10.362573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.363007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:10.376171 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] HTTP exception thrown: Instance e80ff27c-ba30-432b-aa2b-9601751fabc2 could not be found. Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Request method failure captured: Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 HTTP/1.1 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dm5gMOdijFuEyWU8R-02fFQIv11ACJj20sgu_LQplOWB3y0K5UEzqYgdIwixaPoZtFZ7ffFBnMT74_oNNEWAzryv2aJPbA9HSY-rA-D6qf5nttMEIx8kkN1wiajfpSBG4TxkW-WDLsU9ef9BaHCti_J-Y84Y_gB-WySiWht8UbtdcM Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 5df07bd7198c479ca95b593f2a44ca80 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1567651042 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5df07bd7198c479ca95b593f2a44ca80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_5df07bd7198c479ca95b593f2a44ca80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/5df07bd7198c479ca95b593f2a44ca80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/5df07bd7198c479ca95b593f2a44ca80"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1567651042 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 5df07bd7198c479ca95b593f2a44ca80 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1567651042 Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersAdminNegativeTestJSON-1567651042-project Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 2becebb58dc94c19ad687577b7a1ec9a Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1567651042-project Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance e80ff27c-ba30-432b-aa2b-9601751fabc2 could not be found. Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'e80ff27c-ba30-432b-aa2b-9601751fabc2'} Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e80ff27c-ba30-432b-aa2b-9601751fabc2 could not be found. Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e80ff27c-ba30-432b-aa2b-9601751fabc2 could not be found. Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:10.377848 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e80ff27c-ba30-432b-aa2b-9601751fabc2 could not be found. Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] Returning 404 to user: Instance e80ff27c-ba30-432b-aa2b-9601751fabc2 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dd3f056b-a02a-4138-96d9-912b3a92a2a9 tempest-ServersAdminNegativeTestJSON-1567651042 tempest-ServersAdminNegativeTestJSON-1567651042-project] 10.222.0.98 "GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2" status: 404 len: 111 microversion: 2.1 time: 0.030225 Jul 14 15:44:10.381562 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3316/6473] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:10 2022] GET /compute/v2.1/servers/e80ff27c-ba30-432b-aa2b-9601751fabc2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:44:16.188689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.261758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.305915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-424469087", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "6261cd10-e31e-4d65-b972-a6f6fee7658e"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:16.357951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] validate_networks() for [('6261cd10-e31e-4d65-b972-a6f6fee7658e', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:44:16.773363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:44:16.773796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:44:16.774278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:44:16.774698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:44:16.775119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:44:16.786612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:16.787191 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:16.788120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:16.788657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:16.807695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Getting quotas for project cbf3c5a4b2854ac98f3f67ce72a1cdfc. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:44:16.813419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Getting quotas for user 62f485345ff14d08b2f7c3608f5b83b1 and project cbf3c5a4b2854ac98f3f67ce72a1cdfc. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:44:16.827447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:44:16.831362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:44:16.881149 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16252cdd-c498-41a6-b388-a7c8396ffdf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697954 Jul 14 15:44:16.881823 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3158/6474] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:44:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:44:16.892615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba06bc81-3c61-4004-a631-574f0801a3b1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:16.893264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba06bc81-3c61-4004-a631-574f0801a3b1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:16.895731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.896427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.959377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba06bc81-3c61-4004-a631-574f0801a3b1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:16.970563 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba06bc81-3c61-4004-a631-574f0801a3b1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1214 microversion: 2.1 time: 0.082372 Jul 14 15:44:16.973440 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3317/6475] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:16 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:17.993081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:17.994466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:18.002800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:18.003527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:18.004627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:18.005348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:18.081466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:18.090811 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37b4fd2e-7894-478c-b560-e3372bfa1a2b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1274 microversion: 2.1 time: 0.103957 Jul 14 15:44:18.091426 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3159/6476] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:17 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:19.108511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:19.109431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:19.117867 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.118554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.119750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.120396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.331043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:19.342037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e5d16e92-0524-4c8d-9f86-cb2d28640049 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.237538 Jul 14 15:44:19.342635 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3318/6477] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:19 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:19.567246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-aa060d7a-37f7-4cb2-b0ea-9312927521b6 req-187f67bd-1583-4683-af10-6e607f6fe2c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f158a-77e0-410f-b1d4-6a682a619d91", "tag": "3c44588e-fb4f-499a-b1f1-cf10ac96868e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:19.583206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-aa060d7a-37f7-4cb2-b0ea-9312927521b6 req-187f67bd-1583-4683-af10-6e607f6fe2c5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.587375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-aa060d7a-37f7-4cb2-b0ea-9312927521b6 req-187f67bd-1583-4683-af10-6e607f6fe2c5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.624187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-aa060d7a-37f7-4cb2-b0ea-9312927521b6 req-187f67bd-1583-4683-af10-6e607f6fe2c5 service nova] Creating event network-changed:3c44588e-fb4f-499a-b1f1-cf10ac96868e for instance 449f158a-77e0-410f-b1d4-6a682a619d91 on n-h1-768852-23 Jul 14 15:44:19.630607 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-aa060d7a-37f7-4cb2-b0ea-9312927521b6 req-187f67bd-1583-4683-af10-6e607f6fe2c5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067685 Jul 14 15:44:19.631450 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3160/6478] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:20.359692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:20.360419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:20.370462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:20.370915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:20.371728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:20.372177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:20.871752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:20.880070 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4180cc79-6373-495c-b508-df587df11bc2 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.524222 Jul 14 15:44:20.880647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3319/6479] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:20 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:21.899301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:21.899946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:21.906299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:21.906744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:21.907717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:21.908935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:22.043146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:22.050825 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-76be0930-39df-4873-8b91-3349bbd1012f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.156621 Jul 14 15:44:22.051438 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3161/6480] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:21 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:23.067007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:23.067684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:23.074564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:23.075017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:23.075828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:23.076268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:23.210162 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:23.218665 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d6d9972-8db9-4891-9fea-d2fff237d281 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.155552 Jul 14 15:44:23.219404 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3320/6481] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:23 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:24.236289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:24.236914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:24.239711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:24.245223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.245695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.246482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.246931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.250520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:24.381956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:24.389518 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-67f4c2ed-e6d1-4e37-8cd0-a2d825ff30c1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.157813 Jul 14 15:44:24.390088 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3162/6482] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:24 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:25.323571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-09713e37-76cb-468e-ae7e-1b255224d52f req-094663b7-0d45-42dc-a703-a4e4f3081741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f158a-77e0-410f-b1d4-6a682a619d91", "name": "network-vif-plugged", "status": "completed", "tag": "3c44588e-fb4f-499a-b1f1-cf10ac96868e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:25.328124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:25.334978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-09713e37-76cb-468e-ae7e-1b255224d52f req-094663b7-0d45-42dc-a703-a4e4f3081741 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.335471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-09713e37-76cb-468e-ae7e-1b255224d52f req-094663b7-0d45-42dc-a703-a4e4f3081741 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.339788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=72 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:25.348921 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-09713e37-76cb-468e-ae7e-1b255224d52f req-094663b7-0d45-42dc-a703-a4e4f3081741 service nova] Creating event network-vif-plugged:3c44588e-fb4f-499a-b1f1-cf10ac96868e for instance 449f158a-77e0-410f-b1d4-6a682a619d91 on n-h1-768852-23 Jul 14 15:44:25.354039 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-09713e37-76cb-468e-ae7e-1b255224d52f req-094663b7-0d45-42dc-a703-a4e4f3081741 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034289 Jul 14 15:44:25.354648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3321/6483] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:44:25.406533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:25.407138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:25.414416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.414928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.415684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.416122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.553255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:25.561202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-abb17a71-ffd8-40de-b7fe-a666e734acf1 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.158562 Jul 14 15:44:25.561851 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3163/6484] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:25 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:26.580830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:26.581458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:26.590371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.590371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.590371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.590371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.728973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:26.737290 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ab21e55-2ad6-4eb8-8c94-e43284847ac4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1314 microversion: 2.1 time: 0.161802 Jul 14 15:44:26.737874 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3322/6485] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:26 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:27.754158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:27.754778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:27.757510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:27.758178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:27.764325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.764780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.765545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.765993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.903371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:27.911829 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-827f4753-6dbd-4c1c-b3e5-104e9f7a679d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1501 microversion: 2.1 time: 0.161545 Jul 14 15:44:27.912474 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3164/6486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:27 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1501 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:27.939838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:27.941422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:27.943491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:27.949930 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.950380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.951152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.951630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.981584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:27.987562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:44:27.993858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:44:27.994286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:44:27.994762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:44:27.995174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:44:27.995626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:44:28.062655 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea89a74b-3ece-4b29-ba3b-fcc82371dc2a tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "POST /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91/action" status: 202 len: 0 microversion: 2.1 time: 0.129984 Jul 14 15:44:28.063187 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3323/6487] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:44:27 2022] POST /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:44:28.072591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:28.073219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:28.080481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.080946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.081727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.082340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.215378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:28.224196 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9ef744c8-b639-4b80-a495-b0a63242d352 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1510 microversion: 2.1 time: 0.155441 Jul 14 15:44:28.224781 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3165/6488] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:28 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:29.243643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:29.244269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:29.253167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:29.253621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:29.254428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:29.255029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:29.392390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:29.399899 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edb7aa59-f21e-4cc1-afc4-f2e53310b6d6 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1510 microversion: 2.1 time: 0.161396 Jul 14 15:44:29.400473 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3324/6489] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:29 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:30.417668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:30.418297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:30.425323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.425791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.426567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.427019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.564602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:30.572351 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5bc1f65e-3296-4578-8e86-788da5c4f79c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.158582 Jul 14 15:44:30.572930 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3166/6490] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:30 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:31.598212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:31.598732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:31.606270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:31.606733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:31.607535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:31.608057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:31.744754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:31.753362 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-23f33a4a-bd0a-44c6-bcc3-de894082f28f tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.159797 Jul 14 15:44:31.753972 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3325/6491] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:31 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:32.770184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:32.770808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:32.777635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:32.778092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.778859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:32.779330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.910242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:32.917791 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-77b299c5-b7f4-40d9-a931-799c7b74e5a3 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.151530 Jul 14 15:44:32.918374 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3167/6492] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:32 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:33.935084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:33.935747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:33.943698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.944152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.944932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.945376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.080832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:34.088690 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bbdd24e7-2b45-4a72-b5a5-e0f80701486e tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.157394 Jul 14 15:44:34.089297 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3326/6493] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:33 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:35.106449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:35.107091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:35.114520 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:35.114974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:35.115772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:35.116215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:35.250769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:35.259034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c5797f8a-fb4e-4e8e-8812-09de9b43f8ee tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.156459 Jul 14 15:44:35.259658 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3168/6494] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:35 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:36.276369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:36.276987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:36.284137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.284603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.285338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.285769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.420110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:36.427667 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-72498f5a-8558-42a8-845d-c4b3a9fb50cf tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.155185 Jul 14 15:44:36.428257 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3327/6495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:36 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:37.444967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:37.445592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:37.452543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.453003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.453800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.454714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.583290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:37.590915 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-deb428ac-72b2-470c-a041-1fce74f44473 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.149809 Jul 14 15:44:37.591532 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3169/6496] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:37 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:38.608338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:38.608879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:38.616610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.617057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.617813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.618244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.750085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:38.757820 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5aa2f638-f85f-4313-860f-e141d55c853b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.153476 Jul 14 15:44:38.758406 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3328/6497] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:38 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:39.775224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:39.775877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:39.782974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.783729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.784513 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.784969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.919411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:39.927506 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98bad672-1cee-4b14-a6ab-c25cda576fed tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.156199 Jul 14 15:44:39.928091 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3170/6498] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:39 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:40.944790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:40.945400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:40.952249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.952697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:40.953454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.954756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:41.087731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:41.096024 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2f61791f-1b70-44f4-afd3-d2ff2785dc77 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.155169 Jul 14 15:44:41.096603 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3329/6499] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:40 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:42.113828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:42.114481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:42.121132 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:42.121595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.122375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:42.122823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.252929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:42.260505 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f93cd0ee-41ab-416b-bdf1-64c83fc00611 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.151175 Jul 14 15:44:42.261122 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3171/6500] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:42 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:43.278198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:43.278809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:43.287169 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.287638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.288403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.288864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.420002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:43.427796 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2192c37e-325b-4c84-ad6a-a6cb95d7a6da tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.153235 Jul 14 15:44:43.428220 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3330/6501] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:43 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:44.445051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:44.445638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:44.452515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.452971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.454235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.454678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.584487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:44.592477 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1738ff8b-9cfb-4617-ba2e-a3b9bd52e699 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.151329 Jul 14 15:44:44.593068 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3172/6502] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:44 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:45.609632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:45.610742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:45.617618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.618069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.618837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.619293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.753273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:45.760735 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-27530796-54d0-4e38-9ded-f483eafbc707 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.155359 Jul 14 15:44:45.761317 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3331/6503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:45 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:46.777938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:46.778643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:46.785778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.786237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.787008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.787483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.922841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:46.930340 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8124603-e279-41ae-99ce-0911b537f43d tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.156290 Jul 14 15:44:46.930911 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3173/6504] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:46 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:47.948207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:47.948752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:47.955678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.956123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.956883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.957310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:48.090759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:48.098365 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6da97864-1542-4bec-9675-be5a37943616 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.154309 Jul 14 15:44:48.098981 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3332/6505] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:47 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:49.116225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:49.117371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:49.124206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:49.124660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.125443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:49.125888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.259111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:49.266983 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f125bbc6-d3ed-49c3-b5a7-01822baa946b tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.154541 Jul 14 15:44:49.275467 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3174/6506] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:49 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:50.284926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:50.285576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:50.292732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.293053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.293819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.294262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.430013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:50.437762 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-17bc706b-b22d-44aa-9117-43ba90ba5cd5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.157691 Jul 14 15:44:50.438393 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3333/6507] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:50 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:51.454221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:51.454845 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:51.461918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:51.462384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:51.463153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:51.463643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:51.597233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:51.604968 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc69ce69-17c5-403e-ad4a-95b53b740fdc tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.154562 Jul 14 15:44:51.605557 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3175/6508] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:51 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:52.622237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:52.622755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:52.629729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:52.630184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.630946 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:52.631408 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.766491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:52.774125 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-be19d1bc-9016-44b3-97b1-6a15e3c456b5 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.156066 Jul 14 15:44:52.774705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3334/6509] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:52 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:53.791344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:53.791964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:53.799501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.799978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.800733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.801177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.931750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:53.939209 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-25d87c00-351b-4b24-9a1b-481747bbc2d4 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.151803 Jul 14 15:44:53.939830 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3176/6510] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:53 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:54.956512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:54.957127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:54.964193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.964643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.965405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.965848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:55.097174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:55.104833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-48e198b0-b5bf-4b1a-90bd-2397386bf8af tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.152303 Jul 14 15:44:55.105412 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3335/6511] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:54 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:56.122389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:56.123003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:56.126312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=30 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:56.131676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.132135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.132902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.133344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.136809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=90 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:56.270356 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:56.283739 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9a04923f-9f78-477b-be78-c81aa76856fd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1515 microversion: 2.1 time: 0.164580 Jul 14 15:44:56.284794 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3177/6512] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:56 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:57.309428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:57.310174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:57.315872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:57.322546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.323135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.323945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.324383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.327371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:57.468305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:57.475959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c72f647d-c298-4f81-bb56-50150f86feb8 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1514 microversion: 2.1 time: 0.173335 Jul 14 15:44:57.476778 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3336/6513] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:57 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:57.776394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-164932c2-8f1c-48d3-ab39-efe4177bc72f req-1ab0118e-8696-487c-a603-38af17bd18c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f158a-77e0-410f-b1d4-6a682a619d91", "name": "network-vif-unplugged", "status": "completed", "tag": "3c44588e-fb4f-499a-b1f1-cf10ac96868e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:57.786519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-164932c2-8f1c-48d3-ab39-efe4177bc72f req-1ab0118e-8696-487c-a603-38af17bd18c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.786974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-164932c2-8f1c-48d3-ab39-efe4177bc72f req-1ab0118e-8696-487c-a603-38af17bd18c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.800384 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-164932c2-8f1c-48d3-ab39-efe4177bc72f req-1ab0118e-8696-487c-a603-38af17bd18c9 service nova] Creating event network-vif-unplugged:3c44588e-fb4f-499a-b1f1-cf10ac96868e for instance 449f158a-77e0-410f-b1d4-6a682a619d91 on n-h2-768852-23 Jul 14 15:44:57.806279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-164932c2-8f1c-48d3-ab39-efe4177bc72f req-1ab0118e-8696-487c-a603-38af17bd18c9 service nova] Instance 449f158a-77e0-410f-b1d4-6a682a619d91 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:44:57.820858 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-164932c2-8f1c-48d3-ab39-efe4177bc72f req-1ab0118e-8696-487c-a603-38af17bd18c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048332 Jul 14 15:44:57.822216 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3178/6514] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:58.493697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:58.494242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:58.502809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.503261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.504063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.504500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.643580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:58.651689 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a48d72f5-dcfe-487b-8e41-df124987eefa tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1514 microversion: 2.1 time: 0.162179 Jul 14 15:44:58.652313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3337/6515] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:58 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:59.671452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:59.672817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:59.679938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.680396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.681170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.681615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.822232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:59.832110 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe91043e-bcf7-4375-8ada-d4dd1b60b501 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1512 microversion: 2.1 time: 0.164521 Jul 14 15:44:59.832879 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3179/6516] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:59 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1512 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:59.842426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f87df9e2-1ec5-4221-8c5b-18ca586ec4e3 req-ec76517d-27f5-4665-bfee-a805078345c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "449f158a-77e0-410f-b1d4-6a682a619d91", "tag": "3c44588e-fb4f-499a-b1f1-cf10ac96868e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:59.853052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f87df9e2-1ec5-4221-8c5b-18ca586ec4e3 req-ec76517d-27f5-4665-bfee-a805078345c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.853494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f87df9e2-1ec5-4221-8c5b-18ca586ec4e3 req-ec76517d-27f5-4665-bfee-a805078345c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.869726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f87df9e2-1ec5-4221-8c5b-18ca586ec4e3 req-ec76517d-27f5-4665-bfee-a805078345c9 service nova] Creating event network-changed:3c44588e-fb4f-499a-b1f1-cf10ac96868e for instance 449f158a-77e0-410f-b1d4-6a682a619d91 on n-h2-768852-23 Jul 14 15:44:59.875943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-f87df9e2-1ec5-4221-8c5b-18ca586ec4e3 req-ec76517d-27f5-4665-bfee-a805078345c9 service nova] Instance 449f158a-77e0-410f-b1d4-6a682a619d91 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:44:59.887745 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f87df9e2-1ec5-4221-8c5b-18ca586ec4e3 req-ec76517d-27f5-4665-bfee-a805078345c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050891 Jul 14 15:44:59.888682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3338/6517] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:00.848673 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:00.849332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:00.856819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.857289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.858091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.858537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.994142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:01.002161 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a904b48-b0c6-4d56-8fa6-34c21092d003 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1509 microversion: 2.1 time: 0.157363 Jul 14 15:45:01.002733 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3180/6518] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:00 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:01.020504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:01.021070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:01.027544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.028114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.028886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.029319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.059292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:45:01.114726 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.compute.api [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Found an unconfirmed migration during delete, id: 16, status: finished Jul 14 15:45:02.551986 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-10443ed2-634c-42f2-a8c9-75c1f2d14bc9 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "DELETE /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 204 len: 0 microversion: 2.1 time: 1.536288 Jul 14 15:45:02.552749 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3339/6519] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:45:01 2022] DELETE /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 0 bytes in 1538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:45:02.562607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:02.563239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:02.570088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.570557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.572067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.572725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.704232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:02.711753 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-49eb3cd4-bae4-4505-abb3-f79869f07247 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1501 microversion: 2.1 time: 0.153352 Jul 14 15:45:02.712329 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3181/6520] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:02 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1501 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:03.238988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-90b54bfe-d848-4f75-b008-74ae23bb724f req-505e1d3f-985a-4902-86e2-774cb29925f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f158a-77e0-410f-b1d4-6a682a619d91", "name": "network-vif-plugged", "status": "completed", "tag": "3c44588e-fb4f-499a-b1f1-cf10ac96868e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:03.249007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-90b54bfe-d848-4f75-b008-74ae23bb724f req-505e1d3f-985a-4902-86e2-774cb29925f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.249510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-90b54bfe-d848-4f75-b008-74ae23bb724f req-505e1d3f-985a-4902-86e2-774cb29925f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.261728 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-90b54bfe-d848-4f75-b008-74ae23bb724f req-505e1d3f-985a-4902-86e2-774cb29925f4 service nova] Creating event network-vif-plugged:3c44588e-fb4f-499a-b1f1-cf10ac96868e for instance 449f158a-77e0-410f-b1d4-6a682a619d91 on n-h2-768852-23 Jul 14 15:45:03.267669 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-90b54bfe-d848-4f75-b008-74ae23bb724f req-505e1d3f-985a-4902-86e2-774cb29925f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032752 Jul 14 15:45:03.268515 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3340/6521] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:03.729746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:03.730374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:03.737823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.738288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.739069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.739552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.873645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62f485345ff14d08b2f7c3608f5b83b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbf3c5a4b2854ac98f3f67ce72a1cdfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:03.881877 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c0ee2736-5578-425a-bb41-1cf68629abbb tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 200 len: 1501 microversion: 2.1 time: 0.155975 Jul 14 15:45:03.882453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3182/6522] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:03 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 1501 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:04.452023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-444dbb18-ece4-479f-88be-0b0b2c04ff66 req-7ba9e2e2-f016-40d7-8f5c-4560b9ec81d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "449f158a-77e0-410f-b1d4-6a682a619d91", "name": "network-vif-deleted", "tag": "3c44588e-fb4f-499a-b1f1-cf10ac96868e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:04.462598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-444dbb18-ece4-479f-88be-0b0b2c04ff66 req-7ba9e2e2-f016-40d7-8f5c-4560b9ec81d2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.463130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-444dbb18-ece4-479f-88be-0b0b2c04ff66 req-7ba9e2e2-f016-40d7-8f5c-4560b9ec81d2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.476213 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-444dbb18-ece4-479f-88be-0b0b2c04ff66 req-7ba9e2e2-f016-40d7-8f5c-4560b9ec81d2 service nova] Creating event network-vif-deleted:3c44588e-fb4f-499a-b1f1-cf10ac96868e for instance 449f158a-77e0-410f-b1d4-6a682a619d91 on n-h2-768852-23 Jul 14 15:45:04.481652 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-444dbb18-ece4-479f-88be-0b0b2c04ff66 req-7ba9e2e2-f016-40d7-8f5c-4560b9ec81d2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035205 Jul 14 15:45:04.482423 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3341/6523] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:04.900162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.900667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.908194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.908656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.909424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.909872 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.926862 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] HTTP exception thrown: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Request method failure captured: Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 HTTP/1.1 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DnQSFkFXNldfATWg52kryctArzeHKnLSDgPP4ujUEblbFAMAYWGj8PPEFycoZ0L3BvDHzlyqusfwsBqVPE126Q47OH-hiFF1R6UDwvaCeuNCmc4m57iVF4d4CEjuTR58sLgkb5vwTdfgIqq5-VDy-am9c4-Z6qipWQREihMOjFAD18 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cbf3c5a4b2854ac98f3f67ce72a1cdfc Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cbf3c5a4b2854ac98f3f67ce72a1cdfc Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1291852829-project Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 62f485345ff14d08b2f7c3608f5b83b1 Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1291852829-project Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '449f158a-77e0-410f-b1d4-6a682a619d91'} Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:04.928551 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Returning 404 to user: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-554b8e90-4e76-4e81-ace9-aca5e651709c tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 404 len: 111 microversion: 2.1 time: 0.034189 Jul 14 15:45:04.933322 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3183/6524] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:04 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:45:04.947691 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.948312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.955246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.955722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.956477 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.956907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.970522 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] HTTP exception thrown: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Request method failure captured: Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 HTTP/1.1 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DnQSFkFXNldfATWg52kryctArzeHKnLSDgPP4ujUEblbFAMAYWGj8PPEFycoZ0L3BvDHzlyqusfwsBqVPE126Q47OH-hiFF1R6UDwvaCeuNCmc4m57iVF4d4CEjuTR58sLgkb5vwTdfgIqq5-VDy-am9c4-Z6qipWQREihMOjFAD18 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: cbf3c5a4b2854ac98f3f67ce72a1cdfc Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: cbf3c5a4b2854ac98f3f67ce72a1cdfc Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-DeleteServersTestJSON-1291852829-project Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 62f485345ff14d08b2f7c3608f5b83b1 Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-DeleteServersTestJSON-1291852829-project Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '449f158a-77e0-410f-b1d4-6a682a619d91'} Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:45:04.972215 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Returning 404 to user: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cbcf959f-9110-41fc-adff-0664ceb61712 tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "DELETE /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 404 len: 111 microversion: 2.1 time: 0.030724 Jul 14 15:45:04.976245 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3342/6525] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:45:04 2022] DELETE /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:45:04.982327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.983011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] [instance: 449f158a-77e0-410f-b1d4-6a682a619d91] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.989137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.989600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.990367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.990816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.004675 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] HTTP exception thrown: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Request method failure captured: Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 HTTP/1.1 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DnQSFkFXNldfATWg52kryctArzeHKnLSDgPP4ujUEblbFAMAYWGj8PPEFycoZ0L3BvDHzlyqusfwsBqVPE126Q47OH-hiFF1R6UDwvaCeuNCmc4m57iVF4d4CEjuTR58sLgkb5vwTdfgIqq5-VDy-am9c4-Z6qipWQREihMOjFAD18 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: cbf3c5a4b2854ac98f3f67ce72a1cdfc Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/cbf3c5a4b2854ac98f3f67ce72a1cdfc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: cbf3c5a4b2854ac98f3f67ce72a1cdfc Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-DeleteServersTestJSON-1291852829 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-DeleteServersTestJSON-1291852829-project Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 62f485345ff14d08b2f7c3608f5b83b1 Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-DeleteServersTestJSON-1291852829-project Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '449f158a-77e0-410f-b1d4-6a682a619d91'} Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:45:05.006296 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] Returning 404 to user: Instance 449f158a-77e0-410f-b1d4-6a682a619d91 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9409cdfc-8d6c-4730-babc-c773954691bd tempest-DeleteServersTestJSON-1291852829 tempest-DeleteServersTestJSON-1291852829-project] 10.222.0.98 "GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91" status: 404 len: 111 microversion: 2.1 time: 0.029154 Jul 14 15:45:05.010147 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3184/6526] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:04 2022] GET /compute/v2.1/servers/449f158a-77e0-410f-b1d4-6a682a619d91 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:45:10.839621 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:45:10.840206 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:45:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:45:13.466074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-224211503", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "b6dd3cb3-5a34-4e3b-955a-0d17fcb5cfc4"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:13.520044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] validate_networks() for [('b6dd3cb3-5a34-4e3b-955a-0d17fcb5cfc4', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:45:13.906006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:45:13.906463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:45:13.906943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:45:13.907402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:45:13.908115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:45:13.917226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.917676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.918485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.918972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.936687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Getting quotas for project 62c35510a0b94cabbf1faee3ff23a7e2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:45:13.942565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Getting quotas for user cfc469baf90a43a8b1b47725a2199444 and project 62c35510a0b94cabbf1faee3ff23a7e2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:45:13.955929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:45:13.958244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:45:14.002704 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bfa9cc3b-508a-4060-964a-b81dd375eef7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660749 Jul 14 15:45:14.003384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3343/6527] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:45:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:45:14.013547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f709f7b-0dd2-451c-8786-096bc7a10a7d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:14.014211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f709f7b-0dd2-451c-8786-096bc7a10a7d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:14.075592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0f709f7b-0dd2-451c-8786-096bc7a10a7d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:14.084515 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f709f7b-0dd2-451c-8786-096bc7a10a7d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1217 microversion: 2.1 time: 0.074648 Jul 14 15:45:14.084890 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3185/6528] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:14 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:15.102151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:15.102788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:15.110900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:15.111574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:15.112541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:15.113225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:15.576374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:15.591157 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-267e11a8-97cb-410a-9583-63d7b42611f5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1277 microversion: 2.1 time: 0.494036 Jul 14 15:45:15.592083 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3344/6529] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:15 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1277 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:16.609744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:16.610973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:16.617408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=37 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:16.620123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:16.620761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.621712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:16.622160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.802257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:16.816244 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-546e8c68-6e0a-4916-8a6d-f647da71405e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1317 microversion: 2.1 time: 0.210703 Jul 14 15:45:16.817189 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3186/6530] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:16 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1317 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:17.100587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-de35f7ba-c226-4fa0-a0af-76701d930c61 req-95c0a947-39a5-4648-9ad2-45fbec1167b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d4daaf-f32d-4327-a1c5-d51a942df323", "tag": "56504d27-1c21-4080-8bf3-c4fef035d28c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:17.116584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-de35f7ba-c226-4fa0-a0af-76701d930c61 req-95c0a947-39a5-4648-9ad2-45fbec1167b3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.117328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-de35f7ba-c226-4fa0-a0af-76701d930c61 req-95c0a947-39a5-4648-9ad2-45fbec1167b3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.138016 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-de35f7ba-c226-4fa0-a0af-76701d930c61 req-95c0a947-39a5-4648-9ad2-45fbec1167b3 service nova] Creating event network-changed:56504d27-1c21-4080-8bf3-c4fef035d28c for instance 91d4daaf-f32d-4327-a1c5-d51a942df323 on n-h1-768852-23 Jul 14 15:45:17.151121 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-de35f7ba-c226-4fa0-a0af-76701d930c61 req-95c0a947-39a5-4648-9ad2-45fbec1167b3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061896 Jul 14 15:45:17.152642 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3345/6531] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:17.833666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:17.834229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:17.841146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.841603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.842370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.842815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.975454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:17.982980 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0a8ad8d9-f826-4922-a400-46eaacf8c49f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1317 microversion: 2.1 time: 0.153259 Jul 14 15:45:17.983600 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3187/6532] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:17 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:19.001110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:19.001893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:19.009121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.009574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.010364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.010800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.143720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:19.151294 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aec74460-b890-4000-8a7f-7179e00d54de tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1317 microversion: 2.1 time: 0.154614 Jul 14 15:45:19.151884 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3346/6533] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:18 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:20.168323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:20.168961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:20.176671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.177137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.177913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.178361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.308170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:20.316379 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13ccb912-9c28-49b8-8ce4-0a6c7f7f26e5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1317 microversion: 2.1 time: 0.151983 Jul 14 15:45:20.316958 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3188/6534] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:20 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:21.334148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:21.334757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:21.342115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.342558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:21.343339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.343778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:21.478038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:21.485627 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47abc9c5-251f-40e2-a5ca-ea5595ebac74 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1317 microversion: 2.1 time: 0.156042 Jul 14 15:45:21.486208 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3347/6535] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:21 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:21.626786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-662f880c-7d7f-4420-be6d-41465205fa5a req-6e9966f0-4f75-4c4b-aad7-14410f0fff1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d4daaf-f32d-4327-a1c5-d51a942df323", "name": "network-vif-plugged", "status": "completed", "tag": "56504d27-1c21-4080-8bf3-c4fef035d28c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:21.636588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-662f880c-7d7f-4420-be6d-41465205fa5a req-6e9966f0-4f75-4c4b-aad7-14410f0fff1c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.637047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-662f880c-7d7f-4420-be6d-41465205fa5a req-6e9966f0-4f75-4c4b-aad7-14410f0fff1c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:21.648715 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-662f880c-7d7f-4420-be6d-41465205fa5a req-6e9966f0-4f75-4c4b-aad7-14410f0fff1c service nova] Creating event network-vif-plugged:56504d27-1c21-4080-8bf3-c4fef035d28c for instance 91d4daaf-f32d-4327-a1c5-d51a942df323 on n-h1-768852-23 Jul 14 15:45:21.653729 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-662f880c-7d7f-4420-be6d-41465205fa5a req-6e9966f0-4f75-4c4b-aad7-14410f0fff1c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031234 Jul 14 15:45:21.654531 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3189/6536] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:22.502173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:22.502784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:22.509649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:22.510100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:22.510854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:22.511402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:22.650126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:22.658619 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-08363114-b0f7-4b30-8ee3-ad1ea84aa434 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1317 microversion: 2.1 time: 0.160470 Jul 14 15:45:22.659311 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3348/6537] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:22 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:23.678651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:23.679381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:23.687909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.688418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.689188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.689637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.826892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:23.835056 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-722a6947-972b-46c1-9131-7dacafc6e04b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1508 microversion: 2.1 time: 0.162654 Jul 14 15:45:23.835663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3190/6538] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:23 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:23.851783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:23.852403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:23.859541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.860010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.860847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.861286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.927242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:23.949446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:23.990149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:23.997686 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-59fff3fc-88c2-46d0-9f49-14dc11356368 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1508 microversion: 2.1 time: 0.149835 Jul 14 15:45:23.998275 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3349/6539] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:23 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:24.013704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:24.014765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.021322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.021800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.022575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.023028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.081285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:24.088697 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fbdb9bbb-7b0c-4579-aa69-c9b4d37c95c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "PUT /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1080 microversion: 2.1 time: 0.078952 Jul 14 15:45:24.089352 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3191/6540] 10.222.0.98 () {60 vars in 1255 bytes} [Thu Jul 14 15:45:24 2022] PUT /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1080 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:24.103689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:24.104298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.110312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.110752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.111532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.111969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.242307 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:24.250220 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a38bc7c3-be57-4801-99b2-bf701c21f768 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1506 microversion: 2.1 time: 0.150186 Jul 14 15:45:24.251968 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3350/6541] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:24 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:24.269826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:24.270470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.276871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.277333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.278107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.278557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.409330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:24.417099 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0be018c-ddce-448b-8a5b-fc8fe8e665cc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1506 microversion: 2.1 time: 0.151644 Jul 14 15:45:24.417693 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3192/6542] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:24 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:24.433400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:24.434415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.441102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.441556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.442322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.442770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.474316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:24.480141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:45:24.486436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:45:24.486852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:45:24.487405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:45:24.487798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:45:24.488193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:45:24.555059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e59cfa7-de7c-44c6-97eb-cf22ea3036b1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323/action" status: 202 len: 0 microversion: 2.1 time: 0.125635 Jul 14 15:45:24.555709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3351/6543] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:45:24 2022] POST /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:45:24.564457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:24.565417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.571622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.572076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.572879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.573324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.712626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:24.720875 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5461c47-63f0-4301-8ca1-5bd8eb008af8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1517 microversion: 2.1 time: 0.160785 Jul 14 15:45:24.721518 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3193/6544] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:24 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:25.739243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:25.739906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:25.746039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.746490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.747249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.747712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.882392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:25.884658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:25.893194 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e79868fb-a86d-4794-ab38-9f4151ae5b75 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1517 microversion: 2.1 time: 0.158651 Jul 14 15:45:25.893796 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3352/6545] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:25 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:26.911003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:26.911654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:26.914325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=36 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:26.920073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.920534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.921304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.921746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.055025 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:27.063339 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f6218974-e6ac-45cd-bec0-35c29d19c789 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.156388 Jul 14 15:45:27.064546 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3194/6546] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:26 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:28.082012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:28.082628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:28.085839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:28.092138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:28.092591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:28.093370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:28.093863 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:28.230017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:28.237587 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-827a9436-46b9-4ed5-b247-da0bbb8b97bf tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.160187 Jul 14 15:45:28.238167 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3353/6547] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:28 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:29.254669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:29.255302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:29.262233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:29.262693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:29.263500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:29.263943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:29.398982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:29.406590 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-def2022a-60b7-41f6-baab-b3e45687e49e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.156488 Jul 14 15:45:29.407167 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3195/6548] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:29 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:30.425414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:30.426027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:30.432184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.432635 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.433411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.433832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.568084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:30.575933 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a1a68ec-478c-45b4-bf2b-842818d4c066 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.155347 Jul 14 15:45:30.576519 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3354/6549] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:30 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:31.593889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:31.594444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:31.601289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.601755 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.602547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.603028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.743320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:31.751510 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-621208dd-5217-4813-ad0d-cd35783b3eff tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.161686 Jul 14 15:45:31.752102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3196/6550] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:31 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:32.769084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:32.769732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:32.777054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.777504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.778320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.778707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.909802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:32.917736 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-632d2906-2f47-4995-b335-857b5c09ff6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.153072 Jul 14 15:45:32.918873 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3355/6551] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:32 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:33.936175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:33.936834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:33.944386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.944789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.945562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.946012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:34.076945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:34.085456 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c423b3c4-8f61-4c31-bf64-b1ac0f379b52 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.153196 Jul 14 15:45:34.086034 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3197/6552] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:33 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:35.102080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:35.102617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:35.109756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:35.110211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:35.111522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:35.111959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:35.251856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:35.259388 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d3ba749f-2b85-44aa-9737-bfc75e5f1c4b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.161306 Jul 14 15:45:35.259973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3356/6553] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:35 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:36.277077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:36.277693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:36.285027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.285482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.286249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.286690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.418573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:36.426743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8339f105-1a97-4b63-bffe-8d449efaf8a5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.153736 Jul 14 15:45:36.427345 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3198/6554] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:36 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:37.443464 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:37.444077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:37.451009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.451492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.452257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.452693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.585093 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:37.593306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bf08d36a-54e6-4423-841e-794497e760ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.153351 Jul 14 15:45:37.593672 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3357/6555] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:37 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:38.611119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:38.611771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:38.618724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.619184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.619989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.620442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.762241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:38.770644 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94ed30a0-4f9e-4e30-9958-702189cdc875 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.163416 Jul 14 15:45:38.771218 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3199/6556] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:38 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:39.788441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:39.789056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:39.796068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.796518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.797278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.797727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.931194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:39.939245 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fd033e19-5890-4357-aa7f-1e7cc7c85e6a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.154266 Jul 14 15:45:39.939850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3358/6557] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:39 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:40.957666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:40.958295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:40.965935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.966398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.967199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.967675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:41.096395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:41.104067 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc197b69-d78d-437c-bcc8-23bbe550e35c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.150912 Jul 14 15:45:41.104647 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3200/6558] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:40 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:42.121632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:42.122238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:42.129685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:42.130128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.130884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:42.131340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.269979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:42.277706 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5a325de9-fa9f-462b-9ee1-56e589b31007 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.160047 Jul 14 15:45:42.278295 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3359/6559] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:42 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:43.296147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:43.296776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:43.304013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.304476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.305251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.305702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.439458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:43.446917 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-95d3d982-f561-4e23-bc83-6e1c0ba1d50a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.154794 Jul 14 15:45:43.447521 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3201/6560] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:43 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:44.464794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:44.465319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:44.472533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.472988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.473755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.474195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.613278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:44.621593 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3923003-e891-4997-98a5-7b8ec2a7ddb5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.161003 Jul 14 15:45:44.622182 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3360/6561] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:44 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:45.638572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:45.639198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:45.646181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.646642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.647453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.647901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.666024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:45.782643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:45.790374 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b0eb82f-234f-41fb-9bd0-33d0602d6563 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.155455 Jul 14 15:45:45.790950 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3202/6562] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:45 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:46.808061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:46.808585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:46.815966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.816420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.817217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.817656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.954273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:46.962689 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ec7b0d49-a5d6-469d-a4b8-44fd431fe2c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.158529 Jul 14 15:45:46.963352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3361/6563] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:46 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:47.979967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:47.980508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:47.987537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:47.987993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:47.988826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:47.989269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.127424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:48.138349 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec99d670-800c-48c7-82e7-2fef9b6bb058 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.162433 Jul 14 15:45:48.139071 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3203/6564] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:47 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:49.162296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:49.163068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:49.170267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.170720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.171521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.171959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.303928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:49.311815 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-915f1aea-0dc4-4b9b-b525-7c083affa214 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.154179 Jul 14 15:45:49.312415 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3362/6565] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:49 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:50.329382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:50.330047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:50.337438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.337896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.338689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.339137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.479054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:50.486623 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-49c7f804-8767-4e8c-80da-a31d03db9e68 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.161240 Jul 14 15:45:50.487886 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3204/6566] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:50 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:51.504766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:51.505405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:51.512326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.512766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.513522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.513955 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.650493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:51.658562 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f527137c-5441-4cea-aa1b-068f841a4609 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.157655 Jul 14 15:45:51.659738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3363/6567] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:51 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:52.680220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:52.680832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:52.687745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.688206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.688969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.689408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.818632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:52.826266 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d2b9f2da-7234-4dda-bbb9-eaf2e9e87710 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1522 microversion: 2.1 time: 0.149868 Jul 14 15:45:52.826848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3205/6568] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:52 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:53.843255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:53.844066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:53.851004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:53.851564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:53.852426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:53.852865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:53.990214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:53.997905 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ed7f7612-c740-437e-b41e-86aa15030efb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1521 microversion: 2.1 time: 0.158607 Jul 14 15:45:53.998501 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3364/6569] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:53 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:54.109125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3441ceaf-5c97-4236-9316-4ed94508f70f req-7b39f399-7b8a-4dff-8a83-15fba0207ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d4daaf-f32d-4327-a1c5-d51a942df323", "name": "network-vif-unplugged", "status": "completed", "tag": "56504d27-1c21-4080-8bf3-c4fef035d28c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:54.118389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3441ceaf-5c97-4236-9316-4ed94508f70f req-7b39f399-7b8a-4dff-8a83-15fba0207ac6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:54.118852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3441ceaf-5c97-4236-9316-4ed94508f70f req-7b39f399-7b8a-4dff-8a83-15fba0207ac6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:54.131993 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3441ceaf-5c97-4236-9316-4ed94508f70f req-7b39f399-7b8a-4dff-8a83-15fba0207ac6 service nova] Creating event network-vif-unplugged:56504d27-1c21-4080-8bf3-c4fef035d28c for instance 91d4daaf-f32d-4327-a1c5-d51a942df323 on n-h2-768852-23 Jul 14 15:45:54.137608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-3441ceaf-5c97-4236-9316-4ed94508f70f req-7b39f399-7b8a-4dff-8a83-15fba0207ac6 service nova] Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:45:54.149302 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3441ceaf-5c97-4236-9316-4ed94508f70f req-7b39f399-7b8a-4dff-8a83-15fba0207ac6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044053 Jul 14 15:45:54.149929 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3206/6570] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:55.015248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:55.015887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:55.023846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:55.024447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.025279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:55.025724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.164139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:55.172196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d5f6f0c6-a52a-443a-bc94-52d3cf21fdd5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1519 microversion: 2.1 time: 0.160928 Jul 14 15:45:55.172796 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3365/6571] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:55 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:56.168518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-cdf3e7b8-54de-42eb-a1e7-2b0a84b40f48 req-052d4a70-0d0f-43c5-9193-f3afcb8be605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d4daaf-f32d-4327-a1c5-d51a942df323", "tag": "56504d27-1c21-4080-8bf3-c4fef035d28c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:56.176823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cdf3e7b8-54de-42eb-a1e7-2b0a84b40f48 req-052d4a70-0d0f-43c5-9193-f3afcb8be605 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.177278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cdf3e7b8-54de-42eb-a1e7-2b0a84b40f48 req-052d4a70-0d0f-43c5-9193-f3afcb8be605 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.188748 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-cdf3e7b8-54de-42eb-a1e7-2b0a84b40f48 req-052d4a70-0d0f-43c5-9193-f3afcb8be605 service nova] Creating event network-changed:56504d27-1c21-4080-8bf3-c4fef035d28c for instance 91d4daaf-f32d-4327-a1c5-d51a942df323 on n-h2-768852-23 Jul 14 15:45:56.189983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:56.191217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:56.194450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-cdf3e7b8-54de-42eb-a1e7-2b0a84b40f48 req-052d4a70-0d0f-43c5-9193-f3afcb8be605 service nova] Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:45:56.198111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.198560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.199345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.199785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.205436 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-cdf3e7b8-54de-42eb-a1e7-2b0a84b40f48 req-052d4a70-0d0f-43c5-9193-f3afcb8be605 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041792 Jul 14 15:45:56.206577 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3207/6572] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:45:56.429264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:56.439079 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b80d9d9b-97fd-4e68-ae10-ee6aeb796238 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1519 microversion: 2.1 time: 0.253026 Jul 14 15:45:56.439751 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3366/6573] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:56 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1519 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:57.458853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:57.459604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:57.462851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=28 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:57.468451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.468944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.469740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.470194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.607924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:57.615588 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8d2a2cc6-eb49-4983-b8db-670814ece55f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1516 microversion: 2.1 time: 0.162706 Jul 14 15:45:57.616396 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3208/6574] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:57 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:57.632016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:57.632602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:57.640030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.640482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.641249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.641824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.701539 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-87e21e2f-964c-47a4-9338-6198589d8d69 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323/action" status: 204 len: 0 microversion: 2.1 time: 0.073276 Jul 14 15:45:57.702187 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3367/6575] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:45:57 2022] POST /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323/action => generated 0 bytes in 75 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:45:57.710324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:57.711039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:57.717445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.717905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.718732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.719183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.863961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:57.871813 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1c54de7-bf8a-4a17-ba90-f5da2b1e46c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1516 microversion: 2.1 time: 0.165267 Jul 14 15:45:57.872761 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3209/6576] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:57 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1516 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:58.891282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:58.891999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:58.894481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=30 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:58.900233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.900677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.901440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.901873 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.904652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:59.046484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:59.054732 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-18290b7d-e915-4773-97b0-5367e072edf0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1516 microversion: 2.1 time: 0.168646 Jul 14 15:45:59.055401 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3368/6577] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:58 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:59.459555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0658495c-2419-467e-a0cf-1263e69cd86d req-e5c8f61d-17b7-442d-9a9a-7086f03ae3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d4daaf-f32d-4327-a1c5-d51a942df323", "name": "network-vif-plugged", "status": "completed", "tag": "56504d27-1c21-4080-8bf3-c4fef035d28c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:45:59.469108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0658495c-2419-467e-a0cf-1263e69cd86d req-e5c8f61d-17b7-442d-9a9a-7086f03ae3f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:59.469618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0658495c-2419-467e-a0cf-1263e69cd86d req-e5c8f61d-17b7-442d-9a9a-7086f03ae3f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:59.483327 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0658495c-2419-467e-a0cf-1263e69cd86d req-e5c8f61d-17b7-442d-9a9a-7086f03ae3f4 service nova] Creating event network-vif-plugged:56504d27-1c21-4080-8bf3-c4fef035d28c for instance 91d4daaf-f32d-4327-a1c5-d51a942df323 on n-h2-768852-23 Jul 14 15:45:59.489172 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0658495c-2419-467e-a0cf-1263e69cd86d req-e5c8f61d-17b7-442d-9a9a-7086f03ae3f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033262 Jul 14 15:45:59.489878 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3210/6578] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:00.073634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:00.074258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:00.081884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.082339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.083110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.083579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.222058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:00.229729 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c75aba1d-fa42-44c4-99c0-ebe523403313 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1508 microversion: 2.1 time: 0.160138 Jul 14 15:46:00.230318 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3369/6579] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:00 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:00.247046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:00.247788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:00.257085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.257606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.258421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:00.258864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:00.394301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:00.403003 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6cff96b7-cbaa-4b70-ac07-b906aa807403 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1508 microversion: 2.1 time: 0.160634 Jul 14 15:46:00.403624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3211/6580] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:00 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:00.423601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-682496f7-e44c-44ea-9efe-f47a9c1615c8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'create', calling method: .version_select at 0x7fdbf2357820>, body: {"keypair": {"name": "tempest-keypair-736115082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFesAMyjS2n5xeSITxluVA4drrAv1vKFm3qoJpdcFbwGK4CNaP/loDpkBNqjSXc3gSCccxij+Fq0fkLK0fBBT8cSmjX6OV5QzJkBqWbww9KlNNBMq/7y2nt/qR3lGOgqQ=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:00.440262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-682496f7-e44c-44ea-9efe-f47a9c1615c8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Getting quotas for project 62c35510a0b94cabbf1faee3ff23a7e2. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:46:00.445468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-682496f7-e44c-44ea-9efe-f47a9c1615c8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Getting quotas for user cfc469baf90a43a8b1b47725a2199444 and project 62c35510a0b94cabbf1faee3ff23a7e2. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:46:00.459794 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [None req-682496f7-e44c-44ea-9efe-f47a9c1615c8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [c943a4f5-696c-4c72-ae35-41046e16efdf] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:46:01.468174 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [None req-682496f7-e44c-44ea-9efe-f47a9c1615c8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [c943a4f5-696c-4c72-ae35-41046e16efdf] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 39716. Jul 14 15:46:01.484955 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-682496f7-e44c-44ea-9efe-f47a9c1615c8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.065753 Jul 14 15:46:01.485785 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3370/6581] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:46:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:02.670850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:02.671538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:02.677999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:02.678454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:02.679221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:02.679698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:02.811869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:02.820026 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-632b4559-affc-46ee-a5d0-dbb7885c769f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 200 len: 1508 microversion: 2.1 time: 0.153210 Jul 14 15:46:02.820605 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3212/6582] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:02 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:02.837237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:02.837751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:02.844539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:02.844986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:02.845781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:02.846217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:02.871309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:46:02.952180 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bf03e83a-843e-47cb-a305-3e547849151f tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 204 len: 0 microversion: 2.1 time: 0.119057 Jul 14 15:46:02.953244 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3371/6583] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:46:02 2022] DELETE /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:46:03.015316 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1430958006", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "b6dd3cb3-5a34-4e3b-955a-0d17fcb5cfc4"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:03.066959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] validate_networks() for [('b6dd3cb3-5a34-4e3b-955a-0d17fcb5cfc4', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:46:03.435854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:46:03.436286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:46:03.436781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:46:03.437206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:46:03.437636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:46:03.446591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:03.447056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:03.447914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:03.448369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:03.466388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Getting quotas for project 62c35510a0b94cabbf1faee3ff23a7e2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:46:03.471651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Getting quotas for user cfc469baf90a43a8b1b47725a2199444 and project 62c35510a0b94cabbf1faee3ff23a7e2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:46:03.484244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:46:03.486525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:46:03.530807 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1b3a9258-047c-4d2a-bf73-8020c4cde31a tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.519365 Jul 14 15:46:03.531498 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3213/6584] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:46:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:46:03.544250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8bbc421d-d6e0-4944-80f6-06807c1588c9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:03.545155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8bbc421d-d6e0-4944-80f6-06807c1588c9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:03.600473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8bbc421d-d6e0-4944-80f6-06807c1588c9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:03.607448 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8bbc421d-d6e0-4944-80f6-06807c1588c9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1218 microversion: 2.1 time: 0.068337 Jul 14 15:46:03.608045 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3372/6585] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:03 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:04.627131 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:04.627897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:04.637995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:04.638507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:04.639364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:04.640064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:04.723667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:04.731920 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c2f286c-89a0-4fb2-808c-12febf51f00e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1276 microversion: 2.1 time: 0.110629 Jul 14 15:46:04.741697 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3214/6586] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:04 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1276 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:04.894653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-4dd1de11-df22-4e7d-9f40-b46dd36e5e79 req-dc82a371-d1fb-4d16-a90a-52a90650acc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d4daaf-f32d-4327-a1c5-d51a942df323", "name": "network-vif-deleted", "tag": "56504d27-1c21-4080-8bf3-c4fef035d28c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:04.906740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4dd1de11-df22-4e7d-9f40-b46dd36e5e79 req-dc82a371-d1fb-4d16-a90a-52a90650acc9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:04.907560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-4dd1de11-df22-4e7d-9f40-b46dd36e5e79 req-dc82a371-d1fb-4d16-a90a-52a90650acc9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:04.920832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-4dd1de11-df22-4e7d-9f40-b46dd36e5e79 req-dc82a371-d1fb-4d16-a90a-52a90650acc9 service nova] Creating event network-vif-deleted:56504d27-1c21-4080-8bf3-c4fef035d28c for instance 91d4daaf-f32d-4327-a1c5-d51a942df323 on n-h2-768852-23 Jul 14 15:46:04.927433 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-4dd1de11-df22-4e7d-9f40-b46dd36e5e79 req-dc82a371-d1fb-4d16-a90a-52a90650acc9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036344 Jul 14 15:46:04.928352 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3373/6587] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:05.750340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:05.750971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:05.758584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:05.759052 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:05.760092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:05.760705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:05.915767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:05.924964 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-81e560a3-a697-4585-bb37-fc999500418d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.178281 Jul 14 15:46:05.925873 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3215/6588] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:05 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:06.284771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-84ecb1b8-87c2-4e86-8b24-83c99006261b req-805672b7-63c9-4c79-8408-818defc843ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6a56f4-286f-4b06-ace6-97acb5a20d90", "tag": "f9ecf5c3-4016-453d-af4d-e4e3fa83e231"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:06.297027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-84ecb1b8-87c2-4e86-8b24-83c99006261b req-805672b7-63c9-4c79-8408-818defc843ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:06.297609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-84ecb1b8-87c2-4e86-8b24-83c99006261b req-805672b7-63c9-4c79-8408-818defc843ee service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:06.321315 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-84ecb1b8-87c2-4e86-8b24-83c99006261b req-805672b7-63c9-4c79-8408-818defc843ee service nova] Creating event network-changed:f9ecf5c3-4016-453d-af4d-e4e3fa83e231 for instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 on n-h1-768852-23 Jul 14 15:46:06.326688 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-84ecb1b8-87c2-4e86-8b24-83c99006261b req-805672b7-63c9-4c79-8408-818defc843ee service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050841 Jul 14 15:46:06.327884 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3374/6589] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:46:06.941976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:06.942592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:06.949735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:06.950199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:06.950972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:06.951464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:07.079066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:07.086762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a738fc6d-ea5a-4d0c-891a-56c1f80b94ec tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.148684 Jul 14 15:46:07.087361 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3216/6590] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:06 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:08.105341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:08.106055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:08.113639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:08.113639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:08.114046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:08.114486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:08.251954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:08.260253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a17218fe-64a7-42b5-86d1-3048f7053ab4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.160197 Jul 14 15:46:08.260833 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3375/6591] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:08 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:09.277561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:09.278189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:09.285474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:09.285933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:09.286703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:09.287151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:09.421455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:09.429476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21d7df61-b560-47f2-aef4-d38caad01cb9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.155790 Jul 14 15:46:09.430045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3217/6592] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:09 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:10.447208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:10.447848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:10.454901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:10.455387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:10.456142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:10.456575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:10.585038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:10.593050 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9edd98b5-3906-4e7a-88f3-9c74e9002e1e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.149812 Jul 14 15:46:10.593654 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3376/6593] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:10 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:11.610900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:11.612041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:11.619808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:11.620265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:11.621036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:11.621479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:11.754685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:11.762313 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1dd47ff0-6b86-479c-a5dc-6a11a5439ba5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.156006 Jul 14 15:46:11.762876 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3218/6594] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:11 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:11.953424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b97a2025-3551-4f2a-b2ad-592370beca6a req-8d1ddf10-58d6-4f74-ada6-90fbc0765dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6a56f4-286f-4b06-ace6-97acb5a20d90", "name": "network-vif-plugged", "status": "completed", "tag": "f9ecf5c3-4016-453d-af4d-e4e3fa83e231"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:11.962842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b97a2025-3551-4f2a-b2ad-592370beca6a req-8d1ddf10-58d6-4f74-ada6-90fbc0765dc2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:11.963309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b97a2025-3551-4f2a-b2ad-592370beca6a req-8d1ddf10-58d6-4f74-ada6-90fbc0765dc2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:11.975058 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b97a2025-3551-4f2a-b2ad-592370beca6a req-8d1ddf10-58d6-4f74-ada6-90fbc0765dc2 service nova] Creating event network-vif-plugged:f9ecf5c3-4016-453d-af4d-e4e3fa83e231 for instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 on n-h1-768852-23 Jul 14 15:46:11.980943 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b97a2025-3551-4f2a-b2ad-592370beca6a req-8d1ddf10-58d6-4f74-ada6-90fbc0765dc2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031004 Jul 14 15:46:11.981564 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3377/6595] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:12.779759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:12.780384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:12.787758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:12.788247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:12.789027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:12.789472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:12.921768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:12.930331 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11ed3787-5c95-46d6-ac03-6874a66fa3e8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1318 microversion: 2.1 time: 0.154739 Jul 14 15:46:12.930913 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3219/6596] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:12 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:13.948315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:13.948970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:13.951795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:13.958188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:13.958647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:13.959445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:13.959890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.094538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:14.103356 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5d381b3a-f0e5-43c0-b48a-e19ea4e50418 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1509 microversion: 2.1 time: 0.159339 Jul 14 15:46:14.103984 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3378/6597] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:13 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:14.120187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:14.120816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:14.122824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:14.123525 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:14.131138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:14.131620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.132390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:14.132830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.266767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:14.274972 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-143a99e1-dd20-412b-be43-6fd0f243f7f0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1509 microversion: 2.1 time: 0.158652 Jul 14 15:46:14.275582 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3220/6598] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:14 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:14.293434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:14.294485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:14.300746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:14.301195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.301969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:14.302387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.335507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:14.343522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:46:14.352994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:46:14.353417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:46:14.353888 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:46:14.354298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:46:14.354709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:46:14.419449 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29744817-d266-419c-9eb6-ab8b4b932cb1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90/action" status: 202 len: 0 microversion: 2.1 time: 0.130526 Jul 14 15:46:14.420079 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3379/6599] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:14 2022] POST /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:46:14.428753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:14.429380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:14.435563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:14.436034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.436812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:14.437265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:14.442281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=100 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:14.573208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:14.580743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0055eef9-d473-408c-9720-1e1232f547aa tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1516 microversion: 2.1 time: 0.156393 Jul 14 15:46:14.581526 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3221/6600] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:14 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:15.599974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:15.600539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:15.606825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:15.607294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:15.608109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:15.608547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:15.746342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:15.755384 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d7c17b09-ac57-4845-8815-e184c74eb6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1516 microversion: 2.1 time: 0.161008 Jul 14 15:46:15.755973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3380/6601] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:15 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:16.773139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:16.773768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:16.780933 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:16.781399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:16.782448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:16.782896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:16.930484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:16.945538 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e44c1f69-0205-42e1-ae56-0b937244b141 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.175846 Jul 14 15:46:16.946649 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3222/6602] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:16 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:17.965356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:17.965927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:17.972617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:17.973070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:17.973849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:17.974280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:18.119153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:18.127203 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c17639e-8b34-4d39-8bc6-c329fd5be6c2 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.166051 Jul 14 15:46:18.127842 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3381/6603] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:17 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:19.145292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:19.145950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:19.153075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:19.153537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:19.154318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:19.154767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:19.299334 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:19.307591 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e82751b2-12bb-40e8-89fb-d39acbd550e6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.166418 Jul 14 15:46:19.308352 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3223/6604] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:19 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:20.325278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:20.325904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:20.333290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:20.333744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:20.334523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:20.334965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:20.471536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:20.479946 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-52c875c4-a298-48cd-8909-23730f4f16ce tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.159133 Jul 14 15:46:20.480546 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3382/6605] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:20 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:21.497685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:21.498344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:21.505987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:21.506449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:21.507231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:21.507712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:21.648523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:21.656675 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9fed49e6-5072-4c23-920a-4dd8e97288b0 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.162808 Jul 14 15:46:21.657536 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3224/6606] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:21 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:22.675298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:22.675941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:22.683562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:22.684017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:22.684852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:22.685289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:22.821894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:22.829668 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-71d593d2-7e0d-43d7-88c4-f4a236fabb5e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.159183 Jul 14 15:46:22.830258 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3383/6607] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:22 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:23.848279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:23.848898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:23.856106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:23.856591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:23.857374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:23.857809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:23.988082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:23.995655 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8ccd510e-ecc4-451a-906d-1cbf0ff423c3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.151956 Jul 14 15:46:23.996243 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3225/6608] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:23 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:25.012878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:25.013545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:25.020904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:25.021363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:25.022146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:25.022588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:25.165968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:25.173727 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-41edb62a-f99b-4921-8ea5-a2f3cc124ba6 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.164765 Jul 14 15:46:25.175242 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3384/6609] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:25 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:26.191985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:26.192613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:26.199827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:26.200292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:26.201067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:26.201515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:26.336364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:26.344139 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f44ce714-439e-4dbd-bfb2-d5b2481de9a4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.156212 Jul 14 15:46:26.344756 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3226/6610] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:26 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:27.362712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:27.363369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:27.370658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:27.371114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:27.371924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:27.372367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:27.506827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:27.509111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:27.516587 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e204c313-12f8-403f-a029-4010c87635eb tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.158464 Jul 14 15:46:27.517193 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3385/6611] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:27 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:28.536980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:28.537508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:28.540226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:28.546311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:28.546870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:28.547736 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:28.548187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:28.690224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:28.697955 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b863ea68-2a5b-4d6d-a7a1-f3063729355d tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.164984 Jul 14 15:46:28.698543 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3227/6612] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:28 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:29.714581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:29.715190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:29.718515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:29.725982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:29.726428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:29.727203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:29.727669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:29.867676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:29.875483 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9172426-8ed5-4430-9d9a-37cca40cfc70 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.164841 Jul 14 15:46:29.876087 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3386/6613] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:29 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:30.896279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:30.896840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:30.903796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:30.904258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:30.905062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:30.905511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:31.037069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:31.044894 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-51c42d27-3c3c-47c1-b9a9-88399653ab6e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.153146 Jul 14 15:46:31.045495 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3228/6614] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:30 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:32.066374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:32.067544 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:32.079997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:32.080774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:32.082653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:32.083441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:32.250018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:32.261807 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b2a9fc0-3c96-4d25-8ebf-9b79691980b5 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.202838 Jul 14 15:46:32.262611 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3387/6615] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:32 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:33.279868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:33.280580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:33.287657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:33.288118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:33.288894 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:33.289340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:33.439880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:33.448202 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03388221-dc07-4e20-bfe5-9523081abd2c tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.172384 Jul 14 15:46:33.448788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3229/6616] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:33 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:34.465568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:34.466260 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:34.474054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:34.474496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:34.475330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:34.475774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:34.613600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:34.621371 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44a79adb-76f9-40f6-8950-b2e79a2e7d9b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.159842 Jul 14 15:46:34.621985 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3388/6617] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:34 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:35.640107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:35.640692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:35.647856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:35.648319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:35.649121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:35.649572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:35.794062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:35.802197 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-543b9097-b7fb-42a4-b4f9-ab8096b8ba99 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.166042 Jul 14 15:46:35.802786 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3230/6618] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:35 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:36.820649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:36.821230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:36.828392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:36.828839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:36.829613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:36.830052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:36.974672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:36.982703 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-278e3eb4-1b72-4a67-9c14-764fede96158 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.166975 Jul 14 15:46:36.983330 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3389/6619] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:36 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:38.000425 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:38.001046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:38.008241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:38.008687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:38.009470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:38.009937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:38.154881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:38.164428 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8153440-23be-4e25-8438-eaf0d9a1aa14 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.167807 Jul 14 15:46:38.165039 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3231/6620] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:37 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:39.183025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:39.183698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:39.192004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:39.192471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:39.193282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:39.193725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:39.338998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:39.350682 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a72aebc-2aac-4081-8385-efeb94daa45e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.171656 Jul 14 15:46:39.351596 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3390/6621] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:39 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:40.373018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:40.373641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:40.381333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:40.381804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:40.382592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:40.383041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:40.518544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:40.526581 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f9e1c062-3218-47fe-bbc4-46eef03e99df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.157547 Jul 14 15:46:40.527175 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3232/6622] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:40 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:41.545101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:41.545637 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:41.553212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:41.553660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:41.554415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:41.554849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:41.689557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:41.697313 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2296f471-8ae7-4407-982b-fdf3a1a0cfc8 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.156274 Jul 14 15:46:41.697894 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3391/6623] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:41 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:42.716309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:42.716936 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:42.724493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:42.724952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:42.725740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:42.726204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:42.856653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:42.864153 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a5cc8f11-4a5c-4ffd-a800-cfef6a1ee092 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1521 microversion: 2.1 time: 0.151948 Jul 14 15:46:42.864727 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3233/6624] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:42 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:43.881872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:43.883340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:43.890385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:43.890944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:43.891781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:43.892410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:44.035831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:44.043945 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8ab427a-27a5-4a36-9e3a-54fa752d15f4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1520 microversion: 2.1 time: 0.166126 Jul 14 15:46:44.044931 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3392/6625] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:43 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:44.204434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3b15a1be-cbd1-443b-8d6e-20db1129e62c req-e373e86b-06e1-4a2d-8077-b2235a8d5e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6a56f4-286f-4b06-ace6-97acb5a20d90", "name": "network-vif-unplugged", "status": "completed", "tag": "f9ecf5c3-4016-453d-af4d-e4e3fa83e231"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:44.219040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3b15a1be-cbd1-443b-8d6e-20db1129e62c req-e373e86b-06e1-4a2d-8077-b2235a8d5e28 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:44.219426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3b15a1be-cbd1-443b-8d6e-20db1129e62c req-e373e86b-06e1-4a2d-8077-b2235a8d5e28 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:44.236869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3b15a1be-cbd1-443b-8d6e-20db1129e62c req-e373e86b-06e1-4a2d-8077-b2235a8d5e28 service nova] Creating event network-vif-unplugged:f9ecf5c3-4016-453d-af4d-e4e3fa83e231 for instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 on n-h2-768852-23 Jul 14 15:46:44.243176 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-3b15a1be-cbd1-443b-8d6e-20db1129e62c req-e373e86b-06e1-4a2d-8077-b2235a8d5e28 service nova] Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:46:44.256269 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3b15a1be-cbd1-443b-8d6e-20db1129e62c req-e373e86b-06e1-4a2d-8077-b2235a8d5e28 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055439 Jul 14 15:46:44.257191 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3234/6626] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:45.062083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:45.062757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:45.071048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:45.071532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:45.072390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:45.073070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:45.212492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:45.220224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b61b5a27-8a30-4967-995d-31a7b7a4eae1 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1520 microversion: 2.1 time: 0.162276 Jul 14 15:46:45.220819 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3393/6627] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:45 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:46.239647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:46.240294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:46.247702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:46.248154 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:46.248932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:46.249380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:46.252234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=81 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:46.273783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7b15e28a-ce43-44fb-a17d-92bef2291938 req-1b8510c0-dd5b-4462-937b-642700c5ef6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab6a56f4-286f-4b06-ace6-97acb5a20d90", "tag": "f9ecf5c3-4016-453d-af4d-e4e3fa83e231"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:46.284293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7b15e28a-ce43-44fb-a17d-92bef2291938 req-1b8510c0-dd5b-4462-937b-642700c5ef6c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:46.284739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7b15e28a-ce43-44fb-a17d-92bef2291938 req-1b8510c0-dd5b-4462-937b-642700c5ef6c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:46.297249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7b15e28a-ce43-44fb-a17d-92bef2291938 req-1b8510c0-dd5b-4462-937b-642700c5ef6c service nova] Creating event network-changed:f9ecf5c3-4016-453d-af4d-e4e3fa83e231 for instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 on n-h2-768852-23 Jul 14 15:46:46.304080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-7b15e28a-ce43-44fb-a17d-92bef2291938 req-1b8510c0-dd5b-4462-937b-642700c5ef6c service nova] Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:46:46.315781 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7b15e28a-ce43-44fb-a17d-92bef2291938 req-1b8510c0-dd5b-4462-937b-642700c5ef6c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046339 Jul 14 15:46:46.317411 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3394/6628] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:46:46.436380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:46.444701 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e882f03-43df-4d86-a6fd-08ecc608cc92 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1518 microversion: 2.1 time: 0.209924 Jul 14 15:46:46.445500 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3235/6629] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:46 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1518 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:47.464118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:47.464836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:47.471858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:47.472405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:47.473357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:47.473979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:47.641473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:47.656461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-44825699-acc4-4a99-a6b2-b9b0a0f71324 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1515 microversion: 2.1 time: 0.197375 Jul 14 15:46:47.658329 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3395/6630] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:47 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1515 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:47.679837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:47.680760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:47.693296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:47.694431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:47.695966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:47.696797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:47.791258 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-586d9229-93e9-4046-bc6c-ef1575609dbc tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "POST /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90/action" status: 204 len: 0 microversion: 2.1 time: 0.118989 Jul 14 15:46:47.792383 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3236/6631] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:46:47 2022] POST /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90/action => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:46:47.801812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:47.802443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:47.809642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:47.810216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:47.811050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:47.811643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:48.063839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:48.077283 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8bf438c-5451-4c60-84a8-875c1202632b tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1515 microversion: 2.1 time: 0.280310 Jul 14 15:46:48.078499 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3396/6632] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:47 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1515 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:49.097855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:49.098478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:49.105126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:49.105595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:49.106405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:49.106860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:49.285607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:49.296720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-df0bd8bf-e12a-4eef-9c39-d40edfb7e5d4 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1515 microversion: 2.1 time: 0.203680 Jul 14 15:46:49.297806 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3237/6633] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:49 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:49.838398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-58c090c4-8d0e-49d2-b9b7-35ea30f46815 req-34a89940-4f11-4fa8-8e74-a31d77e9c037 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6a56f4-286f-4b06-ace6-97acb5a20d90", "name": "network-vif-plugged", "status": "completed", "tag": "f9ecf5c3-4016-453d-af4d-e4e3fa83e231"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:49.849482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-58c090c4-8d0e-49d2-b9b7-35ea30f46815 req-34a89940-4f11-4fa8-8e74-a31d77e9c037 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:49.850071 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-58c090c4-8d0e-49d2-b9b7-35ea30f46815 req-34a89940-4f11-4fa8-8e74-a31d77e9c037 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:49.863543 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-58c090c4-8d0e-49d2-b9b7-35ea30f46815 req-34a89940-4f11-4fa8-8e74-a31d77e9c037 service nova] Creating event network-vif-plugged:f9ecf5c3-4016-453d-af4d-e4e3fa83e231 for instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 on n-h2-768852-23 Jul 14 15:46:49.868902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-58c090c4-8d0e-49d2-b9b7-35ea30f46815 req-34a89940-4f11-4fa8-8e74-a31d77e9c037 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108811 Jul 14 15:46:49.869684 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3397/6634] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:50.320579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:50.321274 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:50.328496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.328969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.329747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.330230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.483231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:50.491951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19719d79-181b-4dc5-9aac-6c46a76af897 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1507 microversion: 2.1 time: 0.175897 Jul 14 15:46:50.492656 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3238/6635] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:50 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:50.510148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:50.510879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:50.518088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.518501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.519897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.520390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.661893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:50.670097 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1ffe0ab4-17c3-41a6-81f8-b7dff45cdbc9 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1507 microversion: 2.1 time: 0.164287 Jul 14 15:46:50.670712 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3398/6636] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:50 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1507 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:50.687322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:50.687980 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:50.695111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.695611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.696411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.696866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.859917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:50.868869 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-04a2824c-704d-426f-b168-2b2f844487df tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1507 microversion: 2.1 time: 0.185400 Jul 14 15:46:50.869501 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3239/6637] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:50 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:50.888284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:50.889004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:50.898363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.898852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.899934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:50.900470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:50.930607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:46:51.021177 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ddc2aca-c922-4f3b-90b7-a2a5fc0db891 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 204 len: 0 microversion: 2.1 time: 0.138022 Jul 14 15:46:51.021808 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3399/6638] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:46:50 2022] DELETE /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:46:51.040022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:51.040434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:51.046841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.047315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.048137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.048585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.081910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:46:51.129163 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.compute.api [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Instance is already in deleting state, ignoring this request Jul 14 15:46:51.130024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5b36fb83-914c-4369-aa38-f45531d09cd7 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 204 len: 0 microversion: 2.1 time: 0.094427 Jul 14 15:46:51.130618 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3240/6639] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:46:51 2022] DELETE /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:46:51.142900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:51.143663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:51.149950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.150397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.151150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:51.151620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:51.287658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:51.295224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1da839eb-dfd5-46b4-96e2-14978724698e tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1513 microversion: 2.1 time: 0.156705 Jul 14 15:46:51.295751 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3400/6640] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:51 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:46:52.312366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:52.312985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:52.320149 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:52.320610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:52.321433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:52.321885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:52.465682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfc469baf90a43a8b1b47725a2199444', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62c35510a0b94cabbf1faee3ff23a7e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:46:52.473824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d094c19f-0849-4c39-bdbb-84b935698098 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 200 len: 1513 microversion: 2.1 time: 0.165327 Jul 14 15:46:52.474403 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3241/6641] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:52 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:46:53.005081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1033f469-cfea-4343-a403-a7cce10d0efa req-b99b964c-c000-4c1f-9914-62ca5fc7d0ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab6a56f4-286f-4b06-ace6-97acb5a20d90", "name": "network-vif-deleted", "tag": "f9ecf5c3-4016-453d-af4d-e4e3fa83e231"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:46:53.016188 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1033f469-cfea-4343-a403-a7cce10d0efa req-b99b964c-c000-4c1f-9914-62ca5fc7d0ff service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:53.016885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1033f469-cfea-4343-a403-a7cce10d0efa req-b99b964c-c000-4c1f-9914-62ca5fc7d0ff service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:53.033624 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1033f469-cfea-4343-a403-a7cce10d0efa req-b99b964c-c000-4c1f-9914-62ca5fc7d0ff service nova] Creating event network-vif-deleted:f9ecf5c3-4016-453d-af4d-e4e3fa83e231 for instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 on n-h2-768852-23 Jul 14 15:46:53.041625 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1033f469-cfea-4343-a403-a7cce10d0efa req-b99b964c-c000-4c1f-9914-62ca5fc7d0ff service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039318 Jul 14 15:46:53.042282 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3401/6642] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:46:53.492201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:53.492756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: ab6a56f4-286f-4b06-ace6-97acb5a20d90] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:53.500529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:53.501121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:53.502034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:53.502500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:53.518279 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] HTTP exception thrown: Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 could not be found. Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Request method failure captured: Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 HTTP/1.1 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DoJ1iy_zCm4Kb75AFxSB9yFcCdQP-M3T1Pg6euPNUMoETk-hp_8O90e_Zj75ZPu3NcOvPYEgWOtKpNNgHQtO0HiHivcH2g2c1Ej6UEGFTnYv19XPdGyHyQELvgMdJ7LBNyuEqdYKbGELJu76LkaOKq7PoAHk8AIZXprInhHi84uOKo Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 62c35510a0b94cabbf1faee3ff23a7e2 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 62c35510a0b94cabbf1faee3ff23a7e2 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerDiskConfigTestJSON-1015761699-project Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cfc469baf90a43a8b1b47725a2199444 Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerDiskConfigTestJSON-1015761699-project Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 could not be found. Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ab6a56f4-286f-4b06-ace6-97acb5a20d90'} Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 could not be found. Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 could not be found. Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:46:53.520054 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 could not be found. Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Returning 404 to user: Instance ab6a56f4-286f-4b06-ace6-97acb5a20d90 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-116bec18-c27a-4998-91d6-8406f2a6f1ee tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90" status: 404 len: 111 microversion: 2.1 time: 0.034041 Jul 14 15:46:53.524416 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3242/6643] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:53 2022] GET /compute/v2.1/servers/ab6a56f4-286f-4b06-ace6-97acb5a20d90 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:46:53.532359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ace4f830-dcdc-4b0b-aa82-53bbc9227868 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '.version_select at 0x7fdbf1ca0790>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:53.558339 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ace4f830-dcdc-4b0b-aa82-53bbc9227868 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-736115082" status: 202 len: 0 microversion: 2.1 time: 0.030632 Jul 14 15:46:53.558945 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3402/6644] 10.222.0.98 () {58 vars in 1217 bytes} [Thu Jul 14 15:46:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-736115082 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:46:54.220430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:54.220944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:54.227478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.227952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.228864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.229329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.245746 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] HTTP exception thrown: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Request method failure captured: Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 HTTP/1.1 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DoJ1iy_zCm4Kb75AFxSB9yFcCdQP-M3T1Pg6euPNUMoETk-hp_8O90e_Zj75ZPu3NcOvPYEgWOtKpNNgHQtO0HiHivcH2g2c1Ej6UEGFTnYv19XPdGyHyQELvgMdJ7LBNyuEqdYKbGELJu76LkaOKq7PoAHk8AIZXprInhHi84uOKo Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 62c35510a0b94cabbf1faee3ff23a7e2 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 62c35510a0b94cabbf1faee3ff23a7e2 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerDiskConfigTestJSON-1015761699-project Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: cfc469baf90a43a8b1b47725a2199444 Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerDiskConfigTestJSON-1015761699-project Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '91d4daaf-f32d-4327-a1c5-d51a942df323'} Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:46:54.247378 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Returning 404 to user: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe0f8648-817d-4262-a88d-d9e06d65b4d3 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "DELETE /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 404 len: 111 microversion: 2.1 time: 0.032583 Jul 14 15:46:54.251408 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3243/6645] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:46:54 2022] DELETE /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:46:54.263288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:46:54.264550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] [instance: 91d4daaf-f32d-4327-a1c5-d51a942df323] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:46:54.278794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.279573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.280861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:46:54.281881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:54.305675 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] HTTP exception thrown: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Request method failure captured: Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 HTTP/1.1 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DoJ1iy_zCm4Kb75AFxSB9yFcCdQP-M3T1Pg6euPNUMoETk-hp_8O90e_Zj75ZPu3NcOvPYEgWOtKpNNgHQtO0HiHivcH2g2c1Ej6UEGFTnYv19XPdGyHyQELvgMdJ7LBNyuEqdYKbGELJu76LkaOKq7PoAHk8AIZXprInhHi84uOKo Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 62c35510a0b94cabbf1faee3ff23a7e2 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/62c35510a0b94cabbf1faee3ff23a7e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 62c35510a0b94cabbf1faee3ff23a7e2 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1015761699 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerDiskConfigTestJSON-1015761699-project Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: cfc469baf90a43a8b1b47725a2199444 Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerDiskConfigTestJSON-1015761699-project Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '91d4daaf-f32d-4327-a1c5-d51a942df323'} Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:46:54.308717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] Returning 404 to user: Instance 91d4daaf-f32d-4327-a1c5-d51a942df323 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fd36cbc-8383-4517-87b0-2c7c9c813941 tempest-ServerDiskConfigTestJSON-1015761699 tempest-ServerDiskConfigTestJSON-1015761699-project] 10.222.0.98 "GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323" status: 404 len: 111 microversion: 2.1 time: 0.054803 Jul 14 15:46:54.315427 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3403/6646] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:46:54 2022] GET /compute/v2.1/servers/91d4daaf-f32d-4327-a1c5-d51a942df323 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:47:03.420983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3b5dbb54-73b9-47b5-acb4-d96e916f23d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'create', calling method: .version_select at 0x7fdbf1be60d0>, body: {"keypair": {"name": "tempest-keypair-1137010645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAAa2LkvJfltWB/Kolj6pHt3MhkPBcOSmXInEXCVqHDG0ITn5hYLXzf5rKyKrUeAxxGHa66IZ9BrqXGJBeNCwbiIq67fLzZM1n64iVuuR3Pq8H5dP9jn/xUfFxozN07/cw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:03.425741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=34 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:03.438464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3b5dbb54-73b9-47b5-acb4-d96e916f23d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:47:03.445221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3b5dbb54-73b9-47b5-acb4-d96e916f23d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:47:03.475814 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3b5dbb54-73b9-47b5-acb4-d96e916f23d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193624 Jul 14 15:47:03.481606 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3244/6647] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:47:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:04.956761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1608960991", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e730a512-ca0d-4a1f-9015-fe0b96190ff4"}], "security_groups": [{"name": "tempest-securitygroup--956151209"}], "key_name": "tempest-keypair-1137010645", "user_data": "}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:04.965119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:04.966025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:05.080634 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] validate_networks() for [('e730a512-ca0d-4a1f-9015-fe0b96190ff4', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:47:05.498375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:47:05.498807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:47:05.499446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:47:05.499963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:47:05.500998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:47:05.512114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:05.512471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:05.513276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:05.513993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:05.535098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:47:05.541116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:47:05.557706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:47:05.560107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:47:05.612340 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6ca8c0db-11d1-4a85-84ab-8057889a7d99 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.659210 Jul 14 15:47:05.613118 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3404/6648] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:47:04 2022] POST /compute/v2.1/servers => generated 408 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:47:05.621324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:05.626711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dd49f390-03e4-40d5-a440-0d5d6e782a5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:05.630622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dd49f390-03e4-40d5-a440-0d5d6e782a5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:05.706747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dd49f390-03e4-40d5-a440-0d5d6e782a5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:05.715684 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dd49f390-03e4-40d5-a440-0d5d6e782a5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1239 microversion: 2.1 time: 0.095406 Jul 14 15:47:05.726805 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3245/6649] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:05 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1239 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:47:06.734028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:06.734824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:06.750384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:06.750984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:06.751915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:06.752453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:06.821458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:06.831913 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7053e0cd-5e75-44f4-85ff-3747282fa6dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1291 microversion: 2.1 time: 0.101265 Jul 14 15:47:06.832720 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3405/6650] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:06 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1291 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:07.852877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:07.853486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:07.861241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:07.861712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:07.862853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:07.863339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:08.015391 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:08.023415 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e79f4bc-e567-48b8-89ec-e2b46c1dd266 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1364 microversion: 2.1 time: 0.175709 Jul 14 15:47:08.024023 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3246/6651] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:07 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:08.532919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-31eb7a8a-1d1f-42e2-be9a-82ad720f3221 req-a025b4e2-ad0f-4ba8-91eb-e9745af4dded service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:08.543461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31eb7a8a-1d1f-42e2-be9a-82ad720f3221 req-a025b4e2-ad0f-4ba8-91eb-e9745af4dded service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:08.543944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-31eb7a8a-1d1f-42e2-be9a-82ad720f3221 req-a025b4e2-ad0f-4ba8-91eb-e9745af4dded service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:08.558187 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-31eb7a8a-1d1f-42e2-be9a-82ad720f3221 req-a025b4e2-ad0f-4ba8-91eb-e9745af4dded service nova] Creating event network-changed:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h1-768852-23 Jul 14 15:47:08.563576 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-31eb7a8a-1d1f-42e2-be9a-82ad720f3221 req-a025b4e2-ad0f-4ba8-91eb-e9745af4dded service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129001 Jul 14 15:47:08.564272 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3406/6652] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:09.041478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:09.042105 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:09.049088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:09.049561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:09.050351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:09.050805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:09.186897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:09.195196 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a8e7cfae-e4b9-4537-92db-371070bd8c86 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1364 microversion: 2.1 time: 0.157582 Jul 14 15:47:09.195865 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3247/6653] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:09 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:10.214494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:10.215431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:10.222562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:10.223468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:10.224509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:10.225059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:10.447073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:10.456590 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7a0249a-c6f2-41c7-9ba3-9355d5e3c3af tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1364 microversion: 2.1 time: 0.247839 Jul 14 15:47:10.457206 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3407/6654] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:10 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:11.474577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:11.475240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:11.481810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:11.482273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:11.483051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:11.483545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:11.612703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:11.620232 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9afcd99-2e6e-40b8-a8e5-d92a194a2f72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1364 microversion: 2.1 time: 0.150240 Jul 14 15:47:11.620812 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3248/6655] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:11 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:12.269732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-265791bf-51fa-4586-9099-a3320a6ab406 req-835c05d6-9245-46a7-bf0d-65c1556229f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "name": "network-vif-plugged", "status": "completed", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:12.279557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-265791bf-51fa-4586-9099-a3320a6ab406 req-835c05d6-9245-46a7-bf0d-65c1556229f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:12.280010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-265791bf-51fa-4586-9099-a3320a6ab406 req-835c05d6-9245-46a7-bf0d-65c1556229f4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:12.291759 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-265791bf-51fa-4586-9099-a3320a6ab406 req-835c05d6-9245-46a7-bf0d-65c1556229f4 service nova] Creating event network-vif-plugged:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h1-768852-23 Jul 14 15:47:12.296631 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-265791bf-51fa-4586-9099-a3320a6ab406 req-835c05d6-9245-46a7-bf0d-65c1556229f4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031299 Jul 14 15:47:12.297236 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3408/6656] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:12.637232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:12.637860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:12.644793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:12.645258 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:12.646042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:12.646486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:12.778971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:12.787162 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-903d053b-a2b7-4a8e-b944-376f0431455e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1364 microversion: 2.1 time: 0.153820 Jul 14 15:47:12.787869 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3249/6657] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:12 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:13.805204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:13.805923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:13.812510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:13.812962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:13.813736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:13.814175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:14.293519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:14.301644 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b427a19-94f5-4fe8-b118-8abf56c7b695 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1551 microversion: 2.1 time: 0.501970 Jul 14 15:47:14.302225 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3409/6658] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:13 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1551 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:14.318543 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:14.319216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:14.326286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:14.326749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:14.327542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:14.327985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:14.407684 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d68f196b-0862-4d50-bfab-83087e9ee004 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093603 Jul 14 15:47:14.408288 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3250/6659] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:47:14 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:15.359652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7f324938-fcb6-44db-8724-186f8421fc91 req-6e928bb8-9799-4603-9922-2e5a0edd91ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:15.369267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7f324938-fcb6-44db-8724-186f8421fc91 req-6e928bb8-9799-4603-9922-2e5a0edd91ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:15.369976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7f324938-fcb6-44db-8724-186f8421fc91 req-6e928bb8-9799-4603-9922-2e5a0edd91ea service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:15.382589 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7f324938-fcb6-44db-8724-186f8421fc91 req-6e928bb8-9799-4603-9922-2e5a0edd91ea service nova] Creating event network-changed:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h1-768852-23 Jul 14 15:47:15.389002 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7f324938-fcb6-44db-8724-186f8421fc91 req-6e928bb8-9799-4603-9922-2e5a0edd91ea service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033216 Jul 14 15:47:15.390265 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3410/6660] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:47:51.226415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.227368 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.228046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=28 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.232331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:51.232958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:51.240905 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.241370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.242156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.242607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.380764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:51.388914 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf690deb-fcdb-4298-8c3e-28fa6001a681 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1670 microversion: 2.1 time: 0.164426 Jul 14 15:47:51.389492 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3251/6661] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:51 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:51.402415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.403198 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.405001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.405623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=26 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:47:51.410301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:51.411004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:51.419173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.419662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.420423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.420856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.554161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:51.561725 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b8611d0c-39c7-498e-adea-b1b11e463542 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1670 microversion: 2.1 time: 0.160257 Jul 14 15:47:51.562321 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3411/6662] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:51 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1670 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:51.578277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:51.578938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:51.584943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.585393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.586162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.586607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.716633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:51.724239 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4d2a2bfa-8ca8-4140-98bb-a7180451c359 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1670 microversion: 2.1 time: 0.149761 Jul 14 15:47:51.725366 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3252/6663] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:51 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1670 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:51.741782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:47:51.742909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:51.749584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.749584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.750515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.751055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.782346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:51.788685 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:47:51.794876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:47:51.795329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:47:51.795932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:47:51.796355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:47:51.796766 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:47:51.862410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cff47465-df02-42a9-9942-e6962bbdc356 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52/action" status: 202 len: 0 microversion: 2.1 time: 0.125306 Jul 14 15:47:51.863047 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3412/6664] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:47:51 2022] POST /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:47:51.871940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:51.872612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:51.878756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.879227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:51.880153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:51.880642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:52.017935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:52.025976 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3bac43ee-a993-4d91-bd7f-0868b0970b6a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1679 microversion: 2.1 time: 0.157886 Jul 14 15:47:52.026630 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3253/6665] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:51 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:47:53.044036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:53.044581 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:53.050893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:53.051405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:53.052207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:53.053153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:53.184744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:53.192362 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c077eb1a-ef34-49a0-b288-8d23519d9ac6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1679 microversion: 2.1 time: 0.153358 Jul 14 15:47:53.192941 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3413/6666] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:53 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:54.210963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:54.211418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:54.218036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:54.218494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:54.219280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:54.219734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:54.354748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:54.362367 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9517e1ec-b41b-46b3-97b6-4374a0f696cb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.156160 Jul 14 15:47:54.362943 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3254/6667] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:54 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:55.380594 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:55.381312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:55.388253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:55.388700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:55.389454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:55.389885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:55.525793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:55.533770 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4558606-4707-47e4-bcd6-f71e148c2705 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.157140 Jul 14 15:47:55.534351 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3414/6668] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:55 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:56.551747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:56.552293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:56.559745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:56.560211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:56.560990 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:56.561444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:56.692603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:56.700228 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-483c639d-8fe7-4cbc-aff6-c19a41612eb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.152678 Jul 14 15:47:56.700813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3255/6669] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:56 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:57.717629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:57.718302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:57.725138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:57.725592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:57.726851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:57.727303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:57.858889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:57.866488 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-62331c06-d58e-401f-b166-3bcbb48aae4c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.152772 Jul 14 15:47:57.867081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3415/6670] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:57 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:47:58.884539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:47:58.885049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:47:58.891884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:58.892345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:58.893115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:47:58.893558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:47:59.026992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:47:59.035000 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-406b4443-fad4-4cc5-867f-330038e95b0c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.155071 Jul 14 15:47:59.035619 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3256/6671] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:47:58 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:00.052356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:00.052970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:00.060831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:00.061279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:00.062056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:00.062496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:00.200369 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:00.207959 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-611d092c-2261-4345-8dbb-2763d9eb2ca7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.159536 Jul 14 15:48:00.208608 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3416/6672] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:00 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:01.224992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:01.225623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:01.232375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.232837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.233610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.234060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.362895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:01.371114 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-52a05a95-b40f-4539-ac62-2ddada1a474a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.150273 Jul 14 15:48:01.371740 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3257/6673] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:01 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:02.389230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:02.389844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:02.396908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.397354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.398725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.399159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.547992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:02.557384 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-617e3eac-fd04-4e24-a00f-4379d93a353b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.171702 Jul 14 15:48:02.558818 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3417/6674] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:02 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:03.575794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:03.576326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:03.583329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:03.583805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:03.584589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:03.585540 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:03.721497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:03.729126 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-aad8db4f-5bf1-4175-ad3a-e76ad33a59c3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.157420 Jul 14 15:48:03.729705 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3258/6675] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:03 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:04.746381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:04.747032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:04.754077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:04.754532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:04.755323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:04.755768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:04.883802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:04.891470 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a499fe3a-fb7c-48a4-8e61-5dcb75f889f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.148967 Jul 14 15:48:04.892058 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3418/6676] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:04 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:05.909918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:05.910541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:05.918197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:05.918657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:05.919481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:05.919924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:06.052005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:06.060507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9bbdd0df-efa3-4658-b2c2-d6a37e404bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.154754 Jul 14 15:48:06.061096 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3259/6677] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:05 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:07.077722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:07.078342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:07.085629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:07.086081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:07.086856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:07.087322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:07.225591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:07.233218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0ed0b1b4-9986-43d5-8f53-c0418b9ffbe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.159483 Jul 14 15:48:07.233806 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3419/6678] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:07 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:08.251214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:08.251859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:08.259141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:08.259631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:08.260401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:08.260864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:08.649750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:08.657525 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4074eb1f-b541-43b5-afbb-55e2366cda41 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.410182 Jul 14 15:48:08.658094 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3260/6679] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:08 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:09.674964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:09.675593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:09.682966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:09.683450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:09.684217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:09.684773 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:09.815371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:09.823599 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fea1f7eb-044b-4849-b348-18d326779da6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.152587 Jul 14 15:48:09.824185 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3420/6680] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:09 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:10.841650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:10.842358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:10.849862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:10.850333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:10.851826 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:10.852152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:10.993743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:11.000731 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-03d3a0c9-b5ec-4406-8b4b-9fed2d22b371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1684 microversion: 2.1 time: 0.163080 Jul 14 15:48:11.001307 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3261/6681] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:10 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:11.524870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-43c9ba7b-0a03-44cf-a52e-daa6a2fed717 req-b7d99261-cafb-4f01-a8b5-f2a0120004e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "name": "network-vif-unplugged", "status": "completed", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:11.543427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-43c9ba7b-0a03-44cf-a52e-daa6a2fed717 req-b7d99261-cafb-4f01-a8b5-f2a0120004e3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:11.543878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-43c9ba7b-0a03-44cf-a52e-daa6a2fed717 req-b7d99261-cafb-4f01-a8b5-f2a0120004e3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:11.557442 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-43c9ba7b-0a03-44cf-a52e-daa6a2fed717 req-b7d99261-cafb-4f01-a8b5-f2a0120004e3 service nova] Creating event network-vif-unplugged:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h2-768852-23 Jul 14 15:48:11.563062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-43c9ba7b-0a03-44cf-a52e-daa6a2fed717 req-b7d99261-cafb-4f01-a8b5-f2a0120004e3 service nova] Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:48:11.574673 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-43c9ba7b-0a03-44cf-a52e-daa6a2fed717 req-b7d99261-cafb-4f01-a8b5-f2a0120004e3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127966 Jul 14 15:48:11.576543 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3421/6682] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:12.018332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:12.018962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:12.026264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:12.026738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:12.027568 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:12.028202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:12.253312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:12.267688 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-de43b952-b139-40d5-bb0e-a1e1875c00cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1683 microversion: 2.1 time: 0.253323 Jul 14 15:48:12.269173 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3262/6683] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:12 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1683 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:13.286806 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:13.287628 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:13.295551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:13.295994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:13.296748 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:13.297178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:13.435365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:13.446205 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a0bec83d-f75f-497a-8067-9bf3944ea209 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1681 microversion: 2.1 time: 0.163474 Jul 14 15:48:13.446791 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3422/6684] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:13 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:13.591855 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-824a7649-111f-4a4c-b385-cf6a854f99bf req-fad6a430-e708-4e47-a6a9-e8099ba5eae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:13.601170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-824a7649-111f-4a4c-b385-cf6a854f99bf req-fad6a430-e708-4e47-a6a9-e8099ba5eae2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:13.601627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-824a7649-111f-4a4c-b385-cf6a854f99bf req-fad6a430-e708-4e47-a6a9-e8099ba5eae2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:13.613730 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-824a7649-111f-4a4c-b385-cf6a854f99bf req-fad6a430-e708-4e47-a6a9-e8099ba5eae2 service nova] Creating event network-changed:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h2-768852-23 Jul 14 15:48:13.619380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-824a7649-111f-4a4c-b385-cf6a854f99bf req-fad6a430-e708-4e47-a6a9-e8099ba5eae2 service nova] Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:48:13.630302 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-824a7649-111f-4a4c-b385-cf6a854f99bf req-fad6a430-e708-4e47-a6a9-e8099ba5eae2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042157 Jul 14 15:48:13.630893 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3263/6685] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:14.464508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:14.465405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:14.472536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:14.473076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:14.473931 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:14.474471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:14.608722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:14.617227 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cda82cc8-48c3-4ef1-aa6b-6b0e33c0a9df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1678 microversion: 2.1 time: 0.157152 Jul 14 15:48:14.617706 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3423/6686] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:14 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:14.635666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:14.636228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:14.642462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:14.642925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:14.643728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:14.644179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:14.705152 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66131530-f3c7-4ab9-b0e7-641ef525d86f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52/action" status: 204 len: 0 microversion: 2.1 time: 0.075203 Jul 14 15:48:14.705904 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3264/6687] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:48:14 2022] POST /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:48:14.714474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:14.715103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:14.721328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:14.721783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:14.722730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:14.723263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:14.943803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:14.951790 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b4091699-7113-4fa3-a0ca-5109196fa0b6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1678 microversion: 2.1 time: 0.241492 Jul 14 15:48:14.952456 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3424/6688] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:14 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1678 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:15.971186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:15.971949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:15.980195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:15.981270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:15.982215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:15.983164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.057360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-64dd65c9-2594-448d-a657-d33aed8c1f61 req-ada857fd-81fc-4876-8848-a1342714f62c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "name": "network-vif-plugged", "status": "completed", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:16.072588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-64dd65c9-2594-448d-a657-d33aed8c1f61 req-ada857fd-81fc-4876-8848-a1342714f62c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.073393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-64dd65c9-2594-448d-a657-d33aed8c1f61 req-ada857fd-81fc-4876-8848-a1342714f62c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.087173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-64dd65c9-2594-448d-a657-d33aed8c1f61 req-ada857fd-81fc-4876-8848-a1342714f62c service nova] Creating event network-vif-plugged:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h2-768852-23 Jul 14 15:48:16.093221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-64dd65c9-2594-448d-a657-d33aed8c1f61 req-ada857fd-81fc-4876-8848-a1342714f62c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041533 Jul 14 15:48:16.095256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3425/6689] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:16.151567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:16.159668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-49c37e7a-f843-4086-8f52-8ab2a36d0b12 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1670 microversion: 2.1 time: 0.193533 Jul 14 15:48:16.160257 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3265/6690] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:15 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1670 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:16.176856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.177553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:16.184532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.185316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.185659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.186090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.322494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:16.330488 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bac66077-adb6-4f55-84b0-995c73fb9ebd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1670 microversion: 2.1 time: 0.157917 Jul 14 15:48:16.331086 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3426/6691] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:16 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1670 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:16.346498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.347139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:16.353367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.353837 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.354717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.355076 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.494309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:16.496744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:16.504266 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d8535476-5efd-47aa-b554-c682cdf7b7ed tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1670 microversion: 2.1 time: 0.161665 Jul 14 15:48:16.504853 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3266/6692] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:16 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:16.520322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.521275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:16.528245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.528679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.529440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.529869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.534277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:16.558861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:48:16.635145 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e009ce83-dc6d-4a69-8ee1-1d127f1ad50f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 204 len: 0 microversion: 2.1 time: 0.118385 Jul 14 15:48:16.635840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3427/6693] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:48:16 2022] DELETE /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:48:16.644195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:16.644824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:16.652749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.653217 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.654006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:16.654476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:16.786113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:16.794243 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6ec95ebf-e584-4fdc-9315-14a071090abb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1676 microversion: 2.1 time: 0.153937 Jul 14 15:48:16.794825 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3267/6694] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:16 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:17.812917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:17.813646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:17.820164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:17.820660 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:17.821334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:17.821765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:17.954803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:17.963075 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ea86e23e-baa8-4651-b46d-9bffaf115baf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1676 microversion: 2.1 time: 0.154583 Jul 14 15:48:17.963642 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3428/6695] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:17 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:18.981179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:18.981808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:18.988621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:18.989082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:18.989868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:18.990310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:19.075398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:19.083953 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01ebad8a-e53f-486c-8a8e-256b0c9b4859 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 200 len: 1609 microversion: 2.1 time: 0.106604 Jul 14 15:48:19.084547 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3268/6696] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:18 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 1609 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:19.354701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-078794aa-b8f2-4e34-ae8c-d319dc874085 req-93baf63a-7042-4743-85ba-42c320d34e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ee25240-2adb-4baf-8448-0f3069a99b52", "name": "network-vif-deleted", "tag": "46bbce3a-a236-41a1-a78f-fb641296cf3c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:19.364965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-078794aa-b8f2-4e34-ae8c-d319dc874085 req-93baf63a-7042-4743-85ba-42c320d34e8a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:19.365470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-078794aa-b8f2-4e34-ae8c-d319dc874085 req-93baf63a-7042-4743-85ba-42c320d34e8a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:19.377212 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-078794aa-b8f2-4e34-ae8c-d319dc874085 req-93baf63a-7042-4743-85ba-42c320d34e8a service nova] Creating event network-vif-deleted:46bbce3a-a236-41a1-a78f-fb641296cf3c for instance 2ee25240-2adb-4baf-8448-0f3069a99b52 on n-h2-768852-23 Jul 14 15:48:19.382626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-078794aa-b8f2-4e34-ae8c-d319dc874085 req-93baf63a-7042-4743-85ba-42c320d34e8a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032273 Jul 14 15:48:19.383256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3429/6697] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:20.102107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:20.102735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:20.109934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:20.110407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:20.111192 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:20.111701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:20.126901 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 HTTP/1.1 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2ee25240-2adb-4baf-8448-0f3069a99b52'} Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:20.128643 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1dbd551c-eaac-4147-b19d-a22cee897267 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 404 len: 111 microversion: 2.1 time: 0.031980 Jul 14 15:48:20.133893 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3269/6698] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:20 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:48:20.145746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:20.146540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:20.153230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:20.153675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:20.154481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:20.154896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:20.169918 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 HTTP/1.1 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2ee25240-2adb-4baf-8448-0f3069a99b52'} Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:20.171914 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ecb4fad8-23ce-48ff-8888-f18c1fe9b02f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 404 len: 111 microversion: 2.1 time: 0.031934 Jul 14 15:48:20.175613 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3430/6699] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:20 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:48:20.223907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1477524481", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e730a512-ca0d-4a1f-9015-fe0b96190ff4"}], "security_groups": [{"name": "tempest-securitygroup--956151209"}], "key_name": "tempest-keypair-1137010645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:20.330957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] validate_networks() for [('e730a512-ca0d-4a1f-9015-fe0b96190ff4', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:48:20.711681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:48:20.712124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:48:20.712616 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:48:20.713073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:48:20.713509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:48:20.722335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:20.722799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:20.723681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:20.724139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:20.741503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:48:20.746735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:48:20.759915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:48:20.762278 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:48:20.810019 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66682af9-6c58-4dde-a7dd-b7eb949eb246 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.589956 Jul 14 15:48:20.810710 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3270/6700] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:48:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:48:20.821305 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-303133a6-80ba-4e08-8863-49ecb0e9887d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:20.821952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-303133a6-80ba-4e08-8863-49ecb0e9887d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:20.878338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-303133a6-80ba-4e08-8863-49ecb0e9887d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:20.885976 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-303133a6-80ba-4e08-8863-49ecb0e9887d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1239 microversion: 2.1 time: 0.068711 Jul 14 15:48:20.886771 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3431/6701] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:20 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:21.905757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:21.905757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:21.909488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:21.915963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:21.916746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:21.917733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:21.918141 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:22.013016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:22.021852 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-42588f0d-4693-465f-8063-ad199604de6c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1297 microversion: 2.1 time: 0.122216 Jul 14 15:48:22.022454 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3271/6702] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:21 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:23.041248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:23.041910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:23.044862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:23.052003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:23.052548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:23.054363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:23.055340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:23.212953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:23.221300 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a974087-a306-4e57-948c-1db8c4bd207d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1364 microversion: 2.1 time: 0.183999 Jul 14 15:48:23.232115 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3432/6703] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:23 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:23.391677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-cfcd7253-338c-4e34-9347-1a0805fbd212 req-9a4d3204-c1aa-4ff3-a3f5-61fc6019e61d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:23.411603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cfcd7253-338c-4e34-9347-1a0805fbd212 req-9a4d3204-c1aa-4ff3-a3f5-61fc6019e61d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:23.412072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-cfcd7253-338c-4e34-9347-1a0805fbd212 req-9a4d3204-c1aa-4ff3-a3f5-61fc6019e61d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:23.429235 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-cfcd7253-338c-4e34-9347-1a0805fbd212 req-9a4d3204-c1aa-4ff3-a3f5-61fc6019e61d service nova] Creating event network-changed:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h2-768852-23 Jul 14 15:48:23.435890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-cfcd7253-338c-4e34-9347-1a0805fbd212 req-9a4d3204-c1aa-4ff3-a3f5-61fc6019e61d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051420 Jul 14 15:48:23.436685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3272/6704] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:48:24.239547 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:24.240213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:24.249949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:24.250397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:24.251174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:24.251642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:24.396100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:24.404659 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bca20d95-a453-4b74-87f2-3706e0d12241 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1364 microversion: 2.1 time: 0.168985 Jul 14 15:48:24.405255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3433/6705] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:24 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:25.428219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:25.429582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:25.436560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:25.437031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:25.437823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:25.438281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:25.577049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:25.585009 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c591d5e7-ed4c-4a86-aa6f-6ccf18527f42 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1364 microversion: 2.1 time: 0.164781 Jul 14 15:48:25.585597 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3273/6706] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:25 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:26.602368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:26.602922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:26.610323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:26.610777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:26.611674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:26.612109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:26.760405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:26.768002 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-48328e3b-0704-4927-939d-a9cfe7651ca8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1364 microversion: 2.1 time: 0.169757 Jul 14 15:48:26.768585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3434/6707] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:26 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:27.786178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:27.786816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:27.793844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:27.794306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:27.795090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:27.795649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:27.927091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:27.934907 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-996f8967-5228-440a-9ffa-5c35789f1346 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1364 microversion: 2.1 time: 0.152659 Jul 14 15:48:27.935539 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3274/6708] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:27 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:28.154575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-658989ea-622b-4f6c-851c-7620e3d51989 req-9f6734e6-0e54-40a9-b9c4-622bdebe3a76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "name": "network-vif-plugged", "status": "completed", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:28.164282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-658989ea-622b-4f6c-851c-7620e3d51989 req-9f6734e6-0e54-40a9-b9c4-622bdebe3a76 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:28.165042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-658989ea-622b-4f6c-851c-7620e3d51989 req-9f6734e6-0e54-40a9-b9c4-622bdebe3a76 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:28.177249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-658989ea-622b-4f6c-851c-7620e3d51989 req-9f6734e6-0e54-40a9-b9c4-622bdebe3a76 service nova] Creating event network-vif-plugged:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h2-768852-23 Jul 14 15:48:28.182988 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-658989ea-622b-4f6c-851c-7620e3d51989 req-9f6734e6-0e54-40a9-b9c4-622bdebe3a76 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032683 Jul 14 15:48:28.183753 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3435/6709] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:48:28.952017 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:28.952665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:28.959549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:28.960010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:28.960785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:28.961235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:29.094089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:29.102479 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-06cbf191-9c7b-4705-9ac2-be553fe2777a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1364 microversion: 2.1 time: 0.154284 Jul 14 15:48:29.103062 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3275/6710] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:28 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:30.121950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:30.122622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:30.129194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:30.129645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:30.130413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:30.130850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:30.265486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:30.273992 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-da575216-a204-4b4d-8694-7a7a054f21bb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1550 microversion: 2.1 time: 0.157120 Jul 14 15:48:30.274860 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3436/6711] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:30 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:30.291227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:30.292023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:30.299276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:30.299783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:30.300589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:30.301028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:30.380452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b64b40ba-c233-4604-b0df-878a678c6f7b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093138 Jul 14 15:48:30.381076 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3276/6712] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:48:30 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:48:31.358870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-15316f38-72ce-4b1c-b2f3-2ef01600c4b9 req-a56e9208-33dc-4848-b4ed-f9bdfe85936c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:48:31.362678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:31.370439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-15316f38-72ce-4b1c-b2f3-2ef01600c4b9 req-a56e9208-33dc-4848-b4ed-f9bdfe85936c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:31.370881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-15316f38-72ce-4b1c-b2f3-2ef01600c4b9 req-a56e9208-33dc-4848-b4ed-f9bdfe85936c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:31.385719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-15316f38-72ce-4b1c-b2f3-2ef01600c4b9 req-a56e9208-33dc-4848-b4ed-f9bdfe85936c service nova] Creating event network-changed:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h2-768852-23 Jul 14 15:48:31.392135 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-15316f38-72ce-4b1c-b2f3-2ef01600c4b9 req-a56e9208-33dc-4848-b4ed-f9bdfe85936c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036823 Jul 14 15:48:31.392796 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3437/6713] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:06.612999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.613867 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.616943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=11 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.617731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=47 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.622482 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-39f6d405-0209-4d65-b702-a8e6eeb863bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:06.630765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39f6d405-0209-4d65-b702-a8e6eeb863bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:06.631234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-39f6d405-0209-4d65-b702-a8e6eeb863bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:06.655909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-39f6d405-0209-4d65-b702-a8e6eeb863bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:49:06.705210 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-39f6d405-0209-4d65-b702-a8e6eeb863bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action" status: 202 len: 0 microversion: 2.1 time: 0.092860 Jul 14 15:49:06.705842 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3277/6714] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:49:06 2022] POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:49:06.713351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=11 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.714890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:06.719919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:06.720631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:06.731120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:06.731604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:06.732395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:06.732848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:06.926413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:06.939514 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16b18c8b-e9ad-4583-88a9-932892428939 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.228358 Jul 14 15:49:06.940142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3438/6715] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:06 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:07.958772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:07.959523 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:07.965866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:07.966332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:07.967114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:07.967597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:08.149007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:08.156940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b322fca9-12b0-4983-a351-50c9610aa0f2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.203274 Jul 14 15:49:08.157519 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3278/6716] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:07 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:09.175281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:09.176027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:09.182890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:09.183391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:09.184173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:09.184617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:09.322572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:09.330126 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e21ffddd-1b2a-4b6a-8dd4-63ce2a21fe8a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.158921 Jul 14 15:49:09.330715 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3439/6717] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:09 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:10.349961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:10.350586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:10.357554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:10.358015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:10.358789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:10.359240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:10.492828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:10.500445 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9c25395-5622-4363-a620-6961df12776a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.154887 Jul 14 15:49:10.501056 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3279/6718] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:10 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:11.517813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:11.518361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:11.525574 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:11.526017 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:11.526777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:11.527209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:11.656026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:11.664082 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53cba84a-9f38-4865-8e4c-8b60ee09f543 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.150280 Jul 14 15:49:11.664671 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3440/6719] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:11 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:12.682322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:12.682951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:12.689888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:12.690372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:12.691157 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:12.691635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:12.821788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:12.829392 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7235a5f-bf22-461f-aee6-201662d65da5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.151758 Jul 14 15:49:12.829971 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3280/6720] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:12 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:13.849907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:13.850516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:13.857422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:13.857864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:13.858617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:13.859055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:13.991653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:13.999224 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e32ec3b-87cc-47c7-9876-09982a8143f4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.153263 Jul 14 15:49:13.999835 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3441/6721] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:13 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:15.016984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:15.017618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:15.025036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:15.025499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:15.026273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:15.026727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:15.166283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:15.174687 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e611321b-f334-48f1-9a34-a28660e1145e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.161491 Jul 14 15:49:15.175340 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3281/6722] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:15 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:16.193104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:16.193726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:16.201308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:16.201791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:16.202564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:16.203101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:16.339925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:16.347491 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-827f7e45-251d-4020-a8b6-7f4857f898d6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.158453 Jul 14 15:49:16.348083 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3442/6723] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:16 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:17.365435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:17.366061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:17.373092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:17.373560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:17.374330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:17.374776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:17.506874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:17.514486 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-391a8c37-84f1-4ddd-8bc2-b820c19e4c72 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.153040 Jul 14 15:49:17.515069 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3282/6724] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:17 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:18.534866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:18.535516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:18.542825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:18.543362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:18.544128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:18.544562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:18.679007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:18.686856 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3dc03226-2b16-459f-b9b1-d4a88c46747f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.155878 Jul 14 15:49:18.687598 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3443/6725] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:18 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:19.704934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:19.705556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:19.712973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:19.713437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:19.714209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:19.714659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:19.849919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:19.857711 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c677d452-c65e-493a-b060-55f02be165e4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.156695 Jul 14 15:49:19.858286 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3283/6726] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:19 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:20.875442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:20.876058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:20.882975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:20.883541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:20.884311 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:20.884756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:21.015793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:21.023801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-622b47e1-e37b-498f-9eed-e9e4b82bbe18 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.151838 Jul 14 15:49:21.024376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3444/6727] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:20 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:22.041873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:22.042509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:22.049499 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:22.049966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:22.050750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:22.051204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:22.185058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:22.192910 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d78266a0-c3c0-4851-964a-ad29ab16ae1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.155482 Jul 14 15:49:22.193486 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3284/6728] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:22 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:23.210040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:23.210698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:23.217709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:23.218155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:23.218907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:23.219447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:23.353262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:23.360807 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-796f0a84-9688-413f-a0c2-4c842b004742 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1656 microversion: 2.1 time: 0.154716 Jul 14 15:49:23.361389 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3445/6729] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:23 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:23.377824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:23.378945 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:23.386340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:23.386802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:23.387651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:23.388103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:23.416801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:23.422588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Old instance type m1.heat2, new instance type m1.heat {{(pid=125966) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:49:23.428884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:49:23.429812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:49:23.430307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:49:23.430728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:49:23.431158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:49:23.494307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e99de808-65b6-4a71-a661-6d941f998369 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action" status: 202 len: 0 microversion: 2.1 time: 0.120388 Jul 14 15:49:23.494953 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3285/6730] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:49:23 2022] POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:49:23.503127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:23.503849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:23.511022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:23.511516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:23.512286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:23.512724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:23.674739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:23.683086 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b682476-3d4f-4b50-a453-ae8b07760b17 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.183881 Jul 14 15:49:23.683717 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3446/6731] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:23 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:24.702914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:24.703563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:24.710687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:24.711218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:24.712023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:24.712474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:24.845840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:24.853622 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-00bc8cc1-f264-4eb7-97ce-8f689c208c94 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1679 microversion: 2.1 time: 0.155331 Jul 14 15:49:24.854235 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3286/6732] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:24 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:25.872058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:25.872591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:25.879690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:25.880141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:25.880903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:25.881367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:26.014649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:26.022261 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9da3c6c4-a8dd-415b-b068-5d6f2ae08cda tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1684 microversion: 2.1 time: 0.154267 Jul 14 15:49:26.022842 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3447/6733] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:25 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:27.040802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:27.041439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:27.048420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:27.048919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:27.049800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:27.050257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:27.184772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:27.192600 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b0891eab-1887-42f5-9525-3b6d46cc18be tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1684 microversion: 2.1 time: 0.156395 Jul 14 15:49:27.193253 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3287/6734] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:27 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:28.210306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:28.210944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:28.217904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:28.218352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:28.219116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:28.219587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:28.442197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:28.450303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1595c53c-a4f6-489e-8964-f41f75b509cc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1683 microversion: 2.1 time: 0.244214 Jul 14 15:49:28.450882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3448/6735] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:28 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:28.495126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-453647a3-6585-4c62-8b75-4d76ac6bb5e0 req-c2fc9c9c-f7fe-4940-b919-8265df2bad9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "name": "network-vif-unplugged", "status": "completed", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:28.504735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-453647a3-6585-4c62-8b75-4d76ac6bb5e0 req-c2fc9c9c-f7fe-4940-b919-8265df2bad9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:28.505366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-453647a3-6585-4c62-8b75-4d76ac6bb5e0 req-c2fc9c9c-f7fe-4940-b919-8265df2bad9c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:28.517871 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-453647a3-6585-4c62-8b75-4d76ac6bb5e0 req-c2fc9c9c-f7fe-4940-b919-8265df2bad9c service nova] Creating event network-vif-unplugged:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h1-768852-23 Jul 14 15:49:28.523348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-453647a3-6585-4c62-8b75-4d76ac6bb5e0 req-c2fc9c9c-f7fe-4940-b919-8265df2bad9c service nova] Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:49:28.535997 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-453647a3-6585-4c62-8b75-4d76ac6bb5e0 req-c2fc9c9c-f7fe-4940-b919-8265df2bad9c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045334 Jul 14 15:49:28.537199 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3288/6736] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:29.468018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:29.468633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:29.475916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:29.476362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:29.477127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:29.477555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:29.614878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:29.623226 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0e9b6e82-92fc-4a4a-9cad-4933e17c63e3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1683 microversion: 2.1 time: 0.159149 Jul 14 15:49:29.623847 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3449/6737] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:29 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:30.553721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-85493c32-11c7-49fd-a6a4-9600222b876f req-13d66628-8c41-4a1c-949f-fd708caae317 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:30.563725 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-85493c32-11c7-49fd-a6a4-9600222b876f req-13d66628-8c41-4a1c-949f-fd708caae317 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:30.564180 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-85493c32-11c7-49fd-a6a4-9600222b876f req-13d66628-8c41-4a1c-949f-fd708caae317 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:30.576246 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-85493c32-11c7-49fd-a6a4-9600222b876f req-13d66628-8c41-4a1c-949f-fd708caae317 service nova] Creating event network-changed:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h1-768852-23 Jul 14 15:49:30.581546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-85493c32-11c7-49fd-a6a4-9600222b876f req-13d66628-8c41-4a1c-949f-fd708caae317 service nova] Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:49:30.593507 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-85493c32-11c7-49fd-a6a4-9600222b876f req-13d66628-8c41-4a1c-949f-fd708caae317 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044190 Jul 14 15:49:30.594124 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3289/6738] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:30.640877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:30.641494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:30.649350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:30.649801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:30.650578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:30.651043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:30.799629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:30.810306 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d1acf104-d317-4db0-9442-8feb8af24592 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1681 microversion: 2.1 time: 0.173217 Jul 14 15:49:30.822819 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3450/6739] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:30 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:31.830022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:31.830746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:31.837923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:31.838388 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:31.839216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:31.839700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:31.977403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:31.984989 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ce542cd-7230-4b96-9eea-e3ee09ab40b7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1677 microversion: 2.1 time: 0.159283 Jul 14 15:49:31.985582 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3290/6740] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:31 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:32.001420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:32.001956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:32.009387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:32.009832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:32.010585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:32.011016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:32.075253 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-85774c29-459f-407f-84e7-07cbfe851bba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action" status: 204 len: 0 microversion: 2.1 time: 0.077523 Jul 14 15:49:32.075981 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3451/6741] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:49:31 2022] POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:49:32.085153 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:32.086281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:32.092892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:32.093661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:32.094481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:32.094947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:32.353977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:32.357822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:32.362874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be2ba60d-c3bf-435a-8d0d-0d860f867f70 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1677 microversion: 2.1 time: 0.282520 Jul 14 15:49:32.363493 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3291/6742] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:32 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1677 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:32.940907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-be00c3eb-0db4-4d84-9752-4ef7d6735c91 req-8612d57f-cd9f-4de5-b45d-398b7018746b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "name": "network-vif-plugged", "status": "completed", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:32.950982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-be00c3eb-0db4-4d84-9752-4ef7d6735c91 req-8612d57f-cd9f-4de5-b45d-398b7018746b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:32.951388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-be00c3eb-0db4-4d84-9752-4ef7d6735c91 req-8612d57f-cd9f-4de5-b45d-398b7018746b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:32.965677 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-be00c3eb-0db4-4d84-9752-4ef7d6735c91 req-8612d57f-cd9f-4de5-b45d-398b7018746b service nova] Creating event network-vif-plugged:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h1-768852-23 Jul 14 15:49:32.971798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-be00c3eb-0db4-4d84-9752-4ef7d6735c91 req-8612d57f-cd9f-4de5-b45d-398b7018746b service nova] Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:49:32.984264 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-be00c3eb-0db4-4d84-9752-4ef7d6735c91 req-8612d57f-cd9f-4de5-b45d-398b7018746b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047273 Jul 14 15:49:32.985373 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3452/6743] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:33.380716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:33.381353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:33.390667 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.391329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:33.392151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.392601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:33.535466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:33.543406 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93172a8e-ba31-409f-97c0-972400270474 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1656 microversion: 2.1 time: 0.166606 Jul 14 15:49:33.544060 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3292/6744] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:33 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:33.562756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:33.563491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:33.570507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.570966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:33.571974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.572422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:33.708950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:33.715068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:33.720858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f631a993-9165-40f5-b482-41de53bf48fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1656 microversion: 2.1 time: 0.163052 Jul 14 15:49:33.722012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3453/6745] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:33 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1656 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:33.737843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2aa38c13-cfc7-4b6c-a933-7a5237ee6334 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:33.744465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2aa38c13-cfc7-4b6c-a933-7a5237ee6334 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.744923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2aa38c13-cfc7-4b6c-a933-7a5237ee6334 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:33.767070 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2aa38c13-cfc7-4b6c-a933-7a5237ee6334 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Going to try to start instance {{(pid=125966) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:49:33.812150 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2aa38c13-cfc7-4b6c-a933-7a5237ee6334 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action" status: 202 len: 0 microversion: 2.1 time: 0.078073 Jul 14 15:49:33.812686 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3293/6746] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:49:33 2022] POST /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:49:33.822185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:33.822812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:33.829706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.830204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:33.831069 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:33.831540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:34.009963 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:34.018569 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4479f32c-b46f-4ff8-baec-8d595c354b2b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1665 microversion: 2.1 time: 0.201238 Jul 14 15:49:34.019174 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3454/6747] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:33 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:35.038420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:35.039054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:35.045382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:35.045851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:35.046632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:35.047089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:35.182361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:35.190061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a6921ee9-5ad7-43bc-8cdb-0432bf8fa3c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1665 microversion: 2.1 time: 0.156807 Jul 14 15:49:35.190648 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3294/6748] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:35 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:36.207704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:36.208343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:36.215303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:36.215778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:36.216532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:36.216970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:36.349756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:36.357780 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-18c6680a-e4ea-4b48-9f64-7cec523587f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1669 microversion: 2.1 time: 0.154100 Jul 14 15:49:36.358363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3455/6749] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:36 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:36.374907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:36.375464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:36.382962 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:36.383459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:36.384248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:36.384704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:36.411500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:49:36.489197 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6eb37e8a-19ab-4463-8673-28f4092634fe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 204 len: 0 microversion: 2.1 time: 0.117939 Jul 14 15:49:36.489887 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3295/6750] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:49:36 2022] DELETE /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:49:36.499028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:36.499725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:36.505795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:36.506242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:36.507008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:36.507487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:36.637313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:36.644913 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2998988-e946-4d57-93fa-42396e8e96b5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1675 microversion: 2.1 time: 0.149752 Jul 14 15:49:36.645514 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3456/6751] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:36 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:37.663223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:37.664538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:37.667253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:37.672928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:37.673372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:37.674160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:37.674608 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:37.812539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:37.820509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1a892b82-21eb-495e-8d18-35559a8581e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1675 microversion: 2.1 time: 0.161646 Jul 14 15:49:37.821231 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3296/6752] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:37 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:38.809662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-af0d29d1-e6bb-407d-8512-c1a5eef5a62f req-1f11c4a0-3c49-4124-8452-8e7edd165ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87cccb4c-fc66-4647-9e37-3f928cd31536", "name": "network-vif-deleted", "tag": "0f9abd25-7d0e-4891-9d54-cedd39cbe71c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:38.815166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=39 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:38.823034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-af0d29d1-e6bb-407d-8512-c1a5eef5a62f req-1f11c4a0-3c49-4124-8452-8e7edd165ab6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:38.823584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-af0d29d1-e6bb-407d-8512-c1a5eef5a62f req-1f11c4a0-3c49-4124-8452-8e7edd165ab6 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:38.837870 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-af0d29d1-e6bb-407d-8512-c1a5eef5a62f req-1f11c4a0-3c49-4124-8452-8e7edd165ab6 service nova] Creating event network-vif-deleted:0f9abd25-7d0e-4891-9d54-cedd39cbe71c for instance 87cccb4c-fc66-4647-9e37-3f928cd31536 on n-h1-768852-23 Jul 14 15:49:38.838529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:38.839317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:38.843453 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-af0d29d1-e6bb-407d-8512-c1a5eef5a62f req-1f11c4a0-3c49-4124-8452-8e7edd165ab6 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037234 Jul 14 15:49:38.844199 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3457/6753] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:38.852116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:38.852441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:38.853485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:38.856765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:38.936529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:38.944440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7736ad9e-4d81-45dc-bf38-949b47f10f66 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 200 len: 1324 microversion: 2.1 time: 0.110316 Jul 14 15:49:38.945624 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3297/6754] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:38 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 1324 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:39.963053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:39.963795 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:39.971004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:39.971496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:39.972261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:39.972696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:39.985930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 HTTP/1.1 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '87cccb4c-fc66-4647-9e37-3f928cd31536'} Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:39.987617 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f178f3a-5a41-41b9-9694-ac13c97627eb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 404 len: 111 microversion: 2.1 time: 0.030540 Jul 14 15:49:39.992463 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3458/6755] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:39 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:49:40.008146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:40.008809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:40.015761 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:40.016227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:40.016995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:40.017443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:40.030951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 HTTP/1.1 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '87cccb4c-fc66-4647-9e37-3f928cd31536'} Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:49:40.032689 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8b21d8e4-fad2-4de7-a098-4fd0e9d5cb2f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 404 len: 111 microversion: 2.1 time: 0.031008 Jul 14 15:49:40.037121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3298/6756] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:40 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:49:40.080864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-70269577", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e730a512-ca0d-4a1f-9015-fe0b96190ff4"}], "security_groups": [{"name": "tempest-securitygroup--956151209"}], "key_name": "tempest-keypair-1137010645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:40.184043 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] validate_networks() for [('e730a512-ca0d-4a1f-9015-fe0b96190ff4', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:49:40.599498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:49:40.599929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:49:40.600407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:49:40.601387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:49:40.601851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:49:40.610937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:40.611427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:40.612286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:40.612668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:40.629371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:49:40.634753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:49:40.647092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:49:40.649926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:49:40.696909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-78d2d56d-fadb-4c69-a977-cb40bd15d721 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.619853 Jul 14 15:49:40.697591 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3459/6757] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:49:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:49:40.707767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-78d6015f-8209-40d1-9c20-45ebc4e9b6f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:40.708393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-78d6015f-8209-40d1-9c20-45ebc4e9b6f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:40.761699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-78d6015f-8209-40d1-9c20-45ebc4e9b6f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:40.768655 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-78d6015f-8209-40d1-9c20-45ebc4e9b6f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1237 microversion: 2.1 time: 0.064666 Jul 14 15:49:40.769467 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3299/6758] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:40 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1237 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:41.789498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:41.790095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:41.799756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:41.800205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:41.801007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:41.801449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:41.867022 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:41.874520 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-422ac4ab-749f-4266-9581-e94489e5c733 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1295 microversion: 2.1 time: 0.091102 Jul 14 15:49:41.875099 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3460/6759] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:41 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1295 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:42.892424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:42.893731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:42.902306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:42.902878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:42.904066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:42.904856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:43.124164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:43.138755 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-487bc893-4154-4092-8119-dffed0a1e8c5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1362 microversion: 2.1 time: 0.250230 Jul 14 15:49:43.139676 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3300/6760] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:42 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:43.188489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c67b9ba2-140f-4257-bdf4-e9f82c6cf98c req-58a13674-15ac-481d-addd-c44f7f893f18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:43.201657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c67b9ba2-140f-4257-bdf4-e9f82c6cf98c req-58a13674-15ac-481d-addd-c44f7f893f18 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:43.202207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c67b9ba2-140f-4257-bdf4-e9f82c6cf98c req-58a13674-15ac-481d-addd-c44f7f893f18 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:43.224567 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c67b9ba2-140f-4257-bdf4-e9f82c6cf98c req-58a13674-15ac-481d-addd-c44f7f893f18 service nova] Creating event network-changed:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h2-768852-23 Jul 14 15:49:43.230916 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c67b9ba2-140f-4257-bdf4-e9f82c6cf98c req-58a13674-15ac-481d-addd-c44f7f893f18 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046727 Jul 14 15:49:43.232107 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3461/6761] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:44.156032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:44.156672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:44.164382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:44.164856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:44.165656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:44.166118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:44.301128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:44.309644 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0416a6b-b37d-4009-ac25-ed94a56a95f8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1362 microversion: 2.1 time: 0.157759 Jul 14 15:49:44.310291 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3301/6762] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:44 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:45.329344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:45.330186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:45.336849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:45.337292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:45.338052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:45.338487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:45.476037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:45.483911 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-927c034f-0003-443e-8f03-fb36d7374c95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1362 microversion: 2.1 time: 0.159623 Jul 14 15:49:45.484508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3462/6763] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:45 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:46.501454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:46.502089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:46.509897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:46.510373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:46.511173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:46.511657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:46.649654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:46.657606 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9b4e2a9-2258-4570-abc3-219aee0608fc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1362 microversion: 2.1 time: 0.160051 Jul 14 15:49:46.658195 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3302/6764] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:46 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:49:47.676754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:47.677381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:47.684500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:47.685084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:47.686004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:47.686582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:47.826183 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:47.834303 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-330cb3e1-6c46-402e-9f2b-033fdaa82929 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1362 microversion: 2.1 time: 0.162314 Jul 14 15:49:47.835554 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3463/6765] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:47 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:48.533712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9e801c79-c042-4a2a-8c05-b5935ee659a1 req-12f0c322-2007-4b44-9a56-89206f960273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "name": "network-vif-plugged", "status": "completed", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:48.543457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9e801c79-c042-4a2a-8c05-b5935ee659a1 req-12f0c322-2007-4b44-9a56-89206f960273 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:48.543983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9e801c79-c042-4a2a-8c05-b5935ee659a1 req-12f0c322-2007-4b44-9a56-89206f960273 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:48.557978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9e801c79-c042-4a2a-8c05-b5935ee659a1 req-12f0c322-2007-4b44-9a56-89206f960273 service nova] Creating event network-vif-plugged:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h2-768852-23 Jul 14 15:49:48.563139 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9e801c79-c042-4a2a-8c05-b5935ee659a1 req-12f0c322-2007-4b44-9a56-89206f960273 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Jul 14 15:49:48.564019 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3303/6766] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:48.852774 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:48.853309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:48.860515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:48.860968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:48.861780 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:48.862218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:49.003154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:49.011549 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eadd686e-1c7c-45c9-b7c3-f42b1773ff95 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1362 microversion: 2.1 time: 0.162807 Jul 14 15:49:49.012149 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3464/6767] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:48 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:50.031173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:50.032063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:50.039294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:50.039850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:50.041181 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:50.041593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:50.184346 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:49:50.195176 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d7da8bf0-ce7c-4e4d-bac7-6b3dcba66f1e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1548 microversion: 2.1 time: 0.168828 Jul 14 15:49:50.195832 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3304/6768] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:49:50 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:49:50.213608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:49:50.214153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:49:50.221324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:50.221777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:50.222558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:50.222996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:50.310259 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31efd0bb-13b7-43e3-80c9-6fe01817f3a2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100694 Jul 14 15:49:50.311057 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3465/6769] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:49:50 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:49:51.290954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-7ff32708-8d8f-4253-a947-009b9eccdaad req-4f26ef7e-2123-456b-9e02-0f5f0ac92e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:49:51.294453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:49:51.301406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7ff32708-8d8f-4253-a947-009b9eccdaad req-4f26ef7e-2123-456b-9e02-0f5f0ac92e37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:49:51.301860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-7ff32708-8d8f-4253-a947-009b9eccdaad req-4f26ef7e-2123-456b-9e02-0f5f0ac92e37 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:49:51.314186 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-7ff32708-8d8f-4253-a947-009b9eccdaad req-4f26ef7e-2123-456b-9e02-0f5f0ac92e37 service nova] Creating event network-changed:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h2-768852-23 Jul 14 15:49:51.319842 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-7ff32708-8d8f-4253-a947-009b9eccdaad req-4f26ef7e-2123-456b-9e02-0f5f0ac92e37 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032972 Jul 14 15:49:51.320472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3305/6770] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:08.610073 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:08.610676 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:50:10.850254 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:10.850807 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:50:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:50:26.216059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.217243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.220014 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.220767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=55 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.225903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:26.227527 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:26.237548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:26.238011 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:26.238824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:26.239304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:26.267446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:26.274129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:50:26.280682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:50:26.281111 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:50:26.281583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:50:26.281991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:50:26.282403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:50:26.354589 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba7ae0ab-3591-4bda-b0eb-45a55142d622 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd/action" status: 202 len: 0 microversion: 2.1 time: 0.139512 Jul 14 15:50:26.355239 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3466/6771] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:50:26 2022] POST /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:50:26.362021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=21 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.362860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:26.367230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:26.368024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:26.377021 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:26.377490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:26.378293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:26.378747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:26.513554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:26.521743 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-09ed00d9-2429-48ff-9c5b-82b49382d77e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1676 microversion: 2.1 time: 0.162022 Jul 14 15:50:26.522663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3306/6772] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:26 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:27.542583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:27.543254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:27.550128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:27.550576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:27.551349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:27.551784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:27.689461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:27.699462 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-71fb721e-fa39-4fe5-83c4-3d0c98f07f5b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1676 microversion: 2.1 time: 0.161966 Jul 14 15:50:27.700152 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3467/6773] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:27 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:28.717702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:28.718350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:28.725441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:28.725909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:28.727390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:28.727846 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:28.866428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:28.874205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-14242401-0ea5-4ce2-861e-8ac4d02a3871 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.160508 Jul 14 15:50:28.874803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3307/6774] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:28 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:29.892484 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:29.894449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:29.900730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:29.901184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:29.901949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:29.902388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:30.033522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:30.041856 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38886ad6-2ad7-47d9-b481-4daeda2c0d16 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.153248 Jul 14 15:50:30.042433 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3468/6775] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:29 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:31.059806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:31.060386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:31.067430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:31.067895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:31.068675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:31.069124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:31.204185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:31.212060 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1a3b3f3-1533-4230-a3d6-86ed78c2a927 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.156247 Jul 14 15:50:31.212854 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3308/6776] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:31 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:32.231193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:32.231830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:32.238653 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:32.239105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:32.239937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:32.240433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:32.375620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:32.383232 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a626412f-304b-46e0-b3cd-a11c152751e2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.156585 Jul 14 15:50:32.383852 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3469/6777] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:32 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:33.400654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:33.401290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:33.408562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:33.409037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:33.409822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:33.410280 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:33.542116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:33.549669 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68eef2cd-fca3-4749-be90-0a2b81a51291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.153034 Jul 14 15:50:33.550249 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3309/6778] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:33 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:34.567357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:34.567884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:34.575535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:34.575984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:34.576754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:34.577189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:34.710643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:34.718347 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a71bcf13-bfed-4c0b-957c-cbecdc9cca2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.155026 Jul 14 15:50:34.718933 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3470/6779] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:34 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:35.736267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:35.736892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:35.743866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:35.744324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:35.745797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:35.746244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:35.878210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:35.885770 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3f884701-2436-4b40-be39-14b958128b3f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.153415 Jul 14 15:50:35.886353 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3310/6780] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:35 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:36.902997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:36.903641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:36.911012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:36.911502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:36.912269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:36.912700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:37.047666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:37.055493 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-25fe8bef-548b-4c0d-9af0-05802d53f4b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.156358 Jul 14 15:50:37.056232 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3471/6781] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:36 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:38.073935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:38.074567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:38.081758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:38.082255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:38.083040 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:38.083524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:38.216485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:38.224187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9c435907-3119-4598-bc1a-c8a7333c7bf1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.154901 Jul 14 15:50:38.224769 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3311/6782] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:38 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:50:39.241646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:39.242273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:39.249513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:39.249967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:39.250743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:39.251219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:39.388431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:39.396042 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35047b88-de92-4177-881d-3a6e1b39652c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.158326 Jul 14 15:50:39.396632 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3472/6783] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:39 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:40.413928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:40.414560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:40.422165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:40.422635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:40.423445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:40.423901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:40.561944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:40.569598 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d5e72e0c-9fbe-4305-b30d-a2b646028689 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.159552 Jul 14 15:50:40.570175 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3312/6784] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:40 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:41.587374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:41.587954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:41.595110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:41.595589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:41.596355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:41.596791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:41.728036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:41.736059 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-abe6fff2-9fae-44d8-9317-fe0397a7d0d0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.152722 Jul 14 15:50:41.736634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3473/6785] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:41 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:42.754144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:42.754772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:42.761572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:42.762557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:42.763374 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:42.763834 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:42.895415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:42.903017 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c3aa8dd-4bc0-42e1-89ee-217fba6470aa tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.152961 Jul 14 15:50:42.903625 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3313/6786] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:42 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:43.920308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:43.920935 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:43.927851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:43.928298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:43.929061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:43.929494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:44.065100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:44.072751 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d989a6b9-e15f-4590-b14e-1bf86f0e0a4e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.156358 Jul 14 15:50:44.073339 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3474/6787] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:43 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:45.091452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:45.092012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:45.099986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:45.100449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:45.101234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:45.101683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:45.266535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:45.274395 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0753fec8-6844-48cf-91e4-9264d68f98b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1681 microversion: 2.1 time: 0.187475 Jul 14 15:50:45.275338 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3314/6788] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:45 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:45.865006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e8d63865-e19d-4734-8a57-f0e828c89b6b req-05aecce1-e4f4-452e-82fd-0d19237c40c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "name": "network-vif-unplugged", "status": "completed", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:45.874310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e8d63865-e19d-4734-8a57-f0e828c89b6b req-05aecce1-e4f4-452e-82fd-0d19237c40c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:45.874705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e8d63865-e19d-4734-8a57-f0e828c89b6b req-05aecce1-e4f4-452e-82fd-0d19237c40c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:45.887131 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e8d63865-e19d-4734-8a57-f0e828c89b6b req-05aecce1-e4f4-452e-82fd-0d19237c40c8 service nova] Creating event network-vif-unplugged:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h1-768852-23 Jul 14 15:50:45.892656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-e8d63865-e19d-4734-8a57-f0e828c89b6b req-05aecce1-e4f4-452e-82fd-0d19237c40c8 service nova] Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:50:45.904413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e8d63865-e19d-4734-8a57-f0e828c89b6b req-05aecce1-e4f4-452e-82fd-0d19237c40c8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042567 Jul 14 15:50:45.905286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3475/6789] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:46.292961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:46.294163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:46.301785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:46.302581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:46.303714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:46.304387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:46.462480 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:46.472356 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be861dba-debf-4c32-a3ec-a2bd4257645a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1680 microversion: 2.1 time: 0.182467 Jul 14 15:50:46.472356 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3315/6790] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:46 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:47.491056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:47.491778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:47.498040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:47.498485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:47.499238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:47.499704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:47.630269 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:47.638418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-33a159d8-7f72-4192-a4ec-74b1f32674df tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1678 microversion: 2.1 time: 0.152550 Jul 14 15:50:47.639004 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3476/6791] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:47 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:47.920813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-af283acd-2f47-4d64-b142-837adda3c9c7 req-d2d2ed27-8035-4beb-a3e1-83ac2c1cad89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:47.929807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-af283acd-2f47-4d64-b142-837adda3c9c7 req-d2d2ed27-8035-4beb-a3e1-83ac2c1cad89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:47.930266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-af283acd-2f47-4d64-b142-837adda3c9c7 req-d2d2ed27-8035-4beb-a3e1-83ac2c1cad89 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:47.942434 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-af283acd-2f47-4d64-b142-837adda3c9c7 req-d2d2ed27-8035-4beb-a3e1-83ac2c1cad89 service nova] Creating event network-changed:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h1-768852-23 Jul 14 15:50:47.947835 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-af283acd-2f47-4d64-b142-837adda3c9c7 req-d2d2ed27-8035-4beb-a3e1-83ac2c1cad89 service nova] Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:50:47.959110 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-af283acd-2f47-4d64-b142-837adda3c9c7 req-d2d2ed27-8035-4beb-a3e1-83ac2c1cad89 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042037 Jul 14 15:50:47.959767 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3316/6792] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:48.657357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:48.658276 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:48.666075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:48.667842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:48.668633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:48.669274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:48.895621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:48.903506 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-187e7edf-a04d-4552-8441-f719a1eaa09b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1675 microversion: 2.1 time: 0.251564 Jul 14 15:50:48.904363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3477/6793] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:48 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:48.922921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:48.923617 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:48.930953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:48.931442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:48.932242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:48.932740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:48.970299 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:48.970763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:48.971606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:48.972060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:48.992899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:50:48.998689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:50:49.097727 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f996bb79-430e-4331-b8ac-6c3f3862d371 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd/action" status: 202 len: 0 microversion: 2.1 time: 0.180426 Jul 14 15:50:49.098516 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3317/6794] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:50:48 2022] POST /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:50:49.107222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:49.107879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:49.114244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:49.114700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:49.115503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:49.115944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:49.323204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:49.330930 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd473abb-30cb-4fd6-8eaf-2192c4ac0090 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1674 microversion: 2.1 time: 0.228139 Jul 14 15:50:49.331587 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3478/6795] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:49 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:50.350789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:50.351788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:50.360587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:50.361068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:50.361871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:50.362335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:50.505081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:50.512923 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9cc6f37f-65bc-44a9-8af2-d725aafd2819 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1674 microversion: 2.1 time: 0.167323 Jul 14 15:50:50.513510 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3318/6796] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:50 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:51.530507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:51.531116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:51.538245 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:51.538690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:51.539498 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:51.539933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:51.678777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:51.688539 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6636657d-fec0-493e-9839-fc38e4915dd0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1674 microversion: 2.1 time: 0.162166 Jul 14 15:50:51.689148 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3479/6797] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:51 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:52.707621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:52.708836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:52.716682 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:52.717151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:52.717953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:52.718590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:52.924206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:52.928198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:52.933376 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-13e8056a-787e-4f53-829d-7e0cb7b595e7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1674 microversion: 2.1 time: 0.229832 Jul 14 15:50:52.934069 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3319/6798] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:52 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1674 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:52.973520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a58ca3c4-0ee9-4d5f-95d9-145350610b5e req-550aace9-7bce-429d-87aa-e5629ab875d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:52.984359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a58ca3c4-0ee9-4d5f-95d9-145350610b5e req-550aace9-7bce-429d-87aa-e5629ab875d9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:52.985048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a58ca3c4-0ee9-4d5f-95d9-145350610b5e req-550aace9-7bce-429d-87aa-e5629ab875d9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:53.011531 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a58ca3c4-0ee9-4d5f-95d9-145350610b5e req-550aace9-7bce-429d-87aa-e5629ab875d9 service nova] Creating event network-changed:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h2-768852-23 Jul 14 15:50:53.018241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-a58ca3c4-0ee9-4d5f-95d9-145350610b5e req-550aace9-7bce-429d-87aa-e5629ab875d9 service nova] Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:50:53.030314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a58ca3c4-0ee9-4d5f-95d9-145350610b5e req-550aace9-7bce-429d-87aa-e5629ab875d9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063146 Jul 14 15:50:53.031123 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3480/6799] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:53.950097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:53.950730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:53.960712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:53.961199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:53.961992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:53.962443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:54.096868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:54.104586 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a9aa6348-02ab-44af-9a0f-8685805ad675 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1674 microversion: 2.1 time: 0.158455 Jul 14 15:50:54.105181 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3320/6800] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:53 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:55.125785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:55.126514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:55.134705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:55.135501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:55.136394 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:55.136997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:55.316693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:55.322889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:55.326094 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a8afece4-5df8-487e-af9e-0f641ffc9112 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1674 microversion: 2.1 time: 0.207580 Jul 14 15:50:55.326697 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3481/6801] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:55 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1674 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:50:56.345086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:56.345910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:56.353083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.353548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.354337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.354788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.492896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:56.501225 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-33700cef-61bb-45d3-b385-8f1e2f5c576e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1667 microversion: 2.1 time: 0.161126 Jul 14 15:50:56.501814 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3321/6802] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:56 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:56.517704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:56.518317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:56.521487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=37 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:56.527429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.527938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.528757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.529425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.669249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:56.678037 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-67261863-782a-473b-827b-2d2545634893 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1667 microversion: 2.1 time: 0.163990 Jul 14 15:50:56.678930 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3482/6803] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:56 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:56.696260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:56.697203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:56.699137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:56.704460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.704921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.705900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.706465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.797707 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c84e62df-03ab-416b-93ae-9f19c900a9d5 req-8d27fbc5-dca6-4358-9f6c-1d7c08bb104d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "name": "network-vif-plugged", "status": "completed", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:56.806876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c84e62df-03ab-416b-93ae-9f19c900a9d5 req-8d27fbc5-dca6-4358-9f6c-1d7c08bb104d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.807457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c84e62df-03ab-416b-93ae-9f19c900a9d5 req-8d27fbc5-dca6-4358-9f6c-1d7c08bb104d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.820145 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c84e62df-03ab-416b-93ae-9f19c900a9d5 req-8d27fbc5-dca6-4358-9f6c-1d7c08bb104d service nova] Creating event network-vif-plugged:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h2-768852-23 Jul 14 15:50:56.825359 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c84e62df-03ab-416b-93ae-9f19c900a9d5 req-8d27fbc5-dca6-4358-9f6c-1d7c08bb104d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032034 Jul 14 15:50:56.826255 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3483/6804] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:50:56.855635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:56.864672 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-54516781-787e-4a94-adb0-fc6fa40ba08a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1667 microversion: 2.1 time: 0.172519 Jul 14 15:50:56.865281 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3322/6805] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:56 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1667 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:56.881448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:56.882194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:56.888884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.889340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.890103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:56.890541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:56.916435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:50:56.993801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-267515b6-97fa-4102-b50b-f1dc37db51b2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 204 len: 0 microversion: 2.1 time: 0.116272 Jul 14 15:50:56.994413 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3484/6806] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:50:56 2022] DELETE /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:50:57.002989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:57.003645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:57.009808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:57.010269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:57.011038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:57.011528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:57.140693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:57.148360 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4030899d-1383-4abf-a60d-d440bc48d643 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1673 microversion: 2.1 time: 0.149394 Jul 14 15:50:57.148949 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3323/6807] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:56 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:50:58.169268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:58.170230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:58.177485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:58.177932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:58.178690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:58.179121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:58.315458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:58.323067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f4cd538-60ee-49f8-9c16-5420cebfc851 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1673 microversion: 2.1 time: 0.159267 Jul 14 15:50:58.323680 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3485/6808] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:58 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:59.340818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:50:59.341481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:50:59.344474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:59.350245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:59.350711 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:59.351538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:59.351992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:59.510194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:50:59.518006 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a553e7e-4dc1-4af3-bdb6-94f6b11a1f1a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 200 len: 1606 microversion: 2.1 time: 0.181262 Jul 14 15:50:59.518788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3324/6809] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:50:59 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 1606 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:50:59.582989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-251f0981-1a30-48fb-af33-cd27b6a8fbc0 req-93962c03-2414-475d-9f82-f719c61c2e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcf7e911-8853-4472-b9d6-56c9de6e1dfd", "name": "network-vif-deleted", "tag": "79030d3c-ccb8-4636-99df-7d29bde898c0"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:50:59.593206 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-251f0981-1a30-48fb-af33-cd27b6a8fbc0 req-93962c03-2414-475d-9f82-f719c61c2e26 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:50:59.593915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-251f0981-1a30-48fb-af33-cd27b6a8fbc0 req-93962c03-2414-475d-9f82-f719c61c2e26 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:50:59.607936 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-251f0981-1a30-48fb-af33-cd27b6a8fbc0 req-93962c03-2414-475d-9f82-f719c61c2e26 service nova] Creating event network-vif-deleted:79030d3c-ccb8-4636-99df-7d29bde898c0 for instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd on n-h2-768852-23 Jul 14 15:50:59.613541 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-251f0981-1a30-48fb-af33-cd27b6a8fbc0 req-93962c03-2414-475d-9f82-f719c61c2e26 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035410 Jul 14 15:50:59.614194 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3486/6810] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:51:00.536698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:00.537349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:00.543649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:00.544162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:00.544958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:00.545411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:00.560170 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd HTTP/1.1 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'fcf7e911-8853-4472-b9d6-56c9de6e1dfd'} Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:51:00.561901 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d270a7a5-445b-4689-9ae1-e0f967e12a01 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 404 len: 111 microversion: 2.1 time: 0.031557 Jul 14 15:51:00.566289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3325/6811] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:00 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:51:00.581623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:00.582344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:00.589954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:00.590698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:00.591361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:00.591798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:00.606568 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd HTTP/1.1 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fcf7e911-8853-4472-b9d6-56c9de6e1dfd'} Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:51:00.608289 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-beab004a-d493-4d10-946c-095f52a4ed5c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 404 len: 111 microversion: 2.1 time: 0.032259 Jul 14 15:51:00.612236 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3487/6812] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:00 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:51:00.679786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1611413865", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "e730a512-ca0d-4a1f-9015-fe0b96190ff4"}], "security_groups": [{"name": "tempest-securitygroup--956151209"}], "key_name": "tempest-keypair-1137010645", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:00.789777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] validate_networks() for [('e730a512-ca0d-4a1f-9015-fe0b96190ff4', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:51:01.217140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:51:01.217591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:51:01.218085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:51:01.218511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:51:01.218944 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:51:01.227973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:01.228439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:01.229251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:01.229707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:01.247260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:51:01.252629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:51:01.265189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:51:01.267547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:51:01.315382 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5a932a1-5986-4b97-b75b-d484cacf739e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.639425 Jul 14 15:51:01.316040 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3326/6813] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:51:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:51:01.326117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e69aaad8-961b-4df5-8784-af95ac11c30f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:01.326759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e69aaad8-961b-4df5-8784-af95ac11c30f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:01.380561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e69aaad8-961b-4df5-8784-af95ac11c30f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:01.387733 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e69aaad8-961b-4df5-8784-af95ac11c30f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1239 microversion: 2.1 time: 0.065506 Jul 14 15:51:01.388330 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3488/6814] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:01 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1239 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:02.407134 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:02.407795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:02.414899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:02.415418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:02.416209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:02.416693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:02.486601 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:02.501106 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5657c68-d891-48e8-8c1f-8af28d8b67cf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1291 microversion: 2.1 time: 0.098139 Jul 14 15:51:02.501106 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3327/6815] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:02 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1291 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:03.518754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:03.519523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:03.527843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:03.528344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:03.529445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:03.529950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:03.743166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:03.752195 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-96674fdf-b116-4c76-a031-136fd2337901 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.237249 Jul 14 15:51:03.753133 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3489/6816] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:03 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:04.120907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d42d01be-db5d-430e-90b8-3180ac459df1 req-7d84d8cc-ad8f-4c35-85aa-aad2343c9e8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:04.137170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d42d01be-db5d-430e-90b8-3180ac459df1 req-7d84d8cc-ad8f-4c35-85aa-aad2343c9e8e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:04.137639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d42d01be-db5d-430e-90b8-3180ac459df1 req-7d84d8cc-ad8f-4c35-85aa-aad2343c9e8e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:04.150356 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d42d01be-db5d-430e-90b8-3180ac459df1 req-7d84d8cc-ad8f-4c35-85aa-aad2343c9e8e service nova] Creating event network-changed:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h1-768852-23 Jul 14 15:51:04.155899 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d42d01be-db5d-430e-90b8-3180ac459df1 req-7d84d8cc-ad8f-4c35-85aa-aad2343c9e8e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039607 Jul 14 15:51:04.156522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3328/6817] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:51:04.770987 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:04.771640 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:04.779770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:04.780225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:04.781008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:04.781445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:04.916715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:04.924319 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cefcefff-33fd-450f-aa1f-cc7b8f5fcec7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.157330 Jul 14 15:51:04.924944 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3490/6818] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:04 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:05.943317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:05.944039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:05.950287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:05.950751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:05.951553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:05.952007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:06.084270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:06.092563 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e986fccf-7a09-402c-9a9c-0f1ef48cb04f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.154909 Jul 14 15:51:06.093142 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3329/6819] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:05 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:07.110021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:07.110654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:07.117540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:07.118018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:07.118777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:07.119208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:07.253036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:07.260676 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26cc701a-0c90-466a-8787-5b569e9a1788 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.154667 Jul 14 15:51:07.261465 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3491/6820] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:07 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:08.278009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:08.278692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:08.285892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:08.286357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:08.287126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:08.287606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:08.415294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:08.423386 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-def10c06-8ac5-4cf8-b76a-3c8ddc3ad734 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.149268 Jul 14 15:51:08.423973 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3330/6821] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:08 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:09.434604 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-221b6bca-6fb5-45b7-9476-b71c50e019bb req-41a68239-f5a1-4074-9832-02532cb6a41e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "name": "network-vif-plugged", "status": "completed", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:09.445185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-221b6bca-6fb5-45b7-9476-b71c50e019bb req-41a68239-f5a1-4074-9832-02532cb6a41e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:09.445739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-221b6bca-6fb5-45b7-9476-b71c50e019bb req-41a68239-f5a1-4074-9832-02532cb6a41e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:09.447187 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:09.447880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:09.455559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:09.456022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:09.457003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:09.457454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:09.459673 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-221b6bca-6fb5-45b7-9476-b71c50e019bb req-41a68239-f5a1-4074-9832-02532cb6a41e service nova] Creating event network-vif-plugged:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h1-768852-23 Jul 14 15:51:09.464961 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-221b6bca-6fb5-45b7-9476-b71c50e019bb req-41a68239-f5a1-4074-9832-02532cb6a41e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034192 Jul 14 15:51:09.465750 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3492/6822] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:51:09.601982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:09.609824 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-782aa650-ac81-4b74-ad93-ff7d4f724d85 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.166487 Jul 14 15:51:09.610410 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3331/6823] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:09 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:10.628997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:10.629649 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:10.635961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:10.636405 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:10.637160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:10.637615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:10.776812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:10.786043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1bc2e2ae-e9b6-4173-b002-21fafae583c8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1364 microversion: 2.1 time: 0.162327 Jul 14 15:51:10.786840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3493/6824] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:10 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:11.804470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:11.805101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:11.807852 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:11.808649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:11.815595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:11.816068 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:11.816858 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:11.817319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:11.947784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:11.956387 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5d0e42a-b02e-4d0c-9a15-bbb7d66d8daf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1551 microversion: 2.1 time: 0.155917 Jul 14 15:51:11.956971 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3332/6825] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:11 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:11.973172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:11.973680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:11.975712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:11.981775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:11.982225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:11.982990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:11.983453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:12.067695 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a95e33b-0bf2-4795-9c81-88e038888fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098396 Jul 14 15:51:12.068334 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3494/6826] 10.222.0.98 () {58 vars in 1274 bytes} [Thu Jul 14 15:51:11 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:51:13.010457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4480d151-1657-4f27-aea2-9554b02c4f91 req-1393a7d0-1355-4446-ab6f-c4e81e5f7c4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:13.020139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4480d151-1657-4f27-aea2-9554b02c4f91 req-1393a7d0-1355-4446-ab6f-c4e81e5f7c4c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:13.020600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4480d151-1657-4f27-aea2-9554b02c4f91 req-1393a7d0-1355-4446-ab6f-c4e81e5f7c4c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:13.032571 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4480d151-1657-4f27-aea2-9554b02c4f91 req-1393a7d0-1355-4446-ab6f-c4e81e5f7c4c service nova] Creating event network-changed:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h1-768852-23 Jul 14 15:51:13.037636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4480d151-1657-4f27-aea2-9554b02c4f91 req-1393a7d0-1355-4446-ab6f-c4e81e5f7c4c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030848 Jul 14 15:51:13.038428 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3333/6827] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:51:50.471256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:50.472114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:50.476133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:51:50.476753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:50.484108 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:50.484602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:50.485371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:50.485804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:50.626030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:51:50.634281 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e871221e-7598-4a10-9ae8-71539d54f540 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1670 microversion: 2.1 time: 0.164960 Jul 14 15:51:50.634899 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3495/6828] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:51:50 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:51:50.650781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:50.651629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=68 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:51:50.657175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f937979-b0df-42c6-bc36-9d45ce333512"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:51:50.658364 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:51:50.666166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:50.666696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:50.667528 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:51:50.667976 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:51:50.948884 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-73cc1e31-f8ab-4565-b210-4f25a4f48552 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300302 Jul 14 15:51:50.949542 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3334/6829] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:51:50 2022] POST /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-volume_attachments => generated 194 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:01.633284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:01.634252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:01.637035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.637694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.644333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:01.644787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:01.645568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:01.646002 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:01.674790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:01.680709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Old instance type m1.heat2, new instance type m1.heat {{(pid=125965) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 15:52:01.687984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:52:01.688411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:52:01.688883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:52:01.689293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:52:01.689706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:52:01.756607 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a2d78e2-520d-4849-87c4-0682f5c87795 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/action" status: 202 len: 0 microversion: 2.1 time: 0.127181 Jul 14 15:52:01.757226 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3496/6830] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:52:01 2022] POST /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:52:01.766386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.767830 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:01.777436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:01.778443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:01.791460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:01.792000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:01.793019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:01.793699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:01.935415 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:01.943814 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2cf2ef1b-0717-4707-8b76-36dbc75ce26e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1725 microversion: 2.1 time: 0.181541 Jul 14 15:52:01.944643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3335/6831] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:01 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:02.961999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.962686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.969671 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.970118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.970892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.971353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:03.163490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:03.172358 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c274abe3-b827-462a-8dfc-6e1830d36d1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1725 microversion: 2.1 time: 0.215175 Jul 14 15:52:03.173067 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3497/6832] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:04.190031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:04.190662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:04.197773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:04.198235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:04.199015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:04.199497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:04.332551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:04.340509 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1fd7041-72f1-44d7-ad4a-b8f496fd8e79 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.154457 Jul 14 15:52:04.341084 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3336/6833] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:04 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:05.359898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:05.360513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:05.367424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:05.367880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:05.368642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:05.369081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:05.509064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:05.517416 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d283dac-b72c-4cef-9d01-2a8b11dce782 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.162132 Jul 14 15:52:05.517952 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3498/6834] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:05 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:06.536045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:06.536674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:06.543869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:06.544331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:06.545113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:06.545775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:06.689097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:06.697295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e1c32c13-bb76-4435-b8e3-e46ca6901cf0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.165270 Jul 14 15:52:06.697882 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3337/6835] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:06 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:07.715497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:07.716116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:07.723545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:07.724005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:07.724775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:07.725214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:07.854510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:07.863539 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3723269e-2339-44d0-988d-a80066302bcf tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.151910 Jul 14 15:52:07.864192 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3499/6836] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:07 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:08.880974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:08.881604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:08.888688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:08.889151 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:08.889963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:08.890444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:09.017871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:09.029425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b57f895-8e99-4fe4-a34b-5dab1c6ab812 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.152286 Jul 14 15:52:09.030343 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3338/6837] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:08 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:10.047800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:10.048422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:10.055526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:10.055977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:10.056753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:10.057192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:10.194579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:10.203430 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ba3d705c-0714-4256-8327-e662b03df4e1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.160044 Jul 14 15:52:10.204030 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3500/6838] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:10 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:11.221190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:11.221810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:11.228841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:11.229386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:11.230162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:11.230611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:11.363789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:11.372203 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55017fab-ac5e-44ae-9eba-1ac0a20daaa8 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.155189 Jul 14 15:52:11.372807 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3339/6839] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:11 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:12.388919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:12.389568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:12.397459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:12.397908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:12.398690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:12.399827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:12.877925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:12.886092 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ecd1a420-9e66-4b57-a16b-9b87d0362263 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.501078 Jul 14 15:52:12.886694 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3501/6840] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:12 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:13.903644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:13.904276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:13.911591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:13.912054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:13.912823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:13.913273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:14.048123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:14.056212 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0a7bd816-4d26-44e1-8f50-6c40c995986e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.156580 Jul 14 15:52:14.056802 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3340/6841] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:13 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:15.074219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:15.074844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:15.082591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:15.083044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:15.083833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:15.084277 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:15.222693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:15.231439 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0c538a65-b0a1-42d1-9da4-ed118b1791dc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.161098 Jul 14 15:52:15.232026 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3502/6842] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:15 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:16.251111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:16.251868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:16.259205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:16.259802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:16.260483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:16.260931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:16.400162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:16.410085 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a45aec6e-97d8-45b1-a297-78a9af0511e6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.163235 Jul 14 15:52:16.410776 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3341/6843] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:16 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:52:17.428622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:17.429250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:17.436004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:17.436452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:17.437213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:17.437651 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:17.567619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:17.575691 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c07c4ab9-351f-4dd6-a231-76678d3e61f6 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1730 microversion: 2.1 time: 0.151021 Jul 14 15:52:17.576293 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3503/6844] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:17 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:18.578754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-15bfeee1-9f9e-456f-8001-da7c793b045e req-431cf6c4-84d6-4edb-9130-444fec843e4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "name": "network-vif-unplugged", "status": "completed", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:18.594329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:18.595787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:18.603239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:18.603979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:18.604729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-15bfeee1-9f9e-456f-8001-da7c793b045e req-431cf6c4-84d6-4edb-9130-444fec843e4c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:18.605150 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:18.605284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-15bfeee1-9f9e-456f-8001-da7c793b045e req-431cf6c4-84d6-4edb-9130-444fec843e4c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:18.605675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:18.618348 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-15bfeee1-9f9e-456f-8001-da7c793b045e req-431cf6c4-84d6-4edb-9130-444fec843e4c service nova] Creating event network-vif-unplugged:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h2-768852-23 Jul 14 15:52:18.624183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-15bfeee1-9f9e-456f-8001-da7c793b045e req-431cf6c4-84d6-4edb-9130-444fec843e4c service nova] Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:52:18.636324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-15bfeee1-9f9e-456f-8001-da7c793b045e req-431cf6c4-84d6-4edb-9130-444fec843e4c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061454 Jul 14 15:52:18.637289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3342/6845] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:18.761218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:18.770582 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-052489e4-7fc4-409f-b6eb-3089a71ff4d4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1729 microversion: 2.1 time: 0.180134 Jul 14 15:52:18.771353 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3504/6846] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:18 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:52:19.790633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:19.791048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:19.798720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:19.799193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:19.800042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:19.800500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:19.948739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:19.957155 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e3d9e5ca-d3bc-4bf4-ba46-b5e546d7eba5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.171693 Jul 14 15:52:19.957736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3343/6847] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:19 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:20.653904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-ff2eee4f-3902-464b-ab25-f27094cd4528 req-c5ecef52-4fa1-4641-90af-344add31ce39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:20.664306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ff2eee4f-3902-464b-ab25-f27094cd4528 req-c5ecef52-4fa1-4641-90af-344add31ce39 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:20.664830 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-ff2eee4f-3902-464b-ab25-f27094cd4528 req-c5ecef52-4fa1-4641-90af-344add31ce39 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:20.677816 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-ff2eee4f-3902-464b-ab25-f27094cd4528 req-c5ecef52-4fa1-4641-90af-344add31ce39 service nova] Creating event network-changed:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h2-768852-23 Jul 14 15:52:20.683354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-ff2eee4f-3902-464b-ab25-f27094cd4528 req-c5ecef52-4fa1-4641-90af-344add31ce39 service nova] Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:52:20.695363 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-ff2eee4f-3902-464b-ab25-f27094cd4528 req-c5ecef52-4fa1-4641-90af-344add31ce39 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045474 Jul 14 15:52:20.695987 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3505/6848] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:20.975288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:20.976495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:20.985103 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:20.986503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:20.987706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:20.988381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:21.260903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:21.272268 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ffc0e9ae-bd4f-46fd-8d43-c60ded1e2186 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.300908 Jul 14 15:52:21.274242 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3344/6849] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:20 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:22.293666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:22.294368 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:22.301179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:22.301622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:22.302390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:22.302824 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:22.441875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:22.450065 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-797236de-b951-4a88-8d52-91c9949fccc5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.161822 Jul 14 15:52:22.450634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3506/6850] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:22 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:23.468501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:23.468501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:23.476179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:23.476637 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:23.477424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:23.477871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:23.617656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:23.626550 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-517f9293-056e-4f92-9701-63a090588fff tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.162541 Jul 14 15:52:23.627388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3345/6851] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:23 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:52:24.644668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:24.645334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:24.652818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:24.653270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:24.654056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:24.654497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:24.803470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:24.812268 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ae17c6be-a2b0-4133-ab52-5961e0f9860e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.172226 Jul 14 15:52:24.812857 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3507/6852] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:24 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:25.831676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:25.832494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:25.839770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:25.840241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:25.841019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:25.841467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:25.984135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:25.992443 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3a1cca9f-dc12-4838-a7bf-9fa04442b30a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.165457 Jul 14 15:52:25.993179 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3346/6853] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:25 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:27.010309 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:27.010837 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:27.018455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:27.018905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:27.019693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:27.020133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:27.148834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:27.158106 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0366f959-dd7d-45da-8202-cc0a2f5f452a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.151213 Jul 14 15:52:27.158727 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3508/6854] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:27 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:28.175772 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:28.176426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:28.184629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:28.185094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:28.185877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:28.186330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:28.321573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:28.330226 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e00c347a-af65-417a-ac5c-49291ebb717d tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.158515 Jul 14 15:52:28.330803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3347/6855] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:28 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:29.346619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:29.347261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:29.354246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:29.354686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:29.355473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:29.355901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:29.491556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:29.499731 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7eca70f4-419e-44eb-8c40-114396053173 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.156952 Jul 14 15:52:29.500357 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3509/6856] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:29 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:30.517081 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:30.518186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:30.525236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:30.525691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:30.526471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:30.526920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:30.659535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:30.667637 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0bcef4ad-3012-4700-8a0d-3f7f277caeeb tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.154589 Jul 14 15:52:30.668219 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3348/6857] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:30 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:31.686716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:31.687454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:31.690860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=33 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:31.696625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:31.697080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:31.697903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:31.698346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:31.701481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:31.847121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:31.856043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f531e569-26a5-403b-a5a1-97c491b7806e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1727 microversion: 2.1 time: 0.174446 Jul 14 15:52:31.856642 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3510/6858] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:31 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:32.874231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:32.874866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:32.877537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=29 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:32.883019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:32.883524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:32.884319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:32.884773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:32.887683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=83 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:33.038313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:33.046624 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-55c5ba86-8b6c-4516-a3ce-1f4faf9c75c2 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1724 microversion: 2.1 time: 0.176457 Jul 14 15:52:33.047536 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3349/6859] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:32 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:33.063845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:33.064984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:33.072109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:33.072557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:33.073335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:33.073775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:33.113458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:33.113580 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:33.114295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:33.114729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:33.136494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:52:33.142319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Getting quotas for user 29448f858ed24113b4e90ff1bf3f2b1e and project a15e337c6f4c4e1aac98b22bce2555a2. Resources: {'ram', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:52:33.257909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b19473f-aac2-4e7a-b561-a2736cc52247 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "POST /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/action" status: 202 len: 0 microversion: 2.1 time: 0.198025 Jul 14 15:52:33.261759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3511/6860] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:52:33 2022] POST /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:52:33.268553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:33.268553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:33.274998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:33.275519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:33.276330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:33.276795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:33.492863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:33.503391 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c474e84b-b8d4-4e05-b136-27e50d4e9fc7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.239964 Jul 14 15:52:33.504009 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3350/6861] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:33 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:34.523411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:34.524037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:34.534403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:34.534851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:34.535661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:34.536089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:34.666191 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:34.674287 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6da49a22-e794-4845-8494-37d19d32d7fd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.156860 Jul 14 15:52:34.674875 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3512/6862] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:34 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:35.324739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f857ad1e-7f21-4af0-90e9-baedca369b95 req-dd3eb5bc-ec20-4ad5-8a4f-5de7cf2c59a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "name": "network-vif-plugged", "status": "completed", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:35.332955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f857ad1e-7f21-4af0-90e9-baedca369b95 req-dd3eb5bc-ec20-4ad5-8a4f-5de7cf2c59a2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:35.333420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f857ad1e-7f21-4af0-90e9-baedca369b95 req-dd3eb5bc-ec20-4ad5-8a4f-5de7cf2c59a2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:35.346122 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f857ad1e-7f21-4af0-90e9-baedca369b95 req-dd3eb5bc-ec20-4ad5-8a4f-5de7cf2c59a2 service nova] Creating event network-vif-plugged:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h2-768852-23 Jul 14 15:52:35.351759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-f857ad1e-7f21-4af0-90e9-baedca369b95 req-dd3eb5bc-ec20-4ad5-8a4f-5de7cf2c59a2 service nova] Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:52:35.363399 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f857ad1e-7f21-4af0-90e9-baedca369b95 req-dd3eb5bc-ec20-4ad5-8a4f-5de7cf2c59a2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101056 Jul 14 15:52:35.364088 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3351/6863] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:52:35.692753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:35.693399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:35.700357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:35.700804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:35.701560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:35.701995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:35.837934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:35.845919 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f685e11f-8570-435a-a5f4-921ca3d3221f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.157655 Jul 14 15:52:35.846500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3513/6864] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:35 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:36.865596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:36.866313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:36.872674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:36.873155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:36.873926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:36.874378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:37.008185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:37.016387 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-bf2bc608-fc9e-4b8d-9cc8-7c08819a8e2a tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.156824 Jul 14 15:52:37.017061 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3352/6865] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:36 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:38.034288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:38.034916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:38.041992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:38.042443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:38.043296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:38.043750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:38.185967 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:38.195397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fa9a5bf4-eebf-4c06-acc5-ad223f15a1d1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.165271 Jul 14 15:52:38.196044 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3514/6866] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:38 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:52:38.794900 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6a39cb97-c376-4b9b-9dc0-96555d47a49c req-d1b8e133-c80f-469d-8294-03bd55679ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "name": "network-vif-unplugged", "status": "completed", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:38.805007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a39cb97-c376-4b9b-9dc0-96555d47a49c req-d1b8e133-c80f-469d-8294-03bd55679ba5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:38.805267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6a39cb97-c376-4b9b-9dc0-96555d47a49c req-d1b8e133-c80f-469d-8294-03bd55679ba5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:38.820749 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6a39cb97-c376-4b9b-9dc0-96555d47a49c req-d1b8e133-c80f-469d-8294-03bd55679ba5 service nova] Creating event network-vif-unplugged:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h1-768852-23 Jul 14 15:52:38.826882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-6a39cb97-c376-4b9b-9dc0-96555d47a49c req-d1b8e133-c80f-469d-8294-03bd55679ba5 service nova] Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:52:38.839291 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6a39cb97-c376-4b9b-9dc0-96555d47a49c req-d1b8e133-c80f-469d-8294-03bd55679ba5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101330 Jul 14 15:52:38.840478 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3353/6867] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:52:39.213211 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:39.213842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:39.221438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:39.222267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:39.223337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:39.223950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:39.429264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:39.438415 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db1f2be7-baa8-4434-aa03-c81f4524cd32 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.229644 Jul 14 15:52:39.440081 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3515/6868] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:39 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:40.458674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:40.459473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:40.466190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:40.466661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:40.467495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:40.467949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:40.610175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:40.618928 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e6141173-23b2-4d6b-8d68-8f2a57d8c46e tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.165647 Jul 14 15:52:40.619542 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3354/6869] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:40 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:40.856761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6103005c-704f-42b4-a134-9cbc8f294db2 req-9b4a5911-77c3-4997-89ee-fef3bac6febd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:40.866647 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6103005c-704f-42b4-a134-9cbc8f294db2 req-9b4a5911-77c3-4997-89ee-fef3bac6febd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:40.867091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6103005c-704f-42b4-a134-9cbc8f294db2 req-9b4a5911-77c3-4997-89ee-fef3bac6febd service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:40.880585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6103005c-704f-42b4-a134-9cbc8f294db2 req-9b4a5911-77c3-4997-89ee-fef3bac6febd service nova] Creating event network-changed:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h1-768852-23 Jul 14 15:52:40.886389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-6103005c-704f-42b4-a134-9cbc8f294db2 req-9b4a5911-77c3-4997-89ee-fef3bac6febd service nova] Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 15:52:40.898231 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6103005c-704f-42b4-a134-9cbc8f294db2 req-9b4a5911-77c3-4997-89ee-fef3bac6febd service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045109 Jul 14 15:52:40.898856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3516/6870] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:41.637408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:41.638046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:41.645891 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:41.646360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:41.647152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:41.647638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:41.786984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:41.795235 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94fc3118-1e47-41d2-821c-70cbaf0ccbb4 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.161971 Jul 14 15:52:41.795871 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3355/6871] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:41 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:42.815373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:42.816100 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:42.823064 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:42.823459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:42.824238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:42.824674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:42.966854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:42.975355 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ae8b250-de67-4b46-a2dc-3cc670615be7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.165634 Jul 14 15:52:42.975991 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3517/6872] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:42 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:43.993269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:43.993879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:44.001067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:44.001535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:44.002328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:44.002782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:44.135653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:44.144757 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c68055f-65b9-4e62-8f60-9030eced1f5f tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.155552 Jul 14 15:52:44.145385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3356/6873] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:43 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:45.162310 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:45.162975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:45.165076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:45.170913 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:45.171392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:45.172164 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:45.172601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:45.312915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:45.321793 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92d0afd4-9ad5-41ce-8052-16f7423f7b87 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.163713 Jul 14 15:52:45.322382 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3518/6874] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:45 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:46.340073 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:46.340700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:46.348333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:46.348792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:46.349652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:46.350016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:46.487859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:46.495760 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1f20ea4-6bdf-4cfb-995d-06a2df25dd1c tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.159585 Jul 14 15:52:46.496356 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3357/6875] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:46 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:47.513787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:47.514416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:47.522106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:47.522533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:47.523367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:47.523811 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:47.657315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:47.665399 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8aa40e0f-1cac-4f57-91cd-a1be61e339d5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.155504 Jul 14 15:52:47.665980 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3519/6876] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:47 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:52:48.683670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:48.684295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:48.692348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:48.692831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:48.693582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:48.694027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:48.824309 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:48.832535 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-162186d0-ce57-4995-a6fd-bbd22e7d9741 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.152996 Jul 14 15:52:48.833119 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3358/6877] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:48 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:49.850167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:49.850789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:49.857916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:49.858374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:49.859149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:49.859631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:49.991719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:49.999861 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e244899c-8138-444a-96a7-8a2481c633b0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.153682 Jul 14 15:52:50.000653 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3520/6878] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:49 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:51.019128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:51.019779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:51.027380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:51.027850 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:51.028658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:51.029114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:51.182535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:51.193860 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0fc38ea-e3a9-413e-bcbb-f1313161b387 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1723 microversion: 2.1 time: 0.179636 Jul 14 15:52:51.194465 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3359/6879] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:51 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:52.212444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:52.213073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:52.220232 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.221284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.222086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.222526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.358835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:52.366962 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ddf8e76-2451-4d88-9cf0-b1dc79b709f9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1716 microversion: 2.1 time: 0.158551 Jul 14 15:52:52.367582 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3521/6880] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:52 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1716 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:52.385542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:52.386160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:52.393746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.394209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.394983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.395474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.524751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:52.533046 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d58a317e-599e-4b26-8cb8-53fbc13fedd7 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1716 microversion: 2.1 time: 0.151466 Jul 14 15:52:52.533626 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3360/6881] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:52 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1716 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:52.549016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:52.549664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:52.555759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.556212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.556972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.557411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.686512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:52.695013 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b576a9c-6632-4bf3-a9ae-755e99c8bcbe tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1716 microversion: 2.1 time: 0.149848 Jul 14 15:52:52.695637 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3522/6882] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:52 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:52.712208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:52.712742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:52.718814 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.719292 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.720080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.720532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.745762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:52:52.827378 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2a5625f5-597f-4ae8-9516-c233422ed97b tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 204 len: 0 microversion: 2.1 time: 0.118834 Jul 14 15:52:52.828365 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3361/6883] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:52:52 2022] DELETE /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:52:52.837591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:52.838203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:52.844578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.845026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.845833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:52.846265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:52.979371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:52.987937 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-563a5dff-0f2e-4b0c-9f99-a6445490cae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1722 microversion: 2.1 time: 0.154377 Jul 14 15:52:52.988531 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3523/6884] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:52 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:54.006138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:54.007035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:54.014348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:54.014816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:54.015641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:54.016088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:54.153370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:54.162312 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-59e88e3a-9a37-48d4-904e-b8cc472815bc tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1722 microversion: 2.1 time: 0.160495 Jul 14 15:52:54.162892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3362/6885] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:54 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:55.179241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:55.180035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:55.187249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:55.187807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:55.188579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:55.189045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:55.193522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:55.286771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:55.295981 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6990c766-aabd-47e1-b213-5994aec1b423 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1655 microversion: 2.1 time: 0.120534 Jul 14 15:52:55.297843 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3524/6886] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:55 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1655 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:55.589039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-45e04467-1bd9-461b-9f4f-bb15bfbe9157 req-863cbaef-32da-420f-b243-c1123e39a133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a32cbf7-7ea5-4819-84ef-3f26fa47393b", "name": "network-vif-deleted", "tag": "e8441a2e-fc17-43af-b6e9-4009dfdf1631"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:52:55.599690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-45e04467-1bd9-461b-9f4f-bb15bfbe9157 req-863cbaef-32da-420f-b243-c1123e39a133 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:55.600452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-45e04467-1bd9-461b-9f4f-bb15bfbe9157 req-863cbaef-32da-420f-b243-c1123e39a133 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:55.613890 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-45e04467-1bd9-461b-9f4f-bb15bfbe9157 req-863cbaef-32da-420f-b243-c1123e39a133 service nova] Creating event network-vif-deleted:e8441a2e-fc17-43af-b6e9-4009dfdf1631 for instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b on n-h1-768852-23 Jul 14 15:52:55.620040 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-45e04467-1bd9-461b-9f4f-bb15bfbe9157 req-863cbaef-32da-420f-b243-c1123e39a133 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 Jul 14 15:52:55.620900 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3363/6887] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:52:56.313936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:56.315340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:56.322813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:56.323652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:56.324654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:56.325336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:56.402073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:56.432189 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8b52d5e7-f367-4751-b1d4-27c2c1802eba tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1370 microversion: 2.1 time: 0.115749 Jul 14 15:52:56.442542 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3525/6888] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:56 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1370 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:57.451886 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:57.453369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:57.460758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:57.461234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:57.462043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:57.462501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:57.531929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:57.541011 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-114075a1-5685-4f13-919e-783ed2a0a525 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1370 microversion: 2.1 time: 0.094375 Jul 14 15:52:57.541605 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3364/6889] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:57 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:58.558268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:58.559565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:58.566632 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:58.567088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:58.567898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:58.568336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:58.638561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:58.646858 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-22549f7c-e909-483b-866e-2b4659ee5cbd tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1370 microversion: 2.1 time: 0.092590 Jul 14 15:52:58.647508 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3526/6890] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:58 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1370 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:59.665049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:59.665973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:59.673907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:59.674534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:59.675431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:59.675918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:59.692215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:59.750003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29448f858ed24113b4e90ff1bf3f2b1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a15e337c6f4c4e1aac98b22bce2555a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:59.759346 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d541dfd9-3c2b-4b93-b3d7-758dc6954ab5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 200 len: 1370 microversion: 2.1 time: 0.098133 Jul 14 15:52:59.759960 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3365/6891] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:59 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 1370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:53:00.776522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:00.777139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:00.784825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:00.785266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:00.786019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:00.786448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:00.800461 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b HTTP/1.1 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '0a32cbf7-7ea5-4819-84ef-3f26fa47393b'} Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:00.802124 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a19ccc4-dc97-487d-b0f5-f22188f6b291 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 404 len: 111 microversion: 2.1 time: 0.030941 Jul 14 15:53:00.806407 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3527/6892] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:00 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:00.859032 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:00.860013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:00.867640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:00.868107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:00.868881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:00.869339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:00.884985 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-volume_attachments HTTP/1.1 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': '0a32cbf7-7ea5-4819-84ef-3f26fa47393b'} Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:00.886700 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b1ce51e8-10d9-4731-8c89-f291d9b7f837 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033163 Jul 14 15:53:00.891091 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3366/6893] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:53:00 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.199944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.200501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.203437 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:04.210515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.210968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.211856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.212290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.227395 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b HTTP/1.1 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '0a32cbf7-7ea5-4819-84ef-3f26fa47393b'} Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.228956 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef583866-9865-43cf-801c-a268267277ee tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 404 len: 111 microversion: 2.1 time: 0.034469 Jul 14 15:53:04.232717 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3528/6894] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:04 2022] DELETE /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.239724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.240371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 0a32cbf7-7ea5-4819-84ef-3f26fa47393b] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.242897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:04.248317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.248777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.249614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.250061 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.265102 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b HTTP/1.1 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '0a32cbf7-7ea5-4819-84ef-3f26fa47393b'} Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.266998 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. Jul 14 15:53:04.271444 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.273930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 0a32cbf7-7ea5-4819-84ef-3f26fa47393b could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.274847 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0f593d11-46ef-47f8-b394-1af5864267b1 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b" status: 404 len: 111 microversion: 2.1 time: 0.039723 Jul 14 15:53:04.275465 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3367/6895] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:04 2022] GET /compute/v2.1/servers/0a32cbf7-7ea5-4819-84ef-3f26fa47393b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.284920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.285517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.293007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.293460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.294299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.294736 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.309651 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd HTTP/1.1 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'fcf7e911-8853-4472-b9d6-56c9de6e1dfd'} Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.311298 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e58e556b-5070-43bc-81e6-39a53ada5427 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 404 len: 111 microversion: 2.1 time: 0.032944 Jul 14 15:53:04.315117 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3529/6896] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:04 2022] DELETE /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.322467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.323090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: fcf7e911-8853-4472-b9d6-56c9de6e1dfd] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.330551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.331022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.331856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.332310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.348092 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd HTTP/1.1 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'fcf7e911-8853-4472-b9d6-56c9de6e1dfd'} Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.349661 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance fcf7e911-8853-4472-b9d6-56c9de6e1dfd could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98b29b42-b906-49d8-9b8e-e4fb3d9afae5 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd" status: 404 len: 111 microversion: 2.1 time: 0.033281 Jul 14 15:53:04.353762 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3368/6897] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:04 2022] GET /compute/v2.1/servers/fcf7e911-8853-4472-b9d6-56c9de6e1dfd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.360460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.361148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.367731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.368190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.368958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.369396 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.383962 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 HTTP/1.1 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '87cccb4c-fc66-4647-9e37-3f928cd31536'} Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.385526 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.389459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-057413ad-6979-4113-964b-5e397e130ea0 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 404 len: 111 microversion: 2.1 time: 0.030631 Jul 14 15:53:04.390545 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3530/6898] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:04 2022] DELETE /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.396420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.397043 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 87cccb4c-fc66-4647-9e37-3f928cd31536] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.403137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.403642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.404414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.404863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.419802 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 HTTP/1.1 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '87cccb4c-fc66-4647-9e37-3f928cd31536'} Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.421729 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 87cccb4c-fc66-4647-9e37-3f928cd31536 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8aa0321f-6c02-4caa-8993-d563040ace93 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536" status: 404 len: 111 microversion: 2.1 time: 0.031182 Jul 14 15:53:04.426318 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3369/6899] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:04 2022] GET /compute/v2.1/servers/87cccb4c-fc66-4647-9e37-3f928cd31536 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.431889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.432389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.438613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.439062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.439898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.440330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.454378 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 HTTP/1.1 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '2ee25240-2adb-4baf-8448-0f3069a99b52'} Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.456461 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-424fcbed-1cb7-438e-b28d-cc1c1b23a4ac tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 404 len: 111 microversion: 2.1 time: 0.029808 Jul 14 15:53:04.460721 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3531/6900] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:04 2022] DELETE /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:04.466405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.467022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] [instance: 2ee25240-2adb-4baf-8448-0f3069a99b52] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:04.474926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.475418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.476199 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:04.476645 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:04.490645 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] HTTP exception thrown: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Request method failure captured: Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 HTTP/1.1 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dp30xsteMdz6gdU5pbpg6gCoNwUKWcNRPN7xiwJVqGLdW4wjujG2g0qAVTh7p4UsoAgKl9CSOFg56dmk9U_iVd1EhP9hdVs1FpLXUz2GaZslcJQ3ZjdPodxF8R6DbDYSynp8jYIbX95eFNwqQKfbeYOSm6YXIEPJr1Ldb1Z3hSlNYE Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/a15e337c6f4c4e1aac98b22bce2555a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: a15e337c6f4c4e1aac98b22bce2555a2 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServerActionsTestJSON-227587202 Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 29448f858ed24113b4e90ff1bf3f2b1e Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServerActionsTestJSON-227587202-project Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '2ee25240-2adb-4baf-8448-0f3069a99b52'} Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:04.492238 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Returning 404 to user: Instance 2ee25240-2adb-4baf-8448-0f3069a99b52 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d9efe3b3-8b39-4106-b477-89b6b9fcffe3 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52" status: 404 len: 111 microversion: 2.1 time: 0.031127 Jul 14 15:53:04.496385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3370/6901] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:04 2022] GET /compute/v2.1/servers/2ee25240-2adb-4baf-8448-0f3069a99b52 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:53:04.503349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9cfa9616-a0d2-49fd-b4e2-5d74f92ea3c9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] Calling method '.version_select at 0x7fdbf2b4c4c0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:04.527079 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9cfa9616-a0d2-49fd-b4e2-5d74f92ea3c9 tempest-ServerActionsTestJSON-227587202 tempest-ServerActionsTestJSON-227587202-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137010645" status: 202 len: 0 microversion: 2.1 time: 0.028247 Jul 14 15:53:04.527705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3532/6902] 10.222.0.98 () {58 vars in 1220 bytes} [Thu Jul 14 15:53:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1137010645 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:53:13.990764 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-693471095", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c91034a3-a199-4070-a3b9-1c7ea545089d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:14.045303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] validate_networks() for [('c91034a3-a199-4070-a3b9-1c7ea545089d', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:53:14.481820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=13 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:14.740470 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:53:14.740930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:53:14.741422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:53:14.741847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:53:14.742276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:53:14.752421 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:14.752890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:14.753705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:14.754155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:14.771082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Getting quotas for project 8336435f94f44bb7bcff8c714c1205d5. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:53:14.776641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Getting quotas for user 18d5639da8c34dd3b0cd8a18c1fb84c8 and project 8336435f94f44bb7bcff8c714c1205d5. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:53:14.790219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:53:14.792527 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:53:14.842763 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e237a71a-5dbe-4bb8-b10f-db9b4afdf91f tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.982931 Jul 14 15:53:14.844073 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3371/6903] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:53:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:53:14.862550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-12daaeed-bf37-43e8-b9bc-2cb01f96ce38 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:14.863740 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-12daaeed-bf37-43e8-b9bc-2cb01f96ce38 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:14.879827 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=27 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:14.880916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:14.959229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-12daaeed-bf37-43e8-b9bc-2cb01f96ce38 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:14.968373 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-12daaeed-bf37-43e8-b9bc-2cb01f96ce38 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1216 microversion: 2.1 time: 0.114606 Jul 14 15:53:14.969585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3533/6904] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:14 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1216 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:53:15.987246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:15.987981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:15.994921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:15.995433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:15.996447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:15.996910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:16.105935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:16.118083 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c57ec5b-e30d-4852-9251-ab9c5d6d04f7 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1276 microversion: 2.1 time: 0.135677 Jul 14 15:53:16.120487 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3372/6905] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:15 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:17.146765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:17.148271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:17.159412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:17.160334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:17.161726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:17.162319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:17.465531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:17.473908 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-beba75ee-f4b8-4cf8-9161-ad32ee0bba9e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.340389 Jul 14 15:53:17.474773 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3534/6906] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:17 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:17.862023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-bfdbb2e1-4699-4557-b40d-fa49b49d0432 req-515699a2-cb31-46c2-b65b-5ebf07d5266e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f59bdf9-d41f-4d6a-846f-5930cf81ce0e", "tag": "f6fad19b-fc50-4b03-ab45-9b2e8e8a2c52"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:17.877595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bfdbb2e1-4699-4557-b40d-fa49b49d0432 req-515699a2-cb31-46c2-b65b-5ebf07d5266e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:17.878428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-bfdbb2e1-4699-4557-b40d-fa49b49d0432 req-515699a2-cb31-46c2-b65b-5ebf07d5266e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:17.897468 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-bfdbb2e1-4699-4557-b40d-fa49b49d0432 req-515699a2-cb31-46c2-b65b-5ebf07d5266e service nova] Creating event network-changed:f6fad19b-fc50-4b03-ab45-9b2e8e8a2c52 for instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e on n-h1-768852-23 Jul 14 15:53:17.903300 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-bfdbb2e1-4699-4557-b40d-fa49b49d0432 req-515699a2-cb31-46c2-b65b-5ebf07d5266e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047019 Jul 14 15:53:17.904472 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3373/6907] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:53:18.491257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:18.491908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:18.498836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:18.499314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:18.500087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:18.500528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:18.634116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:18.641800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-534d3faf-3997-4d9f-a41c-c8c868315c11 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.154431 Jul 14 15:53:18.642908 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3535/6908] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:18 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:19.660693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:19.661509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:19.668979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:19.669458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:19.670248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:19.670708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:19.807870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:19.815539 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cd40bfe1-1427-44f6-92d2-878f73091f42 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.159985 Jul 14 15:53:19.816118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3374/6909] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:19 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:20.832598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:20.833246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:20.840231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:20.840681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:20.841436 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:20.841866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:20.978203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:20.985738 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1d5a7354-a1bb-48c3-a614-66648acfbdcb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.157068 Jul 14 15:53:20.986902 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3536/6910] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:20 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:22.003427 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:22.004065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:22.010957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:22.011469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:22.012281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:22.012718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:22.150035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:22.157871 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da7c0ebf-5582-4319-adf0-b75ff32e9eb8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.158878 Jul 14 15:53:22.158451 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3375/6911] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:21 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:23.175105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:23.175758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:23.182816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:23.183410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:23.184353 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:23.184973 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:23.316848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:23.324397 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0a97c8ea-b1a0-4a85-b96e-4494d2462ce0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.153203 Jul 14 15:53:23.324979 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3537/6912] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:23 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:24.021737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-a5715d8a-4e28-4112-8f0f-2fad9cbcb79d req-23dc29b0-b5ba-43f5-8bbd-6e70053a12a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f59bdf9-d41f-4d6a-846f-5930cf81ce0e", "name": "network-vif-plugged", "status": "completed", "tag": "f6fad19b-fc50-4b03-ab45-9b2e8e8a2c52"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:24.032123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a5715d8a-4e28-4112-8f0f-2fad9cbcb79d req-23dc29b0-b5ba-43f5-8bbd-6e70053a12a1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:24.032594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-a5715d8a-4e28-4112-8f0f-2fad9cbcb79d req-23dc29b0-b5ba-43f5-8bbd-6e70053a12a1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:24.044119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-a5715d8a-4e28-4112-8f0f-2fad9cbcb79d req-23dc29b0-b5ba-43f5-8bbd-6e70053a12a1 service nova] Creating event network-vif-plugged:f6fad19b-fc50-4b03-ab45-9b2e8e8a2c52 for instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e on n-h1-768852-23 Jul 14 15:53:24.049187 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-a5715d8a-4e28-4112-8f0f-2fad9cbcb79d req-23dc29b0-b5ba-43f5-8bbd-6e70053a12a1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Jul 14 15:53:24.049801 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3376/6913] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:24.341942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:24.342565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:24.349563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:24.350016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:24.350781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:24.351218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:24.479025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:24.487093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-98b2efbc-e6d2-4fb1-b1b8-b88b15cc88a9 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1316 microversion: 2.1 time: 0.149007 Jul 14 15:53:24.487709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3538/6914] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:24 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:25.500966 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:25.502010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:25.507497 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:25.508218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:25.515066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:25.515562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:25.516341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:25.516796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:25.647916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:25.655754 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5c2016b8-d5ec-4609-8379-40cb083ae684 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.155821 Jul 14 15:53:25.656333 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3377/6915] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:25 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:25.708783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1756938247", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "c91034a3-a199-4070-a3b9-1c7ea545089d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:25.715536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:25.761089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] validate_networks() for [('c91034a3-a199-4070-a3b9-1c7ea545089d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:53:26.125019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:53:26.125452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:53:26.125934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:53:26.126402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:53:26.126851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:53:26.135862 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:26.136315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:26.137113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:26.137551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:26.154769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Getting quotas for project 8336435f94f44bb7bcff8c714c1205d5. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:53:26.161044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Getting quotas for user 18d5639da8c34dd3b0cd8a18c1fb84c8 and project 8336435f94f44bb7bcff8c714c1205d5. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:53:26.173538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:53:26.175864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:53:26.221561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aaebfe0f-cf58-4d1d-aa6a-e0bfd992feb2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516524 Jul 14 15:53:26.222122 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3539/6916] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:53:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:53:26.232161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ba9ff1e7-6403-41ea-8dcb-d834cbea8343 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:26.232812 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ba9ff1e7-6403-41ea-8dcb-d834cbea8343 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:26.288485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ba9ff1e7-6403-41ea-8dcb-d834cbea8343 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:26.295352 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ba9ff1e7-6403-41ea-8dcb-d834cbea8343 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1217 microversion: 2.1 time: 0.067080 Jul 14 15:53:26.295949 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3378/6917] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:26 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1217 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:27.313709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:27.314850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:27.321793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:27.322250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:27.323026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:27.323490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:27.389554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:27.397419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb4e587e-119f-4899-b132-d271571d4da0 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1275 microversion: 2.1 time: 0.088413 Jul 14 15:53:27.398011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3540/6918] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:27 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1275 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:28.414079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:28.414623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:28.421993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:28.422457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:28.423798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:28.424255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:28.668693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:28.681326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-69b5c681-9f45-4d84-a4ea-d64bfc3ce14c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1317 microversion: 2.1 time: 0.270859 Jul 14 15:53:28.682267 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3379/6919] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:28 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:28.687893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-286b551b-f660-43dc-9d9f-dcc20bf4005c req-9c1892a8-c995-4607-9b7d-54914c17579d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7ef4da3-c273-4a81-9b20-b2869a1b137e", "tag": "7f66c43a-69ce-4e5a-aafb-bb18e977b66f"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:28.701213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-286b551b-f660-43dc-9d9f-dcc20bf4005c req-9c1892a8-c995-4607-9b7d-54914c17579d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:28.702019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-286b551b-f660-43dc-9d9f-dcc20bf4005c req-9c1892a8-c995-4607-9b7d-54914c17579d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:28.713734 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-286b551b-f660-43dc-9d9f-dcc20bf4005c req-9c1892a8-c995-4607-9b7d-54914c17579d service nova] Creating event network-changed:7f66c43a-69ce-4e5a-aafb-bb18e977b66f for instance f7ef4da3-c273-4a81-9b20-b2869a1b137e on n-h2-768852-23 Jul 14 15:53:28.719188 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-286b551b-f660-43dc-9d9f-dcc20bf4005c req-9c1892a8-c995-4607-9b7d-54914c17579d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120728 Jul 14 15:53:28.719850 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3541/6920] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:29.709808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:29.710445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:29.718333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:29.718800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:29.719614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:29.720069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:29.852472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:29.860160 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93e00741-58d6-4579-a044-052fb551c7cb tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1317 microversion: 2.1 time: 0.154401 Jul 14 15:53:29.860752 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3380/6921] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:29 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:30.858682 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:53:30.860168 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:53:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:53:30.878447 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:30.879189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:30.885492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:30.885947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:30.886704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:30.887140 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:31.027237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:31.036033 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7da54e64-1076-480a-ab0d-e79954cf41b5 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1317 microversion: 2.1 time: 0.162629 Jul 14 15:53:31.036623 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3542/6922] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:30 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:32.053490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:32.054122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:32.061039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:32.061599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:32.062357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:32.062754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:32.199811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:32.208816 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3dda87ec-409b-4238-bb2b-38d8ebcda207 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1317 microversion: 2.1 time: 0.159142 Jul 14 15:53:32.209424 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3381/6923] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:32 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:33.226012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:33.226608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:33.233879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:33.234375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:33.235105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:33.236165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:33.369315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:33.377459 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5338d3e9-3fa6-4f24-a3de-56c32dc29ba2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1317 microversion: 2.1 time: 0.154860 Jul 14 15:53:33.378046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3543/6924] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:33 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:33.587589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-edc64989-da37-494c-8a92-a11d60c89147 req-3f1c3912-b7c1-4893-808a-8df3c6237a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ef4da3-c273-4a81-9b20-b2869a1b137e", "name": "network-vif-plugged", "status": "completed", "tag": "7f66c43a-69ce-4e5a-aafb-bb18e977b66f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:33.598394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edc64989-da37-494c-8a92-a11d60c89147 req-3f1c3912-b7c1-4893-808a-8df3c6237a49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:33.598874 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edc64989-da37-494c-8a92-a11d60c89147 req-3f1c3912-b7c1-4893-808a-8df3c6237a49 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:33.612295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-edc64989-da37-494c-8a92-a11d60c89147 req-3f1c3912-b7c1-4893-808a-8df3c6237a49 service nova] Creating event network-vif-plugged:7f66c43a-69ce-4e5a-aafb-bb18e977b66f for instance f7ef4da3-c273-4a81-9b20-b2869a1b137e on n-h2-768852-23 Jul 14 15:53:33.617654 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-edc64989-da37-494c-8a92-a11d60c89147 req-3f1c3912-b7c1-4893-808a-8df3c6237a49 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033887 Jul 14 15:53:33.618273 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3382/6925] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:34.394875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:34.395517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:34.402399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:34.402846 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:34.403638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:34.404074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:34.537460 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:34.544991 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-19524715-ec62-4c4e-a0b0-9c383524079b tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1317 microversion: 2.1 time: 0.154661 Jul 14 15:53:34.545575 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3544/6926] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:34 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:35.562658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:35.563294 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:35.566792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:35.573631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:35.574092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:35.574868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:35.575338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:35.709491 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:35.718798 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8dbb2242-ad10-45e1-949c-6fa0120c5864 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1506 microversion: 2.1 time: 0.160503 Jul 14 15:53:35.719430 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3383/6927] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:35 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:35.735461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:35.735986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:35.743591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:35.744204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:35.745098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:35.745541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:35.770868 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:53:35.845783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ced7b086-d8e7-4cda-9a4f-8e058d9384f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 204 len: 0 microversion: 2.1 time: 0.113770 Jul 14 15:53:35.846329 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3545/6928] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:35 2022] DELETE /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:53:35.855282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:35.855935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:35.862100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:35.862555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:35.863395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:35.863881 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:36.001304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:36.009513 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36b16cc1-fafc-4a70-b613-f086d79c9b6c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1512 microversion: 2.1 time: 0.158188 Jul 14 15:53:36.010095 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3384/6929] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:35 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:37.027288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:37.028033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:37.030802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:37.031645 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:37.040132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:37.040537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:37.041254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:37.041686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:37.173300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:37.180936 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b092547-752e-4b2a-adaf-2b83029bf152 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1512 microversion: 2.1 time: 0.158035 Jul 14 15:53:37.181519 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3546/6930] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:37 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:37.760323 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2a8f8207-5764-4fa3-a0d2-e844f7b8e4b9 req-88c7c95d-fbef-4af4-b42e-586777fe3013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7ef4da3-c273-4a81-9b20-b2869a1b137e", "name": "network-vif-deleted", "tag": "7f66c43a-69ce-4e5a-aafb-bb18e977b66f"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:37.764754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:37.772282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2a8f8207-5764-4fa3-a0d2-e844f7b8e4b9 req-88c7c95d-fbef-4af4-b42e-586777fe3013 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:37.772765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2a8f8207-5764-4fa3-a0d2-e844f7b8e4b9 req-88c7c95d-fbef-4af4-b42e-586777fe3013 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:37.792684 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2a8f8207-5764-4fa3-a0d2-e844f7b8e4b9 req-88c7c95d-fbef-4af4-b42e-586777fe3013 service nova] Creating event network-vif-deleted:7f66c43a-69ce-4e5a-aafb-bb18e977b66f for instance f7ef4da3-c273-4a81-9b20-b2869a1b137e on n-h2-768852-23 Jul 14 15:53:37.798571 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2a8f8207-5764-4fa3-a0d2-e844f7b8e4b9 req-88c7c95d-fbef-4af4-b42e-586777fe3013 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043186 Jul 14 15:53:37.799612 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3385/6931] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:38.200672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:38.201268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:38.209890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:38.210329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:38.211126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:38.211586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:38.246895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:38.247381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:38.247834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lazy-loading 'fault' on Instance uuid f7ef4da3-c273-4a81-9b20-b2869a1b137e {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:53:38.292572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:38.301292 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4903d318-f967-4f7f-a33c-6874da9a1898 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 200 len: 1307 microversion: 2.1 time: 0.104815 Jul 14 15:53:38.301889 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3547/6932] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:38 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 1307 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:39.320117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:39.320822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.327044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.327530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.328300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.328746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.341978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] HTTP exception thrown: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e HTTP/1.1 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f7ef4da3-c273-4a81-9b20-b2869a1b137e'} Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:39.343658 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 404 to user: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2c77fb40-82c4-4620-9732-cd56d80e51a2 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 404 len: 111 microversion: 2.1 time: 0.030690 Jul 14 15:53:39.348844 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3386/6933] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:39 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:39.355020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:39.355663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.363236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.364200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.364531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.364970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.502403 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:39.510022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3f2a00f-db04-4387-8672-b219c135f34e tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.158977 Jul 14 15:53:39.510611 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3548/6934] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:39 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:39.527650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-335f0b33-3171-4423-9aaf-0705b7029a04 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:39.528586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-335f0b33-3171-4423-9aaf-0705b7029a04 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 6832a2c0-a073-4c65-ae93-0c357716f6af] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.534832 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-335f0b33-3171-4423-9aaf-0705b7029a04 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] HTTP exception thrown: Instance 6832a2c0-a073-4c65-ae93-0c357716f6af could not be found. Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-335f0b33-3171-4423-9aaf-0705b7029a04 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/6832a2c0-a073-4c65-ae93-0c357716f6af/action HTTP/1.1 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 32 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: {"resize": {"flavorRef": "452"}} Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 6832a2c0-a073-4c65-ae93-0c357716f6af could not be found. Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6832a2c0-a073-4c65-ae93-0c357716f6af', 'body': {'resize': {'flavorRef': '452'}}} Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2898, in _get_instance Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6832a2c0-a073-4c65-ae93-0c357716f6af could not be found. Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1048, in _resize Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:39.536439 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6832a2c0-a073-4c65-ae93-0c357716f6af could not be found. Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6832a2c0-a073-4c65-ae93-0c357716f6af could not be found. Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-335f0b33-3171-4423-9aaf-0705b7029a04 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 404 to user: Instance 6832a2c0-a073-4c65-ae93-0c357716f6af could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-335f0b33-3171-4423-9aaf-0705b7029a04 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "POST /compute/v2.1/servers/6832a2c0-a073-4c65-ae93-0c357716f6af/action" status: 404 len: 111 microversion: 2.1 time: 0.014588 Jul 14 15:53:39.541164 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3387/6935] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:53:39 2022] POST /compute/v2.1/servers/6832a2c0-a073-4c65-ae93-0c357716f6af/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:39.546357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:39.546986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.553711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.554175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.554925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.555400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.685218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:39.688882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:39.693818 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e539724c-a2a2-4368-b6b5-5269542f854a tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.151280 Jul 14 15:53:39.694405 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3549/6936] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:39 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:39.715469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:39.716111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.723750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.724219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.725000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.725450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.858332 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:39.867821 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-832252e3-baf1-43e3-a1de-e1922e3c6512 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.156496 Jul 14 15:53:39.868451 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3388/6937] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:39 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:39.885197 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "50214361-51ba-42ac-b99d-fd52c97c0288"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:39.886218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.893303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.893757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.894526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.894968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.924208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:39.929333 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] HTTP exception thrown: Flavor 50214361-51ba-42ac-b99d-fd52c97c0288 could not be found. Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: request: POST /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e/action HTTP/1.1 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 65 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: {"resize": {"flavorRef": "50214361-51ba-42ac-b99d-fd52c97c0288"}} Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: exception: Flavor 50214361-51ba-42ac-b99d-fd52c97c0288 could not be found. Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '3f59bdf9-d41f-4d6a-846f-5930cf81ce0e', 'body': {'resize': {'flavorRef': '50214361-51ba-42ac-b99d-fd52c97c0288'}}} Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1055, in _resize Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4146, in resize Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:53:39.931286 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 50214361-51ba-42ac-b99d-fd52c97c0288 could not be found. Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1141, in _action_resize Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1085, in _resize Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 50214361-51ba-42ac-b99d-fd52c97c0288 could not be found. Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 50214361-51ba-42ac-b99d-fd52c97c0288 could not be found. Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 400 to user: Flavor 50214361-51ba-42ac-b99d-fd52c97c0288 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ac75166-4c9f-4206-91b7-95d6a41321cd tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "POST /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e/action" status: 400 len: 107 microversion: 2.1 time: 0.051815 Jul 14 15:53:39.936074 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3550/6938] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:53:39 2022] POST /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e/action => generated 107 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:53:39.942279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:39.942903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:39.948951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.949404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:39.950170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:39.950614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.079122 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:40.086747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-68e06f79-5788-4086-bf8b-ada321724c83 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.149023 Jul 14 15:53:40.087351 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3389/6939] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:39 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:53:40.104208 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:40.104819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:40.110716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.111160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.112524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.112959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.240154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:40.247854 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94c2ac99-be5b-45f8-ad52-5450f75ebc9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.147433 Jul 14 15:53:40.248442 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3551/6940] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:40 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:40.264255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd415f4d-055e-4e21-8406-ca8a578a7fe8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd415f4d-055e-4e21-8406-ca8a578a7fe8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: request: POST /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e/action HTTP/1.1 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 29 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: {"resize": {"flavorRef": ""}} Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '3f59bdf9-d41f-4d6a-846f-5930cf81ce0e', 'body': {'resize': {'flavorRef': ''}}} Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi On instance['resize']: Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi '' Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:40.266656 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fd415f4d-055e-4e21-8406-ca8a578a7fe8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fd415f4d-055e-4e21-8406-ca8a578a7fe8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "POST /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e/action" status: 400 len: 113 microversion: 2.1 time: 0.008024 Jul 14 15:53:40.271363 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3390/6941] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:53:40 2022] POST /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e/action => generated 113 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:53:40.276992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:40.277616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:40.284564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.285015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.285788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.286234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.417694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:40.425864 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e9566a4-13c0-42c5-a35b-df0c8c401253 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1506 microversion: 2.1 time: 0.152855 Jul 14 15:53:40.426441 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3552/6942] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:40 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:40.447133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:40.447708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:40.454750 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.455211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.456018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.456474 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.469426 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] HTTP exception thrown: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e HTTP/1.1 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f7ef4da3-c273-4a81-9b20-b2869a1b137e'} Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 892, in _delete Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:40.471565 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 404 to user: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-adcf0db5-c5da-4238-a8c9-37da5abf7964 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 404 len: 111 microversion: 2.1 time: 0.030628 Jul 14 15:53:40.475544 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3391/6943] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:40 2022] DELETE /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:53:40.481495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:40.482119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: f7ef4da3-c273-4a81-9b20-b2869a1b137e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:40.488901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.489399 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.490170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.490608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.503898 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] HTTP exception thrown: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e HTTP/1.1 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'f7ef4da3-c273-4a81-9b20-b2869a1b137e'} Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:40.505435 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 404 to user: Instance f7ef4da3-c273-4a81-9b20-b2869a1b137e could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b80c7cfa-2975-4bea-8d34-560fed7c53f8 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e" status: 404 len: 111 microversion: 2.1 time: 0.029270 Jul 14 15:53:40.509809 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3553/6944] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:40 2022] GET /compute/v2.1/servers/f7ef4da3-c273-4a81-9b20-b2869a1b137e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:53:40.515519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:40.516036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:40.522643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.523119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.523937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.524396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.550223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:53:40.634401 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0c30b96e-d7bb-4d9e-a3fb-d1d4c5107c02 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "DELETE /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 204 len: 0 microversion: 2.1 time: 0.122400 Jul 14 15:53:40.634975 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3392/6945] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:53:40 2022] DELETE /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:53:40.644328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:40.645063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:40.651415 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.651861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.652613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:40.653046 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:40.785120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:40.793190 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b659f165-41a2-450a-8144-6c77bbe00b82 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1512 microversion: 2.1 time: 0.154071 Jul 14 15:53:40.793968 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3554/6946] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:40 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:41.810809 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:41.811546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:41.818213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:41.818684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:41.819498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:41.819959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:41.838443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:41.960382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:41.968061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2bcd183d-803b-4d3b-9e49-db3a4a6eb394 tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1512 microversion: 2.1 time: 0.161774 Jul 14 15:53:41.968672 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3393/6947] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:41 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:42.829028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-662eacd6-1393-486f-81e6-e44ad87b5374 req-02f93107-6b34-42ba-9499-26615fab957a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f59bdf9-d41f-4d6a-846f-5930cf81ce0e", "name": "network-vif-deleted", "tag": "f6fad19b-fc50-4b03-ab45-9b2e8e8a2c52"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:53:42.840495 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-662eacd6-1393-486f-81e6-e44ad87b5374 req-02f93107-6b34-42ba-9499-26615fab957a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:42.840853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-662eacd6-1393-486f-81e6-e44ad87b5374 req-02f93107-6b34-42ba-9499-26615fab957a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:42.854619 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-662eacd6-1393-486f-81e6-e44ad87b5374 req-02f93107-6b34-42ba-9499-26615fab957a service nova] Creating event network-vif-deleted:f6fad19b-fc50-4b03-ab45-9b2e8e8a2c52 for instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e on n-h1-768852-23 Jul 14 15:53:42.862038 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-662eacd6-1393-486f-81e6-e44ad87b5374 req-02f93107-6b34-42ba-9499-26615fab957a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Jul 14 15:53:42.863041 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3555/6948] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:53:42.985595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:42.986729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:42.993802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:42.994276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:42.995089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:42.995609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:43.028229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:43.028692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:43.029165 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lazy-loading 'fault' on Instance uuid 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:53:43.071210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18d5639da8c34dd3b0cd8a18c1fb84c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8336435f94f44bb7bcff8c714c1205d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:53:43.079538 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f4adf78c-e490-42f7-a614-0d2f24ecafaf tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 200 len: 1306 microversion: 2.1 time: 0.097944 Jul 14 15:53:43.080098 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3394/6949] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:42 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 1306 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:53:44.097293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:53:44.098129 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] [instance: 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:53:44.105252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:44.105701 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:44.106466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:53:44.106900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:53:44.122975 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] HTTP exception thrown: Instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e could not be found. Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Request method failure captured: Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e HTTP/1.1 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DvpVcoWv1k2LQpi-ncLXfTM-RctbSVS1csTXXqVvgAjVa7IKY9TjTTP1z9bh_fzIoKt0wDx4-ozfMGp5dfRKaG_FFls-VLdw91aF04NEVmWQMDOvNOUtdg4ihISJ8908E7YEaT8YegECCc58VxOJ2_NZzidTcn9qkAN_wKE3QswQsU Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/8336435f94f44bb7bcff8c714c1205d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 8336435f94f44bb7bcff8c714c1205d5 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-ServersNegativeTestJSON-543907377 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 18d5639da8c34dd3b0cd8a18c1fb84c8 Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-ServersNegativeTestJSON-543907377-project Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e could not be found. Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '3f59bdf9-d41f-4d6a-846f-5930cf81ce0e'} Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e could not be found. Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e could not be found. Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:53:44.124665 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e could not be found. Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] Returning 404 to user: Instance 3f59bdf9-d41f-4d6a-846f-5930cf81ce0e could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ef8ebc1-e072-4978-b319-74659b78af9c tempest-ServersNegativeTestJSON-543907377 tempest-ServersNegativeTestJSON-543907377-project] 10.222.0.98 "GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e" status: 404 len: 111 microversion: 2.1 time: 0.033664 Jul 14 15:53:44.129338 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3556/6950] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:53:44 2022] GET /compute/v2.1/servers/3f59bdf9-d41f-4d6a-846f-5930cf81ce0e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:54:17.091620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:17.094158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=10 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:17.397457 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f7b4e9a2-3781-49a4-830c-238a2e565036 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Action: 'create', calling method: .version_select at 0x7fdbf326a550>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1547727674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKo29ntleGuW1ZHHug8iHiCI40eH9RdisG976q2JvlnaqJzyeYVTR4IInNT1Td4wVi9zYTpPM/3WWtU6rBv/DiIfy12tPwiFGaocvQLcaKbu/pCIHYReNSlalvPehQxYRg=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:17.426818 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f7b4e9a2-3781-49a4-830c-238a2e565036 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for project aa96d9f49b334c48a989638b96012cf4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:54:17.434718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-f7b4e9a2-3781-49a4-830c-238a2e565036 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for user 83f5af5fb31042de9ffc151f6c4a7ae6 and project aa96d9f49b334c48a989638b96012cf4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:54:17.479703 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f7b4e9a2-3781-49a4-830c-238a2e565036 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.393651 Jul 14 15:54:17.483696 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3395/6951] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:54:17 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:17.533750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1158280147", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1547727674", "networks": [{"uuid": "c703b670-132a-4f50-80ca-ab39ad647017"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:17.541247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:17.541905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=28 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:17.733505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] validate_networks() for [('c703b670-132a-4f50-80ca-ab39ad647017', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:54:18.118203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:54:18.118661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:54:18.119141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:54:18.119589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:54:18.120000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:54:18.129337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:18.129786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:18.130575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:18.131008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:18.149204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for project aa96d9f49b334c48a989638b96012cf4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:54:18.154536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for user 83f5af5fb31042de9ffc151f6c4a7ae6 and project aa96d9f49b334c48a989638b96012cf4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:54:18.167571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:54:18.169880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:54:18.237750 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84f4e980-c8e9-4671-947e-77a767a9bb44 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708655 Jul 14 15:54:18.238792 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3557/6952] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:54:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:54:18.250495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5fc758b0-752d-458c-8297-cff64be2f293 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:18.251127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5fc758b0-752d-458c-8297-cff64be2f293 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:18.474742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5fc758b0-752d-458c-8297-cff64be2f293 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:18.486014 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5fc758b0-752d-458c-8297-cff64be2f293 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1263 microversion: 2.1 time: 0.238531 Jul 14 15:54:18.486676 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3396/6953] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:18 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1263 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:19.506034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:19.506655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:19.520921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:19.521330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:19.522518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:19.523077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:19.637118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:19.645700 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-49fd500b-2b05-4e58-aeb8-3aa5c8101f96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1333 microversion: 2.1 time: 0.145700 Jul 14 15:54:19.646306 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3558/6954] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:19 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1333 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:20.664419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:20.665710 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:20.677297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:20.678146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:20.679206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:20.679951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:20.923108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:20.961581 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f213267c-4981-49bf-8d04-6736bbe699f0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1363 microversion: 2.1 time: 0.287548 Jul 14 15:54:20.962646 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3397/6955] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:20 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1363 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:54:21.279551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e37e3342-5f77-4056-b9b9-3a0bbbbafb2e req-3021dc40-da44-4084-978d-489456eebb6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75d3b44-f659-4f81-88d2-bf5f054e84b6", "tag": "4bf3bf14-7831-4e09-82e9-f380ea816946"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:21.318271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e37e3342-5f77-4056-b9b9-3a0bbbbafb2e req-3021dc40-da44-4084-978d-489456eebb6a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:21.319292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e37e3342-5f77-4056-b9b9-3a0bbbbafb2e req-3021dc40-da44-4084-978d-489456eebb6a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:21.359953 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e37e3342-5f77-4056-b9b9-3a0bbbbafb2e req-3021dc40-da44-4084-978d-489456eebb6a service nova] Creating event network-changed:4bf3bf14-7831-4e09-82e9-f380ea816946 for instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 on n-h1-768852-23 Jul 14 15:54:21.373941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e37e3342-5f77-4056-b9b9-3a0bbbbafb2e req-3021dc40-da44-4084-978d-489456eebb6a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098193 Jul 14 15:54:21.378061 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3559/6956] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:54:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:21.993386 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:21.994022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:22.001091 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:22.001563 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:22.002351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:22.002851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:22.140633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:22.149148 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-64e55853-30a9-4b19-95a8-e70a3e1c1d2f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1363 microversion: 2.1 time: 0.159876 Jul 14 15:54:22.149727 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3398/6957] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:21 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:23.168079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:23.168694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:23.175089 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:23.175565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:23.176343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:23.176784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:23.358302 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:23.365903 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0d856ae4-33f8-4fa1-a2c6-6660d23e93fb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1363 microversion: 2.1 time: 0.203038 Jul 14 15:54:23.366486 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3560/6958] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:23 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1363 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:24.383465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:24.384092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:24.391039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:24.391535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:24.392385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:24.392831 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:24.531913 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:24.540039 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e15613b3-8263-4d91-aca7-5bc0da72c157 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1363 microversion: 2.1 time: 0.160562 Jul 14 15:54:24.540617 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3399/6959] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:24 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:25.557395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:25.558009 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:25.565040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:25.565494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:25.566253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:25.566937 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:25.696553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:25.704599 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcb990e4-eca5-4d55-8fad-1a5aa69f1a69 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1363 microversion: 2.1 time: 0.151077 Jul 14 15:54:25.705483 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3561/6960] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:25 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:26.440847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-e0606120-4fbc-487e-b42b-b04de1c6ab03 req-2525b51c-ca75-4b8d-9855-be9865469099 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75d3b44-f659-4f81-88d2-bf5f054e84b6", "name": "network-vif-plugged", "status": "completed", "tag": "4bf3bf14-7831-4e09-82e9-f380ea816946"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:26.449766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e0606120-4fbc-487e-b42b-b04de1c6ab03 req-2525b51c-ca75-4b8d-9855-be9865469099 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:26.450230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-e0606120-4fbc-487e-b42b-b04de1c6ab03 req-2525b51c-ca75-4b8d-9855-be9865469099 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:26.466008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-e0606120-4fbc-487e-b42b-b04de1c6ab03 req-2525b51c-ca75-4b8d-9855-be9865469099 service nova] Creating event network-vif-plugged:4bf3bf14-7831-4e09-82e9-f380ea816946 for instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 on n-h1-768852-23 Jul 14 15:54:26.471926 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-e0606120-4fbc-487e-b42b-b04de1c6ab03 req-2525b51c-ca75-4b8d-9855-be9865469099 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034854 Jul 14 15:54:26.472562 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3400/6961] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:26.723296 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:26.723905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:26.730849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:26.731322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:26.732086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:26.732516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:26.863190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:26.870699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-122d7bec-70c3-47e9-b3e9-44d50f23e0cb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1363 microversion: 2.1 time: 0.152581 Jul 14 15:54:26.871296 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3562/6962] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:26 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:27.889459 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:27.890166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:27.897094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:27.897558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:27.898333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:27.898781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.034315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:28.041969 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5ff90185-159e-452d-9257-f7deba869270 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1555 microversion: 2.1 time: 0.157671 Jul 14 15:54:28.042551 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3401/6963] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:27 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1555 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:28.058274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:28.058886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:28.066575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:28.067027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.067825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:28.068262 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:28.140165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.162047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:28.205644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:28.213278 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9ec8afe8-2485-4109-95cd-75082dcdbf9b tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1555 microversion: 2.1 time: 0.158920 Jul 14 15:54:28.213887 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3563/6964] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:28 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:29.799508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "375a3c59-294d-450d-817e-b98214666dd0"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:29.800592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:29.802577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:29.808899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:29.809302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:29.810085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:29.810541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:30.066784 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-257741d8-132d-400a-8942-4e4e36a5e265 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "POST /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271066 Jul 14 15:54:30.067439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3402/6965] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:54:29 2022] POST /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:40.734991 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:40.735572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:40.738249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:40.739004 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:40.745960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:40.746443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:40.747242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:40.747708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:40.828251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lazy-loading 'services' on Instance uuid a75d3b44-f659-4f81-88d2-bf5f054e84b6 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:54:40.904626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-45c86101-f774-4287-8ffe-2282d901b525 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments/375a3c59-294d-450d-817e-b98214666dd0" status: 202 len: 0 microversion: 2.1 time: 0.173514 Jul 14 15:54:40.905561 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3564/6966] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:54:40 2022] DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments/375a3c59-294d-450d-817e-b98214666dd0 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:54:40.912796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:40.914182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:40.918971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:40.920080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:40.928824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:40.929339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:40.930198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:40.930650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:40.963066 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-249d7fa8-0bb0-4f3e-83a4-f51a2bcc66f3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052127 Jul 14 15:54:40.963670 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3403/6967] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:54:40 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:41.975238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:41.976328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:41.984657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:41.985104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:41.985881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:41.986313 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:42.019902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bb0b1493-9260-4b53-92ec-b9945965563d tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049494 Jul 14 15:54:42.020563 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3565/6968] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:54:41 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:43.032393 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:43.033907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:43.041137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:43.041603 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:43.042401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:43.042865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:43.076023 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1cd3b02-c2c3-4eec-8ce3-d76db9ebabcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048070 Jul 14 15:54:43.076827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3404/6969] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:54:43 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:44.088160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:44.089078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:44.097042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:44.097553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:44.098282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:44.098708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:44.130297 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-79a881c5-3806-49ea-8493-f9f3afcd38dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Jul 14 15:54:44.130763 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3566/6970] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:54:44 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:45.141310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:45.142147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:45.149773 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:45.150234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:45.151018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:45.151494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:45.182344 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ec1abd1-e972-472f-9ff3-18bd2f53dd7e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Jul 14 15:54:45.182927 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3405/6971] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:54:45 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:46.194171 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:46.195098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:46.201847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.202298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.203063 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.203524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.232730 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-49840fa9-ff99-4a6f-8cac-8c1d4b316f1e tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042707 Jul 14 15:54:46.233295 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3567/6972] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:54:46 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:54:46.243170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:46.243720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:46.250500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.250958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.251769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:46.252220 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:46.327943 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] HTTP exception thrown: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 is not attached to volume 375a3c59-294d-450d-817e-b98214666dd0 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Request method failure captured: Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments/375a3c59-294d-450d-817e-b98214666dd0 HTTP/1.1 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DwjQAQ9oEmnyJOFeXESt6uEzIHa-UOfyk09XAycdjYMLU1LmHr1BFbzxfSsbrKSf6kJmOd8MwnEy5kdtuH3WloqKTY1xkjU_YNLnAEvxtX2FuEk-nVvDtZRUa3eQcUh4nN3PEQDyY0Ax9sXaKkn6TIuayN1VLzIRwXY-eZVV8v64_E Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 83f5af5fb31042de9ffc151f6c4a7ae6 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 is not attached to volume 375a3c59-294d-450d-817e-b98214666dd0 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': 'a75d3b44-f659-4f81-88d2-bf5f054e84b6', 'id': '375a3c59-294d-450d-817e-b98214666dd0'} Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 375a3c59-294d-450d-817e-b98214666dd0. Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 is not attached to volume 375a3c59-294d-450d-817e-b98214666dd0 Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:54:46.336979 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 is not attached to volume 375a3c59-294d-450d-817e-b98214666dd0 Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Returning 404 to user: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 is not attached to volume 375a3c59-294d-450d-817e-b98214666dd0 {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f94ae2c-ebc5-456b-bc7a-d64e1d5d1e06 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments/375a3c59-294d-450d-817e-b98214666dd0" status: 404 len: 154 microversion: 2.1 time: 0.099267 Jul 14 15:54:46.341546 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3406/6973] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:54:46 2022] DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6/os-volume_attachments/375a3c59-294d-450d-817e-b98214666dd0 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:54:49.662427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:49.663010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:49.670149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:49.670994 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:49.671497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:49.672012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:49.699940 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:54:49.795664 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-12a32ad8-2ef8-4ee8-ba37-ec4675609bcb tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 204 len: 0 microversion: 2.1 time: 0.136786 Jul 14 15:54:49.797006 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3568/6974] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:54:49 2022] DELETE /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:54:49.806385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:49.807101 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:49.817350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:49.817503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:49.818169 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:49.818633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:49.979964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:49.989047 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3ecbb72-399d-498b-a49a-d88b8aaac7df tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1561 microversion: 2.1 time: 0.187432 Jul 14 15:54:49.990140 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3407/6975] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:49 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:51.007235 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:51.007976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:51.014960 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:51.015448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:51.016221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:51.016657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:51.155449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:51.163230 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0904c476-a887-4ae0-9341-eeee89cfbfaf tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1561 microversion: 2.1 time: 0.160299 Jul 14 15:54:51.163833 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3569/6976] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:51 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1561 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:52.114934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0076b066-f199-4682-b6ce-3f066aa615e8 req-3809a0a6-14ce-41df-aaf3-e33861c8ece0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75d3b44-f659-4f81-88d2-bf5f054e84b6", "name": "network-vif-deleted", "tag": "4bf3bf14-7831-4e09-82e9-f380ea816946"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:52.124621 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0076b066-f199-4682-b6ce-3f066aa615e8 req-3809a0a6-14ce-41df-aaf3-e33861c8ece0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:52.125232 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0076b066-f199-4682-b6ce-3f066aa615e8 req-3809a0a6-14ce-41df-aaf3-e33861c8ece0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:52.138278 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0076b066-f199-4682-b6ce-3f066aa615e8 req-3809a0a6-14ce-41df-aaf3-e33861c8ece0 service nova] Creating event network-vif-deleted:4bf3bf14-7831-4e09-82e9-f380ea816946 for instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 on n-h1-768852-23 Jul 14 15:54:52.144415 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0076b066-f199-4682-b6ce-3f066aa615e8 req-3809a0a6-14ce-41df-aaf3-e33861c8ece0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034730 Jul 14 15:54:52.148175 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3408/6977] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:52.181133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:52.181835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:52.189384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:52.190593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:52.191583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:52.192023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:52.265614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:52.274779 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c20104e-905f-4b29-b8ac-bff86f728d80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 200 len: 1348 microversion: 2.1 time: 0.097440 Jul 14 15:54:52.275337 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3570/6978] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:52 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:53.293776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:53.294496 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: a75d3b44-f659-4f81-88d2-bf5f054e84b6] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:53.300889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:53.301355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:53.302139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:53.302600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:53.316488 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] HTTP exception thrown: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 could not be found. Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Request method failure captured: Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 HTTP/1.1 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DwjQAQ9oEmnyJOFeXESt6uEzIHa-UOfyk09XAycdjYMLU1LmHr1BFbzxfSsbrKSf6kJmOd8MwnEy5kdtuH3WloqKTY1xkjU_YNLnAEvxtX2FuEk-nVvDtZRUa3eQcUh4nN3PEQDyY0Ax9sXaKkn6TIuayN1VLzIRwXY-eZVV8v64_E Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 83f5af5fb31042de9ffc151f6c4a7ae6 Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 could not be found. Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'a75d3b44-f659-4f81-88d2-bf5f054e84b6'} Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 could not be found. Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 could not be found. Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:54:53.318133 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 could not be found. Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Returning 404 to user: Instance a75d3b44-f659-4f81-88d2-bf5f054e84b6 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c744eb47-4a26-45ee-a118-ade07cbed4d5 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6" status: 404 len: 111 microversion: 2.1 time: 0.030954 Jul 14 15:54:53.322737 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3409/6979] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:53 2022] GET /compute/v2.1/servers/a75d3b44-f659-4f81-88d2-bf5f054e84b6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:54:53.328558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f8c9517-b7de-4e95-8ec4-0523706b4159 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '.version_select at 0x7fdbf2bba8b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:53.348966 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f8c9517-b7de-4e95-8ec4-0523706b4159 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1547727674" status: 202 len: 0 microversion: 2.1 time: 0.024207 Jul 14 15:54:53.349569 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3571/6980] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 15:54:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1547727674 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:54:53.367186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1731f110-3045-4c04-b7d3-46dc3de8af80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Action: 'create', calling method: .version_select at 0x7fdbf2f8f3a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1728832887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpTWeA5WR/agiQCagKFWHZoQ+XHL2hOhE5wFYZUawDV1HcJu5O5RBq1KrjQ7kk3kXgPna8QceCUCxK87ZeSxwg4tad9cnszZZ0Qatevvp1zas3eojZCfUGlq0AmLaFtLQ=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:53.382160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1731f110-3045-4c04-b7d3-46dc3de8af80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for project aa96d9f49b334c48a989638b96012cf4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:54:53.387359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-1731f110-3045-4c04-b7d3-46dc3de8af80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for user 83f5af5fb31042de9ffc151f6c4a7ae6 and project aa96d9f49b334c48a989638b96012cf4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:54:53.411636 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1731f110-3045-4c04-b7d3-46dc3de8af80 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.048472 Jul 14 15:54:53.412247 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3410/6981] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:54:53 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:53.461698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1923498962", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1728832887", "networks": [{"uuid": "c703b670-132a-4f50-80ca-ab39ad647017"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:53.512526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] validate_networks() for [('c703b670-132a-4f50-80ca-ab39ad647017', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:54:53.930205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:54:53.930639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:54:53.931124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:54:53.931575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:54:53.931996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:54:53.941056 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:53.941510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:53.942314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:53.942759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:53.959959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for project aa96d9f49b334c48a989638b96012cf4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:54:53.965482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Getting quotas for user 83f5af5fb31042de9ffc151f6c4a7ae6 and project aa96d9f49b334c48a989638b96012cf4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:54:53.978352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:54:53.980789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:54:54.027990 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b7ac49e3-f9fa-41cd-b206-fc925a8125b7 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570274 Jul 14 15:54:54.028648 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3572/6982] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:54:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:54:54.038767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ab05f7e6-4aa5-4db9-8f7d-518196d8db1f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:54.039449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ab05f7e6-4aa5-4db9-8f7d-518196d8db1f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:54.094719 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ab05f7e6-4aa5-4db9-8f7d-518196d8db1f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:54.102688 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ab05f7e6-4aa5-4db9-8f7d-518196d8db1f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1263 microversion: 2.1 time: 0.067749 Jul 14 15:54:54.112273 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3411/6983] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:54 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:55.121716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:55.122424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:55.132428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:55.133052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:55.133848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:55.134524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:55.255891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:55.275473 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fba247b0-6dde-4200-a9ee-9dc2244ac362 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1323 microversion: 2.1 time: 0.159081 Jul 14 15:54:55.281775 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3573/6984] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:55 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1323 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:54:56.295216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:56.295984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:56.303889 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:56.304353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:56.305143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:56.305593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:56.463216 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:56.476668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f85747f5-42ae-4f28-8893-caff8b54a8e3 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.185320 Jul 14 15:54:56.477278 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3412/6985] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:56 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:56.686018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-deda137d-5d91-49ff-93f3-4f1084ea3e61 req-43a24b50-341e-4ff1-8110-03f606bffa14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0671a67-3455-4fa8-af47-f3e0cd9a1aaa", "tag": "13712d32-9cc9-4e84-a4ae-98fff42a885c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:54:56.700204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-deda137d-5d91-49ff-93f3-4f1084ea3e61 req-43a24b50-341e-4ff1-8110-03f606bffa14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:56.700538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-deda137d-5d91-49ff-93f3-4f1084ea3e61 req-43a24b50-341e-4ff1-8110-03f606bffa14 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:56.717699 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-deda137d-5d91-49ff-93f3-4f1084ea3e61 req-43a24b50-341e-4ff1-8110-03f606bffa14 service nova] Creating event network-changed:13712d32-9cc9-4e84-a4ae-98fff42a885c for instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa on n-h1-768852-23 Jul 14 15:54:56.724947 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-deda137d-5d91-49ff-93f3-4f1084ea3e61 req-43a24b50-341e-4ff1-8110-03f606bffa14 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048203 Jul 14 15:54:56.729553 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3574/6986] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:54:57.496206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:57.497286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:57.503406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:57.503869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:57.504648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:57.505110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:57.635951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:57.644433 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ec22ee0-b64d-4eb4-8237-13f5353df7c8 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.153064 Jul 14 15:54:57.644999 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3413/6987] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:57 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:58.663028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:58.663727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:58.671026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:58.671516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:58.672349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:58.672814 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:58.807694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:58.815406 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a852e76e-03e8-4372-a26d-f1b359c2a068 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.157380 Jul 14 15:54:58.815994 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3575/6988] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:58 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:54:59.833424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:54:59.833978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:54:59.841338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:59.841878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:59.842664 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:54:59.843124 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:54:59.978437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:54:59.992048 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4898bd0a-b105-485e-8c02-a4d89fedcad1 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.162914 Jul 14 15:54:59.993118 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3414/6989] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:54:59 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:01.009842 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:01.010487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:01.017945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:01.018397 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:01.019244 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:01.019708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:01.156298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:01.164304 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e3f5c3cf-0e91-495f-bc79-bd271defc68a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.158399 Jul 14 15:55:01.164888 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3576/6990] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:01 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:02.181590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:02.182252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:02.189197 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:02.189659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:02.191158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:02.191636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:02.325209 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:02.333617 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-061b5eac-3edc-4d20-a803-d2f74ac04c03 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.155717 Jul 14 15:55:02.334428 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3415/6991] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:02 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:02.615115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c2293a74-779c-4afd-91f2-a021f2d2f908 req-887c72bb-11d8-4d88-b27a-5be71875d99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0671a67-3455-4fa8-af47-f3e0cd9a1aaa", "name": "network-vif-plugged", "status": "completed", "tag": "13712d32-9cc9-4e84-a4ae-98fff42a885c"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:02.622173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c2293a74-779c-4afd-91f2-a021f2d2f908 req-887c72bb-11d8-4d88-b27a-5be71875d99d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:02.622617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c2293a74-779c-4afd-91f2-a021f2d2f908 req-887c72bb-11d8-4d88-b27a-5be71875d99d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:02.634284 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c2293a74-779c-4afd-91f2-a021f2d2f908 req-887c72bb-11d8-4d88-b27a-5be71875d99d service nova] Creating event network-vif-plugged:13712d32-9cc9-4e84-a4ae-98fff42a885c for instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa on n-h1-768852-23 Jul 14 15:55:02.639683 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c2293a74-779c-4afd-91f2-a021f2d2f908 req-887c72bb-11d8-4d88-b27a-5be71875d99d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032317 Jul 14 15:55:02.640313 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3577/6992] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:03.351048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:03.351613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:03.358495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:03.358948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:03.359744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:03.360190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:03.489447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:03.496990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cee36555-101c-49f1-a8d7-7bd3a9ff080a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1363 microversion: 2.1 time: 0.149976 Jul 14 15:55:03.497707 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3416/6993] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:03 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:04.512039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:04.512821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:04.517036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:04.517739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:04.526916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:04.527385 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:04.528283 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:04.528727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:04.661793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:04.669715 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f715169a-8fd7-4ddc-905d-711de612b74a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1556 microversion: 2.1 time: 0.159361 Jul 14 15:55:04.670249 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3578/6994] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:04 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1556 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:04.686271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:04.687318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:04.688895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:04.695612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:04.696146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:04.696871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:04.697327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:04.831983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:04.839700 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-12a9727c-2805-4b76-8ea3-f3210f200a95 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1556 microversion: 2.1 time: 0.157243 Jul 14 15:55:04.840289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3417/6995] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:04 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:06.311522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9978a3ab-33d2-4d98-a126-070dcc67c4bb"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:06.312504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:06.319738 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:06.320195 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:06.320976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:06.321417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:06.578629 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:06.588287 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af95e1ac-6fb6-49b4-b6d6-4e4be54fde4a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "POST /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280851 Jul 14 15:55:06.588901 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3579/6996] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:55:06 2022] POST /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:17.260732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:17.261281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:17.263766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:17.264657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=70 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:17.270533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:17.270992 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:17.271794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:17.272286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:17.352788 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lazy-loading 'services' on Instance uuid e0671a67-3455-4fa8-af47-f3e0cd9a1aaa {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:55:17.422326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-66d56e5b-9a25-4d4b-a4a8-fa321ec70931 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments/9978a3ab-33d2-4d98-a126-070dcc67c4bb" status: 202 len: 0 microversion: 2.1 time: 0.165257 Jul 14 15:55:17.422929 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3418/6997] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:55:17 2022] DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments/9978a3ab-33d2-4d98-a126-070dcc67c4bb => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:55:17.430744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:17.435611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:17.436534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:17.444130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:17.444575 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:17.445339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:17.445772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:17.477789 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4bbf453a-c279-4458-91a7-94884a5aa2dd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049636 Jul 14 15:55:17.478361 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3580/6998] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:55:17 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:18.490752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:18.491928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:18.499440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:18.499901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:18.500683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:18.501129 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:18.532418 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-308afad8-8407-4fc4-b9c1-ba1796f14d96 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046448 Jul 14 15:55:18.533087 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3419/6999] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:55:18 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:19.543772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:19.544638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:19.551893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:19.552342 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:19.553266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:19.553566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:19.586614 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-43eb8d88-0328-4b34-adf6-392ce57fac49 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046945 Jul 14 15:55:19.587221 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3581/7000] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:55:19 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:20.598757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:20.599728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:20.607096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:20.607598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:20.608511 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:20.608972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:20.639828 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ed10f0c4-307b-4f41-bccc-78cb8676c3fa tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045287 Jul 14 15:55:20.640295 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3420/7001] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:55:20 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:21.651765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:21.652693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:21.660759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:21.661804 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:21.662587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:21.663024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:21.693085 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-834b852c-5ae1-4a2d-bcc6-7c262decedb6 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045477 Jul 14 15:55:21.693665 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3582/7002] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:55:21 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:22.704774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:22.705793 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:22.712885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.713347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.714128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.714583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.747918 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8fb45a92-c7c5-415a-a310-2c77816b9fdd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047101 Jul 14 15:55:22.748488 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3421/7003] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:55:22 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 14 15:55:22.758883 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:22.759420 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:22.766267 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.766719 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.767521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:22.767978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:22.846266 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] HTTP exception thrown: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa is not attached to volume 9978a3ab-33d2-4d98-a126-070dcc67c4bb Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Request method failure captured: Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: request: DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments/9978a3ab-33d2-4d98-a126-070dcc67c4bb HTTP/1.1 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0DwjQAQ9oEmnyJOFeXESt6uEzIHa-UOfyk09XAycdjYMLU1LmHr1BFbzxfSsbrKSf6kJmOd8MwnEy5kdtuH3WloqKTY1xkjU_YNLnAEvxtX2FuEk-nVvDtZRUa3eQcUh4nN3PEQDyY0Ax9sXaKkn6TIuayN1VLzIRwXY-eZVV8v64_E Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 83f5af5fb31042de9ffc151f6c4a7ae6 Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa is not attached to volume 9978a3ab-33d2-4d98-a126-070dcc67c4bb Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'server_id': 'e0671a67-3455-4fa8-af47-f3e0cd9a1aaa', 'id': '9978a3ab-33d2-4d98-a126-070dcc67c4bb'} Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9978a3ab-33d2-4d98-a126-070dcc67c4bb. Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa is not attached to volume 9978a3ab-33d2-4d98-a126-070dcc67c4bb Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:55:22.848280 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa is not attached to volume 9978a3ab-33d2-4d98-a126-070dcc67c4bb Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Returning 404 to user: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa is not attached to volume 9978a3ab-33d2-4d98-a126-070dcc67c4bb {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b0e7772-d025-4df7-99a6-01ee0d3e096f tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments/9978a3ab-33d2-4d98-a126-070dcc67c4bb" status: 404 len: 154 microversion: 2.1 time: 0.094905 Jul 14 15:55:22.853524 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3583/7004] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:55:22 2022] DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa/os-volume_attachments/9978a3ab-33d2-4d98-a126-070dcc67c4bb => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:55:26.169533 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:26.170252 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:26.178095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.178556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.179398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.180018 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.208401 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:55:26.295699 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-15e3a5d5-c785-4c85-bbc1-d46e34b6daf0 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 204 len: 0 microversion: 2.1 time: 0.129343 Jul 14 15:55:26.296385 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3422/7005] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:55:26 2022] DELETE /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:55:26.305966 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:26.306794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:26.314001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.314566 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.315441 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:26.315941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:26.455816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:26.463561 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f7ed719a-8268-4bff-9063-24ab9c046b6a tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1562 microversion: 2.1 time: 0.161932 Jul 14 15:55:26.464082 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3584/7006] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:26 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:27.482861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:27.483610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:27.491249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:27.491752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:27.492531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:27.492986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:27.625948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:27.634290 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ee10ac21-2318-4d32-a3b7-ebb7ddd8bc91 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1562 microversion: 2.1 time: 0.155780 Jul 14 15:55:27.634877 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3423/7007] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:27 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1562 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:28.653168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:28.653712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:28.663134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.664013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.664972 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.665406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.665666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c6261597-c1a0-46f0-8d2a-4b4dab349670 req-556167dd-4c8a-4ba5-8aee-56466fc9da46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0671a67-3455-4fa8-af47-f3e0cd9a1aaa", "name": "network-vif-deleted", "tag": "13712d32-9cc9-4e84-a4ae-98fff42a885c"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:28.676494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c6261597-c1a0-46f0-8d2a-4b4dab349670 req-556167dd-4c8a-4ba5-8aee-56466fc9da46 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:28.676946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c6261597-c1a0-46f0-8d2a-4b4dab349670 req-556167dd-4c8a-4ba5-8aee-56466fc9da46 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:28.691774 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c6261597-c1a0-46f0-8d2a-4b4dab349670 req-556167dd-4c8a-4ba5-8aee-56466fc9da46 service nova] Creating event network-vif-deleted:13712d32-9cc9-4e84-a4ae-98fff42a885c for instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa on n-h1-768852-23 Jul 14 15:55:28.698443 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c6261597-c1a0-46f0-8d2a-4b4dab349670 req-556167dd-4c8a-4ba5-8aee-56466fc9da46 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037228 Jul 14 15:55:28.702149 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3424/7008] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:55:28.747332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83f5af5fb31042de9ffc151f6c4a7ae6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa96d9f49b334c48a989638b96012cf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:28.756346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8fdab0fd-601b-49a8-9698-f4ab3eb093fd tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 200 len: 1520 microversion: 2.1 time: 0.108550 Jul 14 15:55:28.757242 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3585/7009] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:28 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 1520 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:29.775333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:29.775970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] [instance: e0671a67-3455-4fa8-af47-f3e0cd9a1aaa] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:29.783390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:29.783861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:29.784639 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:29.785085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:29.798258 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] HTTP exception thrown: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa could not be found. Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Request method failure captured: Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa HTTP/1.1 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0DwjQAQ9oEmnyJOFeXESt6uEzIHa-UOfyk09XAycdjYMLU1LmHr1BFbzxfSsbrKSf6kJmOd8MwnEy5kdtuH3WloqKTY1xkjU_YNLnAEvxtX2FuEk-nVvDtZRUa3eQcUh4nN3PEQDyY0Ax9sXaKkn6TIuayN1VLzIRwXY-eZVV8v64_E Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/aa96d9f49b334c48a989638b96012cf4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: aa96d9f49b334c48a989638b96012cf4 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1328054882 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 83f5af5fb31042de9ffc151f6c4a7ae6 Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestEncryptedCinderVolumes-1328054882-project Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa could not be found. Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'e0671a67-3455-4fa8-af47-f3e0cd9a1aaa'} Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa could not be found. Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa could not be found. Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:55:29.800435 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa could not be found. Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Returning 404 to user: Instance e0671a67-3455-4fa8-af47-f3e0cd9a1aaa could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-444b70c1-d7f5-4987-9135-828b18a45c6c tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa" status: 404 len: 111 microversion: 2.1 time: 0.030919 Jul 14 15:55:29.805036 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3425/7010] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:29 2022] GET /compute/v2.1/servers/e0671a67-3455-4fa8-af47-f3e0cd9a1aaa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:55:29.810753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4dd4684a-06f6-45d1-b73d-178ee2f60fb4 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] Calling method '.version_select at 0x7fdbf31a98b0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:29.830126 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4dd4684a-06f6-45d1-b73d-178ee2f60fb4 tempest-TestEncryptedCinderVolumes-1328054882 tempest-TestEncryptedCinderVolumes-1328054882-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1728832887" status: 202 len: 0 microversion: 2.1 time: 0.023173 Jul 14 15:55:29.830727 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3586/7011] 10.222.0.98 () {58 vars in 1277 bytes} [Thu Jul 14 15:55:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1728832887 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:55:57.117002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-779bbea2-ca77-4a3e-bd11-ad9336c7f077 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'create', calling method: .version_select at 0x7fdbf0354700>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-458069033", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH3g+H19P7mAbYqlRHjPzFxqtBG2xNoCS80k3MwVdmZd1VGZHfPhw+8Ki9CxvVgHA+HXwwisI76gCs0UdmY2MWzJ/jY2nvvP2G0ywvHYWfALTdQBgai1i2uMIeCT+rATLA=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:57.121819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:57.122517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:57.139929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-779bbea2-ca77-4a3e-bd11-ad9336c7f077 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for project 960af42bfb4f4b3b942d1956051d8510. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:57.145952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-779bbea2-ca77-4a3e-bd11-ad9336c7f077 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for user 80098f23a80f47f59060eed03bdb3290 and project 960af42bfb4f4b3b942d1956051d8510. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:57.174999 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-779bbea2-ca77-4a3e-bd11-ad9336c7f077 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.062102 Jul 14 15:55:57.175919 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3426/7012] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:55:57 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:55:57.224894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=36 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:57.225650 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:57.230418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1551827625", "imageRef": "36326049-9252-4dbe-8c50-948eb87a19c0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-458069033", "networks": [{"uuid": "90c7d946-6dcf-4b70-8619-d08feeadcf1d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:55:57.294074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] validate_networks() for [('90c7d946-6dcf-4b70-8619-d08feeadcf1d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:55:57.783081 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:55:57.783543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:55:57.784545 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:55:57.784958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:55:57.785373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:55:57.795458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.795915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.796735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:57.797178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:57.815929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for project 960af42bfb4f4b3b942d1956051d8510. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:55:57.822090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for user 80098f23a80f47f59060eed03bdb3290 and project 960af42bfb4f4b3b942d1956051d8510. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:55:57.838068 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:55:57.840584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='36326049-9252-4dbe-8c50-948eb87a19c0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:55:57.892369 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b5f031d3-8d2d-4257-aa11-583e7b047c4c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669345 Jul 14 15:55:57.893054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3587/7013] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:55:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:55:57.904075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c3c9674c-685d-4bb4-bec6-31c3ac53f612 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:57.904765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c3c9674c-685d-4bb4-bec6-31c3ac53f612 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:57.976358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c3c9674c-685d-4bb4-bec6-31c3ac53f612 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:57.989719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c3c9674c-685d-4bb4-bec6-31c3ac53f612 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1258 microversion: 2.1 time: 0.089794 Jul 14 15:55:57.990363 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3427/7014] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:57 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1258 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:55:59.009423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:55:59.010112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:55:59.020294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:59.022339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:59.024218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:55:59.025018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:55:59.118173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:55:59.127427 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f53ad9fc-7d04-4d09-b1ea-92aa46d65eb8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1318 microversion: 2.1 time: 0.123007 Jul 14 15:55:59.128688 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3588/7015] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:55:59 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1318 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:00.150466 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:00.152075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:00.168908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:00.170339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:00.172706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:00.173896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:00.469817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:00.478512 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-950aba5a-c9f8-481c-812e-d911de8f85e3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.336127 Jul 14 15:56:00.489437 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3428/7016] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:00 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:01.500783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:01.501641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:01.509429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:01.510256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:01.511141 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:01.511610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:01.695852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:01.703928 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2fd35d99-3ba2-4bd4-ae04-49a2d1ce2eb0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.209746 Jul 14 15:56:01.704538 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3589/7017] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:01 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:02.738231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:02.740546 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:02.750379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.750882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.751778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:02.752277 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:02.919559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:02.928536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9b0dadb9-675d-4fd3-8b15-df59e0aaae1c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.202776 Jul 14 15:56:02.929168 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3429/7018] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:02 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:03.946099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.946725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.954166 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.954958 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.955808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.956246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:04.106612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:04.116594 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6a621a03-967b-49ca-80eb-732d9cee730d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.174304 Jul 14 15:56:04.117388 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3590/7019] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:05.135498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:05.136033 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:05.142486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:05.142951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:05.143776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:05.144263 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:05.283985 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:05.291866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c0671852-2fe1-48fe-a9c8-c1970b00e02a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.161099 Jul 14 15:56:05.292685 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3430/7020] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:05 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:06.308134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:06.308724 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:06.316500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:06.316945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.317886 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:06.318393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:06.464113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:06.473497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5e536c4-c9a6-4d65-8051-69dce4000e77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.169112 Jul 14 15:56:06.474294 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3591/7021] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:06 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:07.490942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:07.491632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:07.500194 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:07.500811 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:07.501626 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:07.502111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:07.653063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:07.661958 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d9ab14f-2728-45e3-91dd-1d337097cfa4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.175018 Jul 14 15:56:07.663303 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3431/7022] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:07 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:08.679932 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:08.680512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:08.683222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:08.684035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:08.689875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:08.690323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:08.691096 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:08.691735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:08.831856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:08.848025 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ab58b4e0-29ea-48a5-9dc2-f02c2faf4c77 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.171932 Jul 14 15:56:08.848656 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3592/7023] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:08 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:09.433753 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-26bb940b-95bd-4ebb-af84-3e7f5cb5e3f1 req-ac0a523a-de83-4738-9d38-7c85f1c3b549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:09.437551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:09.448241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-26bb940b-95bd-4ebb-af84-3e7f5cb5e3f1 req-ac0a523a-de83-4738-9d38-7c85f1c3b549 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:09.448722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-26bb940b-95bd-4ebb-af84-3e7f5cb5e3f1 req-ac0a523a-de83-4738-9d38-7c85f1c3b549 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:09.466598 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-26bb940b-95bd-4ebb-af84-3e7f5cb5e3f1 req-ac0a523a-de83-4738-9d38-7c85f1c3b549 service nova] Creating event network-changed:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:56:09.473583 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-26bb940b-95bd-4ebb-af84-3e7f5cb5e3f1 req-ac0a523a-de83-4738-9d38-7c85f1c3b549 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043936 Jul 14 15:56:09.474481 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3432/7024] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:09.865982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:09.866602 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:09.874295 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:09.875110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:09.875920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:09.876335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:10.012470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:10.020491 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5428da21-d933-4c60-a16b-acd6c803b8a4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.159371 Jul 14 15:56:10.021087 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3593/7025] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:09 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:11.038584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:11.039448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:11.046532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:11.046879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:11.047803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:11.048179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:11.279467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:11.288193 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9e78070c-a162-4f71-bb46-042487387b2e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.254779 Jul 14 15:56:11.289019 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3433/7026] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:11 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:12.306261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:12.306879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:12.314553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:12.315531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:12.316312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:12.316744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:12.468411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:12.476123 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cc18c7e2-e05d-4ca4-86ad-2b33c2223adb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.174030 Jul 14 15:56:12.476720 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3594/7027] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:12 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:13.494002 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:13.494630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:13.501631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:13.502146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:13.502932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:13.503411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:13.632666 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:13.640410 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-89d9d60c-28ac-4a58-974f-3af179a53568 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.150409 Jul 14 15:56:13.641217 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3434/7028] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:13 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:14.658502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:14.659121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:14.665413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.665858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.666652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:14.667083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:14.798098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:14.806357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3436dc33-2568-4461-8686-a0bf231d9668 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.152218 Jul 14 15:56:14.806950 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3595/7029] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:14 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:15.823574 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:15.824218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:15.831262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:15.831745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:15.832516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:15.832963 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:15.969698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:15.977267 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5ec6d1c9-e785-46ab-b301-2789c8a1fd36 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.157598 Jul 14 15:56:15.977851 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3435/7030] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:15 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:16.271655 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-de7ad183-2767-43fe-8509-833b155d0893 req-56b6239e-9c62-42e2-9130-41c5c8feef0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "name": "network-vif-plugged", "status": "completed", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:16.280666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-de7ad183-2767-43fe-8509-833b155d0893 req-56b6239e-9c62-42e2-9130-41c5c8feef0e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:16.281475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-de7ad183-2767-43fe-8509-833b155d0893 req-56b6239e-9c62-42e2-9130-41c5c8feef0e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:16.293099 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-de7ad183-2767-43fe-8509-833b155d0893 req-56b6239e-9c62-42e2-9130-41c5c8feef0e service nova] Creating event network-vif-plugged:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:56:16.298327 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-de7ad183-2767-43fe-8509-833b155d0893 req-56b6239e-9c62-42e2-9130-41c5c8feef0e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031133 Jul 14 15:56:16.299019 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3596/7031] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:16.994242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:16.994876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:17.002179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:17.002780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:17.003595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:17.004071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:17.138657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:17.146230 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af103d7f-07a3-43e1-b71e-497af4dda4b4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1358 microversion: 2.1 time: 0.155942 Jul 14 15:56:17.146915 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3436/7032] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:16 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:18.164704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:18.165445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:18.171858 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.172312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.173078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.173515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.312338 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:18.320605 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c98bd586-f0e4-498d-b05b-18f3c1829ccb tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1549 microversion: 2.1 time: 0.161094 Jul 14 15:56:18.321236 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3597/7033] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:18 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:18.336866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:18.337489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:18.344481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.344938 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.345707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.346155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.480222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:18.488420 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c114ed96-a234-4026-a3ca-af072ba5bd19 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1549 microversion: 2.1 time: 0.155467 Jul 14 15:56:18.489006 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3437/7034] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:18 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:18.504179 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:18.507934 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:18.508698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Searching by: {'deleted': False, 'project_id': '960af42bfb4f4b3b942d1956051d8510'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 15:56:18.514086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.514534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.515350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.515793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.540170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 15:56:18.566941 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3c14c386-cb7b-4c0f-b86f-5c7de4d66d31 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.066672 Jul 14 15:56:18.567580 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3598/7035] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 15:56:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:18.577948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:18.578584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:18.585532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.585999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.586779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:18.587234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:18.717828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:18.725554 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2912abcd-fcc6-479b-8be1-ac1f3e22e034 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1549 microversion: 2.1 time: 0.151585 Jul 14 15:56:18.726134 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3438/7036] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:18 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:20.241365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fa6af53-e525-42fc-b0b9-cfa4688857cc"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:20.242639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:20.250999 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.251553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.252445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:20.252896 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:20.506511 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df18a69c-86ff-4eb4-ab80-3d44c646948c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269858 Jul 14 15:56:20.507327 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3599/7037] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 15:56:20 2022] POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:33.645450 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:33.646085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:33.649156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:33.649828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=62 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:33.656335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:33.656805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:33.657592 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:33.658531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:33.800069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:33.808668 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4f557397-538f-4f57-ade3-eb7593cdefaf tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1595 microversion: 2.1 time: 0.167172 Jul 14 15:56:33.809255 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3439/7038] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:33 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1595 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:35.514658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b21cd098-528c-45fe-bf50-6218166d338b req-1870b041-5dbb-4b89-8a04-0790fee0b58d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:35.525202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:35.525907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:35.526893 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:35.536557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b21cd098-528c-45fe-bf50-6218166d338b req-1870b041-5dbb-4b89-8a04-0790fee0b58d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:35.537000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b21cd098-528c-45fe-bf50-6218166d338b req-1870b041-5dbb-4b89-8a04-0790fee0b58d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:35.551359 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b21cd098-528c-45fe-bf50-6218166d338b req-1870b041-5dbb-4b89-8a04-0790fee0b58d service nova] Creating event network-changed:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:56:35.556957 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b21cd098-528c-45fe-bf50-6218166d338b req-1870b041-5dbb-4b89-8a04-0790fee0b58d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046370 Jul 14 15:56:35.557921 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3600/7039] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:56:36.840445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-504972243"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:36.841097 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:36.848503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.848964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.849740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:36.850184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:36.981546 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.network.security_group_api [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Adding security group 3602c757-81f4-4d5f-aef3-7b905bd567ff to port 8313889f-e725-4e0d-84c1-9020212657ac Jul 14 15:56:37.325326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-499a5521-c57a-4d20-b04e-bb7ef1d43c7d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/action" status: 202 len: 0 microversion: 2.1 time: 0.488070 Jul 14 15:56:37.331244 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3440/7040] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:56:36 2022] POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:56:37.335876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:37.337113 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:37.345315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.345996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.347200 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.347943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.512680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:37.522314 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-19fbdedf-bb48-42a0-88c8-b0a3b7bab157 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1760 microversion: 2.1 time: 0.190383 Jul 14 15:56:37.523738 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3601/7041] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:37 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1760 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:56:37.572582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c5195e9e-4822-461d-9d3c-36bf4e21d81e req-93a323b1-fc2e-402b-a1ef-62466c046861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:56:37.580769 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c5195e9e-4822-461d-9d3c-36bf4e21d81e req-93a323b1-fc2e-402b-a1ef-62466c046861 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:37.581476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c5195e9e-4822-461d-9d3c-36bf4e21d81e req-93a323b1-fc2e-402b-a1ef-62466c046861 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:37.593190 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c5195e9e-4822-461d-9d3c-36bf4e21d81e req-93a323b1-fc2e-402b-a1ef-62466c046861 service nova] Creating event network-changed:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:56:37.599290 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c5195e9e-4822-461d-9d3c-36bf4e21d81e req-93a323b1-fc2e-402b-a1ef-62466c046861 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030531 Jul 14 15:56:37.599922 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3441/7042] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:58:16.022698 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.023536 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.027710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:58:16.028692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.036275 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.036727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.037494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.037965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.109513 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5db98a7d-ae3d-4473-8253-8b8d7a5b75bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/action" status: 202 len: 0 microversion: 2.1 time: 0.088635 Jul 14 15:58:16.110759 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3602/7043] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:58:16 2022] POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:58:16.118019 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 15:58:16.121140 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] AMQP server on 10.222.0.98:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 15:58:16.121140 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.122009 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:16.130700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:16.131841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:16.139058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.139555 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.140358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:16.141400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:16.399952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:16.409476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7dee2e2c-f9c7-4bf2-b72d-8c1bb5599635 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1762 microversion: 2.1 time: 0.293709 Jul 14 15:58:16.410079 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3442/7044] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:16 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1762 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:58:17.429020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:17.429756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:17.437362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.438359 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.439128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:17.439593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:17.590906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:17.601142 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef85190f-f982-45be-bff7-a148e0e9ef5d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1760 microversion: 2.1 time: 0.176296 Jul 14 15:58:17.601142 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3603/7045] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:17 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1760 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:58:28.624806 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:58:28.625988 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 15:58:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:58:30.869374 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:58:30.869937 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:58:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:58:31.713493 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:58:31.713651 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:58:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:59:07.646021 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:59:07.646702 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 15:59:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:59:31.237700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.238961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.244547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-504972243"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:31.245423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:31.261394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.262055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.262982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:31.263529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:31.273083 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 41984. Jul 14 15:59:31.284064 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 41982. Jul 14 15:59:31.553522 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.network.security_group_api [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Removing security group 3602c757-81f4-4d5f-aef3-7b905bd567ff from port 8313889f-e725-4e0d-84c1-9020212657ac Jul 14 15:59:31.962562 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9412c391-dc43-44da-bfae-65325d230b01 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/action" status: 202 len: 0 microversion: 2.1 time: 0.728628 Jul 14 15:59:31.966158 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3443/7046] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 15:59:31 2022] POST /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:31.986857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:31.990702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:32.148584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d490e8a2-5d15-41a6-8190-b2f378c1df0c req-5a722fd7-f5c5-42d2-b6a5-5ec0a02c5e7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:32.168266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d490e8a2-5d15-41a6-8190-b2f378c1df0c req-5a722fd7-f5c5-42d2-b6a5-5ec0a02c5e7a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:32.169818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d490e8a2-5d15-41a6-8190-b2f378c1df0c req-5a722fd7-f5c5-42d2-b6a5-5ec0a02c5e7a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:32.199018 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d490e8a2-5d15-41a6-8190-b2f378c1df0c req-5a722fd7-f5c5-42d2-b6a5-5ec0a02c5e7a service nova] Creating event network-changed:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:59:32.214488 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d490e8a2-5d15-41a6-8190-b2f378c1df0c req-5a722fd7-f5c5-42d2-b6a5-5ec0a02c5e7a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240515 Jul 14 15:59:32.216440 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3604/7047] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:33.691701 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:33.692300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:33.698959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.699448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.700237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.700866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.792801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lazy-loading 'services' on Instance uuid 01cd29d3-2eb8-469e-aeca-2fabd23a950f {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:33.879435 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3ee8a829-94df-40a2-ad81-bc16613404ca tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments/6fa6af53-e525-42fc-b0b9-cfa4688857cc" status: 202 len: 0 microversion: 2.1 time: 0.192011 Jul 14 15:59:33.880861 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3444/7048] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:59:33 2022] DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments/6fa6af53-e525-42fc-b0b9-cfa4688857cc => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:33.893264 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:33.894834 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:33.905786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.906910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.908304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:33.909324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:33.944761 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c30197e7-162d-4341-87f4-d780da4a5256 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057298 Jul 14 15:59:33.945472 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3605/7049] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:33 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:34.234246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-fdbeabe5-3664-4a07-9d40-a968122061ff req-ff0cfe96-7e86-4942-a7d5-1c466e18a11e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:34.245925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fdbeabe5-3664-4a07-9d40-a968122061ff req-ff0cfe96-7e86-4942-a7d5-1c466e18a11e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.246806 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fdbeabe5-3664-4a07-9d40-a968122061ff req-ff0cfe96-7e86-4942-a7d5-1c466e18a11e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.260841 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fdbeabe5-3664-4a07-9d40-a968122061ff req-ff0cfe96-7e86-4942-a7d5-1c466e18a11e service nova] Creating event network-changed:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:59:34.270665 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-fdbeabe5-3664-4a07-9d40-a968122061ff req-ff0cfe96-7e86-4942-a7d5-1c466e18a11e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040497 Jul 14 15:59:34.271540 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3445/7050] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:34.958229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:34.959157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:34.966847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.967478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:34.968142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:34.968579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:35.003185 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5569d08-7b79-4d4f-81d9-5b6a8436b193 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048869 Jul 14 15:59:35.003838 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3606/7051] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:34 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:59:36.020800 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:36.022214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:36.030611 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:36.031370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.032164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:36.032615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:36.077563 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5a6a828d-7438-478b-9a01-88998f842b15 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066496 Jul 14 15:59:36.078158 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3446/7052] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:36 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:37.089891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:37.090965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:37.099746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:37.100194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:37.100982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:37.101417 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:37.134223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9c012973-8bfc-404b-9975-2f325b53a7dd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048372 Jul 14 15:59:37.134855 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3607/7053] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:37 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:38.147336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:38.148206 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:38.156487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.156955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.157770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:38.158221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:38.191246 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7cb6a485-64e9-425d-a5af-3f786a5ef676 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048308 Jul 14 15:59:38.191873 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3447/7054] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:38 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:39.203361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:39.204463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:39.211687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:39.212149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.212961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:39.213398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.246788 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fa099a1a-d004-458d-a446-9a5ef14eb088 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048256 Jul 14 15:59:39.247436 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3608/7055] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 15:59:39 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:59:39.258447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:39.259038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:39.267338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:39.267961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.268767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:39.269228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:39.348516 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] HTTP exception thrown: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f is not attached to volume 6fa6af53-e525-42fc-b0b9-cfa4688857cc Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Request method failure captured: Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments/6fa6af53-e525-42fc-b0b9-cfa4688857cc HTTP/1.1 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dx9Y1HZzqsxz56Lf6UilO0lX5Bne-abd6nRegnw-zNBLYD3o42prZ41arDCLFrbZhrf1O55P0F2w-EJGqnDQEgBY-lSapRqe17E-ouiievozUlF6HdM9B-Pfi5LX1OelvVNB0agmAjXV50l6Zk584vO_uZ-pt7XxGOxEMR68OZ8pLA Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestMinimumBasicScenario-1508434070 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 80098f23a80f47f59060eed03bdb3290 Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f is not attached to volume 6fa6af53-e525-42fc-b0b9-cfa4688857cc Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': '01cd29d3-2eb8-469e-aeca-2fabd23a950f', 'id': '6fa6af53-e525-42fc-b0b9-cfa4688857cc'} Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6fa6af53-e525-42fc-b0b9-cfa4688857cc. Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f is not attached to volume 6fa6af53-e525-42fc-b0b9-cfa4688857cc Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:39.350170 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f is not attached to volume 6fa6af53-e525-42fc-b0b9-cfa4688857cc Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Returning 404 to user: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f is not attached to volume 6fa6af53-e525-42fc-b0b9-cfa4688857cc {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d81524b-cfd3-4257-a553-86061ad56fbe tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments/6fa6af53-e525-42fc-b0b9-cfa4688857cc" status: 404 len: 154 microversion: 2.1 time: 0.097376 Jul 14 15:59:39.355034 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3448/7056] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 15:59:39 2022] DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f/os-volume_attachments/6fa6af53-e525-42fc-b0b9-cfa4688857cc => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:59:42.606339 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.606943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.615493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.615983 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.616857 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.617362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.647807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:59:42.733299 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-29f0f60c-6702-4d05-a2b4-7aa923d9a1c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 204 len: 0 microversion: 2.1 time: 0.130697 Jul 14 15:59:42.733917 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3609/7057] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 15:59:42 2022] DELETE /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:59:42.742285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:42.742919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:42.751379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.751953 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.752647 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:42.753096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:42.899150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:42.907433 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1e08ae7d-99e9-4d6b-aba3-1638386ba587 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1555 microversion: 2.1 time: 0.168926 Jul 14 15:59:42.908024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3449/7058] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:42 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1555 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:43.927425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:43.928138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:43.935192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.935669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:43.937013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:43.937448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:44.135568 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:44.148249 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-702222a1-37d1-45e4-82df-7b9cf7c7c5bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1555 microversion: 2.1 time: 0.224933 Jul 14 15:59:44.149206 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3610/7059] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:43 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1555 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:45.028739 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f7a2c2a5-9197-4a9d-8331-48a5b2135eb2 req-af0af5f4-c01a-40d6-a1aa-fd96d09a0ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01cd29d3-2eb8-469e-aeca-2fabd23a950f", "name": "network-vif-deleted", "tag": "8313889f-e725-4e0d-84c1-9020212657ac"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:45.041355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f7a2c2a5-9197-4a9d-8331-48a5b2135eb2 req-af0af5f4-c01a-40d6-a1aa-fd96d09a0ecb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.041807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f7a2c2a5-9197-4a9d-8331-48a5b2135eb2 req-af0af5f4-c01a-40d6-a1aa-fd96d09a0ecb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.054719 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f7a2c2a5-9197-4a9d-8331-48a5b2135eb2 req-af0af5f4-c01a-40d6-a1aa-fd96d09a0ecb service nova] Creating event network-vif-deleted:8313889f-e725-4e0d-84c1-9020212657ac for instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f on n-h2-768852-23 Jul 14 15:59:45.060106 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f7a2c2a5-9197-4a9d-8331-48a5b2135eb2 req-af0af5f4-c01a-40d6-a1aa-fd96d09a0ecb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038714 Jul 14 15:59:45.060745 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3450/7060] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 15:59:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:45.168013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:45.168537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:45.176591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.177059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.178075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.178516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.220549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:45.220997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:45.221564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lazy-loading 'fault' on Instance uuid 01cd29d3-2eb8-469e-aeca-2fabd23a950f {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:59:45.281391 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:45.290063 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dd6079ea-1229-4fa7-af9e-b6e6904e772a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 200 len: 1348 microversion: 2.1 time: 0.126476 Jul 14 15:59:45.290700 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3611/7061] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:45 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 1348 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:46.310524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.311248 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: 01cd29d3-2eb8-469e-aeca-2fabd23a950f] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:46.317784 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.318249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.319036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:46.319514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:46.333143 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] HTTP exception thrown: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f could not be found. Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Request method failure captured: Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f HTTP/1.1 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dx9Y1HZzqsxz56Lf6UilO0lX5Bne-abd6nRegnw-zNBLYD3o42prZ41arDCLFrbZhrf1O55P0F2w-EJGqnDQEgBY-lSapRqe17E-ouiievozUlF6HdM9B-Pfi5LX1OelvVNB0agmAjXV50l6Zk584vO_uZ-pt7XxGOxEMR68OZ8pLA Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestMinimumBasicScenario-1508434070 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 80098f23a80f47f59060eed03bdb3290 Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f could not be found. Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '01cd29d3-2eb8-469e-aeca-2fabd23a950f'} Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f could not be found. Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f could not be found. Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:59:46.334914 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f could not be found. Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Returning 404 to user: Instance 01cd29d3-2eb8-469e-aeca-2fabd23a950f could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d5f71ee4-e2a1-4c8d-b5ff-0e97e25b9003 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f" status: 404 len: 111 microversion: 2.1 time: 0.031148 Jul 14 15:59:46.339594 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3451/7062] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:46 2022] GET /compute/v2.1/servers/01cd29d3-2eb8-469e-aeca-2fabd23a950f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:59:46.346954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d93dc08d-e4a6-4cbd-a81b-c6638a8fcd21 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '.version_select at 0x7fdbf1eb4ee0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:46.373273 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d93dc08d-e4a6-4cbd-a81b-c6638a8fcd21 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-458069033" status: 202 len: 0 microversion: 2.1 time: 0.030766 Jul 14 15:59:46.373973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3612/7063] 10.222.0.98 () {58 vars in 1268 bytes} [Thu Jul 14 15:59:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-458069033 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:59:55.515494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-28964c7e-6947-4a59-8656-d37ae5a373ff tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'create', calling method: .version_select at 0x7fdbf1fba280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1696234991", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJonBovdAsl6PNaXiEBaDhzTRnsgqeLppOjgxGkwLMmZ1dKebPwLQOH/+dgeLoWm9WACCOjXad4PWmhPjLZKQJPLnrsE/wu7nr2y4OiqOrkJBUU/FEixWJu2AAnokY3FXw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:55.534062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-28964c7e-6947-4a59-8656-d37ae5a373ff tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for project 960af42bfb4f4b3b942d1956051d8510. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:55.540094 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-28964c7e-6947-4a59-8656-d37ae5a373ff tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for user 80098f23a80f47f59060eed03bdb3290 and project 960af42bfb4f4b3b942d1956051d8510. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:55.571782 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-28964c7e-6947-4a59-8656-d37ae5a373ff tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.061338 Jul 14 15:59:55.573674 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3452/7064] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 15:59:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:59:55.620838 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:55.625677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-232650450", "imageRef": "3d95871a-26c5-4a61-b1f2-3c901475c84d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1696234991", "networks": [{"uuid": "90c7d946-6dcf-4b70-8619-d08feeadcf1d"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:59:55.680163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] validate_networks() for [('90c7d946-6dcf-4b70-8619-d08feeadcf1d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:59:56.097486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:59:56.097908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:59:56.098380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:59:56.098785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:59:56.099192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:59:56.108564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.109006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.109797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:56.110230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:56.127453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for project 960af42bfb4f4b3b942d1956051d8510. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:59:56.132679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Getting quotas for user 80098f23a80f47f59060eed03bdb3290 and project 960af42bfb4f4b3b942d1956051d8510. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:59:56.144832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:59:56.147021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3d95871a-26c5-4a61-b1f2-3c901475c84d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:59:56.191915 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7ec8935c-ec0d-4ebd-bd0d-fc066c14d34b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.572963 Jul 14 15:59:56.192593 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3613/7065] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 15:59:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 574 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:59:56.202715 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7a15e5de-4016-4815-be49-5961d39ffc20 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:56.203435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7a15e5de-4016-4815-be49-5961d39ffc20 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:56.262184 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7a15e5de-4016-4815-be49-5961d39ffc20 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:56.269874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7a15e5de-4016-4815-be49-5961d39ffc20 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1258 microversion: 2.1 time: 0.071120 Jul 14 15:59:56.270796 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3453/7066] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:56 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:59:57.288872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:57.289709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:57.296564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.296901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.297681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:57.298117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:57.398105 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:57.406419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2e43d01e-4e85-4d61-a09a-9073d906f5d0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1318 microversion: 2.1 time: 0.122677 Jul 14 15:59:57.407413 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3614/7067] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:57 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1318 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:58.424848 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:58.425515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:58.427605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:58.438142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.438897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.440074 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:58.440704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:58.594486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:58.603066 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6cd836d9-881e-4008-a8a6-5b5f50aba9cc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.182584 Jul 14 15:59:58.604313 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3454/7068] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:58 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:59:59.631598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:59:59.632142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:59:59.639084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.640181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.641116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:59:59.641478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:59.801761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:59:59.809417 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a4211a9d-8820-46a9-92ba-115a1025af0b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.181774 Jul 14 15:59:59.815419 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3615/7069] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 15:59:59 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:00.827210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:00.828680 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:00.835971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.836443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.837235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:00.837693 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:00.979729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:00.987999 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d62436b9-4d8a-4d61-9961-876366702103 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.165260 Jul 14 16:00:00.989251 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3455/7070] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:00 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:02.004459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:02.005058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:02.007721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:02.014425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.015137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.015942 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:02.016376 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:02.153240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:02.162725 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-eb21cbe0-5c75-4606-89cb-1e7b0bc282b8 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.161879 Jul 14 16:00:02.163466 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3616/7071] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:01 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:03.180237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.180865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.182952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:03.188792 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.190744 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.190883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.191304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.339026 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:03.347574 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-be0f571a-760f-464e-9acf-d6b1eae4285e tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.171325 Jul 14 16:00:03.348369 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3456/7072] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:04.364938 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.365716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.374528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.375189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.376085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.376613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.515776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.523742 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c07c7335-fb63-41ff-969c-b6f718f1ff35 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.162603 Jul 14 16:00:04.524275 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3617/7073] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:05.542172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.542885 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.550311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.550786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.551804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.552072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.719344 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:05.732030 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cf747cc4-5a75-4b36-8518-4bfc6f7d3926 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.193966 Jul 14 16:00:05.732931 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3457/7074] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:06.754861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.756402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.766389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:06.767925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:06.771904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.772687 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.774103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.774933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.950705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:06.987220 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.994983 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-84e6a9b0-c9b5-4025-ad78-0f8fdf0079a3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.247956 Jul 14 16:00:06.995709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3618/7075] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.031880 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c1da8d03-fe33-4061-8e97-bfa2e42fdd76 req-620da151-b4a6-49bf-9efb-231ef525dcc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:07.041572 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c1da8d03-fe33-4061-8e97-bfa2e42fdd76 req-620da151-b4a6-49bf-9efb-231ef525dcc8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.042042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c1da8d03-fe33-4061-8e97-bfa2e42fdd76 req-620da151-b4a6-49bf-9efb-231ef525dcc8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.054734 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c1da8d03-fe33-4061-8e97-bfa2e42fdd76 req-620da151-b4a6-49bf-9efb-231ef525dcc8 service nova] Creating event network-changed:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:00:07.060298 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c1da8d03-fe33-4061-8e97-bfa2e42fdd76 req-620da151-b4a6-49bf-9efb-231ef525dcc8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120825 Jul 14 16:00:07.061815 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3458/7076] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:08.012551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.013170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.020600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.021135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.021894 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.022326 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.151563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.159954 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-06a906f7-7add-4d3a-8662-ede45604579b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.151449 Jul 14 16:00:08.160538 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3619/7077] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.180431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.181325 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.188237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.188699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.189487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.189935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.323051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.331044 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-845fa599-c5d7-41c3-b76e-970b420d1222 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.156622 Jul 14 16:00:09.331714 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3459/7078] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.348771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.349306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.356555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.357010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.358289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.358726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.492892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.501255 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cd760e2b-3491-4813-8352-813aacc692e9 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.156583 Jul 14 16:00:10.501841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3620/7079] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:11.518951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.519542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.526535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.526999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.527807 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.528262 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.663597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.671235 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3186dfbf-1edc-44b7-b84d-ffcdd1830e52 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.156277 Jul 14 16:00:11.672139 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3460/7080] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.092722 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-fdcec39d-6902-4104-9da6-5a24d13f5511 req-e1852995-ef90-4986-8a1a-848bc38c5dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "name": "network-vif-plugged", "status": "completed", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:12.101090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fdcec39d-6902-4104-9da6-5a24d13f5511 req-e1852995-ef90-4986-8a1a-848bc38c5dfa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.101531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-fdcec39d-6902-4104-9da6-5a24d13f5511 req-e1852995-ef90-4986-8a1a-848bc38c5dfa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.113359 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-fdcec39d-6902-4104-9da6-5a24d13f5511 req-e1852995-ef90-4986-8a1a-848bc38c5dfa service nova] Creating event network-vif-plugged:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:00:12.118276 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-fdcec39d-6902-4104-9da6-5a24d13f5511 req-e1852995-ef90-4986-8a1a-848bc38c5dfa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099456 Jul 14 16:00:12.118876 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3621/7081] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:12.689596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.690208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.697241 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.697698 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.698478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.698918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.834864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.842449 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-90008a2d-e21f-49ac-81d4-fc6530452556 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1358 microversion: 2.1 time: 0.156951 Jul 14 16:00:12.843041 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3461/7082] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:13.861614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.862324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.868681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.869134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.870509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.870979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.000683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.009001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-12866d5b-db20-4c3b-9fa4-138768d67e24 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1549 microversion: 2.1 time: 0.153203 Jul 14 16:00:14.009595 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3622/7083] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:14.024987 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.025635 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.033435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.033904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.034688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.035218 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.164049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.172364 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-281c0c01-32ba-49dc-9eca-45104d40947a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1549 microversion: 2.1 time: 0.151199 Jul 14 16:00:14.172983 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3462/7084] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:14.188299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.191665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.192432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Searching by: {'deleted': False, 'project_id': '960af42bfb4f4b3b942d1956051d8510'} {{(pid=125965) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 16:00:14.197822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.198298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.199095 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.199578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.224756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.multi_cell_list [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125965) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 16:00:14.255989 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fbe92ebe-e03c-48ee-ac2d-927b6d01de0c tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.071491 Jul 14 16:00:14.256487 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3623/7085] 10.222.0.98 () {58 vars in 1124 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:14.266974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.267729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.273977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.274452 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.275242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.275734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.410446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.418057 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dfbf50f4-5e0f-4e3a-b425-5a75bde08196 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1549 microversion: 2.1 time: 0.154993 Jul 14 16:00:14.418640 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3463/7086] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:15.898815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a88e07b-340f-4820-b286-79f68029b700"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:15.899922 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.907752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.908204 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.908979 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.909418 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.171150 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-df685950-d51d-41e7-9759-fc851a6536f0 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276735 Jul 14 16:00:16.171912 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3624/7087] 10.222.0.98 () {60 vars in 1322 bytes} [Thu Jul 14 16:00:15 2022] POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:26.876092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.876741 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.879760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=15 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:26.880504 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=56 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:26.887152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.887656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.888465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.889534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.019542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.027769 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9aefe7cd-4937-431d-af5a-6ac2b57e5a1f tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1595 microversion: 2.1 time: 0.156115 Jul 14 16:00:27.028359 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3464/7088] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:28.629895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-dd605ac4-2a93-478d-b735-50e111355ce3 req-005271e1-906b-4f4d-88c7-31c5f81da3de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:28.634941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:28.641223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=17 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:28.643556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:28.655433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dd605ac4-2a93-478d-b735-50e111355ce3 req-005271e1-906b-4f4d-88c7-31c5f81da3de service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.656440 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-dd605ac4-2a93-478d-b735-50e111355ce3 req-005271e1-906b-4f4d-88c7-31c5f81da3de service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.671375 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-dd605ac4-2a93-478d-b735-50e111355ce3 req-005271e1-906b-4f4d-88c7-31c5f81da3de service nova] Creating event network-changed:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:00:28.678029 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-dd605ac4-2a93-478d-b735-50e111355ce3 req-005271e1-906b-4f4d-88c7-31c5f81da3de service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052126 Jul 14 16:00:28.679222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3625/7089] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:29.664433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-820200986"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:29.665594 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:29.672920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.673389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.674190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.674642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.811663 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.network.security_group_api [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Adding security group 7644e1af-7f9f-4026-b5fe-8dea1cffbb70 to port d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 Jul 14 16:00:30.194732 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0190d92c-5519-4974-b46e-1078e3aa0eb7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/action" status: 202 len: 0 microversion: 2.1 time: 0.534339 Jul 14 16:00:30.195827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3465/7090] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:00:29 2022] POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:30.208726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f11501b3-80e6-447c-b608-49b68a680227 req-a71394e4-3047-43be-8362-1b2eea7d266a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:30.213849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:30.214362 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:30.234840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f11501b3-80e6-447c-b608-49b68a680227 req-a71394e4-3047-43be-8362-1b2eea7d266a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.235324 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f11501b3-80e6-447c-b608-49b68a680227 req-a71394e4-3047-43be-8362-1b2eea7d266a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.238173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.238644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.239511 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.240144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.263782 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f11501b3-80e6-447c-b608-49b68a680227 req-a71394e4-3047-43be-8362-1b2eea7d266a service nova] Creating event network-changed:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:00:30.270142 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f11501b3-80e6-447c-b608-49b68a680227 req-a71394e4-3047-43be-8362-1b2eea7d266a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064934 Jul 14 16:00:30.270768 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3466/7091] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:30.503788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.512694 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e566d9c6-1eb1-4bd5-b36b-187c6dbe9ef4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1759 microversion: 2.1 time: 0.312067 Jul 14 16:00:30.513537 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3626/7092] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:30 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1759 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:49.042270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:49.042961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:49.093107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:49.094147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.100547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.101004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.101783 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.102243 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.178829 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-cc60d52c-a27a-4de3-9d41-c90b41984693 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/action" status: 202 len: 0 microversion: 2.1 time: 0.138494 Jul 14 16:00:49.179723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3467/7093] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:00:49 2022] POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:49.188819 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:49.192928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.200438 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:49.201609 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=8 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:49.203921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.206961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.208642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.209098 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.456347 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:49.464639 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8208d349-2182-4dc5-93ec-c19a7c247959 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1751 microversion: 2.1 time: 0.280938 Jul 14 16:00:49.475357 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3627/7094] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:49 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1751 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:50.483906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:50.484613 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:50.490841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.491329 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.492100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.492642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.639411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:50.647625 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-56800136-1c64-4ec8-9379-58b507cc04d7 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.169309 Jul 14 16:00:50.648212 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3468/7095] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:50 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:51.665770 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:51.666400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:51.673523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.673974 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.674749 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.675186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.819016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:51.828001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0d129fce-471f-494e-953c-8f9ba0a836cd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.166171 Jul 14 16:00:51.828576 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3628/7096] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:51 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:52.845301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:52.845923 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:52.852893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.853349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.854117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.854567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.001514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:53.009805 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f53b316f-cd3d-42d8-9e2c-ceab38f16b84 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.168535 Jul 14 16:00:53.010388 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3469/7097] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:52 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:54.027744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:54.028364 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:54.035530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.035984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.036789 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.037224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.181826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:54.189956 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cc524a77-80c2-40d9-9f33-294b5c3d9a95 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.166140 Jul 14 16:00:54.190549 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3629/7098] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:54 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:55.207529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:55.208208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:55.215095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.215599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.216920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.217238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.361215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:55.369563 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3276cf62-0eda-4e23-9e4e-e9eda61cc014 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.166000 Jul 14 16:00:55.370161 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3470/7099] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:55 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:56.387059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:56.387703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:56.394829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.395288 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.396074 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.396533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.540500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:56.548481 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3d8b06af-635b-498e-9e7f-18aab7685f17 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.165437 Jul 14 16:00:56.549070 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3630/7100] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:56 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:57.566127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:57.566681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:57.573595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.574063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.574838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.575306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.721190 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:57.729537 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b2693c6d-8acd-4b83-8d5b-37aa36896083 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.167398 Jul 14 16:00:57.730120 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3471/7101] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:57 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:58.747762 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:58.748387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:58.755782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.756230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.756995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.757429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.901237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:58.910076 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3e083631-dbeb-434b-9353-4451280383fd tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.166238 Jul 14 16:00:58.910654 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3631/7102] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:58 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:59.926490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:59.927144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:59.934196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.934659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.935522 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.935975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.082417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:00.091508 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-097595e8-c4d6-4d2c-a1ec-5a1c597bb1ed tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1756 microversion: 2.1 time: 0.168405 Jul 14 16:01:00.092104 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3472/7103] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:59 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:01.109384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:01.110005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:01.117400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.117849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.118619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.119057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.267294 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:01.275350 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c609f7a6-8df0-401c-992d-bab02242e736 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1759 microversion: 2.1 time: 0.170414 Jul 14 16:01:01.275940 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3632/7104] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:01 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1759 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:33.605584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-820200986"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:33.606763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.608984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:33.609694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:33.616436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.616955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.617813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.618270 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.774298 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.network.security_group_api [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Removing security group 7644e1af-7f9f-4026-b5fe-8dea1cffbb70 from port d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 Jul 14 16:01:34.161335 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1c46163-aa3b-49b4-a932-378f783ebf26 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/action" status: 202 len: 0 microversion: 2.1 time: 0.559827 Jul 14 16:01:34.171827 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3473/7105] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:01:33 2022] POST /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:01:34.176007 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-53ed7c90-792e-4b4c-8c19-9f40f117d514 req-ebd5a08e-f902-47fb-b939-38df0b1cb006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:34.186716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=12 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:34.188279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=36 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:34.206003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-53ed7c90-792e-4b4c-8c19-9f40f117d514 req-ebd5a08e-f902-47fb-b939-38df0b1cb006 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.206744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-53ed7c90-792e-4b4c-8c19-9f40f117d514 req-ebd5a08e-f902-47fb-b939-38df0b1cb006 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.231945 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-53ed7c90-792e-4b4c-8c19-9f40f117d514 req-ebd5a08e-f902-47fb-b939-38df0b1cb006 service nova] Creating event network-changed:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:01:34.241572 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-53ed7c90-792e-4b4c-8c19-9f40f117d514 req-ebd5a08e-f902-47fb-b939-38df0b1cb006 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076614 Jul 14 16:01:34.247727 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3633/7106] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:35.584998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.585887 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.594591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.595306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.596651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.597370 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.707366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lazy-loading 'services' on Instance uuid f4c56a82-5305-4bf2-a70f-166ebe0f1216 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:01:35.789336 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4861cb60-e65e-4c72-bb91-095d7591a86a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments/0a88e07b-340f-4820-b286-79f68029b700" status: 202 len: 0 microversion: 2.1 time: 0.208906 Jul 14 16:01:35.789918 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3474/7107] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 16:01:35 2022] DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments/0a88e07b-340f-4820-b286-79f68029b700 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:01:35.801554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.801554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.821028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.822130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.822959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.823414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.856832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bc4a8b4f-52e5-479c-88ab-e171db555e3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061799 Jul 14 16:01:35.857457 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3634/7108] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:36.259967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-0330d71e-5e62-4176-ae2f-507b6c9e475c req-95b80d6a-a74c-4a44-919f-090ba62bf4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:36.269869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0330d71e-5e62-4176-ae2f-507b6c9e475c req-95b80d6a-a74c-4a44-919f-090ba62bf4c7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.270398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-0330d71e-5e62-4176-ae2f-507b6c9e475c req-95b80d6a-a74c-4a44-919f-090ba62bf4c7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.283512 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-0330d71e-5e62-4176-ae2f-507b6c9e475c req-95b80d6a-a74c-4a44-919f-090ba62bf4c7 service nova] Creating event network-changed:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:01:36.288834 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-0330d71e-5e62-4176-ae2f-507b6c9e475c req-95b80d6a-a74c-4a44-919f-090ba62bf4c7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Jul 14 16:01:36.289571 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3475/7109] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:36.870392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.872525 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.879734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.880057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.880841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.881282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.914367 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e8f8a621-5775-4ca9-986b-4241757e02c4 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047908 Jul 14 16:01:36.914965 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3635/7110] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:37.928168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.929434 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.936440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.936904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.937724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.938173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.972988 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-938e99e4-268a-4811-a529-f27cae525593 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049971 Jul 14 16:01:37.973628 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3476/7111] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:38.986304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.987582 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.995980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.996429 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.997692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.998133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.030112 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-912c6714-74d6-42dd-a091-cbf16303418b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049032 Jul 14 16:01:39.030705 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3636/7112] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:40.042403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.043475 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.050302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.050758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.051552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.051997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.081025 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-36c7ac97-6b55-4875-a171-7f2dcc393cf3 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042635 Jul 14 16:01:40.081514 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3477/7113] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:41.092988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.093908 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.100815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.101268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.102038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.102474 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.131541 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9220a23d-ce3b-4231-95f8-db614e25de3a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042493 Jul 14 16:01:41.132110 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3637/7114] 10.222.0.98 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:01:41.141974 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.142505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.149440 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.149899 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.150670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.151118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.226096 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] HTTP exception thrown: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 is not attached to volume 0a88e07b-340f-4820-b286-79f68029b700 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Request method failure captured: Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: request: DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments/0a88e07b-340f-4820-b286-79f68029b700 HTTP/1.1 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dx9Y1HZzqsxz56Lf6UilO0lX5Bne-abd6nRegnw-zNBLYD3o42prZ41arDCLFrbZhrf1O55P0F2w-EJGqnDQEgBY-lSapRqe17E-ouiievozUlF6HdM9B-Pfi5LX1OelvVNB0agmAjXV50l6Zk584vO_uZ-pt7XxGOxEMR68OZ8pLA Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestMinimumBasicScenario-1508434070 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 80098f23a80f47f59060eed03bdb3290 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 is not attached to volume 0a88e07b-340f-4820-b286-79f68029b700 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'server_id': 'f4c56a82-5305-4bf2-a70f-166ebe0f1216', 'id': '0a88e07b-340f-4820-b286-79f68029b700'} Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0a88e07b-340f-4820-b286-79f68029b700. Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 is not attached to volume 0a88e07b-340f-4820-b286-79f68029b700 Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:41.227766 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 is not attached to volume 0a88e07b-340f-4820-b286-79f68029b700 Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Returning 404 to user: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 is not attached to volume 0a88e07b-340f-4820-b286-79f68029b700 {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af0ace92-24f0-4e76-82c2-4a98368729dc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments/0a88e07b-340f-4820-b286-79f68029b700" status: 404 len: 154 microversion: 2.1 time: 0.091302 Jul 14 16:01:41.232866 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3478/7115] 10.222.0.98 () {58 vars in 1415 bytes} [Thu Jul 14 16:01:41 2022] DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216/os-volume_attachments/0a88e07b-340f-4820-b286-79f68029b700 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:44.471000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.471543 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.478884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.479354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.480116 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.480542 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.508237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:01:44.588057 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-275dd877-e936-42cf-8edb-1c6ec32aec8b tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 204 len: 0 microversion: 2.1 time: 0.120464 Jul 14 16:01:44.588688 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3638/7116] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:01:44 2022] DELETE /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:01:44.597602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.598242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.608152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.608615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.609411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.609866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.746221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.754978 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da8ada16-849c-45b1-b8c6-78d7af14f8bc tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1555 microversion: 2.1 time: 0.161463 Jul 14 16:01:44.756410 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3479/7117] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:45.773535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.774242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.782112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.782561 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.783356 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.783797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.919674 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.927338 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53973b51-287c-4554-9f72-5a2b1b1bb589 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1555 microversion: 2.1 time: 0.158141 Jul 14 16:01:45.927925 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3639/7118] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:46.948133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:46.949319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:46.962535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.963508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.965253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.965785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.037315 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80098f23a80f47f59060eed03bdb3290', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '960af42bfb4f4b3b942d1956051d8510', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.048475 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1d70f37e-9836-4174-bb4b-582045e8192d tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 200 len: 1513 microversion: 2.1 time: 0.107435 Jul 14 16:01:47.049083 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3480/7119] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:46 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 1513 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:47.083911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-781f8f85-909e-4b85-b7e5-9c7bff51d955 req-c2d2b7a0-953c-4b14-a9c7-f024b4e58c1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c56a82-5305-4bf2-a70f-166ebe0f1216", "name": "network-vif-deleted", "tag": "d1e61cac-5de7-4ad3-8c9e-355c2ca4c361"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:47.092743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-781f8f85-909e-4b85-b7e5-9c7bff51d955 req-c2d2b7a0-953c-4b14-a9c7-f024b4e58c1d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.093187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-781f8f85-909e-4b85-b7e5-9c7bff51d955 req-c2d2b7a0-953c-4b14-a9c7-f024b4e58c1d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.104583 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-781f8f85-909e-4b85-b7e5-9c7bff51d955 req-c2d2b7a0-953c-4b14-a9c7-f024b4e58c1d service nova] Creating event network-vif-deleted:d1e61cac-5de7-4ad3-8c9e-355c2ca4c361 for instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 on n-h1-768852-23 Jul 14 16:01:47.109973 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-781f8f85-909e-4b85-b7e5-9c7bff51d955 req-c2d2b7a0-953c-4b14-a9c7-f024b4e58c1d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030033 Jul 14 16:01:47.110585 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3640/7120] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:48.066034 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.066654 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] [instance: f4c56a82-5305-4bf2-a70f-166ebe0f1216] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.073808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.074205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.075631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.076077 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.089252 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] HTTP exception thrown: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 could not be found. Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Request method failure captured: Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 HTTP/1.1 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0Dx9Y1HZzqsxz56Lf6UilO0lX5Bne-abd6nRegnw-zNBLYD3o42prZ41arDCLFrbZhrf1O55P0F2w-EJGqnDQEgBY-lSapRqe17E-ouiievozUlF6HdM9B-Pfi5LX1OelvVNB0agmAjXV50l6Zk584vO_uZ-pt7XxGOxEMR68OZ8pLA Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/960af42bfb4f4b3b942d1956051d8510"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestMinimumBasicScenario-1508434070 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 960af42bfb4f4b3b942d1956051d8510 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1508434070 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: 80098f23a80f47f59060eed03bdb3290 Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestMinimumBasicScenario-1508434070-project Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 could not be found. Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'f4c56a82-5305-4bf2-a70f-166ebe0f1216'} Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 could not be found. Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 could not be found. Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:01:48.090795 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 could not be found. Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Returning 404 to user: Instance f4c56a82-5305-4bf2-a70f-166ebe0f1216 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1678e389-0964-47df-ac37-1a78ccdb83c5 tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216" status: 404 len: 111 microversion: 2.1 time: 0.030193 Jul 14 16:01:48.095379 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3481/7121] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/f4c56a82-5305-4bf2-a70f-166ebe0f1216 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:01:48.102486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cc3ca5e-778f-44cd-9755-8181f494ad4a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] Calling method '.version_select at 0x7fdbf2b879d0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.121052 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cc3ca5e-778f-44cd-9755-8181f494ad4a tempest-TestMinimumBasicScenario-1508434070 tempest-TestMinimumBasicScenario-1508434070-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1696234991" status: 202 len: 0 microversion: 2.1 time: 0.023449 Jul 14 16:01:48.122158 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3641/7122] 10.222.0.98 () {58 vars in 1271 bytes} [Thu Jul 14 16:01:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1696234991 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:01:51.722054 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:01:51.722531 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:01:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:01:57.781751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b4f38a4-3c09-4130-9afd-14adb1749118 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: .version_select at 0x7fdbf1f8b9d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-285126580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEm1p2qK/rT3iQ81K9X/RG7n5dW9E17aIZmCa3zXGmvqtC9zjlQfq4p0Vw7DRDtX1wR8NjEyGMNPNbT/xK85r0WGe4O3LGqrpTQXOUSWw2413NyX4wlbgP/HVQRfVdSEeg=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:57.799704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6b4f38a4-3c09-4130-9afd-14adb1749118 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:01:57.804802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6b4f38a4-3c09-4130-9afd-14adb1749118 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:01:57.829874 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b4f38a4-3c09-4130-9afd-14adb1749118 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.218244 Jul 14 16:01:57.830426 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3482/7123] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:01:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:03.286919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:03.287716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:03.293329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-227371933", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "2a6484e5-70d3-47ba-bc63-78e61c3455af"}], "key_name": "tempest-TestNetworkAdvancedServerOps-285126580", "security_groups": [{"name": "tempest-secgroup-smoke-1027762081"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:03.419996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] validate_networks() for [('2a6484e5-70d3-47ba-bc63-78e61c3455af', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:02:04.337027 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:02:04.337726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:02:04.338482 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:02:04.339003 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:02:04.339588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:02:04.356523 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.357228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.358225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.358658 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.380796 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:02:04.391615 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:02:04.407744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:02:04.410159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:02:04.465719 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b3bf9542-3f01-45f2-b2e2-92132f3e6bd5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.180641 Jul 14 16:02:04.474112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:04.483518 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3642/7124] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:02:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:02:04.485876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6554f7d1-74c4-40eb-94a2-e5d12c2fd790 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:04.487538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6554f7d1-74c4-40eb-94a2-e5d12c2fd790 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:04.494019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:04.564694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6554f7d1-74c4-40eb-94a2-e5d12c2fd790 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:04.572452 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6554f7d1-74c4-40eb-94a2-e5d12c2fd790 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1265 microversion: 2.1 time: 0.099060 Jul 14 16:02:04.573050 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3483/7125] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:04 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:05.590752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee2c88c7-69ab-47b3-a7a2-2d6cea795714 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:05.591384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee2c88c7-69ab-47b3-a7a2-2d6cea795714 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:05.662489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee2c88c7-69ab-47b3-a7a2-2d6cea795714 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:05.669867 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee2c88c7-69ab-47b3-a7a2-2d6cea795714 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1265 microversion: 2.1 time: 0.083565 Jul 14 16:02:05.670734 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3643/7126] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:05 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:06.687877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-79fea5ef-e40e-4830-a3dc-cc0d4b7f233e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:06.688490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-79fea5ef-e40e-4830-a3dc-cc0d4b7f233e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:06.744638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-79fea5ef-e40e-4830-a3dc-cc0d4b7f233e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.751549 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-79fea5ef-e40e-4830-a3dc-cc0d4b7f233e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1265 microversion: 2.1 time: 0.067634 Jul 14 16:02:06.752131 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3484/7127] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:06 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1265 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:07.769286 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7b9793c2-3e79-4fa9-b74f-f22ca8f5f7f2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:07.770175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7b9793c2-3e79-4fa9-b74f-f22ca8f5f7f2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:07.822739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7b9793c2-3e79-4fa9-b74f-f22ca8f5f7f2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.830410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7b9793c2-3e79-4fa9-b74f-f22ca8f5f7f2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1265 microversion: 2.1 time: 0.064995 Jul 14 16:02:07.830973 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3644/7128] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:07 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1265 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:08.847570 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.848143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:08.855931 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.856405 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.857186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.857642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.920095 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.927623 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a26d1c8c-c9b6-4a84-9364-1f45eddf3e2b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1269 microversion: 2.1 time: 0.084053 Jul 14 16:02:08.928197 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3485/7129] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1269 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.944839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.945450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:09.953337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.953783 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.954548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.954982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.018939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:10.027043 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b2575bb2-28cc-4fd1-ac73-0c7a3ea4933a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1323 microversion: 2.1 time: 0.085835 Jul 14 16:02:10.027734 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3645/7130] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1323 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:11.045569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:11.046338 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:11.055233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.056139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.057048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.057727 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.243503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-27cb498e-bfcf-4aa7-8ae3-6fec7eda3d15 req-10115c0f-0ce3-406b-9179-d9b51f534ec2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6710174f-ebc2-4263-b87d-bb8ab71fed31", "tag": "d6da87eb-9b54-40aa-a72d-58a3c74f20bd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:11.253333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-27cb498e-bfcf-4aa7-8ae3-6fec7eda3d15 req-10115c0f-0ce3-406b-9179-d9b51f534ec2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.253798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-27cb498e-bfcf-4aa7-8ae3-6fec7eda3d15 req-10115c0f-0ce3-406b-9179-d9b51f534ec2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.272876 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-27cb498e-bfcf-4aa7-8ae3-6fec7eda3d15 req-10115c0f-0ce3-406b-9179-d9b51f534ec2 service nova] Creating event network-changed:d6da87eb-9b54-40aa-a72d-58a3c74f20bd for instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 on n-h2-768852-23 Jul 14 16:02:11.278346 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-27cb498e-bfcf-4aa7-8ae3-6fec7eda3d15 req-10115c0f-0ce3-406b-9179-d9b51f534ec2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040988 Jul 14 16:02:11.280003 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3646/7131] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:11.349718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:11.359553 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a4f2532b-32ea-428c-8be8-930ef5e6c6e1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1391 microversion: 2.1 time: 0.317980 Jul 14 16:02:11.360328 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3486/7132] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:11 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1391 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:12.377835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:12.378567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:12.384916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.385358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.386106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.387102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.522167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.530343 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c1f302ee-8ae7-44af-b46b-386ecc3b7d26 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1391 microversion: 2.1 time: 0.157499 Jul 14 16:02:12.531199 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3647/7133] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:12 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:13.549529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:13.550226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.557524 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.557986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.559320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.559732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.693760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:13.701979 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-60a3bc69-1a5a-443d-a9f2-fa298692a28b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1391 microversion: 2.1 time: 0.158245 Jul 14 16:02:13.702591 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3487/7134] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:13 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:14.719951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:14.720565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:14.723057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:14.729029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.729471 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.730234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.730666 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.869989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:14.878111 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a6a206a3-7ba9-4505-a7b2-2743a989a8cd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1391 microversion: 2.1 time: 0.162251 Jul 14 16:02:14.878692 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3648/7135] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:14 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:15.895825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:15.896648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.903706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.904236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.905028 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.905479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.054838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.057711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6b729804-784c-45ed-b68e-1de57b8e01df req-f44f55af-28c6-4f2e-a775-e9f99e589520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6710174f-ebc2-4263-b87d-bb8ab71fed31", "name": "network-vif-plugged", "status": "completed", "tag": "d6da87eb-9b54-40aa-a72d-58a3c74f20bd"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:16.065118 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93f3dc35-9cce-4d31-aa79-67839cc08eb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1391 microversion: 2.1 time: 0.172988 Jul 14 16:02:16.069114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6b729804-784c-45ed-b68e-1de57b8e01df req-f44f55af-28c6-4f2e-a775-e9f99e589520 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.069567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6b729804-784c-45ed-b68e-1de57b8e01df req-f44f55af-28c6-4f2e-a775-e9f99e589520 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.075667 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3488/7136] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:15 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1391 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:16.082495 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6b729804-784c-45ed-b68e-1de57b8e01df req-f44f55af-28c6-4f2e-a775-e9f99e589520 service nova] Creating event network-vif-plugged:d6da87eb-9b54-40aa-a72d-58a3c74f20bd for instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 on n-h2-768852-23 Jul 14 16:02:16.088454 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6b729804-784c-45ed-b68e-1de57b8e01df req-f44f55af-28c6-4f2e-a775-e9f99e589520 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034876 Jul 14 16:02:16.089422 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3649/7137] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:17.083221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:17.083797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:17.085670 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=8 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:17.091983 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.092453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.093291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.093728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.228996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:17.237448 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fa014302-30b7-453d-b61c-ba43205bacbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1391 microversion: 2.1 time: 0.158469 Jul 14 16:02:17.238045 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3489/7138] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:17 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:18.252261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=10 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:18.257500 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:18.258433 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:18.267327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.268151 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.269233 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.270298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.414239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.422493 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-15106f26-1b91-4796-9973-d3c9744daaa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1563 microversion: 2.1 time: 0.172143 Jul 14 16:02:18.423164 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3650/7139] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1563 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:18.439729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:18.440396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:18.447844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.448296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.449087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.449531 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.593840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.602094 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8e32883a-dfbb-47bf-9826-ef5dc841de4b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1563 microversion: 2.1 time: 0.167022 Jul 14 16:02:18.602937 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3490/7140] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:20.337423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.338067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.344196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-256b6b9e-50ec-43e7-b0db-49352011f3bb req-2b0e0a5b-1c3e-4493-be41-486beecb329a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6710174f-ebc2-4263-b87d-bb8ab71fed31", "tag": "d6da87eb-9b54-40aa-a72d-58a3c74f20bd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:20.354214 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-256b6b9e-50ec-43e7-b0db-49352011f3bb req-2b0e0a5b-1c3e-4493-be41-486beecb329a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.355135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.355406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-256b6b9e-50ec-43e7-b0db-49352011f3bb req-2b0e0a5b-1c3e-4493-be41-486beecb329a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.356021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.356790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.357390 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.367835 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-256b6b9e-50ec-43e7-b0db-49352011f3bb req-2b0e0a5b-1c3e-4493-be41-486beecb329a service nova] Creating event network-changed:d6da87eb-9b54-40aa-a72d-58a3c74f20bd for instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 on n-h2-768852-23 Jul 14 16:02:20.373974 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-256b6b9e-50ec-43e7-b0db-49352011f3bb req-2b0e0a5b-1c3e-4493-be41-486beecb329a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033330 Jul 14 16:02:20.374697 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3491/7141] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:20.503304 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.511221 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f2afc0fb-675d-4220-a878-09c13fd810c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1563 microversion: 2.1 time: 0.177739 Jul 14 16:02:20.512495 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3651/7142] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:43.760494 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=21 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:43.761802 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=38 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:43.766127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:43.767145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:43.774160 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.774622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.775437 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.775888 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.843531 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d6867334-255e-4936-8cb1-308becd2f229 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action" status: 200 len: 24567 microversion: 2.1 time: 0.084844 Jul 14 16:02:43.844431 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3492/7143] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:43 2022] POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action => generated 24567 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:02:50.324174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:50.324755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:50.327019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:50.327733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=36 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:50.334757 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.335219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.336042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.336538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.408235 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-cddf9556-4a09-48e6-9c54-6620f37aef7f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action" status: 202 len: 0 microversion: 2.1 time: 0.088188 Jul 14 16:02:50.408895 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3652/7144] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:50 2022] POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:02:50.419200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:50.420118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:50.428600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.429064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.429873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.430326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.563679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:50.571673 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c86460e-e5cf-4e19-a17b-2a9c15935c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1686 microversion: 2.1 time: 0.158145 Jul 14 16:02:50.572244 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3493/7145] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:50 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1686 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:51.591732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:51.592354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:51.598750 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.599243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.599978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.600410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.754741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:51.763322 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6c6721d4-18fa-4710-91e6-f49d795b6638 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1666 microversion: 2.1 time: 0.177481 Jul 14 16:02:51.763882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3653/7146] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:51 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1666 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:52.850298 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:52.851229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:52.859688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.860161 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.860929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.861379 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.922354 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ce1c3ba9-4298-4d9a-86bc-c9fa1b1fd5a0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action" status: 200 len: 32640 microversion: 2.1 time: 0.075897 Jul 14 16:02:52.923073 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3494/7147] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:52 2022] POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action => generated 32640 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:02:52.934506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:52.935062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:52.942234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.942681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.943481 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.943917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.012393 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ff3bd5f-5f4b-4de8-b0db-f4b20d37ec6f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action" status: 202 len: 0 microversion: 2.1 time: 0.082128 Jul 14 16:02:53.016256 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3654/7148] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:52 2022] POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:02:53.021770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:53.022623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:53.029573 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.029997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.031126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.031629 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.175853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:53.187255 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a2b370e9-1cab-4243-bebc-46ff21043a14 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1673 microversion: 2.1 time: 0.169741 Jul 14 16:02:53.187883 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3495/7149] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:53 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1673 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:54.206881 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:54.207618 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:54.214112 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.214555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.215340 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.215776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.349507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:54.358707 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-af721ba6-9b68-4301-9a27-6af61b68e77d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1681 microversion: 2.1 time: 0.156884 Jul 14 16:02:54.359332 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3655/7150] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:54 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:54.455708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:54.456650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:54.464687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.465096 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.465879 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.466331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.521960 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e6bdef92-bf62-4988-8b60-85ab0a21a154 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action" status: 200 len: 35973 microversion: 2.1 time: 0.070091 Jul 14 16:02:54.522641 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3496/7151] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:02:54 2022] POST /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31/action => generated 35973 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:02:55.560699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:55.561231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:55.562984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-29a3ca94-7d31-4461-867c-151ad862f1e9 req-2b9fac54-95a5-485b-83c6-46c095195fe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6710174f-ebc2-4263-b87d-bb8ab71fed31", "tag": "d6da87eb-9b54-40aa-a72d-58a3c74f20bd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:55.568412 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.569148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.569919 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.570352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.572738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-29a3ca94-7d31-4461-867c-151ad862f1e9 req-2b9fac54-95a5-485b-83c6-46c095195fe4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.573407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-29a3ca94-7d31-4461-867c-151ad862f1e9 req-2b9fac54-95a5-485b-83c6-46c095195fe4 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.587633 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-29a3ca94-7d31-4461-867c-151ad862f1e9 req-2b9fac54-95a5-485b-83c6-46c095195fe4 service nova] Creating event network-changed:d6da87eb-9b54-40aa-a72d-58a3c74f20bd for instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 on n-h2-768852-23 Jul 14 16:02:55.593763 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-29a3ca94-7d31-4461-867c-151ad862f1e9 req-2b9fac54-95a5-485b-83c6-46c095195fe4 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034966 Jul 14 16:02:55.594386 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3497/7152] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:55.597710 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:02:55.682368 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e721d0b7-bced-4d0f-b6e3-c2213037fda4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 204 len: 0 microversion: 2.1 time: 0.125626 Jul 14 16:02:55.683460 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3656/7153] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:02:55 2022] DELETE /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:02:55.692869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:55.693602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:55.702915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.703760 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.705515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.705993 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.844454 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:55.852219 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-683a3991-b3fe-4d79-b79a-5edbd3af3fcd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1687 microversion: 2.1 time: 0.164357 Jul 14 16:02:55.852809 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3498/7154] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:55 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:56.871250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:56.871985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:56.878831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.879298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.880059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.880491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.020530 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:57.028711 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4b25194d-6297-443b-9a86-08cc43886262 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1687 microversion: 2.1 time: 0.162375 Jul 14 16:02:57.029286 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3657/7155] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:56 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:57.984502 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-c8a44a9f-3be0-4bd3-bddc-f601c97b8a25 req-cdd9b59b-c273-4b79-a7f5-0bf761723bf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6710174f-ebc2-4263-b87d-bb8ab71fed31", "name": "network-vif-deleted", "tag": "d6da87eb-9b54-40aa-a72d-58a3c74f20bd"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:02:57.993641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c8a44a9f-3be0-4bd3-bddc-f601c97b8a25 req-cdd9b59b-c273-4b79-a7f5-0bf761723bf9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.994100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-c8a44a9f-3be0-4bd3-bddc-f601c97b8a25 req-cdd9b59b-c273-4b79-a7f5-0bf761723bf9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.007386 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-c8a44a9f-3be0-4bd3-bddc-f601c97b8a25 req-cdd9b59b-c273-4b79-a7f5-0bf761723bf9 service nova] Creating event network-vif-deleted:d6da87eb-9b54-40aa-a72d-58a3c74f20bd for instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 on n-h2-768852-23 Jul 14 16:02:58.012564 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-c8a44a9f-3be0-4bd3-bddc-f601c97b8a25 req-cdd9b59b-c273-4b79-a7f5-0bf761723bf9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031707 Jul 14 16:02:58.013173 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3499/7156] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:58.046826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:58.047452 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:58.054865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.055345 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.056118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.056550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.121425 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:58.129107 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e520871f-ee00-4d22-8e49-1606a1a8717b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 200 len: 1350 microversion: 2.1 time: 0.086185 Jul 14 16:02:58.129977 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3658/7157] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:58 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 1350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:59.149219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:59.149924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 6710174f-ebc2-4263-b87d-bb8ab71fed31] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:59.157175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.157633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.158408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.158861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.172947 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] HTTP exception thrown: Instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 could not be found. Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Request method failure captured: Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 HTTP/1.1 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0D310oNQIZeJyEh4Bj2AFJsRKHR0-TVb1L0on-RjiHb-_pDiQ0JZb2e-fY2kKUvQhjZQnQ-NxlYt7x1LFBc5mddSAosoXPGbgYKE4J1aXVFB0MxSPsEYei0nxckWxS0UZcbMu28noCp6iHH4dmRFroK4-EikkYpZqD0qOWJfjh-RApM Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95573e51cb7549d99419265725c74af4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95573e51cb7549d99419265725c74af4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: aa8dea9b55bf4b5eb4fc0572b936f5b0 Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 could not be found. Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '6710174f-ebc2-4263-b87d-bb8ab71fed31'} Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 could not be found. Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 could not be found. Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:02:59.174598 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 could not be found. Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Returning 404 to user: Instance 6710174f-ebc2-4263-b87d-bb8ab71fed31 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-26f11290-1cdd-4561-9818-c5064a244485 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31" status: 404 len: 111 microversion: 2.1 time: 0.032148 Jul 14 16:02:59.179562 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3500/7158] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:59 2022] GET /compute/v2.1/servers/6710174f-ebc2-4263-b87d-bb8ab71fed31 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:03:02.533607 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3ef709cd-3982-4b8e-b350-99bb0c19039a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '.version_select at 0x7fdbf1e741f0>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:02.558067 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3ef709cd-3982-4b8e-b350-99bb0c19039a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-285126580" status: 202 len: 0 microversion: 2.1 time: 0.028912 Jul 14 16:03:02.558920 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3659/7159] 10.222.0.98 () {58 vars in 1280 bytes} [Thu Jul 14 16:03:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-285126580 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:02.586271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-568c19b7-5dec-4a8d-9646-5b210982eecb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: .version_select at 0x7fdbf2ba1af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-175273999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOyW8InqiMoFbFjPCju3bxn7x+CgXAVr2MH9MWpk0TY46dSQUVFq74dy84H3GSWRnsaxw0ucZ+tY5eZJ4Dp8T4JjbFI3Mc/fzPBwjk3oG9HDcFFBiFhbl3E+NEnUTfargg=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:02.601636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-568c19b7-5dec-4a8d-9646-5b210982eecb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:03:02.606875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-568c19b7-5dec-4a8d-9646-5b210982eecb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:03:02.634236 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-568c19b7-5dec-4a8d-9646-5b210982eecb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051958 Jul 14 16:03:02.634846 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3501/7160] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:03:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:07.903303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1030219164", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "1b66da32-7fe8-4423-99be-7e122ccb499a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-175273999", "security_groups": [{"name": "tempest-secgroup-smoke-332705849"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:08.071916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] validate_networks() for [('1b66da32-7fe8-4423-99be-7e122ccb499a', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:03:08.126923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:08.840739 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:03:08.841402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:03:08.841884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:03:08.842317 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:03:08.842735 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:03:08.852555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.853124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.854186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.854706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.872787 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:03:08.878273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:03:08.891793 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:03:08.894092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:03:08.942844 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcdad1c2-5d22-49f4-a652-5302d212e182 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.044988 Jul 14 16:03:08.949634 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3660/7161] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:03:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 1049 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:03:08.954657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8700313-9fcd-4e72-9df0-3800b61fa865 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:08.955458 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8700313-9fcd-4e72-9df0-3800b61fa865 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.016733 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8700313-9fcd-4e72-9df0-3800b61fa865 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:09.023630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8700313-9fcd-4e72-9df0-3800b61fa865 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1266 microversion: 2.1 time: 0.072869 Jul 14 16:03:09.024752 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3502/7162] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:08 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1266 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:10.041265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:10.042392 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:10.051239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.052008 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.052977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.053409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.126792 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:10.138816 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fbf30bd6-d224-4720-82bf-255cb64eaf15 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1318 microversion: 2.1 time: 0.101435 Jul 14 16:03:10.139617 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3661/7163] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:10 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1318 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:11.156825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.157448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.159486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=36 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:11.167144 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.167876 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.168849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.169330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.325066 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:11.333041 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cb7dee2-cfb8-41d4-adf2-598e3f447473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.180272 Jul 14 16:03:11.334048 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3503/7164] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:11.682988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1a2e5083-4c6e-4db0-aa04-66882f8c9502 req-9bae35e8-7651-4241-89a5-bc8359f9d011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12b6862-1c7d-4faf-9829-6bdd7534470c", "tag": "e94e6b85-776f-4ee6-a72f-82a76c620f83"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:11.698642 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1a2e5083-4c6e-4db0-aa04-66882f8c9502 req-9bae35e8-7651-4241-89a5-bc8359f9d011 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.699996 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1a2e5083-4c6e-4db0-aa04-66882f8c9502 req-9bae35e8-7651-4241-89a5-bc8359f9d011 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.712658 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1a2e5083-4c6e-4db0-aa04-66882f8c9502 req-9bae35e8-7651-4241-89a5-bc8359f9d011 service nova] Creating event network-changed:e94e6b85-776f-4ee6-a72f-82a76c620f83 for instance b12b6862-1c7d-4faf-9829-6bdd7534470c on n-h1-768852-23 Jul 14 16:03:11.719896 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1a2e5083-4c6e-4db0-aa04-66882f8c9502 req-9bae35e8-7651-4241-89a5-bc8359f9d011 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040877 Jul 14 16:03:11.720526 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3662/7165] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:12.351037 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.351740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.360178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.360651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.361509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.362011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.502172 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:12.509601 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a229d57-a00a-411f-afb9-391a34c6caa0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.162544 Jul 14 16:03:12.510175 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3504/7166] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:13.527779 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.528475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.534939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.535423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.536187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.536614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.685494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:13.693142 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7be4af7d-fff2-4cb7-8d23-9ca0dde2dede tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.170514 Jul 14 16:03:13.693726 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3663/7167] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:14.710982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:14.711663 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:14.714341 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:14.719988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.720447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.721225 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.721672 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.861810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:14.876144 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9d4a29a6-e9cd-4416-9406-986296cdb518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.169065 Jul 14 16:03:14.877223 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3505/7168] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:14 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:15.894049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.894665 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.901925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.902377 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.903138 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.903610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.042223 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:16.050012 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-94cd5a53-d7d7-4c62-81ee-25f8726970b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.159914 Jul 14 16:03:16.050605 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3664/7169] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:16.946056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-041508ae-6de0-48fc-a5f2-984125cca203 req-3997ca13-3c08-4c3e-bf38-bafe201b7d6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12b6862-1c7d-4faf-9829-6bdd7534470c", "name": "network-vif-plugged", "status": "completed", "tag": "e94e6b85-776f-4ee6-a72f-82a76c620f83"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:16.955155 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-041508ae-6de0-48fc-a5f2-984125cca203 req-3997ca13-3c08-4c3e-bf38-bafe201b7d6a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.955728 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-041508ae-6de0-48fc-a5f2-984125cca203 req-3997ca13-3c08-4c3e-bf38-bafe201b7d6a service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.969941 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-041508ae-6de0-48fc-a5f2-984125cca203 req-3997ca13-3c08-4c3e-bf38-bafe201b7d6a service nova] Creating event network-vif-plugged:e94e6b85-776f-4ee6-a72f-82a76c620f83 for instance b12b6862-1c7d-4faf-9829-6bdd7534470c on n-h1-768852-23 Jul 14 16:03:16.975080 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-041508ae-6de0-48fc-a5f2-984125cca203 req-3997ca13-3c08-4c3e-bf38-bafe201b7d6a service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032817 Jul 14 16:03:16.975788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3506/7170] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:17.067107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.067742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.074466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.074907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.075711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.076145 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.247872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:17.255585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-edf816a2-9380-4a9b-9995-6f9ede3bfc2f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.192358 Jul 14 16:03:17.256162 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3665/7171] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:18.274389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.275123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:18.281767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.282228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.282988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.283460 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.423648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:18.432019 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b359eb9-b7ef-4686-b369-9ae670bf143b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1391 microversion: 2.1 time: 0.162639 Jul 14 16:03:18.433315 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3507/7172] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:18 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:19.450300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.450906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.453662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:19.454349 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:19.460389 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.460831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.461587 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.462019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.597135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:19.605816 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ad166767-f161-4586-8faa-d519ce9f9619 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1564 microversion: 2.1 time: 0.159643 Jul 14 16:03:19.606623 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3666/7173] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:19 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:19.622669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.624167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.627362 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:19.634170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.634649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.635509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.635967 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.780668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:19.788659 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05cd7aea-92cc-4eea-ba82-b513e20f74c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1564 microversion: 2.1 time: 0.170320 Jul 14 16:03:19.789314 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3508/7174] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:19 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1564 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:21.406177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.407381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.408951 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-ffdc87c4-03ea-42b5-b07b-5d68249feaa5 req-bd376d2f-e43e-45bd-be1e-8f20c116b0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12b6862-1c7d-4faf-9829-6bdd7534470c", "tag": "e94e6b85-776f-4ee6-a72f-82a76c620f83"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:21.411798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:21.417099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.417832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.418833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.419367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.420295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ffdc87c4-03ea-42b5-b07b-5d68249feaa5 req-bd376d2f-e43e-45bd-be1e-8f20c116b0c0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.421407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-ffdc87c4-03ea-42b5-b07b-5d68249feaa5 req-bd376d2f-e43e-45bd-be1e-8f20c116b0c0 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.436307 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-ffdc87c4-03ea-42b5-b07b-5d68249feaa5 req-bd376d2f-e43e-45bd-be1e-8f20c116b0c0 service nova] Creating event network-changed:e94e6b85-776f-4ee6-a72f-82a76c620f83 for instance b12b6862-1c7d-4faf-9829-6bdd7534470c on n-h1-768852-23 Jul 14 16:03:21.442520 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-ffdc87c4-03ea-42b5-b07b-5d68249feaa5 req-bd376d2f-e43e-45bd-be1e-8f20c116b0c0 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037693 Jul 14 16:03:21.443544 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3509/7175] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:21.656921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.665396 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-725629d3-266d-4c87-b753-a4d7fd9d99b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1564 microversion: 2.1 time: 0.263861 Jul 14 16:03:21.666011 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3667/7176] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1564 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:44.911896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=9 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:44.913046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=34 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:44.918071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:44.919419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:44.927170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.927745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.928471 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.928926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.995328 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a27999c-20db-40ca-a1a5-9fba11bebec6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c/action" status: 200 len: 24569 microversion: 2.1 time: 0.085186 Jul 14 16:03:44.995978 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3510/7177] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:03:44 2022] POST /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c/action => generated 24569 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:03:55.987870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:03:55.988803 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:55.990874 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:55.991537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=40 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:55.998225 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.998673 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.999469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.999897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.071891 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ebac7c1-9427-423c-9c46-dcf4e9f2a63d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c/action" status: 202 len: 0 microversion: 2.1 time: 0.088078 Jul 14 16:03:56.072540 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3668/7178] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:03:55 2022] POST /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:03:56.082301 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:56.083023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:56.086011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:56.086686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:56.094099 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.094780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.095627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.096166 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.235453 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:56.243548 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e704545c-6b45-4db7-b8fd-c96118a13156 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1675 microversion: 2.1 time: 0.166351 Jul 14 16:03:56.244453 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3511/7179] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:56 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:57.262954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:57.263678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:57.270053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.270505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.271282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.271720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.407923 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:57.415497 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b1656431-b1f1-4601-b158-5ebe4a712542 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.157637 Jul 14 16:03:57.416080 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3669/7180] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:57 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:58.433652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:58.434841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:58.442612 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.443078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.443897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.444352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.578579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:58.586165 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2cfef55d-838b-4a22-b9e0-2131725d49a9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.156465 Jul 14 16:03:58.586748 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3512/7181] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:58 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:59.603610 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:59.604226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:59.611226 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.611704 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.612469 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.612901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.744549 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:59.752116 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b6ad710-1616-4d70-9c93-6766de3b0571 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.152470 Jul 14 16:03:59.752692 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3670/7182] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:59 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:00.770253 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:00.770861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:00.778467 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:00.778926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.779732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:00.780175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.921819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:00.929447 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e246b734-ad70-4c26-9aa3-dd2cd307a5de tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.163836 Jul 14 16:04:00.930031 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3513/7183] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:00 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:01.947821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:01.948443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:01.956123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.956579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.957367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.957810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:02.093845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:02.101268 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fe601a2c-43c1-4b89-9d28-517266c5b812 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.157436 Jul 14 16:04:02.101853 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3671/7184] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:01 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:03.118718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:03.119254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:03.126946 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:03.127331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.128125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:03.128646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.266228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:03.274095 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-667e3f9f-759f-4afa-9e2c-625142588789 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.159477 Jul 14 16:04:03.274715 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3514/7185] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:03 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:04.292676 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:04.293273 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:04.300560 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:04.301005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:04.301777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:04.302207 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:04.437360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:04.444917 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-335e9f00-3ec7-448f-858d-8b38e7b717b7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.156359 Jul 14 16:04:04.445492 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3672/7186] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:04 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:05.462042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:05.462662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:05.470443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.470898 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.471703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.472145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.611029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:05.618882 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a20a0592-71fa-4159-bf01-23d7dc38f385 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.160753 Jul 14 16:04:05.619501 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3515/7187] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:05 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:06.640643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:06.641512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:06.653192 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.653646 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.654916 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.655895 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.801487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:06.808999 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2a2d2de0-17e1-48d3-80e1-e460ba15c1ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1680 microversion: 2.1 time: 0.175297 Jul 14 16:04:06.810137 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3673/7188] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:06 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:07.828205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.828841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:07.836167 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.836644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.837444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.837903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.971762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:07.979427 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0da0bd9f-1cb6-4a0d-99c0-e8fb8d8ed64b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1683 microversion: 2.1 time: 0.155911 Jul 14 16:04:07.980005 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3516/7189] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:07 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:34.175914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:34.176754 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:34.179189 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=12 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:34.179864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:34.186455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.186899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.187689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.188120 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.257083 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b6207fa5-1b92-4625-addc-bfe128013814 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c/action" status: 200 len: 69081 microversion: 2.1 time: 0.084834 Jul 14 16:04:34.257811 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3674/7190] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:04:34 2022] POST /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c/action => generated 69081 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:04:41.291803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:41.292363 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:41.294350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:41.302587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=36 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:41.310106 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.310651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.312117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.312567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.339713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:41.423948 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e0d74018-03aa-46f2-a8a2-accfb464be6a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 204 len: 0 microversion: 2.1 time: 0.136237 Jul 14 16:04:41.424865 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3517/7191] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:04:41 2022] DELETE /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:04:41.434087 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:41.435044 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:41.440854 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3e7f288e-7013-4db9-8856-6f91beccf1df req-a32320e2-1c47-45f1-a03a-1914f17d26dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b12b6862-1c7d-4faf-9829-6bdd7534470c", "tag": "e94e6b85-776f-4ee6-a72f-82a76c620f83"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:41.442174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.442722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.443598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.444119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.450411 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3e7f288e-7013-4db9-8856-6f91beccf1df req-a32320e2-1c47-45f1-a03a-1914f17d26dc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.450865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3e7f288e-7013-4db9-8856-6f91beccf1df req-a32320e2-1c47-45f1-a03a-1914f17d26dc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.462521 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3e7f288e-7013-4db9-8856-6f91beccf1df req-a32320e2-1c47-45f1-a03a-1914f17d26dc service nova] Creating event network-changed:e94e6b85-776f-4ee6-a72f-82a76c620f83 for instance b12b6862-1c7d-4faf-9829-6bdd7534470c on n-h1-768852-23 Jul 14 16:04:41.468457 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3e7f288e-7013-4db9-8856-6f91beccf1df req-a32320e2-1c47-45f1-a03a-1914f17d26dc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171261 Jul 14 16:04:41.469246 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3675/7192] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:41.651041 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:41.659765 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-21da4962-b118-4b8f-aa45-2dcc4dc020ed tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1689 microversion: 2.1 time: 0.229975 Jul 14 16:04:41.660190 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3518/7193] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:41 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1689 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:42.678271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:42.678975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:42.686180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:42.686626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:42.687414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:42.687847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:42.820565 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:42.828683 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d652373d-ce70-43bf-b795-ad13e6d28f3b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1689 microversion: 2.1 time: 0.154743 Jul 14 16:04:42.829258 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3676/7194] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:42 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:43.846593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:43.847417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:43.854939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.855451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.856236 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.856695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.936493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:43.945185 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af815f58-0bc8-454f-8aed-693fe0a6f014 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 200 len: 1503 microversion: 2.1 time: 0.102928 Jul 14 16:04:43.945895 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3519/7195] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:43 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 1503 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:43.962023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-94850189-8d49-4363-8299-b341622dbbf4 req-23745195-af89-4609-bf31-09d8badf0f79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b12b6862-1c7d-4faf-9829-6bdd7534470c", "name": "network-vif-deleted", "tag": "e94e6b85-776f-4ee6-a72f-82a76c620f83"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:43.972696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94850189-8d49-4363-8299-b341622dbbf4 req-23745195-af89-4609-bf31-09d8badf0f79 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.973013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-94850189-8d49-4363-8299-b341622dbbf4 req-23745195-af89-4609-bf31-09d8badf0f79 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.985410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-94850189-8d49-4363-8299-b341622dbbf4 req-23745195-af89-4609-bf31-09d8badf0f79 service nova] Creating event network-vif-deleted:e94e6b85-776f-4ee6-a72f-82a76c620f83 for instance b12b6862-1c7d-4faf-9829-6bdd7534470c on n-h1-768852-23 Jul 14 16:04:43.990906 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-94850189-8d49-4363-8299-b341622dbbf4 req-23745195-af89-4609-bf31-09d8badf0f79 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Jul 14 16:04:43.991702 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3677/7196] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:44.963579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:44.964228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: b12b6862-1c7d-4faf-9829-6bdd7534470c] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:44.971185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:44.971683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:44.972473 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:44.972921 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:44.986658 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] HTTP exception thrown: Instance b12b6862-1c7d-4faf-9829-6bdd7534470c could not be found. Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Request method failure captured: Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c HTTP/1.1 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0D310oNQIZeJyEh4Bj2AFJsRKHR0-TVb1L0on-RjiHb-_pDiQ0JZb2e-fY2kKUvQhjZQnQ-NxlYt7x1LFBc5mddSAosoXPGbgYKE4J1aXVFB0MxSPsEYei0nxckWxS0UZcbMu28noCp6iHH4dmRFroK4-EikkYpZqD0qOWJfjh-RApM Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95573e51cb7549d99419265725c74af4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95573e51cb7549d99419265725c74af4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: aa8dea9b55bf4b5eb4fc0572b936f5b0 Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance b12b6862-1c7d-4faf-9829-6bdd7534470c could not be found. Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'b12b6862-1c7d-4faf-9829-6bdd7534470c'} Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b12b6862-1c7d-4faf-9829-6bdd7534470c could not be found. Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b12b6862-1c7d-4faf-9829-6bdd7534470c could not be found. Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:04:44.988361 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b12b6862-1c7d-4faf-9829-6bdd7534470c could not be found. Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Returning 404 to user: Instance b12b6862-1c7d-4faf-9829-6bdd7534470c could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a55be53a-3b4d-4e4f-97e3-409aa826d4f9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c" status: 404 len: 111 microversion: 2.1 time: 0.030188 Jul 14 16:04:44.993747 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3520/7197] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:44 2022] GET /compute/v2.1/servers/b12b6862-1c7d-4faf-9829-6bdd7534470c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:04:48.359911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-28de3c80-3154-4d7e-9a64-9b92f5d0b4c2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '.version_select at 0x7fdbf1b2b550>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:48.378704 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-28de3c80-3154-4d7e-9a64-9b92f5d0b4c2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-175273999" status: 202 len: 0 microversion: 2.1 time: 0.024808 Jul 14 16:04:48.379332 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3678/7198] 10.222.0.98 () {58 vars in 1280 bytes} [Thu Jul 14 16:04:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-175273999 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:04:48.408489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e713eb9d-917e-4c0b-baf1-1d12dc87a65c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: .version_select at 0x7fdbf2a3e8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-398762927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvOx5mdKZSlvFnhkCtSRefP8PLCsOzJcmijzUdb5NtBkMlMNRd2xgsNmrIEDSsiPgxY6j/qZUHOTPsz609AvDnTitWoi7lzTjC5jAi6/9SG2IVI4v+rTfzsHtOtbaLqSw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:48.424677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e713eb9d-917e-4c0b-baf1-1d12dc87a65c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:04:48.430782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-e713eb9d-917e-4c0b-baf1-1d12dc87a65c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:04:48.455005 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e713eb9d-917e-4c0b-baf1-1d12dc87a65c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.051208 Jul 14 16:04:48.455589 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3521/7199] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:04:48 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:54.049461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-25343219", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "306fbc8f-66c9-4562-950f-c9136e710e71"}], "key_name": "tempest-TestNetworkAdvancedServerOps-398762927", "security_groups": [{"name": "tempest-secgroup-smoke-121004781"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:54.062032 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=14 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:54.348024 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] validate_networks() for [('306fbc8f-66c9-4562-950f-c9136e710e71', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:04:54.807808 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:04:54.808550 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:04:54.809190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:04:54.809613 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:04:54.810016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:04:54.820157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.822589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.823480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.824051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.842835 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:04:54.848856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:04:54.863224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:04:54.865815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:04:54.937811 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6869f10b-a50a-47b7-948a-26bc478d978f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.890462 Jul 14 16:04:54.938840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3679/7200] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:04:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:04:54.949702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-523aecd7-6d64-4e30-b51b-7a4314c3930c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:54.950331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-523aecd7-6d64-4e30-b51b-7a4314c3930c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:54.983438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:55.027237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-523aecd7-6d64-4e30-b51b-7a4314c3930c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:55.038054 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-523aecd7-6d64-4e30-b51b-7a4314c3930c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1264 microversion: 2.1 time: 0.092883 Jul 14 16:04:55.038784 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3522/7201] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:54 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1264 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:56.062592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:56.063844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:56.072623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:56.073257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.075611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:56.075611 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.170287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:56.184050 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c27dab10-912f-4706-8786-34b7445eb762 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1324 microversion: 2.1 time: 0.127513 Jul 14 16:04:56.184662 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3680/7202] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:56 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1324 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:57.202371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.203901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.211999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.212632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.213856 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.214675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.746973 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:57.755217 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7dcc78bd-db4c-4dad-adba-d50880f7f406 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1389 microversion: 2.1 time: 0.557045 Jul 14 16:04:57.755834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3523/7203] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:57 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1389 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:58.064612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-d3504da2-c3c2-4770-a130-25015c1a99de req-003e91b7-6906-4175-8fef-5fc8536fdd6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:58.083125 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d3504da2-c3c2-4770-a130-25015c1a99de req-003e91b7-6906-4175-8fef-5fc8536fdd6c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.088054 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-d3504da2-c3c2-4770-a130-25015c1a99de req-003e91b7-6906-4175-8fef-5fc8536fdd6c service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.103993 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-d3504da2-c3c2-4770-a130-25015c1a99de req-003e91b7-6906-4175-8fef-5fc8536fdd6c service nova] Creating event network-changed:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h2-768852-23 Jul 14 16:04:58.115357 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-d3504da2-c3c2-4770-a130-25015c1a99de req-003e91b7-6906-4175-8fef-5fc8536fdd6c service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055608 Jul 14 16:04:58.116004 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3681/7204] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:58.772083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:58.772771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:58.779937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.780657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.781446 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.781901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.917631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:58.925551 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4b90e490-a9e3-4849-a4ff-a868bdc18de4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1389 microversion: 2.1 time: 0.157257 Jul 14 16:04:58.926144 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3524/7205] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:58 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1389 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:59.944509 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:59.945212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:59.953248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.953694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.954461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.954899 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:00.097463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:00.105116 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-32d8f538-aafd-440b-9bc7-6346f6699a78 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1389 microversion: 2.1 time: 0.165031 Jul 14 16:05:00.105713 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3682/7206] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:59 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1389 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:01.123408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:01.123956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:01.130930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.131430 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.132221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.132678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.271175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.279343 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41116013-5b4d-40ae-b8bc-f61b76da2fa2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1389 microversion: 2.1 time: 0.159518 Jul 14 16:05:01.279919 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3525/7207] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:01 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1389 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:02.297175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:02.297809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:02.304686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.305135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.305879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.306308 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.439957 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.448525 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1b41c73c-d8d6-4885-a398-10450f9f04f3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1389 microversion: 2.1 time: 0.155791 Jul 14 16:05:02.449126 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3683/7208] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:02 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:02.975320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-d91877e3-1cfc-4ddf-a090-09b295134af5 req-38f4bf35-4737-467f-b0c2-4d0839f96dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "name": "network-vif-plugged", "status": "completed", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:02.984656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d91877e3-1cfc-4ddf-a090-09b295134af5 req-38f4bf35-4737-467f-b0c2-4d0839f96dc2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.985112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-d91877e3-1cfc-4ddf-a090-09b295134af5 req-38f4bf35-4737-467f-b0c2-4d0839f96dc2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.998041 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-d91877e3-1cfc-4ddf-a090-09b295134af5 req-38f4bf35-4737-467f-b0c2-4d0839f96dc2 service nova] Creating event network-vif-plugged:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h2-768852-23 Jul 14 16:05:03.003670 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-d91877e3-1cfc-4ddf-a090-09b295134af5 req-38f4bf35-4737-467f-b0c2-4d0839f96dc2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031802 Jul 14 16:05:03.004283 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3526/7209] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:03.468268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:03.468975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:03.478360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.478801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.479614 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.480051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.611053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.618806 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5623e12e-276c-4b47-b2a8-d27e9dd6466a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1389 microversion: 2.1 time: 0.154466 Jul 14 16:05:03.619417 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3684/7210] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:03 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1389 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:04.637321 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.637952 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.645948 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.646413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.647203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.647687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.789677 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.798569 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3e3a7a1b-667f-4b65-ab38-3618ecc03051 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1561 microversion: 2.1 time: 0.165621 Jul 14 16:05:04.799205 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3527/7211] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:04.816065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.816694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.819904 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:04.825456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.826573 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.827453 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.827900 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.831812 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:04.862424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:04.975753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.985144 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b0382ed0-363b-47ef-a964-f867af273b40 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1561 microversion: 2.1 time: 0.173244 Jul 14 16:05:04.985744 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3685/7212] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:06.614319 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-aa920aa9-d013-4d86-bb06-7403e4eace97 req-9dde9439-5cb1-46fb-8177-4c9e641f779b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:06.619610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:06.625485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:06.627622 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:06.634382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aa920aa9-d013-4d86-bb06-7403e4eace97 req-9dde9439-5cb1-46fb-8177-4c9e641f779b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.634831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-aa920aa9-d013-4d86-bb06-7403e4eace97 req-9dde9439-5cb1-46fb-8177-4c9e641f779b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.642436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.643229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.644215 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.644669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.647238 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-aa920aa9-d013-4d86-bb06-7403e4eace97 req-9dde9439-5cb1-46fb-8177-4c9e641f779b service nova] Creating event network-changed:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h2-768852-23 Jul 14 16:05:06.652342 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-aa920aa9-d013-4d86-bb06-7403e4eace97 req-9dde9439-5cb1-46fb-8177-4c9e641f779b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041839 Jul 14 16:05:06.653202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3686/7213] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:05:06.905529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.913630 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2493537a-a20d-433d-bdbf-cc6427a279d4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1561 microversion: 2.1 time: 0.305198 Jul 14 16:05:06.914917 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3528/7214] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:06 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1561 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:11.731813 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:05:11.732496 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:05:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:05:30.209442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:30.210221 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=36 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:30.214786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:30.215839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:30.223638 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.224091 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.224866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.225312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.291778 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-53447a9b-45d0-4ce8-9b2f-a6d703118ca2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action" status: 200 len: 24561 microversion: 2.1 time: 0.084332 Jul 14 16:05:30.292446 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3687/7215] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:05:30 2022] POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action => generated 24561 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:05:41.321020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:05:41.321988 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:41.324300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:41.325019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=32 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:41.332204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.332662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.333439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.333884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.419211 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:41.425721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Old instance type m1.heat2, new instance type m1.heat {{(pid=125966) resize /opt/stack/nova/nova/compute/api.py:4166}} Jul 14 16:05:41.432428 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:05:41.432892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:05:41.433383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:05:41.433808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:05:41.434245 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:05:41.499644 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-481db983-db9c-4b79-9f98-0184d5d7ab58 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action" status: 202 len: 0 microversion: 2.1 time: 0.182514 Jul 14 16:05:41.500265 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3529/7216] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:05:41 2022] POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:05:41.510107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:41.510817 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:41.513909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:41.514633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:41.522911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.523427 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.524240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.524794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.707747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:41.716629 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8cd37faa-e99b-41eb-96f1-8525ae09e282 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1688 microversion: 2.1 time: 0.211332 Jul 14 16:05:41.717217 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3688/7217] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:41 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:42.734810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:42.735515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:42.741708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:42.742175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.742942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:42.743412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.878695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.886264 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-70d7aaed-086b-4ea9-ae80-db6dada1a314 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1688 microversion: 2.1 time: 0.156217 Jul 14 16:05:42.886834 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3530/7218] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:42 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:43.903656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:43.904413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:43.911683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.912136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.912897 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.913334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.049249 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:44.056800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6af4a347-a777-4d9f-ab77-2346a7ee37d5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.157034 Jul 14 16:05:44.057384 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3689/7219] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:43 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:45.073939 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:45.074581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:45.081797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.082259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.083036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.083538 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.226627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:45.234326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b607cfcb-19a5-449c-97f5-8fa1f72931bb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.164309 Jul 14 16:05:45.234912 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3531/7220] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:45 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:46.252371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:46.252950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:46.259252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:46.259729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.260489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:46.260927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.394086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:46.401540 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-39c1e5aa-336f-4a0f-ba76-b0a6c0eefc4e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.154177 Jul 14 16:05:46.402117 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3690/7221] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:46 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:47.420023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:47.420651 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:47.428257 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.428720 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.429509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.429957 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.567634 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:47.575536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-831d8819-c3f7-453d-a637-0477b2c06c9a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.159442 Jul 14 16:05:47.576124 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3532/7222] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:47 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:48.593746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:48.594499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:48.601902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:48.602355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:48.603147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:48.603617 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:48.744729 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:48.753088 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f838ac2-2d02-448d-a6f2-cd9cd2025f3e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.163421 Jul 14 16:05:48.753688 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3691/7223] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:48 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:49.770743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:49.771694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:49.781029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.781559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.782392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.782844 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.934125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:49.943853 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-10f7f2bb-8437-4f5c-9074-b14525b101ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.177321 Jul 14 16:05:49.944451 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3533/7224] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:49 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:50.962727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:50.963386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:50.971461 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.971920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:50.972711 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.973155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:51.108270 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:51.116511 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-240f2ebc-47bf-4271-bbda-c21eea0f9876 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.157737 Jul 14 16:05:51.117172 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3692/7225] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:50 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:52.134607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:52.135233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:52.142396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:52.143126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:52.143745 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:52.144566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:52.284724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:52.292561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f95cc32e-2b80-4742-83ef-45278c6126ec tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.161907 Jul 14 16:05:52.293146 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3534/7226] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:52 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:53.310444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:53.311085 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:53.318657 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.319110 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.319902 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.320343 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.458592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:53.466617 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aca849b0-f83a-4ecc-9f10-25238d09aca8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.160059 Jul 14 16:05:53.467224 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3693/7227] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:53 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:54.484961 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:54.485627 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:54.492679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.493142 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.493915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.494354 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.631100 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:54.638697 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05c14dea-6079-40ec-a539-264bc1a87722 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.157658 Jul 14 16:05:54.639304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3535/7228] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:54 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:55.659144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:55.659875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:55.666969 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:55.667455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.668239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:55.668887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.815381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:55.823294 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-35403871-e09e-4aa5-b4cd-9e884d6332d9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.169865 Jul 14 16:05:55.823911 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3694/7229] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:55 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:56.842055 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:56.842642 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:56.850877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.851508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.852318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.852776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.996624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.004476 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e7dc76a8-938f-4da8-9c7b-513e39f770a6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.166677 Jul 14 16:05:57.005076 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3536/7230] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:56 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:58.022224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:58.022833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:58.030505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.030939 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.032357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.032798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.177928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.185875 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-31c26293-8543-472b-937b-9395fe0f9687 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.167651 Jul 14 16:05:58.186473 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3695/7231] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:58 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:59.205373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:59.206029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:59.213279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.213746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.214537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.214989 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.357694 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:59.366363 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6fcbd1bf-8b8e-484b-867d-5ffcb21e09e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.165237 Jul 14 16:05:59.366957 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3537/7232] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:59 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:00.385892 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:00.386540 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:00.394538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.394984 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.395791 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.396227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.580601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.589634 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8973dd86-7cf3-4121-9df3-4b2e393edda6 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1693 microversion: 2.1 time: 0.208724 Jul 14 16:06:00.590260 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3696/7233] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:00 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1693 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:01.309212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f92f5509-6ac5-475b-80ff-a36cd61e6083 req-8e08c89d-b62d-4023-a3ad-898873a433af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "name": "network-vif-unplugged", "status": "completed", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:01.318598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f92f5509-6ac5-475b-80ff-a36cd61e6083 req-8e08c89d-b62d-4023-a3ad-898873a433af service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.318970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f92f5509-6ac5-475b-80ff-a36cd61e6083 req-8e08c89d-b62d-4023-a3ad-898873a433af service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.344667 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f92f5509-6ac5-475b-80ff-a36cd61e6083 req-8e08c89d-b62d-4023-a3ad-898873a433af service nova] Creating event network-vif-unplugged:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h1-768852-23 Jul 14 16:06:01.352179 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [req-f92f5509-6ac5-475b-80ff-a36cd61e6083 req-8e08c89d-b62d-4023-a3ad-898873a433af service nova] Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125966) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 16:06:01.364623 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f92f5509-6ac5-475b-80ff-a36cd61e6083 req-8e08c89d-b62d-4023-a3ad-898873a433af service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142462 Jul 14 16:06:01.365892 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3538/7234] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:01.617341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:01.618185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:01.627393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.627849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.628667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.629102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:02.036456 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:02.045184 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d0b3411-25ba-4feb-aaed-8433d9d2dcbb tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1692 microversion: 2.1 time: 0.432806 Jul 14 16:06:02.045802 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3697/7235] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:01 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1692 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:03.066423 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:03.067610 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:03.074575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.075036 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.075859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.076306 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.225968 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:03.234047 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4825c782-1866-43c6-9f0f-c043f8928397 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1690 microversion: 2.1 time: 0.173660 Jul 14 16:06:03.235155 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3539/7236] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:03 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1690 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:03.389023 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5c3d3bf1-470d-4a39-8f83-79157b88a945 req-2a765f0d-4cd0-43e2-8e76-6c66ba7fd891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:03.398856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5c3d3bf1-470d-4a39-8f83-79157b88a945 req-2a765f0d-4cd0-43e2-8e76-6c66ba7fd891 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.399315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5c3d3bf1-470d-4a39-8f83-79157b88a945 req-2a765f0d-4cd0-43e2-8e76-6c66ba7fd891 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.412219 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5c3d3bf1-470d-4a39-8f83-79157b88a945 req-2a765f0d-4cd0-43e2-8e76-6c66ba7fd891 service nova] Creating event network-changed:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h1-768852-23 Jul 14 16:06:03.417764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [req-5c3d3bf1-470d-4a39-8f83-79157b88a945 req-2a765f0d-4cd0-43e2-8e76-6c66ba7fd891 service nova] Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-768852-23', 'n-h1-768852-23'} {{(pid=125965) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5807}} Jul 14 16:06:03.428763 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5c3d3bf1-470d-4a39-8f83-79157b88a945 req-2a765f0d-4cd0-43e2-8e76-6c66ba7fd891 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043739 Jul 14 16:06:03.429388 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3698/7237] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:04.255799 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:04.256819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:04.267085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.267085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.267085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.267085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.467526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:04.476775 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-43afa7f2-f337-4deb-b52d-d7df39fbedaa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1690 microversion: 2.1 time: 0.227625 Jul 14 16:06:04.477392 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3540/7238] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:04 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1690 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:05.496732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:05.497351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:05.503961 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.504407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.505170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.505599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.674114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:05.683852 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5903c054-8b99-4304-9490-adef4ef7b9e0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1687 microversion: 2.1 time: 0.192216 Jul 14 16:06:05.684527 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3699/7239] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:05 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:05.702119 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:05.702702 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:05.709841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.710313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.711112 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.711623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.785913 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b79cc533-3309-4fa9-8c19-b0669e1cc4ac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action" status: 204 len: 0 microversion: 2.1 time: 0.087343 Jul 14 16:06:05.787006 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3541/7240] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:06:05 2022] POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:06:05.796058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:05.796954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:05.805057 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.805548 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.806341 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.806866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.984106 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.005714 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-55047388-45d4-4926-90f4-672e69dcdcb7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1687 microversion: 2.1 time: 0.213226 Jul 14 16:06:06.007458 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3700/7241] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:05 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1687 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:06.026042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:06.026920 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:06.036731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.037371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.038498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.039075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.333674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.349878 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6b3410f1-fbec-4e3d-99cb-ee0b534e2605 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1687 microversion: 2.1 time: 0.328604 Jul 14 16:06:06.360304 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3542/7242] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:06 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1687 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:07.369109 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:07.369988 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:07.379546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.379997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.380782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.381218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.580147 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:07.588410 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d8cb1fe9-9b23-4477-aaaa-72ad8934a4a7 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1679 microversion: 2.1 time: 0.223106 Jul 14 16:06:07.589012 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3701/7243] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:07 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:07.947854 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-96107811-669f-461a-b9aa-d77a447f8c78 req-3a5b630a-9567-4845-a6e7-9f31f7d1b793 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "name": "network-vif-plugged", "status": "completed", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:07.958174 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-96107811-669f-461a-b9aa-d77a447f8c78 req-3a5b630a-9567-4845-a6e7-9f31f7d1b793 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.958636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-96107811-669f-461a-b9aa-d77a447f8c78 req-3a5b630a-9567-4845-a6e7-9f31f7d1b793 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.971833 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-96107811-669f-461a-b9aa-d77a447f8c78 req-3a5b630a-9567-4845-a6e7-9f31f7d1b793 service nova] Creating event network-vif-plugged:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h1-768852-23 Jul 14 16:06:07.977168 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-96107811-669f-461a-b9aa-d77a447f8c78 req-3a5b630a-9567-4845-a6e7-9f31f7d1b793 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112135 Jul 14 16:06:07.977803 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3543/7244] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:31.790993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:31.792444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:31.795041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=28 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:31.795825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=82 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:31.803087 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.803572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.804358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.804800 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.872256 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-47b7af55-be71-465f-bac1-d284e349c518 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action" status: 200 len: 24577 microversion: 2.1 time: 0.085978 Jul 14 16:06:31.872947 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3702/7245] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:06:31 2022] POST /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3/action => generated 24577 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:06:39.353336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=34 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:39.354261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:39.357190 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-b3e9893f-d21a-4ff0-8390-1fcb8342a72b req-808acfed-0136-4d36-8d49-d6651989d1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:39.358766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:39.359560 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:39.367322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.367322 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.367706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b3e9893f-d21a-4ff0-8390-1fcb8342a72b req-808acfed-0136-4d36-8d49-d6651989d1c2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.368217 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-b3e9893f-d21a-4ff0-8390-1fcb8342a72b req-808acfed-0136-4d36-8d49-d6651989d1c2 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.368331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.369455 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.382832 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-b3e9893f-d21a-4ff0-8390-1fcb8342a72b req-808acfed-0136-4d36-8d49-d6651989d1c2 service nova] Creating event network-changed:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h1-768852-23 Jul 14 16:06:39.388353 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-b3e9893f-d21a-4ff0-8390-1fcb8342a72b req-808acfed-0136-4d36-8d49-d6651989d1c2 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035036 Jul 14 16:06:39.389606 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3703/7246] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:39.399907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:06:39.487024 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-32a75859-ea53-43f2-a19c-4824e49627b9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 204 len: 0 microversion: 2.1 time: 0.135625 Jul 14 16:06:39.490739 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3544/7247] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:06:39 2022] DELETE /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:06:39.496831 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:39.497541 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:39.504533 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.504981 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.505747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.506177 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.646558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:39.654339 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50b1aee6-443e-40b3-9aa4-ff00c0369919 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1685 microversion: 2.1 time: 0.162052 Jul 14 16:06:39.655190 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3704/7248] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:39 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:40.672954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:40.673671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:40.680517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:40.680981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.681756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:40.682205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.827493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:40.835481 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-acc06e89-196a-4548-ad7e-a19b468aba86 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1685 microversion: 2.1 time: 0.166724 Jul 14 16:06:40.836289 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3545/7249] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:40 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:41.763520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-5d012c73-8e03-41d1-8821-38b9b36401ec req-3328a9ee-2b27-4da5-981e-a6b9782a84fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b335b5-42f1-46d9-a33c-f8e5cb12b0a3", "name": "network-vif-deleted", "tag": "04cdc5e2-9113-4674-bf8a-1a2fa1e1928e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:41.777626 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5d012c73-8e03-41d1-8821-38b9b36401ec req-3328a9ee-2b27-4da5-981e-a6b9782a84fb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.777954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-5d012c73-8e03-41d1-8821-38b9b36401ec req-3328a9ee-2b27-4da5-981e-a6b9782a84fb service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.792905 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-5d012c73-8e03-41d1-8821-38b9b36401ec req-3328a9ee-2b27-4da5-981e-a6b9782a84fb service nova] Creating event network-vif-deleted:04cdc5e2-9113-4674-bf8a-1a2fa1e1928e for instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 on n-h1-768852-23 Jul 14 16:06:41.799218 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-5d012c73-8e03-41d1-8821-38b9b36401ec req-3328a9ee-2b27-4da5-981e-a6b9782a84fb service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039703 Jul 14 16:06:41.799856 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3705/7250] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:41.853827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:41.854567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:41.862244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.862665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.863477 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.863929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.895462 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.895986 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.896486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lazy-loading 'fault' on Instance uuid 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:06:41.943382 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:41.950927 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-518d4315-2a5e-4e74-a3f3-0bc6e4329ef2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 200 len: 1354 microversion: 2.1 time: 0.101003 Jul 14 16:06:41.951535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3546/7251] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:41 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 1354 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:42.969678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:42.970444 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:42.977990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.978432 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.979187 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.979644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.993342 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] HTTP exception thrown: Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 could not be found. Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Request method failure captured: Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 HTTP/1.1 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0D310oNQIZeJyEh4Bj2AFJsRKHR0-TVb1L0on-RjiHb-_pDiQ0JZb2e-fY2kKUvQhjZQnQ-NxlYt7x1LFBc5mddSAosoXPGbgYKE4J1aXVFB0MxSPsEYei0nxckWxS0UZcbMu28noCp6iHH4dmRFroK4-EikkYpZqD0qOWJfjh-RApM Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95573e51cb7549d99419265725c74af4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95573e51cb7549d99419265725c74af4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: aa8dea9b55bf4b5eb4fc0572b936f5b0 Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 could not be found. Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '19b335b5-42f1-46d9-a33c-f8e5cb12b0a3'} Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 could not be found. Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 could not be found. Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:06:42.995234 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 could not be found. Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Returning 404 to user: Instance 19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-241d8309-905c-43cb-8ff7-eac24bd9f86b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3" status: 404 len: 111 microversion: 2.1 time: 0.031629 Jul 14 16:06:43.000423 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3706/7252] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:42 2022] GET /compute/v2.1/servers/19b335b5-42f1-46d9-a33c-f8e5cb12b0a3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:06:46.404735 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da50d9ce-0667-4f6c-8c3a-e0b1c028ea54 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '.version_select at 0x7fdbf1ed3280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:46.425741 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da50d9ce-0667-4f6c-8c3a-e0b1c028ea54 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-398762927" status: 202 len: 0 microversion: 2.1 time: 0.025271 Jul 14 16:06:46.426280 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3547/7253] 10.222.0.98 () {58 vars in 1280 bytes} [Thu Jul 14 16:06:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-398762927 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:06:46.455253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e2cd346e-142b-4415-b6f0-5ca9547e83b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: .version_select at 0x7fdbf1ea5ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1160933014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBETbEuvIa3638nS6B5SQMtPbQdxfQiU5fQZeMRouxGGrKAvGd9qW/ZPQksq+LYS6MKCZhX+m2ikXfHjggNXCgEzN51qXLPEiRZcsUBQesqtVvqBG23ph4wvD9q0xFT5C2Q=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:46.470794 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e2cd346e-142b-4415-b6f0-5ca9547e83b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:06:46.477241 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-e2cd346e-142b-4415-b6f0-5ca9547e83b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:06:46.501022 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e2cd346e-142b-4415-b6f0-5ca9547e83b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.049624 Jul 14 16:06:46.502101 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3707/7254] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:06:46 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:52.080318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:52.085575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-510964080", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "f35a7957-d622-4a17-bb2c-3e1dc8c632a5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1160933014", "security_groups": [{"name": "tempest-secgroup-smoke-1110966416"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:52.229351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] validate_networks() for [('f35a7957-d622-4a17-bb2c-3e1dc8c632a5', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:06:52.722752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:06:52.723286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:06:52.723869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:06:52.724398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:06:52.724927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:06:52.734929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:52.735469 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:52.736293 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:52.737046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:52.756417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:06:52.761998 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:06:52.779051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:06:52.782118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:06:52.835397 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16fad9a1-5054-4f80-bdd5-9cf38de2fd28 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.756951 Jul 14 16:06:52.842040 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3548/7255] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:06:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:06:52.847809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a7dfdee2-4d94-4660-8ccc-71109fc196c2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:52.849013 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a7dfdee2-4d94-4660-8ccc-71109fc196c2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:52.908214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a7dfdee2-4d94-4660-8ccc-71109fc196c2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:52.916621 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a7dfdee2-4d94-4660-8ccc-71109fc196c2 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1266 microversion: 2.1 time: 0.073544 Jul 14 16:06:52.917719 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3708/7256] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:52 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1266 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:53.935659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:53.936597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:53.948751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:53.950734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:53.951797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:53.953283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:54.070376 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:54.084192 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ac8ee984-b425-411c-bae0-fe64b7b1fb1a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1326 microversion: 2.1 time: 0.152910 Jul 14 16:06:54.096910 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3549/7257] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:53 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1326 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:55.104251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:55.104915 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:55.108406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=16 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:55.116535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.117285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.118388 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.119413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.367350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:55.376274 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6b25d580-4a9b-4c31-bb2d-d14c200d28dd tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1392 microversion: 2.1 time: 0.275650 Jul 14 16:06:55.377088 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3709/7258] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:55 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:55.714426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-fa5359fd-7a37-4f48-817c-364832e47ca2 req-582cc0e0-903b-4333-8221-bd027f11b52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572d3d33-1b94-4fe7-a72e-bc438bb4b103", "tag": "18c96e59-bc9d-4ced-9ed2-f8db07270ee9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:06:55.734614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fa5359fd-7a37-4f48-817c-364832e47ca2 req-582cc0e0-903b-4333-8221-bd027f11b52d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.737935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-fa5359fd-7a37-4f48-817c-364832e47ca2 req-582cc0e0-903b-4333-8221-bd027f11b52d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.753324 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-fa5359fd-7a37-4f48-817c-364832e47ca2 req-582cc0e0-903b-4333-8221-bd027f11b52d service nova] Creating event network-changed:18c96e59-bc9d-4ced-9ed2-f8db07270ee9 for instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 on n-h1-768852-23 Jul 14 16:06:55.758714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-fa5359fd-7a37-4f48-817c-364832e47ca2 req-582cc0e0-903b-4333-8221-bd027f11b52d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052269 Jul 14 16:06:55.759643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3550/7259] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:06:56.394419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:56.395161 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:56.401951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.402401 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.403158 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.403693 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.537823 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:56.545752 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d0dff6e2-c02b-45d9-917a-5b332100ca43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1392 microversion: 2.1 time: 0.155941 Jul 14 16:06:56.546363 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3710/7260] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:56 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:57.565008 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:57.565653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:57.573012 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.573483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.574283 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.574743 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.766441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.774711 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a16dd0fa-1809-4d4f-87e2-a81822a457ea tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1392 microversion: 2.1 time: 0.214935 Jul 14 16:06:57.775345 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3551/7261] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:57 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:58.793097 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:58.793621 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:58.801154 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.801591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.802346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.802776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.932997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:58.941223 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef9c29df-7a7e-42ba-bd8a-cb9b92d5e1b5 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1392 microversion: 2.1 time: 0.152000 Jul 14 16:06:58.941797 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3711/7262] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:58 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:59.958371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:59.958947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:59.966072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:59.966536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:59.967353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:59.967815 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:00.041050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-00a344f4-4a87-4b73-bc81-4364e2103350 req-0c69f8ae-1f65-427b-adcc-70be751dcf74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572d3d33-1b94-4fe7-a72e-bc438bb4b103", "name": "network-vif-plugged", "status": "completed", "tag": "18c96e59-bc9d-4ced-9ed2-f8db07270ee9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:00.051398 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-00a344f4-4a87-4b73-bc81-4364e2103350 req-0c69f8ae-1f65-427b-adcc-70be751dcf74 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:00.051864 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-00a344f4-4a87-4b73-bc81-4364e2103350 req-0c69f8ae-1f65-427b-adcc-70be751dcf74 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:00.068640 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-00a344f4-4a87-4b73-bc81-4364e2103350 req-0c69f8ae-1f65-427b-adcc-70be751dcf74 service nova] Creating event network-vif-plugged:18c96e59-bc9d-4ced-9ed2-f8db07270ee9 for instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 on n-h1-768852-23 Jul 14 16:07:00.073902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-00a344f4-4a87-4b73-bc81-4364e2103350 req-0c69f8ae-1f65-427b-adcc-70be751dcf74 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036856 Jul 14 16:07:00.074791 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3712/7263] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:07:00.116451 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:00.124887 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98d3796f-d7ab-4130-8ef8-b447ff12761b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1392 microversion: 2.1 time: 0.171108 Jul 14 16:07:00.125480 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3552/7264] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:59 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:01.143298 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:01.144018 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:01.150371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.150829 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.151623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.152065 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.289234 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.296909 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9d9831e4-7d64-4af0-aea1-5a012619c5ab tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1392 microversion: 2.1 time: 0.158919 Jul 14 16:07:01.297501 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3713/7265] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:01 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:02.315168 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:02.315836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:02.322231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.322703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.323598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.324054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.461003 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.469754 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dffffb34-a0bf-4706-88aa-ec79ab31b24f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1564 microversion: 2.1 time: 0.159161 Jul 14 16:07:02.470348 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3553/7266] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:02 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:02.487257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:02.487903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:02.489843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:02.495163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.495648 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.496410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.496850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.634252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.641833 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c8d7edb3-b272-4a78-981d-335b6c96d495 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1564 microversion: 2.1 time: 0.159751 Jul 14 16:07:02.642454 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3714/7267] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:02 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:04.592464 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:04.592989 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-612fc8f5-207a-456f-ba40-691dd734c946 req-83351e09-ae6f-4fbb-8b79-81a7f7e2e1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572d3d33-1b94-4fe7-a72e-bc438bb4b103", "tag": "18c96e59-bc9d-4ced-9ed2-f8db07270ee9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:04.594614 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:04.598136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.599311 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.600203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:04.604088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-612fc8f5-207a-456f-ba40-691dd734c946 req-83351e09-ae6f-4fbb-8b79-81a7f7e2e1e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.604558 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-612fc8f5-207a-456f-ba40-691dd734c946 req-83351e09-ae6f-4fbb-8b79-81a7f7e2e1e8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.612439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.613226 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.614317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.615007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.617664 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-612fc8f5-207a-456f-ba40-691dd734c946 req-83351e09-ae6f-4fbb-8b79-81a7f7e2e1e8 service nova] Creating event network-changed:18c96e59-bc9d-4ced-9ed2-f8db07270ee9 for instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 on n-h1-768852-23 Jul 14 16:07:04.627351 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-612fc8f5-207a-456f-ba40-691dd734c946 req-83351e09-ae6f-4fbb-8b79-81a7f7e2e1e8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038220 Jul 14 16:07:04.627979 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3715/7268] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:04.769709 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.777779 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8bbff151-ed23-47c5-b773-c2a52c0885fa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1564 microversion: 2.1 time: 0.190924 Jul 14 16:07:04.778564 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3554/7269] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:04 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1564 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:28.030344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:28.031170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:28.035872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:28.036875 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:28.043912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.044365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.045126 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.045564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.119096 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4a8685a3-75d6-4e73-955e-0c0819f6a84f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action" status: 200 len: 24566 microversion: 2.1 time: 0.090781 Jul 14 16:07:28.120054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3716/7270] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:07:28 2022] POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action => generated 24566 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:07:39.155113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c00c0cee-2e0b-4e95-9114-ffc7428fa514 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:39.157152 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:39.158005 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=34 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:39.165348 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c00c0cee-2e0b-4e95-9114-ffc7428fa514 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.165801 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c00c0cee-2e0b-4e95-9114-ffc7428fa514 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.189705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c00c0cee-2e0b-4e95-9114-ffc7428fa514 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Going to try to stop instance {{(pid=125966) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 16:07:39.239867 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c00c0cee-2e0b-4e95-9114-ffc7428fa514 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action" status: 202 len: 0 microversion: 2.1 time: 0.088411 Jul 14 16:07:39.240507 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3555/7271] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:07:39 2022] POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:07:39.249567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:39.250282 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:39.253231 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:39.254134 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=4 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:39.261997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.262449 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.263229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.263721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.404599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.412904 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e78c1cc9-06fb-4b08-9bd9-d68ffbde323e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.167740 Jul 14 16:07:39.413440 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3717/7272] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:39 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:40.431019 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:40.431781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:40.438861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.439352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.440128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.440576 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.572185 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.579720 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-37781513-dcda-474c-895c-4996cd84895c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.153668 Jul 14 16:07:40.580292 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3556/7273] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:40 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:41.597753 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.598361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.605280 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.605728 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.606492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.606921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.739998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.747863 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d8d7b2b-65e2-48d0-899f-c3ed4fc35e6d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.154040 Jul 14 16:07:41.748449 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3718/7274] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:41 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:42.765164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:42.765780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:42.773394 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.773861 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.774636 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.775089 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.909843 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:42.917485 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-703d5c75-da47-4db8-82c3-76e81fd212c0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.156232 Jul 14 16:07:42.918102 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3557/7275] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:42 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:43.934475 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:43.935086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:43.941920 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.942355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.943747 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.944178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.078175 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.086419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c7657f68-193e-471b-909a-ea14e1ef02aa tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.155796 Jul 14 16:07:44.087002 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3719/7276] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:43 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:45.103873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:45.104506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:45.111724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.112193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:45.112995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.113445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:45.244558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:45.252287 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d752d9ea-2a40-4ba7-b6c9-9a16ea210791 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.152879 Jul 14 16:07:45.252866 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3558/7277] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:45 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:46.270413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:46.271925 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:46.278741 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.279130 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.280165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.280601 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.417965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.425711 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8084c2fd-0928-484e-bfa1-34c8313cb3e8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.159366 Jul 14 16:07:46.426297 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3720/7278] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:46 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:47.443383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:47.444013 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:47.450964 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.451465 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.452240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.452691 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.591756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:47.602410 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7912dc71-ab95-4ccf-9ef6-22cd440303c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.162855 Jul 14 16:07:47.603332 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3559/7279] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:47 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:48.620084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:48.620699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:48.627643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.628077 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.628841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.629278 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.768078 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.776551 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8f34218e-49b0-4ae6-863f-e723bddfd0b3 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1692 microversion: 2.1 time: 0.160325 Jul 14 16:07:48.777147 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3721/7280] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:48 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1692 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:49.796419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:49.797804 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:49.805426 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.805892 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.806687 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.807130 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.943816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.951528 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a0130329-10e3-49ff-a232-4dc244c40df0 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1669 microversion: 2.1 time: 0.160270 Jul 14 16:07:49.952106 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3560/7281] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:49 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1669 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:51.042606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:51.043562 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.050583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.051026 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.052467 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.052910 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.107917 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14ba6efe-0db1-4628-b5f0-d68895027618 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action" status: 200 len: 38365 microversion: 2.1 time: 0.068989 Jul 14 16:07:51.108607 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3722/7282] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:07:51 2022] POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action => generated 38365 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:07:51.120271 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-9f54ebf7-4d48-4c37-8cd1-e39d152e495e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:51.127286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f54ebf7-4d48-4c37-8cd1-e39d152e495e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.127759 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-9f54ebf7-4d48-4c37-8cd1-e39d152e495e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.151010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-9f54ebf7-4d48-4c37-8cd1-e39d152e495e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Going to try to start instance {{(pid=125966) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 16:07:51.193986 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-9f54ebf7-4d48-4c37-8cd1-e39d152e495e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action" status: 202 len: 0 microversion: 2.1 time: 0.077532 Jul 14 16:07:51.194616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3561/7283] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:07:51 2022] POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:07:51.203287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:51.203997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.211662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.212115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.213019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.213528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.427519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.434951 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-0b651d2e-1765-4647-ad99-fe98c6b842ee tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1678 microversion: 2.1 time: 0.235868 Jul 14 16:07:51.435566 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3723/7284] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:51 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:52.455196 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:52.455943 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:52.462927 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:52.463489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.464275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:52.464731 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.602978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.610883 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fc8506a2-8580-4aa4-9586-ad9c40be9e3f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1678 microversion: 2.1 time: 0.160883 Jul 14 16:07:52.611496 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3562/7285] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:52 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:53.629597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:53.630143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:53.637115 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.637563 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.638323 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.638758 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.773268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:53.781001 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2eaed144-2c8e-470c-951b-4f9ca273f482 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1682 microversion: 2.1 time: 0.155392 Jul 14 16:07:53.781615 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3724/7286] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:53 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:19.975159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:19.976042 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:19.978602 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=16 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:19.979445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:19.986125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.986588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.987412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.987864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.055850 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c4bf25e7-0b9a-493f-aa6e-04f353be7e1f tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action" status: 200 len: 62920 microversion: 2.1 time: 0.085129 Jul 14 16:08:20.056535 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3563/7287] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:08:19 2022] POST /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103/action => generated 62920 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:08:27.078839 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:27.079772 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:27.083061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=16 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:27.083205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-3be00d7f-d983-4675-85ed-bd9a3cc83654 req-b5ec4f37-f54c-4d57-bb80-eeff97a1e823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "572d3d33-1b94-4fe7-a72e-bc438bb4b103", "tag": "18c96e59-bc9d-4ced-9ed2-f8db07270ee9"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:27.084219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=46 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:27.091168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.091720 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.092612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.093246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.094723 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3be00d7f-d983-4675-85ed-bd9a3cc83654 req-b5ec4f37-f54c-4d57-bb80-eeff97a1e823 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.095776 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-3be00d7f-d983-4675-85ed-bd9a3cc83654 req-b5ec4f37-f54c-4d57-bb80-eeff97a1e823 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.110537 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-3be00d7f-d983-4675-85ed-bd9a3cc83654 req-b5ec4f37-f54c-4d57-bb80-eeff97a1e823 service nova] Creating event network-changed:18c96e59-bc9d-4ced-9ed2-f8db07270ee9 for instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 on n-h1-768852-23 Jul 14 16:08:27.118928 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-3be00d7f-d983-4675-85ed-bd9a3cc83654 req-b5ec4f37-f54c-4d57-bb80-eeff97a1e823 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040874 Jul 14 16:08:27.120293 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3564/7288] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:27.121697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:08:27.217739 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e4af43fc-4818-4e50-8840-29e90e99ca92 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 204 len: 0 microversion: 2.1 time: 0.142134 Jul 14 16:08:27.218892 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3725/7289] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:08:27 2022] DELETE /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:08:27.228917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:27.229652 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:27.237607 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.238111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.238925 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.242851 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.395509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.403212 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c171b20-27e6-4467-9f3e-8f8cb050db8c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1688 microversion: 2.1 time: 0.179893 Jul 14 16:08:27.404314 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3565/7290] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:27 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:28.422414 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:28.423117 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:28.430324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.430768 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.431828 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.432274 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.570669 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.581400 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a5cfa9e9-e25f-4aed-a731-bc9123ec4bd9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1688 microversion: 2.1 time: 0.162967 Jul 14 16:08:28.582230 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3726/7291] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:28 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:29.606649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:29.607333 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:29.614922 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.615420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.616202 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.616646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.637371 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7de1ab8c-7f81-4bb5-8818-4490038f81dd req-9c7523fc-121e-4ae0-8bea-f72be1c03673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "572d3d33-1b94-4fe7-a72e-bc438bb4b103", "name": "network-vif-deleted", "tag": "18c96e59-bc9d-4ced-9ed2-f8db07270ee9"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:29.648497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7de1ab8c-7f81-4bb5-8818-4490038f81dd req-9c7523fc-121e-4ae0-8bea-f72be1c03673 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.649073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7de1ab8c-7f81-4bb5-8818-4490038f81dd req-9c7523fc-121e-4ae0-8bea-f72be1c03673 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.662337 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7de1ab8c-7f81-4bb5-8818-4490038f81dd req-9c7523fc-121e-4ae0-8bea-f72be1c03673 service nova] Creating event network-vif-deleted:18c96e59-bc9d-4ced-9ed2-f8db07270ee9 for instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 on n-h1-768852-23 Jul 14 16:08:29.668093 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7de1ab8c-7f81-4bb5-8818-4490038f81dd req-9c7523fc-121e-4ae0-8bea-f72be1c03673 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036244 Jul 14 16:08:29.668824 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3727/7292] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:29.695857 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.704149 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-34e99d54-575c-49f1-b2cd-f55f202e1631 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 200 len: 1502 microversion: 2.1 time: 0.101954 Jul 14 16:08:29.704765 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3566/7293] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:29 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 1502 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:30.730213 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:30.731489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: 572d3d33-1b94-4fe7-a72e-bc438bb4b103] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:30.743019 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.743845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.745160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.745903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.769799 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] HTTP exception thrown: Instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 could not be found. Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Request method failure captured: Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 HTTP/1.1 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0D310oNQIZeJyEh4Bj2AFJsRKHR0-TVb1L0on-RjiHb-_pDiQ0JZb2e-fY2kKUvQhjZQnQ-NxlYt7x1LFBc5mddSAosoXPGbgYKE4J1aXVFB0MxSPsEYei0nxckWxS0UZcbMu28noCp6iHH4dmRFroK4-EikkYpZqD0qOWJfjh-RApM Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95573e51cb7549d99419265725c74af4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95573e51cb7549d99419265725c74af4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: aa8dea9b55bf4b5eb4fc0572b936f5b0 Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 could not be found. Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': '572d3d33-1b94-4fe7-a72e-bc438bb4b103'} Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 could not be found. Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 could not be found. Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:08:30.773466 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 could not be found. Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Returning 404 to user: Instance 572d3d33-1b94-4fe7-a72e-bc438bb4b103 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c95ca8cd-be4b-4b5d-aec8-226156ffb95c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103" status: 404 len: 111 microversion: 2.1 time: 0.055060 Jul 14 16:08:30.781918 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3728/7294] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:30 2022] GET /compute/v2.1/servers/572d3d33-1b94-4fe7-a72e-bc438bb4b103 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:08:34.399046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0bbff5a0-6ed3-4ad3-affa-2f04c503ad5d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '.version_select at 0x7fdbf1c278b0>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.424135 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0bbff5a0-6ed3-4ad3-affa-2f04c503ad5d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1160933014" status: 202 len: 0 microversion: 2.1 time: 0.030930 Jul 14 16:08:34.424736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3567/7295] 10.222.0.98 () {58 vars in 1283 bytes} [Thu Jul 14 16:08:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1160933014 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:08:34.459852 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9d00310-8cae-4286-b144-28b98c61e3e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: .version_select at 0x7fdbf1e74040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1483609384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDnCkblzlmOPZPTWYA2DDCNg42aeoIf/YafSlXb4AQ7NVxPhESo9hEtJHIJ0rhiJEPZjLkNC0uYzAe4nWOztB6foHyhopLyzAMkx3qM1piFkKVraVp/Pr3f6v/TT/03jig=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:34.476334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b9d00310-8cae-4286-b144-28b98c61e3e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:08:34.481470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-b9d00310-8cae-4286-b144-28b98c61e3e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:08:34.505904 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9d00310-8cae-4286-b144-28b98c61e3e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.050560 Jul 14 16:08:34.506515 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3729/7296] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:08:34 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:41.293488 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1482400782", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "networks": [{"uuid": "30a72348-ba71-4813-97ab-18d62fad6d41"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1483609384", "security_groups": [{"name": "tempest-secgroup-smoke-1742527942"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:41.311766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=18 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:41.454878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] validate_networks() for [('30a72348-ba71-4813-97ab-18d62fad6d41', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:08:42.042649 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:08:42.043351 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:08:42.044137 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:08:42.044805 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:08:42.045500 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:08:42.056724 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.057260 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.058336 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.058996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.087489 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:08:42.095481 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Getting quotas for user aa8dea9b55bf4b5eb4fc0572b936f5b0 and project 95573e51cb7549d99419265725c74af4. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:08:42.116071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:08:42.119201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:08:42.193292 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d85edbff-4970-4a4f-a9f5-68367b16917d tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.905326 Jul 14 16:08:42.199907 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3568/7297] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:08:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:08:42.212334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-4ddfa474-7815-450d-bfbe-e568485988e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:42.212993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-4ddfa474-7815-450d-bfbe-e568485988e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:42.216196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:42.315142 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-4ddfa474-7815-450d-bfbe-e568485988e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.342841 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-4ddfa474-7815-450d-bfbe-e568485988e9 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1267 microversion: 2.1 time: 0.135215 Jul 14 16:08:42.343500 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3730/7298] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:42 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1267 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:43.376758 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:43.377444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:43.400580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.401863 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.403763 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.405069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.516862 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.533123 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e65ff6ab-13be-44dc-83f7-5776f17daf12 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1319 microversion: 2.1 time: 0.175406 Jul 14 16:08:43.534680 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3569/7299] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:43 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:44.561327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:44.561928 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:44.574248 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.580832 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.584367 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.585119 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.683591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:44.694204 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-21111435-c68f-47c8-8bab-06127f62697b tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1325 microversion: 2.1 time: 0.137031 Jul 14 16:08:44.694822 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3731/7300] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:44 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1325 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:45.721261 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:45.721903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:45.729331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.729692 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.730501 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.730981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.992536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.001878 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-8beab6e3-97db-48b1-b903-d33fc8506326 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.285763 Jul 14 16:08:46.002488 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3570/7301] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:45 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:46.155532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7ccdb2f7-42a1-496d-a1e9-89e552ce34a3 req-f98f1f29-4b6f-4e09-8ae8-31060a723348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaa22bf-00ba-4459-bfee-004a9ac7d4cc", "tag": "9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:46.166822 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7ccdb2f7-42a1-496d-a1e9-89e552ce34a3 req-f98f1f29-4b6f-4e09-8ae8-31060a723348 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.167765 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7ccdb2f7-42a1-496d-a1e9-89e552ce34a3 req-f98f1f29-4b6f-4e09-8ae8-31060a723348 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.187341 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7ccdb2f7-42a1-496d-a1e9-89e552ce34a3 req-f98f1f29-4b6f-4e09-8ae8-31060a723348 service nova] Creating event network-changed:9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc for instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc on n-h2-768852-23 Jul 14 16:08:46.195403 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7ccdb2f7-42a1-496d-a1e9-89e552ce34a3 req-f98f1f29-4b6f-4e09-8ae8-31060a723348 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045204 Jul 14 16:08:46.195989 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3732/7302] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:08:47.019774 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:47.020510 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:47.027748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.028264 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.029361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.029859 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.172275 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.182698 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-01877212-c56f-4ade-8c99-f9964c17d4ca tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.166926 Jul 14 16:08:47.183321 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3571/7303] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:47 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:48.201776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.202476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.209479 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.209924 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.210690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.211153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.351672 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.359508 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b08351d4-ce54-4d56-b137-f99f9ad69eac tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.163035 Jul 14 16:08:48.360088 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3733/7304] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:48 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:49.377367 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.378403 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.386984 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.387476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.388849 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.389400 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.597684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.614981 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b8a05db4-d02b-4fbd-a2ac-4b21741520c1 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.241455 Jul 14 16:08:49.616046 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3572/7305] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:49 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:50.640590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.641413 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.649419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.649877 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.650668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.651107 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.808921 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:50.817293 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-16af1cd2-200b-4fb2-b61e-a51cd4e5e961 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.180961 Jul 14 16:08:50.826969 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3734/7306] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:50 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:51.835378 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:51.836010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:51.838661 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:51.845159 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:51.845679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:51.846565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:51.847078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.003084 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.013012 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7c77c987-3340-4d3f-8803-8491e6d3d473 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.181865 Jul 14 16:08:52.014089 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3573/7307] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:51 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:52.165694 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-8932c16a-13cd-442f-9b76-3f3864a4f445 req-ea78eda2-1c2e-42a0-aea2-b1348f968d25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaa22bf-00ba-4459-bfee-004a9ac7d4cc", "name": "network-vif-plugged", "status": "completed", "tag": "9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:52.182952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8932c16a-13cd-442f-9b76-3f3864a4f445 req-ea78eda2-1c2e-42a0-aea2-b1348f968d25 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.183756 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-8932c16a-13cd-442f-9b76-3f3864a4f445 req-ea78eda2-1c2e-42a0-aea2-b1348f968d25 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.206413 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-8932c16a-13cd-442f-9b76-3f3864a4f445 req-ea78eda2-1c2e-42a0-aea2-b1348f968d25 service nova] Creating event network-vif-plugged:9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc for instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc on n-h2-768852-23 Jul 14 16:08:52.215926 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-8932c16a-13cd-442f-9b76-3f3864a4f445 req-ea78eda2-1c2e-42a0-aea2-b1348f968d25 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055405 Jul 14 16:08:52.217084 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3735/7308] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:53.038404 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:53.039072 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:53.041285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:53.042235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:53.052080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.052575 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.053395 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.053853 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.203813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:53.211684 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c6921b70-c476-4229-b14d-89615d5fbf31 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1393 microversion: 2.1 time: 0.178352 Jul 14 16:08:53.212259 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3574/7309] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:53 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1393 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:54.226076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:54.231459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:54.232185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:54.239962 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.240416 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.241210 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.241652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.418146 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.427215 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f5fb52ca-474f-4a8b-a859-0a6b95b55d2a tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1566 microversion: 2.1 time: 0.201391 Jul 14 16:08:54.428046 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3736/7310] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:54 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:54.454339 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:54.455413 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:54.464740 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.465205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.466027 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.466490 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.642530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.651945 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fe60706d-69ac-4268-bbca-82864bfac959 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1566 microversion: 2.1 time: 0.202739 Jul 14 16:08:54.651945 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3575/7311] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:54 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:56.889035 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:56.889912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:56.892559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-50d14c7e-695b-45b5-83e4-ea72c959f0b0 req-c1e2cc4e-cdde-4169-b46f-013eeb68d334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaa22bf-00ba-4459-bfee-004a9ac7d4cc", "tag": "9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:08:56.899000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.899522 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.900521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.901170 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.905177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-50d14c7e-695b-45b5-83e4-ea72c959f0b0 req-c1e2cc4e-cdde-4169-b46f-013eeb68d334 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.905632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-50d14c7e-695b-45b5-83e4-ea72c959f0b0 req-c1e2cc4e-cdde-4169-b46f-013eeb68d334 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.918394 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-50d14c7e-695b-45b5-83e4-ea72c959f0b0 req-c1e2cc4e-cdde-4169-b46f-013eeb68d334 service nova] Creating event network-changed:9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc for instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc on n-h2-768852-23 Jul 14 16:08:56.924569 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-50d14c7e-695b-45b5-83e4-ea72c959f0b0 req-c1e2cc4e-cdde-4169-b46f-013eeb68d334 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035789 Jul 14 16:08:56.925837 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3576/7312] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:08:57.049517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:57.058906 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c114d76c-9cef-4b50-8a38-442fb47c15c8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1566 microversion: 2.1 time: 0.173871 Jul 14 16:08:57.071205 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3737/7313] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:56 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:19.407638 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:19.408675 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:19.411107 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=7 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:19.411829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=46 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:19.419506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.419895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.420690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.421162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.498675 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d98a3c1e-22b4-41ee-a5de-a4571c551649 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action" status: 200 len: 24575 microversion: 2.1 time: 0.096239 Jul 14 16:09:19.499601 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3577/7314] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:09:19 2022] POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action => generated 24575 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 16:09:25.899959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:25.900553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:25.902683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:25.903534 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:25.911180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:25.911652 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:25.912423 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:25.912859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:25.937258 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lazy-loading 'flavor' on Instance uuid adaa22bf-00ba-4459-bfee-004a9ac7d4cc {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:09:26.005991 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d9ed3655-be2b-4894-8b3d-5e966c21abb4 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action" status: 202 len: 0 microversion: 2.1 time: 0.110336 Jul 14 16:09:26.006575 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3738/7315] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:09:25 2022] POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:09:26.015291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:26.016024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:26.024609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:26.025093 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.025908 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:26.026432 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.163006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:26.170652 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-864a149d-e5eb-42a7-9cc9-3e9e121742be tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1693 microversion: 2.1 time: 0.159580 Jul 14 16:09:26.171233 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3578/7316] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:26 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:27.188907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:27.189616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:27.196878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.197320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.198092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.198556 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.349263 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:27.360781 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7a175cf6-8b20-4288-9b39-c9c37e20aac8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1676 microversion: 2.1 time: 0.177092 Jul 14 16:09:27.361752 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3739/7317] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:27 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:28.479577 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:28.480509 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:28.488223 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.489384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.490233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.490584 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.545802 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fa37caae-4740-4a27-b8d6-8adbb3236b1e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action" status: 200 len: 35130 microversion: 2.1 time: 0.070006 Jul 14 16:09:28.546467 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3579/7318] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:09:28 2022] POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action => generated 35130 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:09:28.557759 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:28.558664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:28.566061 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.566508 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.567281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.567721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.638481 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d060739c-1e79-40f8-a3fa-7fc0c9597664 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action" status: 202 len: 0 microversion: 2.1 time: 0.084600 Jul 14 16:09:28.639127 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3740/7319] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:09:28 2022] POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:09:28.648035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:28.648752 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:28.657411 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.658020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.659054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.659708 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.850767 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:28.859425 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-dca1683b-e96f-4d2d-994b-6f04e2d541dc tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1682 microversion: 2.1 time: 0.215153 Jul 14 16:09:28.860203 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3580/7320] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:28 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:29.879250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:29.879959 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:29.887021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.887512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.888285 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.888723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:30.023801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:30.031620 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1e981881-58ab-4a84-9e71-eedd60a6a087 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1682 microversion: 2.1 time: 0.157521 Jul 14 16:09:30.032212 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3741/7321] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:29 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:31.050817 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:31.051487 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:31.058746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.059221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.060495 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.060950 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.209229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:31.216991 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d152b84-d5c6-434d-8777-a16eb9c74c10 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1685 microversion: 2.1 time: 0.170277 Jul 14 16:09:31.217576 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3581/7322] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:31 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1685 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:31.314279 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:31.315101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:31.322929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.323393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.324163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.324596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.384106 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-080d10ef-616a-4681-a042-1855762da471 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action" status: 200 len: 35130 microversion: 2.1 time: 0.073559 Jul 14 16:09:31.384967 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3742/7323] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:09:31 2022] POST /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc/action => generated 35130 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:09:32.541340 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:32.542051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:32.544870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1fbf79f0-5e40-4ba8-824e-15a27dc50365 req-2374df3c-03dc-4ad7-8a90-7684c5c22c34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adaa22bf-00ba-4459-bfee-004a9ac7d4cc", "tag": "9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:32.549707 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.550178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.550960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.551545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.554571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1fbf79f0-5e40-4ba8-824e-15a27dc50365 req-2374df3c-03dc-4ad7-8a90-7684c5c22c34 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.555016 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1fbf79f0-5e40-4ba8-824e-15a27dc50365 req-2374df3c-03dc-4ad7-8a90-7684c5c22c34 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.567163 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1fbf79f0-5e40-4ba8-824e-15a27dc50365 req-2374df3c-03dc-4ad7-8a90-7684c5c22c34 service nova] Creating event network-changed:9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc for instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc on n-h2-768852-23 Jul 14 16:09:32.572779 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1fbf79f0-5e40-4ba8-824e-15a27dc50365 req-2374df3c-03dc-4ad7-8a90-7684c5c22c34 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032395 Jul 14 16:09:32.573920 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3743/7324] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:09:32.580422 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:09:32.724823 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1dc88419-9aab-488e-82b2-df3ae6eaca95 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 204 len: 0 microversion: 2.1 time: 0.188117 Jul 14 16:09:32.725437 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3582/7325] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:09:32 2022] DELETE /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:09:32.742334 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:32.743531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:32.757947 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.758532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.759856 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.760790 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.934608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:32.944365 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-298a3d5c-190a-457c-8df8-352ed1ce196c tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1691 microversion: 2.1 time: 0.210352 Jul 14 16:09:32.945020 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3744/7326] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:32 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:33.966177 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:33.966895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:33.974795 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.975326 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.976136 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.976591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.181111 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:34.194701 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0d97664d-d2e2-4813-9b3d-214a51a13c6e tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1691 microversion: 2.1 time: 0.232369 Jul 14 16:09:34.195738 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3583/7327] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:33 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1691 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:35.006178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-7e30e1e1-f7ab-4e7a-b30f-99da2a9c456f req-03c1286e-179f-4d75-a073-307e3a4c92de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adaa22bf-00ba-4459-bfee-004a9ac7d4cc", "name": "network-vif-deleted", "tag": "9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:35.017330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7e30e1e1-f7ab-4e7a-b30f-99da2a9c456f req-03c1286e-179f-4d75-a073-307e3a4c92de service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.017761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-7e30e1e1-f7ab-4e7a-b30f-99da2a9c456f req-03c1286e-179f-4d75-a073-307e3a4c92de service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.030875 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-7e30e1e1-f7ab-4e7a-b30f-99da2a9c456f req-03c1286e-179f-4d75-a073-307e3a4c92de service nova] Creating event network-vif-deleted:9034ba0d-1f2e-4560-bc3d-f8b3f3101cbc for instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc on n-h2-768852-23 Jul 14 16:09:35.037902 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-7e30e1e1-f7ab-4e7a-b30f-99da2a9c456f req-03c1286e-179f-4d75-a073-307e3a4c92de service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037167 Jul 14 16:09:35.038627 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3745/7328] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:35.214706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:35.215235 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:35.222777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.223238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.224064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.224508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.257822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.258797 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.259259 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lazy-loading 'fault' on Instance uuid adaa22bf-00ba-4459-bfee-004a9ac7d4cc {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:09:35.308565 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa8dea9b55bf4b5eb4fc0572b936f5b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95573e51cb7549d99419265725c74af4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:35.316713 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-684341c6-9b3e-4779-a3e0-143bef7a5c43 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 200 len: 1357 microversion: 2.1 time: 0.105935 Jul 14 16:09:35.317321 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3584/7329] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:35 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 1357 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:36.339329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:36.340603 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] [instance: adaa22bf-00ba-4459-bfee-004a9ac7d4cc] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:36.347181 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.347656 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.348424 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.349491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.365850 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] HTTP exception thrown: Instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc could not be found. Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Request method failure captured: Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc HTTP/1.1 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0D310oNQIZeJyEh4Bj2AFJsRKHR0-TVb1L0on-RjiHb-_pDiQ0JZb2e-fY2kKUvQhjZQnQ-NxlYt7x1LFBc5mddSAosoXPGbgYKE4J1aXVFB0MxSPsEYei0nxckWxS0UZcbMu28noCp6iHH4dmRFroK4-EikkYpZqD0qOWJfjh-RApM Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_95573e51cb7549d99419265725c74af4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/95573e51cb7549d99419265725c74af4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/95573e51cb7549d99419265725c74af4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: 95573e51cb7549d99419265725c74af4 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1650420056 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: aa8dea9b55bf4b5eb4fc0572b936f5b0 Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1650420056-project Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc could not be found. Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'adaa22bf-00ba-4459-bfee-004a9ac7d4cc'} Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc could not be found. Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc could not be found. Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:09:36.367529 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc could not be found. Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Returning 404 to user: Instance adaa22bf-00ba-4459-bfee-004a9ac7d4cc could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-aaa62d99-ab25-45b0-bf42-e270b50f8f63 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc" status: 404 len: 111 microversion: 2.1 time: 0.034878 Jul 14 16:09:36.372431 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3746/7330] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:36 2022] GET /compute/v2.1/servers/adaa22bf-00ba-4459-bfee-004a9ac7d4cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:09:39.969545 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f64ad89d-77ec-4632-b2e0-6c859dc771b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] Calling method '.version_select at 0x7fdbf1eb9280>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:40.000391 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f64ad89d-77ec-4632-b2e0-6c859dc771b8 tempest-TestNetworkAdvancedServerOps-1650420056 tempest-TestNetworkAdvancedServerOps-1650420056-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1483609384" status: 202 len: 0 microversion: 2.1 time: 0.034888 Jul 14 16:09:40.001015 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3585/7331] 10.222.0.98 () {58 vars in 1283 bytes} [Thu Jul 14 16:09:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1483609384 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:09:52.923627 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=18 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:52.924400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:53.118980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-362c743c-d00a-4772-9de9-8d386fe3329f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'create', calling method: .version_select at 0x7fdbf1e90550>, body: {"keypair": {"name": "tempest-TestShelveInstance-892764598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIzori/UAYX4AR5XhI5ys1OstkG20lsg05W+FsymIgxlChwm8FF6Zxfy9g+atGf7bJHL7flPosqP99vUe3LZ8afDnOndss0L3F0OJz+Mi96DsmrYsWqf3rhQYUP73S5d0A=="}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:53.134036 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-362c743c-d00a-4772-9de9-8d386fe3329f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:09:53.140067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-362c743c-d00a-4772-9de9-8d386fe3329f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for user bd16884baf734654860f1c60809f51ac and project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'key_pairs'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:09:53.168342 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-362c743c-d00a-4772-9de9-8d386fe3329f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.250747 Jul 14 16:09:53.168971 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3747/7332] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:09:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:54.229148 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1430345720", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-892764598", "security_groups": [{"name": "tempest-secgroup-smoke-719311938"}], "networks": [{"uuid": "111881fa-0340-4bf9-9bd3-3f9f572fd20d"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:54.237717 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:54.238542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:54.455514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] validate_networks() for [('111881fa-0340-4bf9-9bd3-3f9f572fd20d', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:09:54.858999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:09:54.859539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:09:54.860198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:09:54.860631 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:09:54.861057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:09:54.870224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.870688 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.871534 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.872175 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.889436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:09:54.894930 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for user bd16884baf734654860f1c60809f51ac and project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:09:54.909742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:09:54.912683 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:09:54.958486 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-63222975-7594-4de9-b11c-1b410dba82d5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.732627 Jul 14 16:09:54.964133 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3586/7333] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:09:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:09:54.970597 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb8087e8-02b1-4499-ae4f-503d1151ff35 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:54.971380 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fb8087e8-02b1-4499-ae4f-503d1151ff35 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:55.198373 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fb8087e8-02b1-4499-ae4f-503d1151ff35 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:55.209624 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb8087e8-02b1-4499-ae4f-503d1151ff35 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1246 microversion: 2.1 time: 0.243909 Jul 14 16:09:55.220623 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3748/7334] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:54 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1246 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:56.230286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:56.232029 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:56.250409 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.251163 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.252529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.253328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.346713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:56.357250 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-86928511-a214-441e-94a3-1a03b9670744 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1306 microversion: 2.1 time: 0.132759 Jul 14 16:09:56.358772 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3587/7335] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:56 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1306 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:57.384636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:57.385266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:57.393153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.393599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.394386 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.394821 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.651752 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:57.663512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-50fcdd16-9927-4e64-8cc0-8e1857501fec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.284943 Jul 14 16:09:57.666039 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3749/7336] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:57 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:58.059441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-edf57d94-3085-4a3d-bf03-6d755ba78b9a req-dedb6bc7-a3e8-4a6c-9a40-336edab530d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:09:58.086668 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edf57d94-3085-4a3d-bf03-6d755ba78b9a req-dedb6bc7-a3e8-4a6c-9a40-336edab530d9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:58.087126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-edf57d94-3085-4a3d-bf03-6d755ba78b9a req-dedb6bc7-a3e8-4a6c-9a40-336edab530d9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:58.104717 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-edf57d94-3085-4a3d-bf03-6d755ba78b9a req-dedb6bc7-a3e8-4a6c-9a40-336edab530d9 service nova] Creating event network-changed:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h1-768852-23 Jul 14 16:09:58.112516 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-edf57d94-3085-4a3d-bf03-6d755ba78b9a req-dedb6bc7-a3e8-4a6c-9a40-336edab530d9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064708 Jul 14 16:09:58.113919 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3588/7337] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:09:58.684732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:58.685324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:58.692608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:58.693052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:58.693820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:58.694253 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:58.847086 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:58.855783 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f6eb2d59-01ee-4d4a-9ff4-6b0ff8f98561 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.175118 Jul 14 16:09:58.856376 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3750/7338] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:58 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:59.873530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:59.874222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:59.882266 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:59.882721 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:59.883535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:59.884007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.034408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:00.042486 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-34ae3017-37f1-4d39-8caa-92a89433c579 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.173201 Jul 14 16:10:00.043246 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3589/7339] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:59 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:01.061124 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:01.061742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:01.069255 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.069706 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.070767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.071457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.211805 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:01.219210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-058ef44b-eb87-4e75-9f2a-30e469a6dc41 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.162281 Jul 14 16:10:01.219821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3751/7340] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:01 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:02.235671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:02.236300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:02.243420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.243882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.244662 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.245108 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.377485 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:02.385237 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-586a88d9-cd98-4b86-a7ab-0627d1476e4d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.153716 Jul 14 16:10:02.385813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3590/7341] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:02 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:03.403218 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:03.404203 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:03.411079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.411552 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.412332 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.412816 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.552572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:03.560590 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ac6de560-aa67-45e1-9732-0dd6275c9aa7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.161403 Jul 14 16:10:03.561169 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3752/7342] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:03 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:04.578503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:04.579242 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:04.587069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:04.587571 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:04.588519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:04.588975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:04.735699 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:04.744512 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c5e5ff11-5108-41ec-8ea0-e67e5b29d762 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.169863 Jul 14 16:10:04.745142 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3591/7343] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:04 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:04.799006 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-c4438e36-0737-4c48-a164-333f66d0f2d1 req-703f350a-36cd-4d7d-ab21-9fc586a301c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "name": "network-vif-plugged", "status": "completed", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:04.810761 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c4438e36-0737-4c48-a164-333f66d0f2d1 req-703f350a-36cd-4d7d-ab21-9fc586a301c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:04.811237 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-c4438e36-0737-4c48-a164-333f66d0f2d1 req-703f350a-36cd-4d7d-ab21-9fc586a301c9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:04.823168 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-c4438e36-0737-4c48-a164-333f66d0f2d1 req-703f350a-36cd-4d7d-ab21-9fc586a301c9 service nova] Creating event network-vif-plugged:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h1-768852-23 Jul 14 16:10:04.829712 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-c4438e36-0737-4c48-a164-333f66d0f2d1 req-703f350a-36cd-4d7d-ab21-9fc586a301c9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034437 Jul 14 16:10:04.830336 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3753/7344] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:05.762981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:05.763674 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:05.765646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.766319 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.774123 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.774589 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.775390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.775838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.915381 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.927976 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-46390fae-09d5-463c-831f-cd6c2b07dba1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1371 microversion: 2.1 time: 0.169054 Jul 14 16:10:05.928824 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3592/7345] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:05 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:06.942885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:06.950243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:06.950950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:06.958251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.958690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.959483 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.959912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.118643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.127011 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c24dfcab-aadd-443c-90a0-6f3603bf966a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1555 microversion: 2.1 time: 0.184960 Jul 14 16:10:07.128114 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3754/7346] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:06 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1555 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:07.144819 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:07.146007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:07.152791 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.153249 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.154287 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.154732 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.297086 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.304990 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c9c9c1e6-77d5-431c-a878-b66503fd689e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1555 microversion: 2.1 time: 0.164234 Jul 14 16:10:07.305588 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3593/7347] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:07 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:08.709434 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:08.710043 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:09.424714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-df2229ff-ba8e-49f7-b292-409ea0b46328 req-30b29103-9909-4468-961e-6dac5769831e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:09.434462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-df2229ff-ba8e-49f7-b292-409ea0b46328 req-30b29103-9909-4468-961e-6dac5769831e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:09.435005 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-df2229ff-ba8e-49f7-b292-409ea0b46328 req-30b29103-9909-4468-961e-6dac5769831e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.447584 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-df2229ff-ba8e-49f7-b292-409ea0b46328 req-30b29103-9909-4468-961e-6dac5769831e service nova] Creating event network-changed:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h1-768852-23 Jul 14 16:10:09.453182 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-df2229ff-ba8e-49f7-b292-409ea0b46328 req-30b29103-9909-4468-961e-6dac5769831e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092342 Jul 14 16:10:09.453826 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3755/7348] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:12:06.599495 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:12:06.600590 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:12:06.601786 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:06.602777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=40 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:06.607387 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:06.607956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:06.615838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.616327 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.617201 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.617660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.644375 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.objects.instance [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lazy-loading 'flavor' on Instance uuid ec86172d-5723-462a-88e5-ce3fc2823340 {{(pid=125966) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:12:07.064536 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7b1bbed5-8f5a-4383-a726-62949cef3d94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340/action" status: 202 len: 0 microversion: 2.1 time: 0.466791 Jul 14 16:12:07.065172 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3594/7349] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:12:06 2022] POST /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:12:07.072539 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [-] [574aebdb-cb84-4fd6-8f40-ef27447caa36] AMQP server on 10.222.0.98:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 16:12:07.073722 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72ca8299-b74b-446c-b746-de563576c583] AMQP server on 10.222.0.98:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 16:12:07.074038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:07.075044 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=34 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:07.080625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:07.081344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:07.089623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:07.090075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.090851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:07.091316 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.229917 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.237580 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-d2c82f12-144e-47ac-a122-e16bbb85d18d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.167643 Jul 14 16:12:07.238254 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3756/7350] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:07 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:08.257820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:08.258530 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:08.266014 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.266483 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.267250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.267718 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.274945 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 43734. Jul 14 16:12:08.285616 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 43732. Jul 14 16:12:08.404646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.412351 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f8076ab6-c6e4-465e-9a47-9e98610f0fd2 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.160216 Jul 14 16:12:08.412933 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3595/7351] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:08 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:09.430075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:09.430681 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:09.443909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.444360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.445118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.445551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.451781 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] [72ca8299-b74b-446c-b746-de563576c583] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 43742. Jul 14 16:12:09.454836 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] [574aebdb-cb84-4fd6-8f40-ef27447caa36] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 43740. Jul 14 16:12:09.582990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:09.591281 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-40331ce2-81e5-4205-a1f1-eff687c653d3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.165239 Jul 14 16:12:09.591875 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3757/7352] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:09 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:10.609941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:10.610492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:10.617748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.618212 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.618999 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.619519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.754929 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.763125 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05213cd5-fd22-4974-aaa8-37ec17dc615b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.157237 Jul 14 16:12:10.763736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3596/7353] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:10 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:11.781315 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:11.781954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:11.788912 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.789357 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.790114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.790546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.929878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.937671 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f986d7f3-4b20-4f58-aa8e-dc153461b93d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.160578 Jul 14 16:12:11.938270 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3758/7354] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:11 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:12.955604 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:12.956237 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:12.963836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.964279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.965056 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.965508 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:13.096444 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:13.104142 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0960bf11-8bcd-4b7d-9b50-10fbcb03b167 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.152468 Jul 14 16:12:13.104720 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3597/7355] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:12 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:13.234624 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:12:13.235179 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:12:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:12:14.121383 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:14.121998 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:14.128887 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.129329 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.130088 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.130516 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.262518 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:14.270232 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5feafa3b-a191-4aa7-8743-3b123d897e12 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.152779 Jul 14 16:12:14.270810 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3759/7356] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:14 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:15.288919 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:15.289548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:15.296536 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.296994 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.297775 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.298224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.435547 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:15.443170 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5cc876a7-882d-4832-884c-a7fae9312b95 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.158845 Jul 14 16:12:15.443848 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3598/7357] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:15 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:16.461051 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:16.461644 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:16.468712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.469167 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.469965 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.470402 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.606546 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:16.614256 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2cf67804-c4cc-4680-96d4-99828bf921f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.157617 Jul 14 16:12:16.614841 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3760/7358] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:16 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:17.631746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:17.632901 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:17.640302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.640771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.641550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.641996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.777049 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:17.785621 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ca41333-087e-434c-96c9-bc95fceb7a68 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1699 microversion: 2.1 time: 0.157774 Jul 14 16:12:17.786275 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3599/7359] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:17 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1699 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:18.804468 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:18.805084 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:18.812137 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.812586 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.813346 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.813785 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.947320 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:18.954845 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca18df35-044e-4faf-8ffe-61e7319b2d87 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1699 microversion: 2.1 time: 0.155004 Jul 14 16:12:18.955467 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3761/7360] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:18 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1699 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:19.972633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:19.973247 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:19.981302 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.981779 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:19.982624 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.983082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:20.130519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:20.139951 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-16b08c7a-bff1-4853-bb8a-b02b54bbda30 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.171004 Jul 14 16:12:20.140618 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3600/7361] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:19 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:21.161715 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:21.163041 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:21.169489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.169936 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.170945 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.171577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.339977 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:21.349903 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-168006fb-51d4-4b4a-ab56-0f7f8842d527 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.195473 Jul 14 16:12:21.364594 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3762/7362] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:21 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:21.427083 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-9be34c76-3477-46cb-b213-b8986aed4bc3 req-67edaed1-7580-47ab-9989-20bc6d58e7c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "name": "network-vif-plugged", "status": "completed", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:21.436734 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9be34c76-3477-46cb-b213-b8986aed4bc3 req-67edaed1-7580-47ab-9989-20bc6d58e7c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.437389 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-9be34c76-3477-46cb-b213-b8986aed4bc3 req-67edaed1-7580-47ab-9989-20bc6d58e7c8 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.453741 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-9be34c76-3477-46cb-b213-b8986aed4bc3 req-67edaed1-7580-47ab-9989-20bc6d58e7c8 service nova] Creating event network-vif-plugged:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h1-768852-23 Jul 14 16:12:21.460422 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-9be34c76-3477-46cb-b213-b8986aed4bc3 req-67edaed1-7580-47ab-9989-20bc6d58e7c8 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111597 Jul 14 16:12:21.461522 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3601/7363] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:12:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:12:22.371382 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:22.372695 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:22.380168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.380855 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.382266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.382782 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.541734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:22.551674 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5ab8ac85-6d70-4223-be8a-fb86032205fe tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.184418 Jul 14 16:12:22.552610 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3763/7364] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:22 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:23.570902 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:23.571689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:23.579519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.580022 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.580813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.581267 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.733063 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:23.741212 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-436c56bc-aa5f-45af-9b73-5a3bd83962b4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.175017 Jul 14 16:12:23.751439 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3602/7365] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:23 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:24.758238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:24.758907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:24.766690 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.767155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.767976 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.768426 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.931224 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:24.939512 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b57a4272-3dcb-461a-9189-4b14b9dd0884 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.185365 Jul 14 16:12:24.943944 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3764/7366] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:24 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:25.960304 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:25.960970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:25.969738 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.970343 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.971397 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.971890 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:26.131193 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:26.140458 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b634e529-629c-4f61-8209-339e0a2f7da5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.184501 Jul 14 16:12:26.141498 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3603/7367] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:25 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:27.158180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:27.161384 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:27.169836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:27.170624 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.171528 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:27.172214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.326659 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:27.335403 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ee99247c-3489-4418-83aa-f138964b0f24 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.180390 Jul 14 16:12:27.336369 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3765/7368] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:27 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:28.353785 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:28.354418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:28.367250 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.367742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.368551 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.369016 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.542098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:28.551008 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1af72aca-2ad3-4f06-aea0-78eb4c91df16 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.201843 Jul 14 16:12:28.552024 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3604/7369] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:28 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:29.571502 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:29.572128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:29.579592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.580042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.580818 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.581247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.717929 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:29.726279 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd99b0ef-b444-4fd7-a1ba-1a845b94fb0c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1694 microversion: 2.1 time: 0.158184 Jul 14 16:12:29.726874 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3766/7370] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:29 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1694 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:30.745046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:30.745714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:30.753178 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.753641 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.754505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.754954 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.910841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:30.919015 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-123c3675-9094-4e09-b4b6-00d102e0fef0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1676 microversion: 2.1 time: 0.178958 Jul 14 16:12:30.919639 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3605/7371] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:30 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1676 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:31.938000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:31.938606 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:31.946131 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.946585 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.947395 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.947836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:32.095721 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:32.104392 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fb6ac408-fad7-4c8f-b714-b7e4964f9597 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1676 microversion: 2.1 time: 0.170458 Jul 14 16:12:32.105006 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3767/7372] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:31 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:33.123548 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:33.124358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:33.130549 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.131010 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.132396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.132842 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.268491 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f7ea3b3a-d9ac-4960-bec1-baaacc5b4e7f req-6b4229b2-2759-45c9-a939-d0e01de66310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "name": "network-vif-unplugged", "status": "completed", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:33.281725 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f7ea3b3a-d9ac-4960-bec1-baaacc5b4e7f req-6b4229b2-2759-45c9-a939-d0e01de66310 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.282186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.282442 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f7ea3b3a-d9ac-4960-bec1-baaacc5b4e7f req-6b4229b2-2759-45c9-a939-d0e01de66310 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.292019 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b0a404bb-47d9-46d0-9a7c-fd899496f04e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1619 microversion: 2.1 time: 0.173503 Jul 14 16:12:33.302482 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3606/7373] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:33 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1619 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:33.302682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.compute.server_external_events [req-f7ea3b3a-d9ac-4960-bec1-baaacc5b4e7f req-6b4229b2-2759-45c9-a939-d0e01de66310 service nova] Unable to find a host for instance ec86172d-5723-462a-88e5-ce3fc2823340. Dropping event network-vif-unplugged {{(pid=125965) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 14 16:12:33.302682 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f7ea3b3a-d9ac-4960-bec1-baaacc5b4e7f req-6b4229b2-2759-45c9-a939-d0e01de66310 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032723 Jul 14 16:12:33.302682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3768/7374] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 14 16:12:33.309542 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:33.310164 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:33.316823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.317290 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.318082 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.318539 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.475988 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7920293-ef1c-454e-82bd-2b638e045fd3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340/action" status: 202 len: 0 microversion: 2.1 time: 0.169867 Jul 14 16:12:33.476678 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3607/7375] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:12:33 2022] POST /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:12:33.485045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:33.485667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:33.492178 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.492978 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.493689 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.494127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.635400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.643199 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e7d29606-6709-44c1-ae23-6fee4787e25f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1627 microversion: 2.1 time: 0.162027 Jul 14 16:12:33.643832 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3769/7376] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:33 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1627 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:34.661956 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:34.662564 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:34.668771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.669228 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.669996 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.670441 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.674553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:34.811392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:34.819802 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2b6de042-b13b-45ff-8c18-e29dc2f5600c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.161936 Jul 14 16:12:34.820400 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3608/7377] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:34 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:35.639771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-20849288-4d67-4031-b9fc-c94f605f9673 req-94720497-de17-4f48-a41a-53ece465ea4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:35.649826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-20849288-4d67-4031-b9fc-c94f605f9673 req-94720497-de17-4f48-a41a-53ece465ea4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.650503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-20849288-4d67-4031-b9fc-c94f605f9673 req-94720497-de17-4f48-a41a-53ece465ea4b service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.662635 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-20849288-4d67-4031-b9fc-c94f605f9673 req-94720497-de17-4f48-a41a-53ece465ea4b service nova] Creating event network-changed:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h2-768852-23 Jul 14 16:12:35.670151 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-20849288-4d67-4031-b9fc-c94f605f9673 req-94720497-de17-4f48-a41a-53ece465ea4b service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105049 Jul 14 16:12:35.671093 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3770/7378] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:12:35.837904 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:35.839221 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:35.846276 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.846782 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.847550 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.848015 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.983623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:35.991355 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e5866537-19eb-40c0-a7c7-63f7942478e4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.158035 Jul 14 16:12:35.992053 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3609/7379] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:35 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:37.011448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:37.012459 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:37.020058 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.020505 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.021271 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.021705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.161813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:37.165662 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=87 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:37.174296 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-05fcb384-dfb0-4fd8-9a2a-67851c64eeff tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.168284 Jul 14 16:12:37.175865 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3771/7380] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:37 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:38.194937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:38.196251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:38.202836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=35 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:38.204777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.205553 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.206918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.207628 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.386684 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:38.395912 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-f69a4c98-e0ac-47ef-99c6-5a4c261b8f8d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.206121 Jul 14 16:12:38.397669 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3610/7381] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:38 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:39.419202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:39.419870 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:39.422578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=33 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:39.428589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:39.429038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:39.429809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:39.430243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:39.591000 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:39.600749 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-875572f7-8486-42b3-ac88-ba90eeca5fe8 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.184675 Jul 14 16:12:39.601587 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3772/7382] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:39 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:40.618730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:40.619349 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:40.626183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.626640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.627493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.627940 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.766704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:40.779227 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-2f96304c-0b94-4cf3-b3db-5ff8f16d4f5e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.164657 Jul 14 16:12:40.789488 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3611/7383] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:40 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:41.799050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:41.799726 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:41.807531 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.808001 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.808775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.809205 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.954448 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:41.961938 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5bbbd4b0-5866-413d-a319-9f233b54fd73 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.167417 Jul 14 16:12:41.962506 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3773/7384] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:41 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:42.980088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:42.980864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:42.988648 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.989118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.989915 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.990371 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:43.139254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:43.147404 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b4d07ee1-32ed-4577-8b53-f6249e115411 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.170666 Jul 14 16:12:43.147984 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3612/7385] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:42 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:44.173591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:44.176243 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:44.185850 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.186299 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.187688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.187688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.614176 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:44.622640 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c9cd0a3a-4719-4a62-a24d-6c55ec6edefd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.459049 Jul 14 16:12:44.623230 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3774/7386] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:44 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:45.640893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:45.641484 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:45.648932 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.649390 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.650158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.650600 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.790445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:45.798131 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-242f37c1-7cd4-4233-8c53-655f473fc251 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.161184 Jul 14 16:12:45.798724 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3613/7387] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:45 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:46.816619 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:46.817261 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:46.824591 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.825045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.825813 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.826251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.972570 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:46.981326 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a3bbc607-0cd6-46ed-9a9e-bee9644226e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.168716 Jul 14 16:12:46.981923 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3775/7388] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:46 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:47.998947 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:47.999597 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:48.007714 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:48.008269 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.009147 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:48.009596 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.139866 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:48.148120 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4bb3103b-7f17-4fbf-8b58-9970be4f4976 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.152981 Jul 14 16:12:48.148643 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3614/7389] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:47 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:49.156643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-e0e22a63-05a8-41da-89fe-8d2794bd5aac req-1e518b5b-a824-410b-b3bb-aa5ba0f2ab54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "name": "network-vif-plugged", "status": "completed", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:49.166268 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e0e22a63-05a8-41da-89fe-8d2794bd5aac req-1e518b5b-a824-410b-b3bb-aa5ba0f2ab54 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.166700 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-e0e22a63-05a8-41da-89fe-8d2794bd5aac req-1e518b5b-a824-410b-b3bb-aa5ba0f2ab54 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.167433 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:49.168138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:49.181396 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-e0e22a63-05a8-41da-89fe-8d2794bd5aac req-1e518b5b-a824-410b-b3bb-aa5ba0f2ab54 service nova] Creating event network-vif-plugged:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h2-768852-23 Jul 14 16:12:49.186875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.187414 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.188177 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-e0e22a63-05a8-41da-89fe-8d2794bd5aac req-1e518b5b-a824-410b-b3bb-aa5ba0f2ab54 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035351 Jul 14 16:12:49.188335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.188632 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.189103 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3776/7390] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:12:49.341827 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:49.350581 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-386020c4-8633-46dd-a91c-29b10a027e3f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.187870 Jul 14 16:12:49.351169 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3615/7391] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:49 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:50.369266 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:50.369956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:50.377228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.377668 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.378422 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.378848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.553551 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:50.561475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-92c58aae-f0ab-4e78-8041-df4b96087611 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1685 microversion: 2.1 time: 0.197056 Jul 14 16:12:50.562068 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3777/7392] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:50 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1685 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:51.579399 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:51.579942 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:51.587419 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.587884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.588665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.589138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.721897 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:51.730043 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-fa478400-7a06-4899-ba71-ad05ad98d5f6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1672 microversion: 2.1 time: 0.154706 Jul 14 16:12:51.730627 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3616/7393] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:51 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:28.722193 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:13:28.722840 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:14:04.211982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:04.212677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:04.215593 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=11 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:04.216204 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-130cde80-57b1-4972-b79b-46a3f7911dce req-1c3802cd-0487-4f34-b2aa-7ed6bba91e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:04.217015 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=33 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:04.224952 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:04.225406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:04.226185 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:04.226616 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:04.235233 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=13 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:04.236182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=52 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:04.239085 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-130cde80-57b1-4972-b79b-46a3f7911dce req-1c3802cd-0487-4f34-b2aa-7ed6bba91e4f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:04.242448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-130cde80-57b1-4972-b79b-46a3f7911dce req-1c3802cd-0487-4f34-b2aa-7ed6bba91e4f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:04.255434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:14:04.257561 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-130cde80-57b1-4972-b79b-46a3f7911dce req-1c3802cd-0487-4f34-b2aa-7ed6bba91e4f service nova] Creating event network-changed:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h2-768852-23 Jul 14 16:14:04.263533 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-130cde80-57b1-4972-b79b-46a3f7911dce req-1c3802cd-0487-4f34-b2aa-7ed6bba91e4f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054470 Jul 14 16:14:04.264547 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3617/7394] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:14:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:14:04.350418 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-bd593bbc-e28b-4423-b56f-45b370debf03 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "DELETE /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 204 len: 0 microversion: 2.1 time: 0.144172 Jul 14 16:14:04.351036 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3778/7395] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:14:04 2022] DELETE /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:14:04.359816 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:04.360529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:04.366924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:04.367420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:04.368207 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:04.368918 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:04.511671 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:04.519714 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3d07e91d-4c80-44a3-88ed-39163f533b07 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.163992 Jul 14 16:14:04.520348 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3618/7396] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:04 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:05.538667 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:05.539410 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:05.546553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:05.546997 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:05.547820 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:05.548256 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:05.768281 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:05.777040 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-54b8d025-5f8e-4152-8bfe-787d09330206 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1678 microversion: 2.1 time: 0.242409 Jul 14 16:14:05.777647 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3779/7397] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:05 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1678 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:14:06.365768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-4bd0d496-dc51-479a-b405-8eba83bb6329 req-0a271043-3a82-4312-9e3f-e08d52ba4963 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec86172d-5723-462a-88e5-ce3fc2823340", "name": "network-vif-deleted", "tag": "a147862b-592c-4883-9e5c-907065f56182"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:06.376618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4bd0d496-dc51-479a-b405-8eba83bb6329 req-0a271043-3a82-4312-9e3f-e08d52ba4963 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.377071 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-4bd0d496-dc51-479a-b405-8eba83bb6329 req-0a271043-3a82-4312-9e3f-e08d52ba4963 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.392316 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-4bd0d496-dc51-479a-b405-8eba83bb6329 req-0a271043-3a82-4312-9e3f-e08d52ba4963 service nova] Creating event network-vif-deleted:a147862b-592c-4883-9e5c-907065f56182 for instance ec86172d-5723-462a-88e5-ce3fc2823340 on n-h2-768852-23 Jul 14 16:14:06.399465 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-4bd0d496-dc51-479a-b405-8eba83bb6329 req-0a271043-3a82-4312-9e3f-e08d52ba4963 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038458 Jul 14 16:14:06.400101 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3619/7398] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:06.797643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:06.798254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:06.806144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.806598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.807407 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.807872 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.842506 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:06.843228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:06.843702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lazy-loading 'fault' on Instance uuid ec86172d-5723-462a-88e5-ce3fc2823340 {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:14:06.887306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:06.894664 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7e800e9e-45a0-4de8-92d7-33209367156c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 200 len: 1336 microversion: 2.1 time: 0.101460 Jul 14 16:14:06.895202 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3780/7399] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:06 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 1336 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:07.913303 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:07.914058 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: ec86172d-5723-462a-88e5-ce3fc2823340] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:07.921369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:07.921836 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:07.922623 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:07.923080 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:07.939253 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] HTTP exception thrown: Instance ec86172d-5723-462a-88e5-ce3fc2823340 could not be found. Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Request method failure captured: Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 HTTP/1.1 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0D_Kmg48fJW5rSAfMqz4EyNeyyJbo8odoVUconYlGWzzpy5Ai4EYSD8wK_OFaGhvIDbUNhBKEMWANf83K6s4eHAahqgw0aqqIeC9bR8zgyZNGI8Sa6poWbaZZkEhavhG3kXTv72kr2E0NgwwyyEYBCecsfsrb13sGSfAHn8U-iYc1X8 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 6fd559ec5b4c4693a19b7730fc4c3820 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestShelveInstance-179018525 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestShelveInstance-179018525 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 6fd559ec5b4c4693a19b7730fc4c3820 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestShelveInstance-179018525 Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestShelveInstance-179018525-project Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: bd16884baf734654860f1c60809f51ac Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestShelveInstance-179018525-project Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance ec86172d-5723-462a-88e5-ce3fc2823340 could not be found. Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': 'ec86172d-5723-462a-88e5-ce3fc2823340'} Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec86172d-5723-462a-88e5-ce3fc2823340 could not be found. Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec86172d-5723-462a-88e5-ce3fc2823340 could not be found. Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:07.940971 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec86172d-5723-462a-88e5-ce3fc2823340 could not be found. Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Returning 404 to user: Instance ec86172d-5723-462a-88e5-ce3fc2823340 could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0587bf7d-ac72-44d1-8c4a-eccc299e69af tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340" status: 404 len: 111 microversion: 2.1 time: 0.034238 Jul 14 16:14:07.946695 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3620/7400] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:07 2022] GET /compute/v2.1/servers/ec86172d-5723-462a-88e5-ce3fc2823340 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:14:08.120361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f155f2f-2b1f-4fb6-a2ba-bb583fa6de29 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '.version_select at 0x7fdbf1d2ec10>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:08.148233 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f155f2f-2b1f-4fb6-a2ba-bb583fa6de29 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-892764598" status: 202 len: 0 microversion: 2.1 time: 0.031881 Jul 14 16:14:08.148709 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3781/7401] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 16:14:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-892764598 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:14:08.170650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6a12fd16-2747-462e-a7ef-26abc27c4819 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'create', calling method: .version_select at 0x7fdbf1daf310>, body: {"keypair": {"name": "tempest-TestShelveInstance-120912112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcILPdM6S/ASngi1Y7tD5SYSLgPO9bbGbBxFpHf3rE9VK6EUgijLKtyObW9Wwcm37AinNqft7vBzxId80zjKUGftGhjrYCOcbE3+GnDc3/h7aXeP5gJCRklF3XFdb1yzw=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:08.184971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6a12fd16-2747-462e-a7ef-26abc27c4819 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:14:08.190318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-6a12fd16-2747-462e-a7ef-26abc27c4819 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for user bd16884baf734654860f1c60809f51ac and project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:14:08.215589 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6a12fd16-2747-462e-a7ef-26abc27c4819 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.048854 Jul 14 16:14:08.216203 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3621/7402] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:14:08 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:24.450439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1577124896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-120912112", "security_groups": [{"name": "tempest-secgroup-smoke-871012663"}], "networks": [{"uuid": "111881fa-0340-4bf9-9bd3-3f9f572fd20d"}], "block_device_mapping_v2": [{"uuid": "c6960a8f-41b6-4eb9-be82-a0c829e5d630", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:24.460062 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:24.460853 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:24.567746 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] validate_networks() for [('111881fa-0340-4bf9-9bd3-3f9f572fd20d', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:14:24.984327 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:14:24.984755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:14:24.985254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:14:24.985661 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:14:24.986073 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:14:24.994884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:24.995351 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:24.996136 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:24.996571 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:25.013985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:14:25.019219 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Getting quotas for user bd16884baf734654860f1c60809f51ac and project 6fd559ec5b4c4693a19b7730fc4c3820. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:14:25.077458 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:14:25.079576 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c6960a8f-41b6-4eb9-be82-a0c829e5d630',volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:14:25.207432 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-237945cf-e1e4-4633-bc5c-7defae7ab246 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.760825 Jul 14 16:14:25.208091 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3782/7403] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:14:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:14:25.216317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:25.217653 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=4 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:25.218361 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:25.222296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-46071a04-3a84-4b9e-b3c7-dbd78e59ec98 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:25.222935 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-46071a04-3a84-4b9e-b3c7-dbd78e59ec98 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:25.285768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-46071a04-3a84-4b9e-b3c7-dbd78e59ec98 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:25.292648 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-46071a04-3a84-4b9e-b3c7-dbd78e59ec98 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1088 microversion: 2.1 time: 0.078172 Jul 14 16:14:25.293230 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3622/7404] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:25 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1088 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:26.312445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:26.313324 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:26.321128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.321801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.322949 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.324028 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.401216 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:26.409660 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-14a76f64-79e9-468b-9c26-93a56d5cbbce tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1204 microversion: 2.1 time: 0.102607 Jul 14 16:14:26.410311 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3783/7405] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:26 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:27.430535 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:27.431955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:27.440447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.441173 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.442825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.443486 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.603777 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:27.615108 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e2f5fe32-e72f-4ac5-9e37-51013e00f11a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1271 microversion: 2.1 time: 0.188112 Jul 14 16:14:27.616069 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3623/7406] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:27 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:14:27.721365 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-bf1d0d16-92e0-4862-b7b1-fd62ea2e7fd2 req-c1bed520-dbfb-4d3b-9171-a7ee98492423 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:27.734713 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bf1d0d16-92e0-4862-b7b1-fd62ea2e7fd2 req-c1bed520-dbfb-4d3b-9171-a7ee98492423 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.735042 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-bf1d0d16-92e0-4862-b7b1-fd62ea2e7fd2 req-c1bed520-dbfb-4d3b-9171-a7ee98492423 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.759740 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-bf1d0d16-92e0-4862-b7b1-fd62ea2e7fd2 req-c1bed520-dbfb-4d3b-9171-a7ee98492423 service nova] Creating event network-changed:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h1-768852-23 Jul 14 16:14:27.765068 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-bf1d0d16-92e0-4862-b7b1-fd62ea2e7fd2 req-c1bed520-dbfb-4d3b-9171-a7ee98492423 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048277 Jul 14 16:14:27.766571 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3784/7407] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:28.633198 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:28.633765 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:28.640824 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:28.641289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:28.642078 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:28.642529 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:28.787255 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:28.795963 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6d268e18-50d8-4e31-898f-9109f677de25 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1271 microversion: 2.1 time: 0.167364 Jul 14 16:14:28.796813 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3624/7408] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:28 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1271 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:29.814557 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:29.815293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:29.822333 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.822784 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.823583 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.824029 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.963985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:29.971795 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-db29e5de-3dd2-4003-82ee-248e06555e5f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1271 microversion: 2.1 time: 0.162516 Jul 14 16:14:29.972396 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3785/7409] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:29 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:30.988265 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:30.988896 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:30.995995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:30.996447 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:30.997231 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:30.997678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:31.147067 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:31.155358 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4a957bb2-abbc-4189-9b59-e50729c0310a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1271 microversion: 2.1 time: 0.170932 Jul 14 16:14:31.156250 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3625/7410] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:30 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:32.173487 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:32.174101 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:32.184254 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:32.184703 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:32.185473 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:32.185901 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:32.331123 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:32.339705 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-952850da-c747-4164-b290-ed2e626fe316 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.170071 Jul 14 16:14:32.340288 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3786/7411] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:32 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:33.357398 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:33.358062 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:33.365213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:33.365678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:33.366463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:33.366916 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:33.500995 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:33.508806 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-07bf582b-bc6c-43c6-b79c-2e1692c5737f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.155303 Jul 14 16:14:33.509394 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3626/7412] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:33 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:34.526160 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:34.526985 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:34.533777 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:34.534229 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:34.534980 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:34.535439 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:34.665982 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:34.673447 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8c11289b-1987-438b-9005-1cc1680b9aa9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.151345 Jul 14 16:14:34.674029 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3787/7413] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:34 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:35.690038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:35.690722 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:35.694158 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:35.699659 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:35.700125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:35.700911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:35.701359 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:35.842442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:35.850818 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a89bd8e1-d978-4ab6-8983-89a563ae5587 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.164665 Jul 14 16:14:35.851446 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3627/7414] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:35 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:36.866992 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:36.867639 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:36.869579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:36.870247 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:36.877501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:36.877941 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:36.879354 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:36.879797 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:37.363228 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:37.371484 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-fcea88b3-36c3-42fe-9636-7d14443cf3e5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.508409 Jul 14 16:14:37.372095 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3788/7415] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:36 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:38.389503 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:38.390115 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:38.396383 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:38.396875 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:38.397716 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:38.398906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:38.538685 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:38.546326 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-19efdde8-7489-4845-a01a-413651ba975d tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.161046 Jul 14 16:14:38.546912 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3628/7416] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:38 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:39.564358 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:39.565155 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:39.571230 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:39.571712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:39.572476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:39.572911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:39.714470 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:39.722400 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d61c174-eae9-49aa-9d81-f49649136076 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.163219 Jul 14 16:14:39.723004 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3789/7417] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:39 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:40.739516 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:40.740230 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:40.747047 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:40.747541 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:40.748307 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:40.748754 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:40.882312 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:40.889979 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-94c1b4b6-4a4e-4bb3-af37-59f14e0709ab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.154365 Jul 14 16:14:40.890558 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3629/7418] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:40 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:41.856201 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-317b7850-42e6-4e46-985f-88ded9d93d7f req-efe8533c-903d-4916-947e-d59016d72e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "name": "network-vif-plugged", "status": "completed", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:41.865851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-317b7850-42e6-4e46-985f-88ded9d93d7f req-efe8533c-903d-4916-947e-d59016d72e8f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:41.866066 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-317b7850-42e6-4e46-985f-88ded9d93d7f req-efe8533c-903d-4916-947e-d59016d72e8f service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:41.879428 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-317b7850-42e6-4e46-985f-88ded9d93d7f req-efe8533c-903d-4916-947e-d59016d72e8f service nova] Creating event network-vif-plugged:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h1-768852-23 Jul 14 16:14:41.884467 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-317b7850-42e6-4e46-985f-88ded9d93d7f req-efe8533c-903d-4916-947e-d59016d72e8f service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Jul 14 16:14:41.885089 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3790/7419] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:41.908579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:41.909305 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:41.916665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:41.917125 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:41.917906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:41.918384 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:42.060941 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:42.069388 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b7aa197e-6ea2-4df6-9d43-8ef1c028f836 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.165479 Jul 14 16:14:42.069977 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3630/7420] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:41 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:43.087743 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:43.088446 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:43.094926 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:43.095406 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:43.096174 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:43.096612 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:43.236510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:43.248597 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-dd9d9d06-f0f0-4e49-b516-f4fcc1734c9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1259 microversion: 2.1 time: 0.165869 Jul 14 16:14:43.249536 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3791/7421] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:43 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:44.266120 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:44.266751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:44.274580 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:44.275039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:44.275878 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:44.276331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:44.408949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:44.416747 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-583bdeaa-35d8-4753-bb73-1a83f40aac96 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1443 microversion: 2.1 time: 0.154655 Jul 14 16:14:44.417358 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3631/7422] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:44 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:44.433434 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:44.434049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:44.442242 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:44.442686 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:44.443514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:44.443954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:44.575510 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:44.583822 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b0a09823-ee03-46e2-b4f3-f7f8073146ec tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1443 microversion: 2.1 time: 0.154206 Jul 14 16:14:44.584408 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3792/7423] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:44 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:46.182871 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2533d65e-6581-4fba-8060-861b3bad5e92 req-d5e39a77-134d-4e50-b890-d30bda494297 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:46.195798 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2533d65e-6581-4fba-8060-861b3bad5e92 req-d5e39a77-134d-4e50-b890-d30bda494297 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:46.196372 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2533d65e-6581-4fba-8060-861b3bad5e92 req-d5e39a77-134d-4e50-b890-d30bda494297 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:46.207987 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2533d65e-6581-4fba-8060-861b3bad5e92 req-d5e39a77-134d-4e50-b890-d30bda494297 service nova] Creating event network-changed:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h1-768852-23 Jul 14 16:14:46.213704 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2533d65e-6581-4fba-8060-861b3bad5e92 req-d5e39a77-134d-4e50-b890-d30bda494297 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Jul 14 16:14:46.214736 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3632/7424] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:15:11.747482 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:15:11.748256 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:15:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:16:43.674139 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [-] [574aebdb-cb84-4fd6-8f40-ef27447caa36] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:16:43.675011 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72ca8299-b74b-446c-b746-de563576c583] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:16:43.675620 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:43.676374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=54 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:43.734163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:16:43.734572 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:43.740696 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:43.741143 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:43.741905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:43.742378 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:43.765344 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lazy-loading 'flavor' on Instance uuid 9ee96238-d674-4fc4-8498-37b7a1d5daea {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:16:43.836194 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9563cdc5-6ad3-4837-8cef-bcee62d98ea4 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea/action" status: 202 len: 0 microversion: 2.1 time: 0.168024 Jul 14 16:16:43.836822 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3793/7425] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:16:43 2022] POST /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:16:43.844472 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:16:43.845357 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:16:43.846127 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=24 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:43.847039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=56 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:16:43.852007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:43.853035 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:43.861424 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:43.861882 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:43.862644 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:43.863088 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:44.046291 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:44.054046 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3773301d-9668-403b-ae15-ce52ed41941c tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.211795 Jul 14 16:16:44.054616 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3633/7426] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:43 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:45.074577 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:45.075361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:45.083457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:45.083898 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:45.084654 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:45.085102 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:45.090186 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] [574aebdb-cb84-4fd6-8f40-ef27447caa36] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44290. Jul 14 16:16:45.091002 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] [72ca8299-b74b-446c-b746-de563576c583] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44292. Jul 14 16:16:45.268679 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:45.276185 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-906f6e7e-aac3-422c-b6fe-406e0c693c4e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.207350 Jul 14 16:16:45.276772 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3794/7427] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:45 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:46.293558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:46.294822 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:46.304681 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:46.305150 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:46.305934 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:46.306385 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:46.322695 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44300. Jul 14 16:16:46.323506 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44298. Jul 14 16:16:46.440587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:46.448841 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-e90cfe9e-1a5f-4441-99a7-67ff31628f9a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.159209 Jul 14 16:16:46.449663 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3634/7428] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:46 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:47.467114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:47.467755 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:47.474825 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:47.475290 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:47.476053 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:47.476485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:47.611212 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:47.618878 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-552150ce-42c8-4eee-8ce7-d87648bd67da tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.155707 Jul 14 16:16:47.619492 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3795/7429] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:47 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:48.636498 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:48.637051 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:48.644657 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:48.645114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:48.645884 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:48.646331 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:48.648889 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:16:48.649311 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:16:48.731160 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:16:48.731349 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:16:48.782746 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:48.790904 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-05f91c68-4594-4e79-aeae-a74033b88a82 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.158384 Jul 14 16:16:48.791516 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3635/7430] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:48 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:49.808990 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:49.809692 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:49.817744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:49.818196 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:49.819379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:49.819844 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:49.960493 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:49.968179 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-1993ed89-26bc-4a70-94e3-0c1d5d0249eb tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.163260 Jul 14 16:16:49.968752 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3796/7431] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:49 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:50.893473 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:16:50.894016 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:16:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:16:50.986330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:50.987020 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:50.994222 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:50.994679 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:50.995561 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:50.996121 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:51.131353 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:51.139387 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c7010af6-2b7a-425f-8a2c-87834422d2fd tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.157449 Jul 14 16:16:51.139953 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3636/7432] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:50 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:52.157435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:52.158050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:52.165251 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:52.165699 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:52.166457 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:52.166890 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:52.299031 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:52.306737 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-a55cc64f-ba6e-4b2b-90dc-8149d5c15c55 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.153665 Jul 14 16:16:52.307341 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3797/7433] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:52 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:53.324113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:53.324729 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:53.331751 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:53.332208 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:53.332971 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:53.333416 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:53.467030 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:53.474701 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-250a2062-197c-4e9f-9205-fd9833fb4eb7 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.154718 Jul 14 16:16:53.475296 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3637/7434] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:53 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:54.492670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:54.493292 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:54.501021 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:54.501478 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:54.502360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:54.502764 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:54.705848 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:54.713417 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-382d9373-68b6-4c14-b178-8549ecf72222 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.224686 Jul 14 16:16:54.713999 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3798/7435] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:54 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:55.731505 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:55.732643 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:55.739749 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:55.740205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:55.740977 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:55.741417 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:55.877514 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:55.885103 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d9d18c78-7358-473d-af7e-a86ba53af3e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.157590 Jul 14 16:16:55.885679 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3638/7436] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:55 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:56.902381 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:56.903238 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:56.910240 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:56.910688 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:56.911496 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:56.911933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:57.043631 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:57.051984 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c8d2e01-6f35-4ba5-8dbd-6dc7a0a9a81f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.153821 Jul 14 16:16:57.052569 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3799/7437] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:56 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:58.069841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:58.070463 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:58.077949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:58.078567 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:58.079380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:58.079865 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:58.220171 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:58.227937 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-6388fd5f-32e9-48c5-960c-e492b9f149a6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.161965 Jul 14 16:16:58.228515 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3639/7438] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:58 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:58.486717 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1fa379e9-aa9e-4d40-943b-e72a284620cb req-8d5e78df-9612-4725-b7e7-4f1e19b1afac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "name": "network-vif-unplugged", "status": "completed", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:16:58.497798 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1fa379e9-aa9e-4d40-943b-e72a284620cb req-8d5e78df-9612-4725-b7e7-4f1e19b1afac service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:58.498578 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1fa379e9-aa9e-4d40-943b-e72a284620cb req-8d5e78df-9612-4725-b7e7-4f1e19b1afac service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:58.511105 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1fa379e9-aa9e-4d40-943b-e72a284620cb req-8d5e78df-9612-4725-b7e7-4f1e19b1afac service nova] Creating event network-vif-unplugged:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h1-768852-23 Jul 14 16:16:58.517801 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1fa379e9-aa9e-4d40-943b-e72a284620cb req-8d5e78df-9612-4725-b7e7-4f1e19b1afac service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035272 Jul 14 16:16:58.518417 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3800/7439] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:16:59.245288 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:59.245911 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:59.253579 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:59.254039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:59.254810 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:59.255251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:59.384182 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:59.391717 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-da30f15b-a265-4eb9-bac2-5d7606594eb6 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1509 microversion: 2.1 time: 0.150291 Jul 14 16:16:59.392283 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3640/7440] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:59 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:16:59.408885 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:16:59.409553 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:59.415907 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:59.416355 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:59.417114 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:59.417554 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:59.510419 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-5cea89b0-51a7-41bc-b362-da6b243391fc tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "POST /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea/action" status: 202 len: 0 microversion: 2.1 time: 0.105691 Jul 14 16:16:59.511069 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3801/7441] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:16:59 2022] POST /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:16:59.519133 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:16:59.519895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:16:59.526790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:59.527369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:59.528240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:16:59.528978 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:16:59.672757 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:16:59.681064 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-1ff036b6-f606-474b-a6e5-f2efd195d9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1517 microversion: 2.1 time: 0.165738 Jul 14 16:16:59.681655 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3641/7442] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:16:59 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:00.698903 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:00.699675 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:00.707059 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:00.707625 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:00.708480 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:00.709012 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:00.848731 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:00.857186 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6d5d84e0-1849-45ac-bb09-f1517ba1b553 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1519 microversion: 2.1 time: 0.163045 Jul 14 16:17:00.857793 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3802/7443] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:00 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:01.875203 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:01.877350 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:01.884969 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:01.885439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:01.886227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:01.886705 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:02.021183 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:02.030014 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7d642638-58df-49fd-afaf-1ee3501f7ad1 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1519 microversion: 2.1 time: 0.158825 Jul 14 16:17:02.039731 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3642/7444] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:01 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:03.048080 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:03.049083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:03.056499 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:03.056956 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:03.057751 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:03.058193 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:03.202801 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:03.210873 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-543a2fc3-7fae-4c41-8802-d189a61bb9ba tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1519 microversion: 2.1 time: 0.167249 Jul 14 16:17:03.220882 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3803/7445] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:03 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:04.227582 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:04.228117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:04.235588 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:04.236048 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:04.236833 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:04.237282 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:04.374024 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:04.382358 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a1c45525-7c03-429e-8904-4dc39ab34c45 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1519 microversion: 2.1 time: 0.158810 Jul 14 16:17:04.382937 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3643/7446] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:04 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:05.400165 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:05.401047 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:05.408075 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:05.408526 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:05.409293 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:05.409733 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:05.547052 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:05.555096 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-38c35ce3-7524-463e-997c-442fc79a42e9 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.158867 Jul 14 16:17:05.555710 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3804/7447] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:05 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:06.550240 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-6df4f68c-aac6-41a9-bab4-eadd2d55d051 req-ff89ee9f-65a3-4d7f-9d04-22f8537d96ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:17:06.559006 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6df4f68c-aac6-41a9-bab4-eadd2d55d051 req-ff89ee9f-65a3-4d7f-9d04-22f8537d96ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:06.559506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-6df4f68c-aac6-41a9-bab4-eadd2d55d051 req-ff89ee9f-65a3-4d7f-9d04-22f8537d96ab service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:06.572366 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-6df4f68c-aac6-41a9-bab4-eadd2d55d051 req-ff89ee9f-65a3-4d7f-9d04-22f8537d96ab service nova] Creating event network-changed:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h2-768852-23 Jul 14 16:17:06.573914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:06.575788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:06.580565 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-6df4f68c-aac6-41a9-bab4-eadd2d55d051 req-ff89ee9f-65a3-4d7f-9d04-22f8537d96ab service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101771 Jul 14 16:17:06.582121 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3644/7448] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:17:06.584849 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:06.585409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:06.586445 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:06.587103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:06.731641 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:06.740968 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9b8e5193-9c8f-4d73-816a-9e510fd53566 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.172133 Jul 14 16:17:06.741825 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3805/7449] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:06 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:07.759703 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:07.760448 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:07.768244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:07.768712 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:07.769506 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:07.769955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:07.993620 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:08.001992 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5d51626b-9b74-486a-9f55-349e7e0a9457 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.246400 Jul 14 16:17:08.002573 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3645/7450] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:07 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:09.019409 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:09.020034 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:09.027555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:09.028030 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:09.028802 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:09.029239 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:09.165964 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:09.174072 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ca9c81e5-9888-46e6-bab0-7d8b34472e23 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.159057 Jul 14 16:17:09.174661 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3806/7451] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:09 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:10.191937 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:10.192557 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:10.199566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:10.200023 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:10.200803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:10.201244 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:10.336590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:10.344821 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d730a867-90d2-41a5-ab5d-32bdbbec6f94 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.156419 Jul 14 16:17:10.345394 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3646/7452] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:10 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:17:11.362010 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:11.362622 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:11.369933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:11.370375 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:11.371127 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:11.371588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:11.376184 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:11.507595 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:11.515122 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a9df221-0489-4da0-9304-264e20f75b97 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.157465 Jul 14 16:17:11.515779 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3807/7453] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:11 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:12.532558 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:12.533114 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:12.540117 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:12.540581 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:12.541366 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:12.541813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:12.681599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:12.689740 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5e67e5da-0a9b-4305-9d56-d371b8084885 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.161189 Jul 14 16:17:12.690314 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3647/7454] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:12 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:13.707360 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:13.708033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:13.710683 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=33 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:13.716379 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:13.716826 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:13.717598 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:13.718072 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:13.849663 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:13.857585 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-26afceb0-faa5-4066-8ac0-a04a9dc7eb5b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.154338 Jul 14 16:17:13.858168 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3808/7455] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:13 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:14.876143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:14.876771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:14.879605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=31 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:14.885031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:14.885492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:14.886279 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:14.886748 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:14.889583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=87 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:17:15.026408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:15.034119 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-db24a7c4-ad93-48c1-9221-84c08919eeaf tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.162462 Jul 14 16:17:15.034723 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3648/7456] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:14 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:16.053297 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:16.054215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:16.061520 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:16.062133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:16.063788 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:16.064485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:16.213507 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:16.221326 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7c197670-0ce3-4664-a556-bdd2147019a3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.173895 Jul 14 16:17:16.221913 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3809/7457] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:16 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:17.239162 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:17.239832 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:17.246418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:17.246873 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:17.247676 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:17.248118 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:17.381493 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:17.389325 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-a998d7d1-705a-4179-94e3-cba3953911f0 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.154101 Jul 14 16:17:17.389907 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3649/7458] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:17 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:18.408157 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:18.408778 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:18.415697 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:18.416148 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:18.416914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:18.417352 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:18.550104 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:18.558452 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-7dd93660-861f-4aca-8c91-e6c3baa6a4b5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.154804 Jul 14 16:17:18.559150 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3810/7459] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:18 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:18.658435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-44bcf533-48e3-405d-8f41-bdcf237f0936 req-6092fff3-c59a-43c5-92d0-e974ff23d85e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "name": "network-vif-plugged", "status": "completed", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:17:18.668205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-44bcf533-48e3-405d-8f41-bdcf237f0936 req-6092fff3-c59a-43c5-92d0-e974ff23d85e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:18.668825 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-44bcf533-48e3-405d-8f41-bdcf237f0936 req-6092fff3-c59a-43c5-92d0-e974ff23d85e service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:18.682664 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-44bcf533-48e3-405d-8f41-bdcf237f0936 req-6092fff3-c59a-43c5-92d0-e974ff23d85e service nova] Creating event network-vif-plugged:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h2-768852-23 Jul 14 16:17:18.689224 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-44bcf533-48e3-405d-8f41-bdcf237f0936 req-6092fff3-c59a-43c5-92d0-e974ff23d85e service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033556 Jul 14 16:17:18.690006 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3650/7460] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:17:19.576532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:19.577083 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:19.584579 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:19.585038 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:19.585810 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:19.586250 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:19.724538 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:19.732310 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3628dfb2-568e-4d80-ab82-b4fe923dddab tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1575 microversion: 2.1 time: 0.159791 Jul 14 16:17:19.732903 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3811/7461] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:19 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:17:20.749840 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:17:20.750591 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:17:20.757883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:20.758337 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:20.759110 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:17:20.759590 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:17:20.891864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:17:20.900167 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ad266d69-7e0e-424e-a752-bb7640f986ac tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1562 microversion: 2.1 time: 0.154505 Jul 14 16:17:20.901011 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3651/7462] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:17:20 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:31.756707 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:18:31.757422 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:18:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:35.254159 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:35.255489 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:35.257387 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=7 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:35.258050 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=28 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:35.264686 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-2bb660c7-3a5a-456e-90a3-3679b34aa495 req-b5074c92-001c-4bc7-8840-7173d7b7d0c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:18:35.265909 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:35.267067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:35.268807 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:35.269943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:35.278519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=7 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:35.279318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=19 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:35.281803 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2bb660c7-3a5a-456e-90a3-3679b34aa495 req-b5074c92-001c-4bc7-8840-7173d7b7d0c3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:35.283156 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-2bb660c7-3a5a-456e-90a3-3679b34aa495 req-b5074c92-001c-4bc7-8840-7173d7b7d0c3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:35.297343 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-2bb660c7-3a5a-456e-90a3-3679b34aa495 req-b5074c92-001c-4bc7-8840-7173d7b7d0c3 service nova] Creating event network-changed:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h2-768852-23 Jul 14 16:18:35.303539 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-2bb660c7-3a5a-456e-90a3-3679b34aa495 req-b5074c92-001c-4bc7-8840-7173d7b7d0c3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048232 Jul 14 16:18:35.304144 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3652/7463] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:18:35.308300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Going to try to terminate instance {{(pid=125965) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:18:35.397667 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-e58f6a43-3774-46de-80ec-9174ac7ae49f tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "DELETE /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 204 len: 0 microversion: 2.1 time: 0.148175 Jul 14 16:18:35.398207 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3812/7464] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:18:35 2022] DELETE /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:18:35.407297 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:35.408060 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:35.414519 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:35.414972 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:35.415778 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:35.416227 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:35.549813 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:35.558389 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b5900ec1-40d5-4861-a299-2cae8abc9100 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.155376 Jul 14 16:18:35.558970 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3653/7465] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:35 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:36.576968 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:36.577684 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:36.585589 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:36.586039 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:36.586815 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:36.587252 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:36.721172 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:36.728948 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c026ac99-1d97-4d27-b361-a3204394128b tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1568 microversion: 2.1 time: 0.156377 Jul 14 16:18:36.729538 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3813/7466] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:36 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:18:37.638345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f2bf79a7-fe61-4ba5-8ca2-f04c73054939 req-da3a4b14-cb73-48a9-a95f-be4ec7e8874d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ee96238-d674-4fc4-8498-37b7a1d5daea", "name": "network-vif-deleted", "tag": "ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:18:37.646928 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f2bf79a7-fe61-4ba5-8ca2-f04c73054939 req-da3a4b14-cb73-48a9-a95f-be4ec7e8874d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:37.647308 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f2bf79a7-fe61-4ba5-8ca2-f04c73054939 req-da3a4b14-cb73-48a9-a95f-be4ec7e8874d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:37.663839 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f2bf79a7-fe61-4ba5-8ca2-f04c73054939 req-da3a4b14-cb73-48a9-a95f-be4ec7e8874d service nova] Creating event network-vif-deleted:ac94c9fe-ac7e-4c58-bba5-1a4f018ff88b for instance 9ee96238-d674-4fc4-8498-37b7a1d5daea on n-h2-768852-23 Jul 14 16:18:37.668975 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f2bf79a7-fe61-4ba5-8ca2-f04c73054939 req-da3a4b14-cb73-48a9-a95f-be4ec7e8874d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088602 Jul 14 16:18:37.669589 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3654/7467] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:18:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:18:37.747515 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:37.748312 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:37.755372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:37.755911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:37.756799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:37.757370 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:37.823454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:37.831414 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8bdaf977-8993-46ef-8190-d4fc18f27609 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1219 microversion: 2.1 time: 0.087905 Jul 14 16:18:37.832251 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3814/7468] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:37 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:38.850435 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:38.851219 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:38.857841 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:38.858347 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:38.859126 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:38.859595 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:38.924789 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:38.932666 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ea8bd8ad-2669-4083-8da0-09a252e9c5f5 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1219 microversion: 2.1 time: 0.087468 Jul 14 16:18:38.933248 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3655/7469] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:38 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:39.949970 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:39.951289 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:39.958879 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:39.959350 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:39.960139 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:39.960599 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:40.028300 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:40.047717 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-6f889645-761c-473d-b1ba-4110b41e5ec3 tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1219 microversion: 2.1 time: 0.101532 Jul 14 16:18:40.048323 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3815/7470] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:39 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1219 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:41.065606 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:41.066239 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:41.073189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:41.073656 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:41.074438 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:41.074924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:41.140689 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:41.148704 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c1bf642b-d998-41a9-a5d2-61e14b02863a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1219 microversion: 2.1 time: 0.086943 Jul 14 16:18:41.149216 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3656/7471] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:41 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:42.166082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:42.166708 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:42.174494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:42.175045 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:42.176214 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:42.177236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:42.218133 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:42.218592 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:42.219048 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.objects.instance [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lazy-loading 'fault' on Instance uuid 9ee96238-d674-4fc4-8498-37b7a1d5daea {{(pid=125965) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:18:42.273841 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd16884baf734654860f1c60809f51ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fd559ec5b4c4693a19b7730fc4c3820', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:18:42.282287 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-986744f4-7498-412f-8c3f-d9fed817beaa tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 200 len: 1178 microversion: 2.1 time: 0.120445 Jul 14 16:18:42.283222 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3816/7472] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:42 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 1178 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:18:43.300135 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:43.300781 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] [instance: 9ee96238-d674-4fc4-8498-37b7a1d5daea] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:43.308926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:43.309392 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:43.310345 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:43.310838 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:43.324940 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.wsgi [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] HTTP exception thrown: Instance 9ee96238-d674-4fc4-8498-37b7a1d5daea could not be found. Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Request method failure captured: Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: request: GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea HTTP/1.1 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Accept: application/json Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Accept-Encoding: identity Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Connection: close Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Content-Length: 0 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Content-Type: application/json Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Host: 10.222.0.98 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: Openstack-System-Scope: None Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: User-Agent: python-urllib3/1.26.9 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Auth-Token: gAAAAABi0D_Kmg48fJW5rSAfMqz4EyNeyyJbo8odoVUconYlGWzzpy5Ai4EYSD8wK_OFaGhvIDbUNhBKEMWANf83K6s4eHAahqgw0aqqIeC9bR8zgyZNGI8Sa6poWbaZZkEhavhG3kXTv72kr2E0NgwwyyEYBCecsfsrb13sGSfAHn8U-iYc1X8 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Id: None Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Domain-Name: None Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Identity-Status: Confirmed Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Is-Admin-Project: True Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Id: default Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Domain-Name: Default Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Id: 6fd559ec5b4c4693a19b7730fc4c3820 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Project-Name: tempest-TestShelveInstance-179018525 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Role: member,reader Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Roles: member,reader Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/6fd559ec5b4c4693a19b7730fc4c3820"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant: tempest-TestShelveInstance-179018525 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Id: 6fd559ec5b4c4693a19b7730fc4c3820 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-Tenant-Name: tempest-TestShelveInstance-179018525 Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-User: tempest-TestShelveInstance-179018525-project Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Id: default Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-User-Domain-Name: Default Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-User-Id: bd16884baf734654860f1c60809f51ac Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: X-User-Name: tempest-TestShelveInstance-179018525-project Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: method: > Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: exception: Instance 9ee96238-d674-4fc4-8498-37b7a1d5daea could not be found. Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: action_args: {'id': '9ee96238-d674-4fc4-8498-37b7a1d5daea'} Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ee96238-d674-4fc4-8498-37b7a1d5daea could not be found. Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ee96238-d674-4fc4-8498-37b7a1d5daea could not be found. Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:18:43.326655 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ee96238-d674-4fc4-8498-37b7a1d5daea could not be found. Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: ERROR nova.api.openstack.wsgi Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Returning 404 to user: Instance 9ee96238-d674-4fc4-8498-37b7a1d5daea could not be found. {{(pid=125966) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-ec5aa777-8c38-419a-bb9f-88b46722c31e tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea" status: 404 len: 111 microversion: 2.1 time: 0.031983 Jul 14 16:18:43.331569 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3657/7473] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:18:43 2022] GET /compute/v2.1/servers/9ee96238-d674-4fc4-8498-37b7a1d5daea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:18:43.498121 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-9f220e8f-fbe7-489c-a00b-6fe2583e101a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] Calling method '.version_select at 0x7fdbf1ec9d30>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:43.523173 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-9f220e8f-fbe7-489c-a00b-6fe2583e101a tempest-TestShelveInstance-179018525 tempest-TestShelveInstance-179018525-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-120912112" status: 202 len: 0 microversion: 2.1 time: 0.030915 Jul 14 16:18:43.524372 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3817/7474] 10.222.0.98 () {58 vars in 1250 bytes} [Thu Jul 14 16:18:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-120912112 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:19:01.687625 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=12 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:01.688406 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=24 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:01.872903 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-3102e40e-9ad8-4b45-87f2-ebd50e6e23b2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Action: 'create', calling method: .version_select at 0x7fdbf1c25700>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-627160547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxTCKmghOH8XGZW3A52KyZp72y8kBO7e8gyx/4jka/NCNf/lswRvFO0VbDkYAtp/ATx/zsafguvXOss41Jux7dS7XUDtRaHba3bgGpIkPWeRiqPxmFqVXhLHh86XGYPwQ=="}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:01.887991 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3102e40e-9ad8-4b45-87f2-ebd50e6e23b2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Getting quotas for project af641a9a7c3b487db865837958578c66. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:19:01.893360 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-3102e40e-9ad8-4b45-87f2-ebd50e6e23b2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Getting quotas for user 68d145662d434c5f8b7ccd5a0ac9192f and project af641a9a7c3b487db865837958578c66. Resources: {'key_pairs'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:19:01.924610 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-3102e40e-9ad8-4b45-87f2-ebd50e6e23b2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.243214 Jul 14 16:19:01.925217 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3658/7475] 10.222.0.98 () {60 vars in 1158 bytes} [Thu Jul 14 16:19:01 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:19:02.903306 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:02.905099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:02.911173 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-285102323", "imageRef": "882b5d60-a014-41cb-b7f7-f80f1fdee9e4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-627160547", "security_groups": [{"name": "tempest-secgroup-smoke-1798022696"}], "networks": [{"uuid": "550c8794-cfff-4ea3-84b5-e8e7f50d6fdf"}]}} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:03.037845 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.network.neutron [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] validate_networks() for [('550c8794-cfff-4ea3-84b5-e8e7f50d6fdf', None, None, None, None, None)] {{(pid=125965) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:19:03.432132 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Flavor limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:19:03.432588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Image limits 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:19:03.433092 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Flavor pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:19:03.433504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Image pref 0:0:0 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:19:03.433914 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.virt.hardware [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125965) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:19:03.443163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:03.443643 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:03.444435 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:03.444880 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:03.462716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Getting quotas for project af641a9a7c3b487db865837958578c66. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:19:03.467993 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.quota [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Getting quotas for user 68d145662d434c5f8b7ccd5a0ac9192f and project af641a9a7c3b487db865837958578c66. Resources: {'ram', 'instances', 'cores'} {{(pid=125965) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:19:03.481633 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Going to run 1 instances... {{(pid=125965) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:19:03.483884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='882b5d60-a014-41cb-b7f7-f80f1fdee9e4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125965) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:19:03.532697 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f770998a-c68b-4ddc-96a3-dc67e05458aa tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.631267 Jul 14 16:19:03.533878 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3818/7476] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:19:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:19:03.544829 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-98d5f5ea-2640-453b-8ac8-ab939080907d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:03.545556 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-98d5f5ea-2640-453b-8ac8-ab939080907d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:03.630064 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-98d5f5ea-2640-453b-8ac8-ab939080907d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:03.632473 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-98d5f5ea-2640-453b-8ac8-ab939080907d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1247 microversion: 2.1 time: 0.092017 Jul 14 16:19:03.633606 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3659/7477] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:03 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1247 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:04.650851 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:04.651504 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:04.659118 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:04.659590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:04.660366 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:04.661450 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:04.744859 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:04.755728 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ce76470-0c35-4774-89ca-4b6d40cc40e9 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1299 microversion: 2.1 time: 0.108833 Jul 14 16:19:04.757964 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3819/7478] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:04 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:05.775320 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:05.775979 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:05.791251 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:05.791955 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:05.792959 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:05.793650 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:05.939380 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:05.947872 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-35bf0bb0-c576-4411-8998-52bd640f2bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.176708 Jul 14 16:19:05.948710 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3660/7479] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:05 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:06.419236 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-3d8d39b9-5c08-4888-86ff-c69e07cdac2d req-def6bf81-781b-45d4-a3eb-e609d2fcc3a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:06.438501 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3d8d39b9-5c08-4888-86ff-c69e07cdac2d req-def6bf81-781b-45d4-a3eb-e609d2fcc3a5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:06.438954 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-3d8d39b9-5c08-4888-86ff-c69e07cdac2d req-def6bf81-781b-45d4-a3eb-e609d2fcc3a5 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:06.452031 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-3d8d39b9-5c08-4888-86ff-c69e07cdac2d req-def6bf81-781b-45d4-a3eb-e609d2fcc3a5 service nova] Creating event network-changed:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:19:06.457482 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-3d8d39b9-5c08-4888-86ff-c69e07cdac2d req-def6bf81-781b-45d4-a3eb-e609d2fcc3a5 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042490 Jul 14 16:19:06.461394 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3820/7480] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:19:06.964906 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:06.965526 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:06.972552 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:06.973011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:06.974373 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:06.974823 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:07.105960 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:07.113455 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d70473c4-5f11-48dd-8e68-bc3c01db5801 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.152472 Jul 14 16:19:07.114032 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3661/7481] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:06 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:08.132180 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:08.132933 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:08.139202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:08.139680 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:08.140455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:08.140891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:08.351843 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:08.359463 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-177ed749-ad86-4c9b-9e2f-977d8a9edbbf tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.232665 Jul 14 16:19:08.360300 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3821/7482] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:08 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:09.377234 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:09.377868 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:09.385330 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:09.385794 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:09.386583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:09.387038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:09.524145 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:09.531977 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-401b7789-9d69-412e-81f5-28095583a995 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.158725 Jul 14 16:19:09.532548 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3662/7483] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:09 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:10.549152 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:10.549767 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:10.557884 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:10.558330 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:10.559099 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:10.559564 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:10.697744 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:10.705294 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c43ed331-a0a6-4c16-a182-41ee01daa09c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.160064 Jul 14 16:19:10.705879 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3822/7484] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:10 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:11.489281 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-02ad00bf-e2c5-452b-86e8-d4732291891e req-6bd5585f-f905-4eb6-9248-af52dd0369b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "name": "network-vif-plugged", "status": "completed", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:11.498195 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-02ad00bf-e2c5-452b-86e8-d4732291891e req-6bd5585f-f905-4eb6-9248-af52dd0369b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:11.498646 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-02ad00bf-e2c5-452b-86e8-d4732291891e req-6bd5585f-f905-4eb6-9248-af52dd0369b1 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:11.510461 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-02ad00bf-e2c5-452b-86e8-d4732291891e req-6bd5585f-f905-4eb6-9248-af52dd0369b1 service nova] Creating event network-vif-plugged:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:19:11.515665 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-02ad00bf-e2c5-452b-86e8-d4732291891e req-6bd5585f-f905-4eb6-9248-af52dd0369b1 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100695 Jul 14 16:19:11.516302 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3663/7485] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:19:11.722055 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:11.722670 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:11.729705 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:11.730149 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:11.730905 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:11.731363 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:11.861771 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:11.869250 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3a323525-698d-4c66-a43f-32a4b49f3239 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.151117 Jul 14 16:19:11.869830 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3823/7486] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:11 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:12.891420 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:12.892476 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:12.905771 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:12.906583 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:12.907982 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:12.908630 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:13.045585 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:13.053205 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7f3107ae-6b40-499b-9be1-a4090de5ebb4 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1373 microversion: 2.1 time: 0.170026 Jul 14 16:19:13.053799 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3664/7487] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:12 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1373 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:14.071067 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:14.071716 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:14.074492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:14.075163 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=6 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:14.081400 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:14.081517 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:14.082336 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:14.082776 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:14.218869 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:14.226995 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-b9030463-4404-4f29-8e35-7c0f9b84c5e0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1557 microversion: 2.1 time: 0.160360 Jul 14 16:19:14.227682 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3824/7488] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:14 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:14.243877 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:14.244599 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:14.246578 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:14.252633 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:14.253090 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:14.253864 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:14.254310 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:14.391742 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:14.400061 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-995a21d7-8b42-427c-8035-8a1b3af22230 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1557 microversion: 2.1 time: 0.160419 Jul 14 16:19:14.400640 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3665/7489] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:14 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:16.431374 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-f7e49c94-90cb-46df-9730-be21570a3495 req-932a46de-239c-44f5-a76b-c9d093a07f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:16.440393 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f7e49c94-90cb-46df-9730-be21570a3495 req-932a46de-239c-44f5-a76b-c9d093a07f29 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:16.440927 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-f7e49c94-90cb-46df-9730-be21570a3495 req-932a46de-239c-44f5-a76b-c9d093a07f29 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:16.452715 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-f7e49c94-90cb-46df-9730-be21570a3495 req-932a46de-239c-44f5-a76b-c9d093a07f29 service nova] Creating event network-changed:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:19:16.457800 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-f7e49c94-90cb-46df-9730-be21570a3495 req-932a46de-239c-44f5-a76b-c9d093a07f29 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030932 Jul 14 16:19:16.459236 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3825/7490] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:13.865615 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:21:13.866757 n-d-768852-23 devstack@n-api.service[125966]: ERROR oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] AMQP server on 10.222.0.98:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:21:13.867284 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:13.868188 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=32 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:13.873285 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1342946912"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:13.874313 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:13.881532 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.882004 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.882790 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.883229 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:14.152440 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-eeb34ffa-70c5-45f6-98aa-663b935336c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "POST /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7/action" status: 202 len: 0 microversion: 2.1 time: 0.288321 Jul 14 16:21:14.153091 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3666/7491] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:21:13 2022] POST /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7/action => generated 0 bytes in 290 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 16:21:17.917839 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [-] [72ca8299-b74b-446c-b746-de563576c583] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:21:17.918655 n-d-768852-23 devstack@n-api.service[125965]: ERROR oslo.messaging._drivers.impl_rabbit [-] [574aebdb-cb84-4fd6-8f40-ef27447caa36] AMQP server on 10.222.0.98:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:21:17.919537 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:17.920702 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=36 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:17.925889 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-1182de8f-229e-4551-8184-b064a2619723 req-4c2eecbc-86b5-442b-9a6e-f582253487fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "name": "network-vif-plugged", "status": "completed", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:17.938257 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1182de8f-229e-4551-8184-b064a2619723 req-4c2eecbc-86b5-442b-9a6e-f582253487fa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:17.938709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-1182de8f-229e-4551-8184-b064a2619723 req-4c2eecbc-86b5-442b-9a6e-f582253487fa service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:17.951891 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-1182de8f-229e-4551-8184-b064a2619723 req-4c2eecbc-86b5-442b-9a6e-f582253487fa service nova] Creating event network-vif-plugged:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:21:17.957784 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-1182de8f-229e-4551-8184-b064a2619723 req-4c2eecbc-86b5-442b-9a6e-f582253487fa service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041992 Jul 14 16:21:17.958812 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3826/7492] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:27.717116 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:27.718011 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:27.722618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-2021306672", "imageRef": "e358cd06-bf1f-46e0-a875-374bc3e11967", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-627160547", "security_groups": [{"name": "tempest-secgroup-smoke-1798022696"}], "networks": [{"uuid": "550c8794-cfff-4ea3-84b5-e8e7f50d6fdf"}]}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:27.752764 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [b858ae8c-506f-41cb-a31e-fcda53a6a19a] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44804. Jul 14 16:21:27.753073 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] [97ade173-2c43-43d0-b937-94e606bf8807] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44806. Jul 14 16:21:27.842766 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.network.neutron [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] validate_networks() for [('550c8794-cfff-4ea3-84b5-e8e7f50d6fdf', None, None, None, None, None)] {{(pid=125966) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:21:28.341730 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Flavor limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:21:28.342210 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Image limits 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:21:28.342704 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Flavor pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:21:28.343128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Image pref 0:0:0 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:21:28.343586 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.virt.hardware [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125966) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:21:28.352924 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:28.353443 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:28.354256 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:28.354713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:28.375796 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Getting quotas for project af641a9a7c3b487db865837958578c66. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:21:28.381431 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.quota [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Getting quotas for user 68d145662d434c5f8b7ccd5a0ac9192f and project af641a9a7c3b487db865837958578c66. Resources: {'ram', 'instances', 'cores'} {{(pid=125966) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:21:28.394478 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Going to run 1 instances... {{(pid=125966) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:21:28.396997 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e358cd06-bf1f-46e0-a875-374bc3e11967',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125966) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:21:28.444198 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-65acd828-4bab-42d2-961e-02e271bec681 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730515 Jul 14 16:21:28.444853 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3667/7493] 10.222.0.98 () {60 vars in 1146 bytes} [Thu Jul 14 16:21:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:21:28.454775 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:28.455567 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:28.460714 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-3f0a00d4-7f6a-4a1c-a5b9-9acbfa37648a tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:28.461513 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-3f0a00d4-7f6a-4a1c-a5b9-9acbfa37648a tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:28.477032 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] [72ca8299-b74b-446c-b746-de563576c583] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44824. Jul 14 16:21:28.479387 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] [574aebdb-cb84-4fd6-8f40-ef27447caa36] Reconnected to AMQP server on 10.222.0.98:5672 via [amqp] client with port 44826. Jul 14 16:21:28.528494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-3f0a00d4-7f6a-4a1c-a5b9-9acbfa37648a tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:28.536626 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-3f0a00d4-7f6a-4a1c-a5b9-9acbfa37648a tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1248 microversion: 2.1 time: 0.084725 Jul 14 16:21:28.537194 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3827/7494] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:28 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1248 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:21:29.554700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:29.555407 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:29.564300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:29.564762 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:29.565537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:29.565981 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:29.631860 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:29.639648 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4994b8b6-9eae-43a1-ab41-dd0a5f7c929c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1252 microversion: 2.1 time: 0.089035 Jul 14 16:21:29.640221 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3668/7495] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:29 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1252 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:29.940882 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-00a46d73-d7d7-4034-bbcc-e094db97fc67 req-25dfe394-d365-49b8-99bf-dda2fcaa1dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "name": "network-vif-unplugged", "status": "completed", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:29.951079 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-00a46d73-d7d7-4034-bbcc-e094db97fc67 req-25dfe394-d365-49b8-99bf-dda2fcaa1dd3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:29.951555 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-00a46d73-d7d7-4034-bbcc-e094db97fc67 req-25dfe394-d365-49b8-99bf-dda2fcaa1dd3 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:29.963592 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-00a46d73-d7d7-4034-bbcc-e094db97fc67 req-25dfe394-d365-49b8-99bf-dda2fcaa1dd3 service nova] Creating event network-vif-unplugged:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:21:29.973399 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-00a46d73-d7d7-4034-bbcc-e094db97fc67 req-25dfe394-d365-49b8-99bf-dda2fcaa1dd3 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036345 Jul 14 16:21:29.974054 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3828/7496] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:30.660138 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:30.662213 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:30.671000 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:30.671515 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:30.672318 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:30.672770 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:30.738046 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:30.747066 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-11450ed4-8a0e-4027-97c5-f55cf064d238 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1306 microversion: 2.1 time: 0.093242 Jul 14 16:21:30.747696 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3669/7497] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:30 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1306 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:31.771335 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:31.774833 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:31.788975 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:31.789734 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:31.791128 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:31.791950 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:32.000723 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:32.010009 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-86660023-30bd-4464-9a74-812ddc5848d0 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.247271 Jul 14 16:21:32.011198 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3829/7498] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:31 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:33.037472 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:33.038113 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:33.045828 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:33.046286 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:33.047065 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:33.047537 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:33.199295 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:33.208018 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4274faf8-4539-4934-94db-47ad53e46aa1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.174351 Jul 14 16:21:33.208611 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3670/7499] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:33 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:34.224678 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:34.225246 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:34.232630 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:34.233082 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:34.233986 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:34.234428 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:34.396462 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:34.405550 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-180f9320-008a-479f-abf4-bc20c371b514 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.184780 Jul 14 16:21:34.406368 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3830/7500] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:34 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:35.422377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:35.423031 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:35.430246 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:35.430706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:35.431593 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:35.432039 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:35.580696 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:35.590049 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-41c0b0b5-d26f-4bd9-b68f-353c9f9bd0ff tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.171515 Jul 14 16:21:35.591065 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3671/7501] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:35 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:36.608372 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:36.609090 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:36.616361 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:36.616809 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:36.617590 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:36.618020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:36.778664 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:36.786997 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-8d4129a6-931e-47f5-9cc1-abf45694ab38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.182990 Jul 14 16:21:36.787652 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3831/7502] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:36 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:21:37.805289 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:37.807554 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:37.815102 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:37.815609 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:37.816436 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:37.817069 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:37.970907 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:37.979802 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-b43530e0-08f3-462a-b25f-43b9dfd06e70 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.178468 Jul 14 16:21:37.986909 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3672/7503] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:37 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:38.996519 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:38.997144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:39.000037 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell0:SELECT=2 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:39.005860 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:39.006303 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:39.007070 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:39.007535 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:39.146512 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:39.155138 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-71e41164-0ebf-4842-af25-1aa001815374 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.162582 Jul 14 16:21:39.155747 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3832/7504] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:38 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:40.170640 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:40.171615 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell0:SELECT=6 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:40.178418 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:40.179057 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:40.186780 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:40.187170 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:40.188205 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:40.188660 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:40.307742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6f9b6ec0-3a7d-41e6-ab4c-c837bbf70e48 req-363d2e46-8a11-4b99-a3a9-88be0789a7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75da2bd-8ae1-4fbf-9013-8effb0093801", "tag": "2b5e70f8-65c6-41e5-be6b-af6eb9f1927a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:40.318209 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6f9b6ec0-3a7d-41e6-ab4c-c837bbf70e48 req-363d2e46-8a11-4b99-a3a9-88be0789a7bc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:40.325049 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6f9b6ec0-3a7d-41e6-ab4c-c837bbf70e48 req-363d2e46-8a11-4b99-a3a9-88be0789a7bc service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:40.339312 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6f9b6ec0-3a7d-41e6-ab4c-c837bbf70e48 req-363d2e46-8a11-4b99-a3a9-88be0789a7bc service nova] Creating event network-changed:2b5e70f8-65c6-41e5-be6b-af6eb9f1927a for instance a75da2bd-8ae1-4fbf-9013-8effb0093801 on n-h2-768852-23 Jul 14 16:21:40.347148 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6f9b6ec0-3a7d-41e6-ab4c-c837bbf70e48 req-363d2e46-8a11-4b99-a3a9-88be0789a7bc service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043187 Jul 14 16:21:40.348131 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3833/7505] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:21:40.364566 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:40.374806 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-c64f04cd-e031-430c-a115-66c52852578f tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.204901 Jul 14 16:21:40.376910 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3673/7506] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:40 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:41.396040 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:41.396682 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:41.403486 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:41.403943 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:41.404709 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:41.405153 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:41.556727 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:41.564577 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-f6105c70-0c6f-417b-b8c7-ad2ebf938abb tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.173678 Jul 14 16:21:41.565181 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3834/7507] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:41 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:42.582189 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:42.582808 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:42.589847 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:42.590300 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:42.591079 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:42.591559 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:42.730442 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:42.738116 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4e1ec075-dd19-4da2-9142-d22dbfc35e32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.160047 Jul 14 16:21:42.738702 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3674/7508] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:42 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:43.756584 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:43.757215 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:43.764623 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:43.764786 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:43.765514 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:43.765951 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:43.905463 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:43.913254 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c5f3ecac-ce68-48bd-b0fe-3c6c625a2e02 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.160640 Jul 14 16:21:43.913858 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3835/7509] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:43 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:44.931975 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:44.932726 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:44.939690 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:44.940146 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:44.940910 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:44.941355 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:45.129439 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:45.141767 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-acc7d7bb-df89-419e-9b24-fbb3752978cd tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.214146 Jul 14 16:21:45.142370 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3675/7510] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:44 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:45.921781 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-96ad5cab-3d67-470d-8924-9698aba8fdbd req-9b110421-11a4-4846-8598-94265b13ce17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75da2bd-8ae1-4fbf-9013-8effb0093801", "name": "network-vif-plugged", "status": "completed", "tag": "2b5e70f8-65c6-41e5-be6b-af6eb9f1927a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:45.931454 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-96ad5cab-3d67-470d-8924-9698aba8fdbd req-9b110421-11a4-4846-8598-94265b13ce17 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:45.931911 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-96ad5cab-3d67-470d-8924-9698aba8fdbd req-9b110421-11a4-4846-8598-94265b13ce17 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:45.947212 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-96ad5cab-3d67-470d-8924-9698aba8fdbd req-9b110421-11a4-4846-8598-94265b13ce17 service nova] Creating event network-vif-plugged:2b5e70f8-65c6-41e5-be6b-af6eb9f1927a for instance a75da2bd-8ae1-4fbf-9013-8effb0093801 on n-h2-768852-23 Jul 14 16:21:45.952523 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-96ad5cab-3d67-470d-8924-9698aba8fdbd req-9b110421-11a4-4846-8598-94265b13ce17 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034383 Jul 14 16:21:45.953435 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3836/7511] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:46.159377 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:46.160007 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:46.166909 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:46.167396 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:46.168605 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:46.169054 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:46.313970 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:46.328920 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-7fee01b7-f90a-405e-a912-c642f3fbc264 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1374 microversion: 2.1 time: 0.173103 Jul 14 16:21:46.329953 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3676/7512] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:46 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:47.347861 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:47.348485 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:47.355135 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:47.355636 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:47.356421 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:47.356866 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:47.661494 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:47.669242 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-24720871-ffdb-4ce4-9e34-4c0710569f6d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1558 microversion: 2.1 time: 0.326921 Jul 14 16:21:47.669840 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3837/7513] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:47 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1558 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:47.686618 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:47.687254 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:47.694335 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:47.695045 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:47.695869 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:47.696317 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:47.836517 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:47.844781 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-d90b8b6d-4235-4dbc-b329-1ffda16bf14c tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1558 microversion: 2.1 time: 0.162322 Jul 14 16:21:47.845381 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3677/7514] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:47 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:21:48.659520 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:48.660120 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:21:48.742974 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:48.743306 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:21:49.866492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a38098c6-2980-4b36-aeab-3f1de6e3e0d1 req-6c44536a-dd45-44ed-adef-c912c4325960 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75da2bd-8ae1-4fbf-9013-8effb0093801", "tag": "2b5e70f8-65c6-41e5-be6b-af6eb9f1927a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:49.877202 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a38098c6-2980-4b36-aeab-3f1de6e3e0d1 req-6c44536a-dd45-44ed-adef-c912c4325960 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:49.877906 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a38098c6-2980-4b36-aeab-3f1de6e3e0d1 req-6c44536a-dd45-44ed-adef-c912c4325960 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:49.889873 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a38098c6-2980-4b36-aeab-3f1de6e3e0d1 req-6c44536a-dd45-44ed-adef-c912c4325960 service nova] Creating event network-changed:2b5e70f8-65c6-41e5-be6b-af6eb9f1927a for instance a75da2bd-8ae1-4fbf-9013-8effb0093801 on n-h2-768852-23 Jul 14 16:21:49.895472 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a38098c6-2980-4b36-aeab-3f1de6e3e0d1 req-6c44536a-dd45-44ed-adef-c912c4325960 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032676 Jul 14 16:21:49.896324 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3838/7515] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:50.903231 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:50.903861 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:21:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:23:17.866492 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:17.867296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=62 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:17.871357 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1592676376"}} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:17.872479 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:17.880200 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:17.880665 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:17.881445 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:17.881895 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:18.158552 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5784ae48-77d9-4dd4-a1e6-f4862c43ce32 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "POST /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801/action" status: 202 len: 0 microversion: 2.1 time: 0.293748 Jul 14 16:23:18.159200 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3678/7516] 10.222.0.98 () {60 vars in 1277 bytes} [Thu Jul 14 16:23:17 2022] POST /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Jul 14 16:23:24.519443 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_api:SELECT=26 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:24.521455 n-d-768852-23 devstack@n-api.service[125965]: DEBUG dbcounter [-] [125965] Writing DB stats nova_cell1:SELECT=50 {{(pid=125965) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:24.541995 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-197f9f28-9000-4cab-a761-e83b762f9dd9 req-ef50e7a5-e63c-4df7-965b-b990ed9be44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75da2bd-8ae1-4fbf-9013-8effb0093801", "name": "network-vif-plugged", "status": "completed", "tag": "2b5e70f8-65c6-41e5-be6b-af6eb9f1927a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:24.567799 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-197f9f28-9000-4cab-a761-e83b762f9dd9 req-ef50e7a5-e63c-4df7-965b-b990ed9be44d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:24.568596 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-197f9f28-9000-4cab-a761-e83b762f9dd9 req-ef50e7a5-e63c-4df7-965b-b990ed9be44d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:24.594631 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-197f9f28-9000-4cab-a761-e83b762f9dd9 req-ef50e7a5-e63c-4df7-965b-b990ed9be44d service nova] Creating event network-vif-plugged:2b5e70f8-65c6-41e5-be6b-af6eb9f1927a for instance a75da2bd-8ae1-4fbf-9013-8effb0093801 on n-h2-768852-23 Jul 14 16:23:24.609838 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-197f9f28-9000-4cab-a761-e83b762f9dd9 req-ef50e7a5-e63c-4df7-965b-b990ed9be44d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097519 Jul 14 16:23:24.610821 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3839/7517] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:31.766329 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:23:31.767369 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:23:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:23:31.782143 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:31.782756 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:31.784820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_api:SELECT=2 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:31.785518 n-d-768852-23 devstack@n-api.service[125966]: DEBUG dbcounter [-] [125966] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125966) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:31.792598 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:31.793075 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:31.793949 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:31.794408 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:31.823870 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:23:31.856847 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a4b74c64-697e-408a-b2a6-96a32d37504f req-9fbf06a9-3c58-452a-a7d7-4202920180a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a75da2bd-8ae1-4fbf-9013-8effb0093801", "tag": "2b5e70f8-65c6-41e5-be6b-af6eb9f1927a"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:31.867732 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a4b74c64-697e-408a-b2a6-96a32d37504f req-9fbf06a9-3c58-452a-a7d7-4202920180a7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:31.868265 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a4b74c64-697e-408a-b2a6-96a32d37504f req-9fbf06a9-3c58-452a-a7d7-4202920180a7 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:31.881167 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a4b74c64-697e-408a-b2a6-96a32d37504f req-9fbf06a9-3c58-452a-a7d7-4202920180a7 service nova] Creating event network-changed:2b5e70f8-65c6-41e5-be6b-af6eb9f1927a for instance a75da2bd-8ae1-4fbf-9013-8effb0093801 on n-h2-768852-23 Jul 14 16:23:31.887479 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a4b74c64-697e-408a-b2a6-96a32d37504f req-9fbf06a9-3c58-452a-a7d7-4202920180a7 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104105 Jul 14 16:23:31.888329 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3840/7518] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:23:31.912231 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-4ca15ba3-465c-416d-8df8-98f686efa259 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 204 len: 0 microversion: 2.1 time: 0.134371 Jul 14 16:23:31.912838 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3679/7519] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:31 2022] DELETE /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:23:31.922301 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:31.923337 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:31.929730 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:31.930186 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:31.931020 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:31.931492 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:32.099891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:32.107650 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-731cfbc3-90b1-423e-9576-a1a93b578f1d tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1682 microversion: 2.1 time: 0.190151 Jul 14 16:23:32.108231 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3841/7520] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:31 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1682 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:33.126507 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:33.127128 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:33.135412 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:33.135926 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:33.136700 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:33.137139 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:33.276958 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:33.285161 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-0e18e5ad-2216-4ca7-9b9b-37a3bb6f9d49 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1682 microversion: 2.1 time: 0.162482 Jul 14 16:23:33.285733 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3680/7521] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:33 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:34.302532 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:34.303103 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:34.309865 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:34.310314 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:34.311076 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:34.311539 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:34.457222 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:34.465210 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-2ad423ca-0e10-4b95-a068-388650b83bd1 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 200 len: 1564 microversion: 2.1 time: 0.166595 Jul 14 16:23:34.465927 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3842/7522] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:34 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:34.570186 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [req-f8e584b7-d36e-4bbc-87aa-9475ce601e46 req-30575f5f-f29b-4c77-a9d8-b1422c9d1658 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a75da2bd-8ae1-4fbf-9013-8effb0093801", "name": "network-vif-deleted", "tag": "2b5e70f8-65c6-41e5-be6b-af6eb9f1927a"}]} {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:34.581820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f8e584b7-d36e-4bbc-87aa-9475ce601e46 req-30575f5f-f29b-4c77-a9d8-b1422c9d1658 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:34.582358 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [req-f8e584b7-d36e-4bbc-87aa-9475ce601e46 req-30575f5f-f29b-4c77-a9d8-b1422c9d1658 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:34.595295 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.compute.server_external_events [req-f8e584b7-d36e-4bbc-87aa-9475ce601e46 req-30575f5f-f29b-4c77-a9d8-b1422c9d1658 service nova] Creating event network-vif-deleted:2b5e70f8-65c6-41e5-be6b-af6eb9f1927a for instance a75da2bd-8ae1-4fbf-9013-8effb0093801 on n-h2-768852-23 Jul 14 16:23:34.602192 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [req-f8e584b7-d36e-4bbc-87aa-9475ce601e46 req-30575f5f-f29b-4c77-a9d8-b1422c9d1658 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035704 Jul 14 16:23:34.602788 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3681/7523] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:35.483144 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:35.484287 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: a75da2bd-8ae1-4fbf-9013-8effb0093801] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:35.491322 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:35.491769 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:35.492521 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:35.492953 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:35.507000 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] HTTP exception thrown: Instance a75da2bd-8ae1-4fbf-9013-8effb0093801 could not be found. Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Request method failure captured: Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 HTTP/1.1 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0EHwpfCkFhaUNsRs2SY8t3nNKUe2GolDvbfzfQSnCecH1P4rEotiA8H8cmcw22KTe0FDnjmv_ImiplfqU84XWvH58JgLm2EAOK5096Mq4PVijDX01uJd_FC1p6EdcZi632bmGlR0ZBlhgntsOi7FycTVuNY4UirzrJvnecREQQxc8_U Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: af641a9a7c3b487db865837958578c66 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestSnapshotPattern-1988016682 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/af641a9a7c3b487db865837958578c66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_af641a9a7c3b487db865837958578c66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/af641a9a7c3b487db865837958578c66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/af641a9a7c3b487db865837958578c66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestSnapshotPattern-1988016682 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: af641a9a7c3b487db865837958578c66 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestSnapshotPattern-1988016682 Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestSnapshotPattern-1988016682-project Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 68d145662d434c5f8b7ccd5a0ac9192f Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestSnapshotPattern-1988016682-project Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance a75da2bd-8ae1-4fbf-9013-8effb0093801 could not be found. Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'a75da2bd-8ae1-4fbf-9013-8effb0093801'} Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a75da2bd-8ae1-4fbf-9013-8effb0093801 could not be found. Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a75da2bd-8ae1-4fbf-9013-8effb0093801 could not be found. Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:35.508677 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a75da2bd-8ae1-4fbf-9013-8effb0093801 could not be found. Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Returning 404 to user: Instance a75da2bd-8ae1-4fbf-9013-8effb0093801 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-73cf601d-7b9a-4e4c-9654-7aeadf023117 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801" status: 404 len: 111 microversion: 2.1 time: 0.030953 Jul 14 16:23:35.514490 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3843/7524] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:35 2022] GET /compute/v2.1/servers/a75da2bd-8ae1-4fbf-9013-8effb0093801 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:37.124092 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:37.124768 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:37.125712 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-6a96e192-a363-40ce-9751-16077a23b639 req-7fd46b29-044a-43c2-9a19-7057efc2ee0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:37.132273 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.132820 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.133713 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.134238 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.135891 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6a96e192-a363-40ce-9751-16077a23b639 req-7fd46b29-044a-43c2-9a19-7057efc2ee0d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.136497 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-6a96e192-a363-40ce-9751-16077a23b639 req-7fd46b29-044a-43c2-9a19-7057efc2ee0d service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.148070 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-6a96e192-a363-40ce-9751-16077a23b639 req-7fd46b29-044a-43c2-9a19-7057efc2ee0d service nova] Creating event network-changed:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:23:37.154196 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-6a96e192-a363-40ce-9751-16077a23b639 req-7fd46b29-044a-43c2-9a19-7057efc2ee0d service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032117 Jul 14 16:23:37.155127 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3844/7525] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:37.168098 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Going to try to terminate instance {{(pid=125966) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:23:37.256175 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-28f45752-aa10-434a-9073-374b8d663d46 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "DELETE /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 204 len: 0 microversion: 2.1 time: 0.135926 Jul 14 16:23:37.257041 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3682/7526] 10.222.0.98 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:37 2022] DELETE /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:23:37.267419 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:37.268608 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:37.276588 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.277033 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.278025 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.278476 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.414836 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.policy [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125965) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:37.422661 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-c4572eb9-099e-43b9-8c3c-2377921722c2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1682 microversion: 2.1 time: 0.161166 Jul 14 16:23:37.423257 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3845/7527] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:37 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:38.440587 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:38.441296 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:38.448224 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:38.448678 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:38.449449 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:38.449893 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:38.586369 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:38.594573 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-5416e7bb-c1e3-4952-8e95-34e5ee1c0a38 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1682 microversion: 2.1 time: 0.158162 Jul 14 16:23:38.595140 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3683/7528] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:38 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:39.577600 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [req-a0d258b2-e10f-4486-8c6f-cb610f20d025 req-8834c734-8569-4af0-91ee-fb9b8b6e7bb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d76a1258-d41c-4f40-ab57-701a0276a6b7", "name": "network-vif-deleted", "tag": "4f50c8c9-c094-4374-9d3a-b543a38f092e"}]} {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:39.587194 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a0d258b2-e10f-4486-8c6f-cb610f20d025 req-8834c734-8569-4af0-91ee-fb9b8b6e7bb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.587878 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [req-a0d258b2-e10f-4486-8c6f-cb610f20d025 req-8834c734-8569-4af0-91ee-fb9b8b6e7bb9 service nova] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.600595 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.compute.server_external_events [req-a0d258b2-e10f-4486-8c6f-cb610f20d025 req-8834c734-8569-4af0-91ee-fb9b8b6e7bb9 service nova] Creating event network-vif-deleted:4f50c8c9-c094-4374-9d3a-b543a38f092e for instance d76a1258-d41c-4f40-ab57-701a0276a6b7 on n-h1-768852-23 Jul 14 16:23:39.605475 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [req-a0d258b2-e10f-4486-8c6f-cb610f20d025 req-8834c734-8569-4af0-91ee-fb9b8b6e7bb9 service nova] 10.222.0.98 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031876 Jul 14 16:23:39.606122 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3846/7529] 10.222.0.98 () {64 vars in 1317 bytes} [Thu Jul 14 16:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:39.613038 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:39.613669 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.compute.api [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125966) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:39.620461 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.620917 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.621883 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.622328 n-d-768852-23 devstack@n-api.service[125966]: DEBUG oslo_concurrency.lockutils [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125966) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.686706 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.policy [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68d145662d434c5f8b7ccd5a0ac9192f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af641a9a7c3b487db865837958578c66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125966) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:39.694553 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-93da1d98-0fba-457f-a20f-eefcef74d9cc tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 200 len: 1332 microversion: 2.1 time: 0.086066 Jul 14 16:23:39.695142 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3684/7530] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:39 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 1332 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:40.713168 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '>' {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:40.713876 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.compute.api [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] [instance: d76a1258-d41c-4f40-ab57-701a0276a6b7] Fetching instance by UUID {{(pid=125965) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:40.720284 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:40.720742 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:40.721503 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:40.721944 n-d-768852-23 devstack@n-api.service[125965]: DEBUG oslo_concurrency.lockutils [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Lock "851d78d8-3f11-4b86-a356-449411903277" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125965) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:40.735717 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.wsgi [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] HTTP exception thrown: Instance d76a1258-d41c-4f40-ab57-701a0276a6b7 could not be found. Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Request method failure captured: Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: request: GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 HTTP/1.1 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Accept: application/json Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Accept-Encoding: identity Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Connection: close Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Content-Length: 0 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Content-Type: application/json Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Host: 10.222.0.98 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: Openstack-System-Scope: None Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Auth-Token: gAAAAABi0EHwpfCkFhaUNsRs2SY8t3nNKUe2GolDvbfzfQSnCecH1P4rEotiA8H8cmcw22KTe0FDnjmv_ImiplfqU84XWvH58JgLm2EAOK5096Mq4PVijDX01uJd_FC1p6EdcZi632bmGlR0ZBlhgntsOi7FycTVuNY4UirzrJvnecREQQxc8_U Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Id: None Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Domain-Name: None Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Identity-Status: Confirmed Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Is-Admin-Project: True Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Id: default Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Domain-Name: Default Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Id: af641a9a7c3b487db865837958578c66 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Project-Name: tempest-TestSnapshotPattern-1988016682 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Role: member,reader Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Roles: member,reader Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/af641a9a7c3b487db865837958578c66"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.98:8080", "publicURL": "http://10.222.0.98:8080/v1/AUTH_af641a9a7c3b487db865837958578c66"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/volume/v3/af641a9a7c3b487db865837958578c66"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/compute/v2/af641a9a7c3b487db865837958578c66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.98/identity"}]}] Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant: tempest-TestSnapshotPattern-1988016682 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Id: af641a9a7c3b487db865837958578c66 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-Tenant-Name: tempest-TestSnapshotPattern-1988016682 Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-User: tempest-TestSnapshotPattern-1988016682-project Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Id: default Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Domain-Name: Default Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Id: 68d145662d434c5f8b7ccd5a0ac9192f Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: X-User-Name: tempest-TestSnapshotPattern-1988016682-project Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: method: > Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: exception: Instance d76a1258-d41c-4f40-ab57-701a0276a6b7 could not be found. Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: action_args: {'id': 'd76a1258-d41c-4f40-ab57-701a0276a6b7'} Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: {{(pid=125965) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d76a1258-d41c-4f40-ab57-701a0276a6b7 could not be found. Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 472, in show Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 378, in _get_server Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d76a1258-d41c-4f40-ab57-701a0276a6b7 could not be found. Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:40.737328 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d76a1258-d41c-4f40-ab57-701a0276a6b7 could not be found. Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: ERROR nova.api.openstack.wsgi Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: DEBUG nova.api.openstack.wsgi [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Returning 404 to user: Instance d76a1258-d41c-4f40-ab57-701a0276a6b7 could not be found. {{(pid=125965) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: INFO nova.api.openstack.requestlog [None req-ef15c372-4cf5-47a5-b4f1-0845194aa2f2 tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7" status: 404 len: 111 microversion: 2.1 time: 0.030662 Jul 14 16:23:40.742227 n-d-768852-23 devstack@n-api.service[125965]: [pid: 125965|app: 0|req: 3847/7531] 10.222.0.98 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:40 2022] GET /compute/v2.1/servers/d76a1258-d41c-4f40-ab57-701a0276a6b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:40.905352 n-d-768852-23 devstack@n-api.service[125966]: DEBUG nova.api.openstack.wsgi [None req-af9d55f8-39e1-4030-8cb9-6ca332f4faef tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] Calling method '.version_select at 0x7fdbf0355e50>' {{(pid=125966) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:40.930972 n-d-768852-23 devstack@n-api.service[125966]: INFO nova.api.openstack.requestlog [None req-af9d55f8-39e1-4030-8cb9-6ca332f4faef tempest-TestSnapshotPattern-1988016682 tempest-TestSnapshotPattern-1988016682-project] 10.222.0.98 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-627160547" status: 202 len: 0 microversion: 2.1 time: 0.029468 Jul 14 16:23:40.931701 n-d-768852-23 devstack@n-api.service[125966]: [pid: 125966|app: 0|req: 3685/7532] 10.222.0.98 () {58 vars in 1253 bytes} [Thu Jul 14 16:23:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-627160547 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:25:08.669368 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:25:08.669970 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:25:08.753086 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:25:08.753262 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:26:50.914675 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:26:50.915515 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:26:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:26:51.776556 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:26:51.776800 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:26:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:28:28.677358 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:28:28.677976 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:28:28.760615 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:28:28.760839 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:28:53.261775 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:28:53.262627 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:28:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:29:07.682177 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:29:07.682834 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:30:10.924067 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:30:10.924662 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:30:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:30:11.784192 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:30:11.784423 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:30:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:31:48.685157 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:31:48.685728 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:31:48.768163 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:31:48.768316 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:32:13.273254 n-d-768852-23 devstack@n-api.service[125965]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:32:13.273851 n-d-768852-23 devstack@n-api.service[125965]: Thu Jul 14 16:32:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:32:27.690382 n-d-768852-23 devstack@n-api.service[125966]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:32:27.690973 n-d-768852-23 devstack@n-api.service[125966]: Thu Jul 14 16:32:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!